Attention improves performance primarily by reducing interneuronal correlations

High Magnesium Promotes the Recovery of Binocular Vision from Amblyopia via TRPM7

Abnormal visual experience during the critical period can cause deficits in visual function, such as amblyopia. High magnesium (Mg2+) supplementary can restore ocular dominance (OD) plasticity, which promotes the recovery of amblyopic eye acuity in adults. However, it remains unsolved whether Mg2+ could recover binocular vision in amblyopic adults and what the molecular mechanism is for the recovery. We found that in addition to the recovery of OD plasticity, binocular integration can be restored under the treatment of high Mg2+ in amblyopic mice. Behaviorally, Mg2+-treated amblyopic mice showed better depth perception. Moreover, the effect of high Mg2+ can be suppressed with transient receptor potential melastatin-like 7 (TRPM7) knockdown. Collectively, our results demonstrate that high Mg2+ could restore binocular visual functions from amblyopia. TRPM7 is required for the restoration of plasticity in the visual cortex after high Mg2+ treatment, which can provide possible clinical applications for future research and treatment of amblyopia.

Correlated variability and its attentional modulation depend on anatomical connectivity

Visual cortical neurons show variability in their responses to repeated presentations of a stimulus and a portion of this variability is shared across neurons. Attention may enhance visual perception by reducing shared spiking variability. However, shared variability and its attentional modulation are not consistent within or across cortical areas, and depend on additional factors such as neuronal type. A critical factor that has not been tested is actual anatomical connectivity. We measured spike count correlations among pairs of simultaneously recorded neurons in the primary visual cortex (V1) for which anatomical connectivity was inferred from spiking cross-correlations. Neurons were recorded in monkeys performing a contrast-change discrimination task requiring covert shifts in visual spatial attention. Accordingly, spike count correlations were compared across trials in which attention was directed toward or away from the visual stimulus overlapping recorded neuronal receptive fields. Consistent with prior findings, attention did not significantly alter spike count correlations among random pairings of unconnected V1 neurons. However, V1 neurons connected via excitatory synapses showed a significant reduction in spike count correlations with attention. Interestingly, V1 neurons connected via inhibitory synapses demonstrated high spike count correlations overall that were not modulated by attention. Correlated variability in excitatory circuits also depended upon neuronal tuning for contrast, the task-relevant stimulus feature. These results indicate that shared variability depends on the type of connectivity in neuronal circuits. Also, attention significantly reduces shared variability in excitatory circuits, even when attention effects on randomly sampled neurons within the same area are weak.

Task-specific invariant representation in auditory cortex

Categorical sensory representations are critical for many behaviors, including speech perception. In the auditory system, categorical information is thought to arise hierarchically, becoming increasingly prominent in higher-order cortical regions. The neural mechanisms that support this robust and flexible computation remain poorly understood. Here, we studied sound representations in the ferret primary and non-primary auditory cortex while animals engaged in a challenging sound discrimination task. Population-level decoding of simultaneously recorded single neurons revealed that task engagement caused categorical sound representations to emerge in non-primary auditory cortex. In primary auditory cortex, task engagement caused a general enhancement of sound decoding that was not specific to task-relevant categories. These findings are consistent with mixed selectivity models of neural disentanglement, in which early sensory regions build an overcomplete representation of the world and allow neurons in downstream brain regions to flexibly and selectively read out behaviorally relevant, categorical information.

STN-PFC circuit related to attentional fluctuations during non-movement decision-making

Decision-making is a cognitive process, in which participants need to attend to relevant information and ignore the irrelevant information. Previous studies have described a set of cortical areas important for attention. It is unclear whether subcortical areas also serve a role. The subthalamic nucleus (STN), a part of basal ganglia, is traditionally considered a critical node in the cortico-basal ganglia-thalamus-cortico network. Given the location of the STN and its widespread connections with cortical and subcortical brain regions, the STN plays an important role in motor and non-motor cognitive processing. We would like to know if STN is also related to fluctuations in attentional task performance, and how the STN interacts with prefrontal cortical regions during the process. We examined neural activities within STN covaried with lapses of attention (defined as behavior error). We found that decreased neural activities in STN were associated with sustained attention. By examining connectivity across STN and various sub-regions of the prefrontal cortex (PFC), we found that decreased connectivity across areas was associated with sustained attention. Our results indicated that decreased STN activities were associated with sustained attention, and the STN-PFC circuit supported this process.

Circuit-motivated generalized affine models characterize stimulus-dependent visual cortical shared variability

Correlated variability in the visual cortex is modulated by stimulus properties. The stimulus dependence of correlated variability impacts stimulus coding and is indicative of circuit structure. An affine model combining a multiplicative factor and an additive offset has been proposed to explain how correlated variability in primary visual cortex (V1) depends on stimulus orientations. However, whether the affine model could be extended to explain modulations by other stimulus variables or variability shared between two brain areas is unknown. Motivated by a simple neural circuit mechanism, we modified the affine model to better explain the contrast dependence of neural variability shared within either primary or secondary visual cortex (V1 or V2) as well as the orientation dependence of neural variability shared between V1 and V2. Our results bridge neural circuit mechanisms and statistical models and provide a parsimonious explanation for the stimulus dependence of correlated variability within and between visual areas.

The right posterior parietal cortex mediates spatial reorienting of attentional choice bias

Attention facilitates behavior by enhancing perceptual sensitivity (sensory processing) and choice bias (decisional weighting) for attended information. Whether distinct neural substrates mediate these distinct components of attention remains unknown. We investigate the causal role of key nodes of the right posterior parietal cortex (rPPC) in the forebrain attention network in sensitivity versus bias control. Two groups of participants performed a cued attention task while we applied either inhibitory, repetitive transcranial magnetic stimulation (n = 28) or 40 Hz transcranial alternating current stimulation (n = 26) to the dorsal rPPC. We show that rPPC stimulation - with either modality - impairs task performance by selectively altering attentional modulation of bias but not sensitivity. Specifically, participants' bias toward the uncued, but not the cued, location reduced significantly following rPPC stimulation - an effect that was consistent across both neurostimulation cohorts. In sum, the dorsal rPPC causally mediates the reorienting of choice bias, one particular component of visual spatial attention.

Reward history cues focal attention in whisker somatosensory cortex

Prior reward is a potent cue for attentional capture, but the underlying neurobiology is largely unknown. In a novel whisker touch detection task, we show that mice flexibly shift attention between specific whiskers on a trial-by-trial timescale, guided by the recent history of stimulus-reward association. 2-photon calcium imaging and spike recordings revealed a robust neurobiological correlate of attention in somatosensory cortex (S1), boosting sensory responses to the attended whisker in L2/3 and L5, but not L4. Attentional boosting in L2/3 pyramidal cells was topographically precise and whisker-specific, and shifted receptive fields towards the attended whisker. L2/3 VIP interneurons were broadly activated by whisker stimuli, motion and arousal but did not carry a whisker-specific attentional signal, and thus did not mediate focal tactile attention. Thus, the history of stimuli and rewards in the recent past can dynamically engage local modulation in cortical sensory maps to guide flexible shifts in ongoing behavior.

Orbitofrontal cortex modulates auditory cortical sensitivity and sound perception in Mongolian gerbils

Sensory perception is dynamic, quickly adapting to sudden shifts in environmental or behavioral context. Although decades of work have established that these dynamics are mediated by rapid fluctuations in sensory cortical activity, we have a limited understanding of the brain regions and pathways that orchestrate these changes. Neurons in the orbitofrontal cortex (OFC) encode contextual information, and recent data suggest that some of these signals are transmitted to sensory cortices. Whether and how these signals shape sensory encoding and perceptual sensitivity remain uncertain. Here, we asked whether the OFC mediates context-dependent changes in auditory cortical sensitivity and sound perception by monitoring and manipulating OFC activity in freely moving Mongolian gerbils of both sexes under two behavioral contexts: passive sound exposure and engagement in an amplitude modulation (AM) detection task. We found that the majority of OFC neurons, including the specific subset that innervates the auditory cortex, were strongly modulated by task engagement. Pharmacological inactivation of the OFC prevented rapid context-dependent changes in auditory cortical firing and significantly impaired behavioral AM detection. Our findings suggest that contextual information from the OFC mediates rapid plasticity in the auditory cortex and facilitates the perception of behaviorally relevant sounds.

Coupled oscillations orchestrate selective information transmission in visual cortex

Performing visually guided behavior involves flexible routing of sensory information towards associative areas. We hypothesize that in visual cortical areas, this routing is shaped by a gating influence of the local neuronal population on the activity of the same population's single neurons. We analyzed beta frequencies (representing local population activity), high-gamma frequencies (representative of the activity of local clusters of neurons), and the firing of single neurons in the medial temporal (MT) area of behaving rhesus monkeys. Our results show an influence of beta activity on single neurons, predictive of behavioral performance. Similarly, the temporal dependence of high-gamma on beta predicts behavioral performance. These demonstrate a unidirectional influence of network-level neural dynamics on single-neuron activity, preferentially routing relevant information. This demonstration of a local top-down influence unveils a previously unexplored perspective onto a core feature of cortical information processing: the selective transmission of sensory information to downstream areas based on behavioral relevance.

Patterns of neural activity in prelimbic cortex neurons correlate with attentional behavior in the rodent continuous performance test

Sustained attention, the ability to focus on a stimulus or task over extended periods, is crucial for higher level cognition, and is impaired in individuals diagnosed with neuropsychiatric and neurodevelopmental disorders, including attention-deficit/hyperactivity disorder, schizophrenia, and depression. Translational tasks like the rodent continuous performance test (rCPT) can be used to study the cellular mechanisms underlying sustained attention. Accumulating evidence points to a role for the prelimbic cortex (PrL) in sustained attention, as electrophysiological single unit and local field (LFPs) recordings reflect changes in neural activity in the PrL in mice performing sustained attention tasks. While the evidence correlating PrL electrical activity with sustained attention is compelling, limitations inherent to electrophysiological recording techniques, including low sampling in single unit recordings and source ambivalence for LFPs, impede the ability to fully resolve the cellular mechanisms in the PrL that contribute to sustained attention. In vivo endoscopic calcium imaging using genetically encoded calcium sensors in behaving animals can address these questions by simultaneously recording up to hundreds of neurons at single cell resolution. Here, we used in vivo endoscopic calcium imaging to record patterns of neuronal activity in PrL neurons using the genetically encoded calcium sensor GCaMP6f in mice performing the rCPT at three timepoints requiring differing levels of cognitive demand and task proficiency. A higher proportion of PrL neurons were recruited during correct responses in sessions requiring high cognitive demand and task proficiency, and mice intercalated non-responsive-disengaged periods with responsive-engaged periods that resemble attention lapses. During disengaged periods, the correlation of calcium activity between PrL neurons was higher compared to engaged periods, suggesting a neuronal network state change during attention lapses in the PrL. Overall, these findings illustrate that cognitive demand, task proficiency, and task engagement differentially recruit activity in a subset of PrL neurons during sustained attention.

Neocortical inhibitory imbalance predicts successful sensory detection

Perceptual success depends on fast-spiking, parvalbumin-positive interneurons (FS/PVs). However, competing theories of optimal rate and correlation in pyramidal (PYR) firing make opposing predictions regarding the underlying FS/PV dynamics. We addressed this with population calcium imaging of FS/PVs and putative PYR neurons during threshold detection. In primary somatosensory and visual neocortex, a distinct PYR subset shows increased rate and spike-count correlations on detected trials ("hits"), while most show no rate change and decreased correlations. A larger fraction of FS/PVs predicts hits with either rate increases or decreases. Using computational modeling, we found that inhibitory imbalance, created by excitatory "feedback" and interactions between FS/PV pools, can account for the data. Rate-decreasing FS/PVs increase rate and correlation in a PYR subset, while rate-increasing FS/PVs reduce correlations and offset enhanced excitation in PYR neurons. These findings indicate that selection of informative PYR ensembles, through transient inhibitory imbalance, is a common motif of optimal neocortical processing.

Distinct feedforward and feedback pathways for cell-type specific attention effects

Selective attention is thought to depend on enhanced firing activity in extrastriate areas. Theories suggest that this enhancement depends on selective inter-areal communication via gamma (30-80 Hz) phase-locking. To test this, we simultaneously recorded from different cell types and cortical layers of macaque V1 and V4. We find that while V1-V4 gamma phase-locking between local field potentials increases with attention, the V1 gamma rhythm does not engage V4 excitatory-neurons, but only fast-spiking interneurons in L4 of V4. By contrast, attention enhances V4 spike-rates in both excitatory and inhibitory cells, most strongly in L2/3. The rate increase in L2/3 of V4 precedes V1 in time. These findings suggest enhanced signal transmission with attention does not depend on inter-areal gamma phase-locking and show that the endogenous gamma rhythm has cell-type- and layer-specific effects on downstream target areas. Similar findings were made in the mouse visual system, based on opto-tagging of identified interneurons.

Coordinated Response Modulations Enable Flexible Use of Visual Information

We use sensory information in remarkably flexible ways. We can generalize by ignoring task-irrelevant features, report different features of a stimulus, and use different actions to report a perceptual judgment. These forms of flexible behavior are associated with small modulations of the responses of sensory neurons. While the existence of these response modulations is indisputable, efforts to understand their function have been largely relegated to theory, where they have been posited to change information coding or enable downstream neurons to read out different visual and cognitive information using flexible weights. Here, we tested these ideas using a rich, flexible behavioral paradigm, multi-neuron, multi-area recordings in primary visual cortex (V1) and mid-level visual area V4. We discovered that those response modulations in V4 (but not V1) contain the ingredients necessary to enable flexible behavior, but not via those previously hypothesized mechanisms. Instead, we demonstrated that these response modulations are precisely coordinated across the population such that downstream neurons have ready access to the correct information to flexibly guide behavior without making changes to information coding or synapses. Our results suggest a novel computational role for task-dependent response modulations: they enable flexible behavior by changing the information that gets out of a sensory area, not by changing information coding within it.

Recent visual experience reshapes V4 neuronal activity and improves perceptual performance

Recent visual experience heavily influences our visual perception, but how this is mediated by the reshaping of neuronal activity to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in mid-level visual cortex.

Context-invariant beliefs are supported by dynamic reconfiguration of single unit functional connectivity in prefrontal cortex of male macaques

Natural behaviors occur in closed action-perception loops and are supported by dynamic and flexible beliefs abstracted away from our immediate sensory milieu. How this real-world flexibility is instantiated in neural circuits remains unknown. Here, we have male macaques navigate in a virtual environment by primarily leveraging sensory (optic flow) signals, or by more heavily relying on acquired internal models. We record single-unit spiking activity simultaneously from the dorsomedial superior temporal area (MSTd), parietal area 7a, and the dorso-lateral prefrontal cortex (dlPFC). Results show that while animals were able to maintain adaptive task-relevant beliefs regardless of sensory context, the fine-grain statistical dependencies between neurons, particularly in 7a and dlPFC, dynamically remapped with the changing computational demands. In dlPFC, but not 7a, destroying these statistical dependencies abolished the area's ability for cross-context decoding. Lastly, correlational analyses suggested that the more unit-to-unit couplings remapped in dlPFC, and the less they did so in MSTd, the less were population codes and behavior impacted by the loss of sensory evidence. We conclude that dynamic functional connectivity between neurons in prefrontal cortex maintain a stable population code and context-invariant beliefs during naturalistic behavior.

Probabilistic neural transfer function estimation with Bayesian system identification

Neural population responses in sensory systems are driven by external physical stimuli. This stimulus-response relationship is typically characterized by receptive fields, which have been estimated by neural system identification approaches. Such models usually require a large amount of training data, yet, the recording time for animal experiments is limited, giving rise to epistemic uncertainty for the learned neural transfer functions. While deep neural network models have demonstrated excellent power on neural prediction, they usually do not provide the uncertainty of the resulting neural representations and derived statistics, such as most exciting inputs (MEIs), from in silico experiments. Here, we present a Bayesian system identification approach to predict neural responses to visual stimuli, and explore whether explicitly modeling network weight variability can be beneficial for identifying neural response properties. To this end, we use variational inference to estimate the posterior distribution of each model weight given the training data. Tests with different neural datasets demonstrate that this method can achieve higher or comparable performance on neural prediction, with a much higher data efficiency compared to Monte Carlo dropout methods and traditional models using point estimates of the model parameters. At the same time, our variational method provides us with an effectively infinite ensemble, avoiding the idiosyncrasy of any single model, to generate MEIs. This allows us to estimate the uncertainty of stimulus-response function, which we have found to be negatively correlated with the predictive performance at model level and may serve to evaluate models. Furthermore, our approach enables us to identify response properties with credible intervals and to determine whether the inferred features are meaningful by performing statistical tests on MEIs. Finally, in silico experiments show that our model generates stimuli driving neuronal activity significantly better than traditional models in the limited-data regime.

Preconfigured architecture of the developing mouse brain

In the adult brain, structural and functional parameters, such as synaptic sizes and neuronal firing rates, follow right-skewed and heavy-tailed distributions. While this organization is thought to have significant implications, its development is still largely unknown. Here, we address this knowledge gap by investigating a large-scale dataset recorded from the prefrontal cortex and the olfactory bulb of mice aged 4-60 postnatal days. We show that firing rates and spike train interactions have a largely stable distribution shape throughout the first 60 postnatal days and that the prefrontal cortex displays a functional small-world architecture. Moreover, early brain activity exhibits an oligarchical organization, where high-firing neurons have hub-like properties. In a neural network model, we show that analogously right-skewed and heavy-tailed synaptic parameters are instrumental to consistently recapitulate the experimental data. Thus, functional and structural parameters in the developing brain are already extremely distributed, suggesting that this organization is preconfigured and not experience dependent.

Dissociation of attentional state and behavioral outcome using local field potentials

Successful behavior depends on attentional state and other factors related to decision-making, which may modulate neuronal activity differently. Here, we investigated whether attentional state and behavioral outcome (i.e., whether a target is detected or missed) are distinguishable using the power and phase of local field potential (LFP) recorded bilaterally from area V4 of monkeys performing a cued visual attention task. To link each trial's outcome to pairwise measures of attention that are typically averaged across trials, we used several methods to obtain single-trial estimates of spike count correlation and phase consistency. Surprisingly, while attentional location was best discriminated using gamma and high-gamma power, behavioral outcome was best discriminated by alpha power and steady-state visually evoked potential. Power outperformed absolute phase in attentional/behavioral discriminability, although single-trial gamma phase consistency provided reasonably high attentional discriminability. Our results suggest a dissociation between the neuronal mechanisms that regulate attentional focus and behavioral outcome.

Brain-state mediated modulation of inter-laminar dependencies in visual cortex

Spatial attention is critical for recognizing behaviorally relevant objects in a cluttered environment. How the deployment of spatial attention aids the hierarchical computations of object recognition remains unclear. We investigated this in the laminar cortical network of visual area V4, an area strongly modulated by attention. We found that deployment of attention strengthened unique dependencies in neural activity across cortical layers. On the other hand, shared dependencies were reduced within the excitatory population of a layer. Surprisingly, attention strengthened unique dependencies within a laminar population. Crucially, these modulation patterns were also observed during successful behavioral outcomes that are thought to be mediated by internal brain state fluctuations. Successful behavioral outcomes were also associated with phases of reduced neural excitability, suggesting a mechanism for enhanced information transfer during optimal states. Our results suggest common computation goals of optimal sensory states that are attained by either task demands or internal fluctuations.

Origins of noise in both improving and degrading decision making

Noise is a fundamental problem for information processing in neural systems. In decision-making, noise is assumed to have a primary role in errors and stochastic choice behavior. However, little is known about how noise arising from different sources contributes to value coding and choice behaviors, especially when it interacts with neural computation. Here we examine how noise arising early versus late in the choice process differentially impacts context-dependent choice behavior. We found in model simulations that early and late noise predict opposing context effects: under early noise, contextual information enhances choice accuracy; while under late noise, context degrades choice accuracy. Furthermore, we verified these opposing predictions in experimental human choice behavior. Manipulating early and late noise - by inducing uncertainty in option values and controlling time pressure - produced dissociable positive and negative context effects. These findings reconcile controversial experimental findings in the literature reporting either context-driven impairments or improvements in choice performance, suggesting a unified mechanism for context-dependent choice. More broadly, these findings highlight how different sources of noise can interact with neural computations to differentially modulate behavior.

Significance

The current study addresses the role of noise origin in decision-making, reconciling controversies around how decision-making is impacted by context. We demonstrate that different types of noise - either arising early during evaluation or late during option comparison - leads to distinct results: with early noise, context enhances choice accuracy, while with late noise, context impairs it. Understanding these dynamics offers potential strategies for improving decision-making in noisy environments and refining existing neural computation models. Overall, our findings advance our understanding of how neural systems handle noise in essential cognitive tasks, suggest a beneficial role for contextual modulation under certain conditions, and highlight the profound implications of noise structure in decision-making.

Cholinergic Neuromodulation of Prefrontal Attractor Dynamics Controls Performance in Spatial Working Memory

The behavioral and neural effects of the endogenous release of acetylcholine following stimulation of the nucleus basalis (NB) of Meynert have been recently examined in two male monkeys (Qi et al., 2021). Counterintuitively, NB stimulation enhanced behavioral performance while broadening neural tuning in the prefrontal cortex (PFC). The mechanism by which a weaker mnemonic neural code could lead to better performance remains unclear. Here, we show that increased neural excitability in a simple continuous bump attractor model can induce broader neural tuning and decrease bump diffusion, provided neural rates are saturated. Increased memory precision in the model overrides memory accuracy, improving overall task performance. Moreover, we show that bump attractor dynamics can account for the nonuniform impact of neuromodulation on distractibility, depending on distractor distance from the target. Finally, we delve into the conditions under which bump attractor tuning and diffusion balance in biologically plausible heterogeneous network models. In these discrete bump attractor networks, we show that reducing spatial correlations or enhancing excitatory transmission can improve memory precision. Altogether, we provide a mechanistic understanding of how cholinergic neuromodulation controls spatial working memory through perturbed attractor dynamics in the PFC.

Orthogonal neural representations support perceptual judgements of natural stimuli

In natural behavior, observers must separate relevant information from a barrage of irrelevant information. Many studies have investigated the neural underpinnings of this ability using artificial stimuli presented on simple backgrounds. Natural viewing, however, carries a set of challenges that are inaccessible using artificial stimuli, including neural responses to background objects that are task-irrelevant. An emerging body of evidence suggests that the visual abilities of humans and animals can be modeled through the linear decoding of task-relevant information from visual cortex. This idea suggests the hypothesis that irrelevant features of a natural scene should impair performance on a visual task only if their neural representations intrude on the linear readout of the task relevant feature, as would occur if the representations of task-relevant and irrelevant features are not orthogonal in the underlying neural population. We tested this hypothesis using human psychophysics and monkey neurophysiology, in response to parametrically variable naturalistic stimuli. We demonstrate that 1) the neural representation of one feature (the position of a central object) in visual area V4 is orthogonal to those of several background features, 2) the ability of human observers to precisely judge object position was largely unaffected by task-irrelevant variation in those background features, and 3) many features of the object and the background are orthogonally represented by V4 neural responses. Our observations are consistent with the hypothesis that orthogonal neural representations can support stable perception of objects and features despite the tremendous richness of natural visual scenes.

Different emotional states engage distinct descending pathways from the prefrontal cortex

Emotion regulation, essential for adaptive behavior, depends on the brain's capacity to process a range of emotions. Current research has largely focused on individual emotional circuits without fully exploring how their interaction influences physiological responses or understanding the neural mechanisms that differentiate emotional valence. Using in vivo calcium imaging, electrophysiology, and optogenetics, we examined neural circuit dynamics in the medial prefrontal cortex (mPFC), targeting two key areas: the basal lateral amygdala (BLA) and nucleus accumbens (NAc). Our results demonstrate distinct activation patterns in the mPFC→BLA and mPFC→NAc pathways in response to social stimuli, indicating a mechanism for discriminating emotions: increased mPFC→BLA activity signals anxiety, while heightened mPFC→NAc responses are linked to exploration. Additionally, chronic emotional states amplify activity in these pathways-positivity enhances mPFC→NAc, while negativity boosts mPFC→BLA. This study sheds light on the nuanced neural circuitry involved in emotion regulation, revealing the pivotal roles of mPFC projections in emotional processing. Identifying these specific circuits engaged by varied emotional states advances our understanding of emotional regulation's biological underpinnings and highlights potential targets for addressing emotional dysregulation in psychiatric conditions.

Significance statement

While existing circuitry studies have underscored the significance of emotional circuits, the majority of research has concentrated on individual circuits. The assessment of whether and how the balance among multiple circuits influences overall physiological outcomes is often overlooked. This study delves into the neural underpinnings of emotion regulation, focusing on how positive and negative valences are discriminated and managed. By examining the specific pathways from the medial prefrontal cortex (mPFC) to key emotional centers-the basal lateral amygdala (BLA) for negative valence and the nucleus accumbens (NAc) for positive one-we uncovered a novel dual-balanced neural circuit mechanism that enables this essential aspect of human cognition.

Decision-related activity and movement selection in primate visual cortex

Fluctuations in the activity of sensory neurons often predict perceptual decisions. This connection can be quantified with a metric called choice probability (CP), and there is a longstanding debate about whether CP reflects a causal influence on decisions or an echo of decision-making activity elsewhere in the brain. Here, we show that CP can reflect a third variable, namely, the movement used to indicate the decision. In a standard visual motion discrimination task, neurons in the middle temporal (MT) area of primate cortex responded more strongly during trials that involved a saccade toward their receptive fields. This variability accounted for much of the CP observed across the neuronal population, and it arose through training. Moreover, pharmacological inactivation of MT biased behavioral responses away from the corresponding visual field locations. These results demonstrate that training on a task with fixed sensorimotor contingencies introduces movement-related activity in sensory brain regions and that this plasticity can shape the neural circuitry of perceptual decision-making.

Temporal interference stimulation disrupts spike timing in the primate brain

Electrical stimulation can regulate brain activity, producing clear clinical benefits, but focal and effective neuromodulation often requires surgically implanted electrodes. Recent studies argue that temporal interference (TI) stimulation may provide similar outcomes non-invasively. During TI, scalp electrodes generate multiple electrical fields in the brain, modulating neural activity only at their intersection. Despite considerable enthusiasm for this approach, little empirical evidence demonstrates its effectiveness, especially under conditions suitable for human use. Here, using single-neuron recordings in non-human primates, we establish that TI reliably alters the timing, but not the rate, of spiking activity. However, we show that TI requires strategies-high carrier frequencies, multiple electrodes, and amplitude-modulated waveforms-that also limit its effectiveness. Combined, these factors make TI 80 % weaker than other forms of non-invasive brain stimulation. Although unlikely to cause widespread neuronal entrainment, TI may be ideal for disrupting pathological oscillatory activity, a hallmark of many neurological disorders.

Distributed and dynamical communication: a mechanism for flexible cortico-cortical interactions and its functional roles in visual attention

Perceptual and cognitive processing relies on flexible communication among cortical areas; however, the underlying neural mechanism remains unclear. Here we report a mechanism based on the realistic spatiotemporal dynamics of propagating wave patterns in neural population activity. Using a biophysically plausible, multiarea spiking neural circuit model, we demonstrate that these wave patterns, characterized by their rich and complex dynamics, can account for a wide variety of empirically observed neural processes. The coordinated interactions of these wave patterns give rise to distributed and dynamic communication (DDC) that enables flexible and rapid routing of neural activity across cortical areas. We elucidate how DDC unifies the previously proposed oscillation synchronization-based and subspace-based views of interareal communication, offering experimentally testable predictions that we validate through the analysis of Allen Institute Neuropixels data. Furthermore, we demonstrate that DDC can be effectively modulated during attention tasks through the interplay of neuromodulators and cortical feedback loops. This modulation process explains many neural effects of attention, underscoring the fundamental functional role of DDC in cognition.

Greater up-modulation of intra-individual brain signal variability makes a high-load cognitive task more arduous for older adults

The extent to which brain responses are less distinctive across varying cognitive loads in older adults is referred to as neural dedifferentiation. Moment-to-moment brain signal variability, an emerging indicator, reveals not only the adaptability of an individual's brain as an inter-individual trait, but also the allocation of neural resources within an individual due to ever-changing task demands, thus shedding novel insight into the process of neural dedifferentiation. However, how the modulation of intra-individual brain signal variability reflects behavioral differences related to cognitively demanding tasks remains unclear. In this study, we employed functional near-infrared spectroscopy (fNIRS) imaging to capture the variability of brain signals, which was quantified by the standard deviation, during both the resting state and an n-back task (n = 1, 2, 3) in 57 healthy older adults. Using multivariate Partial Least Squares (PLS) analysis, we found that fNIRS signal variability increased from the resting state to the task and increased with working memory load in older adults. We further confirmed that greater fNIRS signal variability generally supported faster and more stable response time in the 2- and 3-back conditions. However, the intra-individual level analysis showed that the greater the up-modulation in fNIRS signal variability with cognitive loads, the more its accuracy decreases and mean response time increases, suggesting that a greater intra-individual brain signal variability up-modulation may reflect decreased efficiency in neural information processing. Taken together, our findings offer new insights into the nature of brain signal variability, suggesting that inter- and intra-individual brain signal variability may index distinct theoretical constructs.

Are neuronal mechanisms of attention universal across human sensory and motor brain maps?

One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.

What does the mean mean? A simple test for neuroscience

Trial-averaged metrics, e.g. tuning curves or population response vectors, are a ubiquitous way of characterizing neuronal activity. But how relevant are such trial-averaged responses to neuronal computation itself? Here we present a simple test to estimate whether average responses reflect aspects of neuronal activity that contribute to neuronal processing. The test probes two assumptions implicitly made whenever average metrics are treated as meaningful representations of neuronal activity: Reliability: Neuronal responses repeat consistently enough across trials that they convey a recognizable reflection of the average response to downstream regions.Behavioural relevance: If a single-trial response is more similar to the average template, it is more likely to evoke correct behavioural responses. We apply this test to two data sets: (1) Two-photon recordings in primary somatosensory cortices (S1 and S2) of mice trained to detect optogenetic stimulation in S1; and (2) Electrophysiological recordings from 71 brain areas in mice performing a contrast discrimination task. Under the highly controlled settings of Data set 1, both assumptions were largely fulfilled. In contrast, the less restrictive paradigm of Data set 2 met neither assumption. Simulations predict that the larger diversity of neuronal response preferences, rather than higher cross-trial reliability, drives the better performance of Data set 1. We conclude that when behaviour is less tightly restricted, average responses do not seem particularly relevant to neuronal computation, potentially because information is encoded more dynamically. Most importantly, we encourage researchers to apply this simple test of computational relevance whenever using trial-averaged neuronal metrics, in order to gauge how representative cross-trial averages are in a given context.

Neural populations within macaque early vestibular pathways are adapted to encode natural self-motion

How the activities of large neural populations are integrated in the brain to ensure accurate perception and behavior remains a central problem in systems neuroscience. Here, we investigated population coding of naturalistic self-motion by neurons within early vestibular pathways in rhesus macaques (Macacca mulatta). While vestibular neurons displayed similar dynamic tuning to self-motion, inspection of their spike trains revealed significant heterogeneity. Further analysis revealed that, during natural but not artificial stimulation, heterogeneity resulted primarily from variability across neurons as opposed to trial-to-trial variability. Interestingly, vestibular neurons displayed different correlation structures during naturalistic and artificial self-motion. Specifically, while correlations due to the stimulus (i.e., signal correlations) did not differ, correlations between the trial-to-trial variabilities of neural responses (i.e., noise correlations) were instead significantly positive during naturalistic but not artificial stimulation. Using computational modeling, we show that positive noise correlations during naturalistic stimulation benefits information transmission by heterogeneous vestibular neural populations. Taken together, our results provide evidence that neurons within early vestibular pathways are adapted to the statistics of natural self-motion stimuli at the population level. We suggest that similar adaptations will be found in other systems and species.

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Probing the Structure and Functional Properties of the Dropout-Induced Correlated Variability in Convolutional Neural Networks

Computational neuroscience studies have shown that the structure of neural variability to an unchanged stimulus affects the amount of information encoded. Some artificial deep neural networks, such as those with Monte Carlo dropout layers, also have variable responses when the input is fixed. However, the structure of the trial-by-trial neural covariance in neural networks with dropout has not been studied, and its role in decoding accuracy is unknown. We studied the above questions in a convolutional neural network model with dropout in both the training and testing phases. We found that trial-by-trial correlation between neurons (i.e., noise correlation) is positive and low dimensional. Neurons that are close in a feature map have larger noise correlation. These properties are surprisingly similar to the findings in the visual cortex. We further analyzed the alignment of the main axes of the covariance matrix. We found that different images share a common trial-by-trial noise covariance subspace, and they are aligned with the global signal covariance. This evidence that the noise covariance is aligned with signal covariance suggests that noise covariance in dropout neural networks reduces network accuracy, which we further verified directly with a trial-shuffling procedure commonly used in neuroscience. These findings highlight a previously overlooked aspect of dropout layers that can affect network performance. Such dropout networks could also potentially be a computational model of neural variability.

The influence of cortical activity on perception depends on behavioral state and sensory context

The mechanistic link between neural circuit activity and behavior remains unclear. While manipulating cortical activity can bias certain behaviors and elicit artificial percepts, some tasks can still be solved when cortex is silenced or removed. Here, mice were trained to perform a visual detection task during which we selectively targeted groups of visually responsive and co-tuned neurons in L2/3 of primary visual cortex (V1) for two-photon photostimulation. The influence of photostimulation was conditional on two key factors: the behavioral state of the animal and the contrast of the visual stimulus. The detection of low-contrast stimuli was enhanced by photostimulation, while the detection of high-contrast stimuli was suppressed, but crucially, only when mice were highly engaged in the task. When mice were less engaged, our manipulations of cortical activity had no effect on behavior. The behavioral changes were linked to specific changes in neuronal activity. The responses of non-photostimulated neurons in the local network were also conditional on two factors: their functional similarity to the photostimulated neurons and the contrast of the visual stimulus. Functionally similar neurons were increasingly suppressed by photostimulation with increasing visual stimulus contrast, correlating with the change in behavior. Our results show that the influence of cortical activity on perception is not fixed, but dynamically and contextually modulated by behavioral state, ongoing activity and the routing of information through specific circuits.

Whole-brain neural substrates of behavioral variability in the larval zebrafish

Animals engaged in naturalistic behavior can exhibit a large degree of behavioral variability even under sensory invariant conditions. Such behavioral variability can include not only variations of the same behavior, but also variability across qualitatively different behaviors driven by divergent cognitive states, such as fight-or-flight decisions. However, the neural circuit mechanisms that generate such divergent behaviors across trials are not well understood. To investigate this question, here we studied the visual-evoked responses of larval zebrafish to moving objects of various sizes, which we found exhibited highly variable and divergent responses across repetitions of the same stimulus. Given that the neuronal circuits underlying such behaviors span sensory, motor, and other brain areas, we built a novel Fourier light field microscope which enables high-resolution, whole-brain imaging of larval zebrafish during behavior. This enabled us to screen for neural loci which exhibited activity patterns correlated with behavioral variability. We found that despite the highly variable activity of single neurons, visual stimuli were robustly encoded at the population level, and the visual-encoding dimensions of neural activity did not explain behavioral variability. This robustness despite apparent single neuron variability was due to the multi-dimensional geometry of the neuronal population dynamics: almost all neural dimensions that were variable across individual trials, i.e. the "noise" modes, were orthogonal to those encoding for sensory information. Investigating this neuronal variability further, we identified two sparsely-distributed, brain-wide neuronal populations whose pre-motor activity predicted whether the larva would respond to a stimulus and, if so, which direction it would turn on a single-trial level. These populations predicted single-trial behavior seconds before stimulus onset, indicating they encoded time-varying internal modulating behavior, perhaps organizing behavior over longer timescales or enabling flexible behavior routines dependent on the animal's internal state. Our results provide the first whole-brain confirmation that sensory, motor, and internal variables are encoded in a highly mixed fashion throughout the brain and demonstrate that de-mixing each of these components at the neuronal population level is critical to understanding the mechanisms underlying the brain's remarkable flexibility and robustness.

Disinhibition by VIP interneurons is orthogonal to cross-modal attentional modulation in primary visual cortex

Attentional modulation of sensory processing is a key feature of cognition; however, its neural circuit basis is poorly understood. A candidate mechanism is the disinhibition of pyramidal cells through vasoactive intestinal peptide (VIP) and somatostatin (SOM)-positive interneurons. However, the interaction of attentional modulation and VIP-SOM disinhibition has never been directly tested. We used all-optical methods to bi-directionally manipulate VIP interneuron activity as mice performed a cross-modal attention-switching task. We measured the activities of VIP, SOM, and parvalbumin (PV)-positive interneurons and pyramidal neurons identified in the same tissue and found that although activity in all cell classes was modulated by both attention and VIP manipulation, their effects were orthogonal. Attention and VIP-SOM disinhibition relied on distinct patterns of changes in activity and reorganization of interactions between inhibitory and excitatory cells. Circuit modeling revealed a precise network architecture consistent with multiplexing strong yet non-interacting modulations in the same neural population.

Primate neocortex performs balanced sensory amplification

The sensory cortex amplifies relevant features of external stimuli. This sensitivity and selectivity arise through the transformation of inputs by cortical circuitry. We characterize the circuit mechanisms and dynamics of cortical amplification by making large-scale simultaneous measurements of single cells in awake primates and testing computational models. By comparing network activity in both driven and spontaneous states with models, we identify the circuit as operating in a regime of non-normal balanced amplification. Incoming inputs are strongly but transiently amplified by strong recurrent feedback from the disruption of excitatory-inhibitory balance in the network. Strong inhibition rapidly quenches responses, thereby permitting the tracking of time-varying stimuli.

Endogenous cannabinoids in the piriform cortex tune olfactory perception

Sensory perception depends on interactions between external inputs transduced by peripheral sensory organs and internal network dynamics generated by central neuronal circuits. In the sensory cortex, desynchronized network states associate with high signal-to-noise ratio stimulus-evoked responses and heightened perception. Cannabinoid-type-1-receptors (CB1Rs) - which influence network coordination in the hippocampus - are present in anterior piriform cortex (aPC), a sensory paleocortex supporting olfactory perception. Yet, how CB1Rs shape aPC network activity and affect odor perception is unknown. Using pharmacological manipulations coupled with multi-electrode recordings or fiber photometry in the aPC of freely moving male mice, we show that systemic CB1R blockade as well as local drug infusion increases the amplitude of gamma oscillations in aPC, while simultaneously reducing the occurrence of synchronized population events involving aPC excitatory neurons. In animals exposed to odor sources, blockade of CB1Rs reduces correlation among aPC excitatory units and lowers behavioral olfactory detection thresholds. These results suggest that endogenous endocannabinoid signaling promotes synchronized population events and dampen gamma oscillations in the aPC which results in a reduced sensitivity to external sensory inputs.

Brain-state mediated modulation of inter-laminar dependencies in visual cortex

Spatial attention is a quintessential example of adaptive information processing in the brain and is critical for recognizing behaviorally relevant objects in a cluttered environment. Object recognition is mediated by neural encoding along the ventral visual hierarchy. How the deployment of spatial attention aids these hierarchical computations is unclear. Prior studies point to two distinct mechanisms: an improvement in the efficacy of information directed from one encoding stage to another, and/or a suppression of shared information within encoding stages. To test these proposals, it is crucial to estimate the attentional modulation of unique information flow across and shared information within the encoding stages of the visual hierarchy. We investigated this in the multi-stage laminar network of visual area V4, an area strongly modulated by attention. Using network-based dependency estimation from multivariate data, we quantified the modulation of inter-layer information flow during a change detection task and found that deployment of attention indeed strengthened unique dependencies between the input and superficial layers. Using the partial information decomposition framework, we estimated the modulation of shared dependencies and found that they are reduced specifically in the putative excitatory subpopulations within a layer. Surprisingly, we found a strengthening of unique dependencies within the laminar populations, a finding not previously predicted. Crucially, these modulation patterns were also observed during successful behavioral outcomes (hits) that are thought to be mediated by endogenous brain state fluctuations, and not by experimentally imposed attentive states. Finally, phases of endogenous fluctuations that were optimal for 'hits' were associated with reduced neural excitability. A reduction in neural excitability, potentially mediated by diminished shared inputs, suggests a novel mechanism for enhancing unique information transmission during optimal states. By decomposing the modulation of multivariate information, and combined with prior theoretical work, our results suggest common computations of optimal sensory states that are attained by either task demands or endogenous fluctuations.

Deep brain stimulation of the central thalamus restores arousal and motivation in a zolpidem-responsive patient with akinetic mutism after severe brain injury

After severe brain injury, zolpidem is known to cause spectacular, often short-lived, restorations of brain functions in a small subgroup of patients. Previously, we showed that these zolpidem-induced neurological recoveries can be paralleled by significant changes in functional connectivity throughout the brain. Deep brain stimulation (DBS) is a neurosurgical intervention known to modulate functional connectivity in a wide variety of neurological disorders. In this study, we used DBS to restore arousal and motivation in a zolpidem-responsive patient with severe brain injury and a concomitant disorder of diminished motivation, more than 10 years after surviving hypoxic ischemia. We found that DBS of the central thalamus, targeted at the centromedian-parafascicular complex, immediately restored arousal and was able to transition the patient from a state of deep sleep to full wakefulness. Moreover, DBS was associated with temporary restoration of communication and ability to walk and eat in an otherwise wheelchair-bound and mute patient. With the use of magnetoencephalography (MEG), we revealed that DBS was generally associated with a marked decrease in aberrantly high levels of functional connectivity throughout the brain, mimicking the effects of zolpidem. These results imply that 'pathological hyperconnectivity' after severe brain injury can be associated with reduced arousal and behavioral performance and that DBS is able to modulate connectivity towards a 'healthier baseline' with lower synchronization, and, can restore functional brain networks long after severe brain injury. The presence of hyperconnectivity after brain injury may be a possible future marker for a patient's responsiveness for restorative interventions, such as DBS, and suggests that lower degrees of overall brain synchronization may be conducive to cognition and behavioral responsiveness.

Dissociable components of attention exhibit distinct neuronal signatures in primate visual cortex

Attention can be deployed in multiple forms and facilitates behavior by influencing perceptual sensitivity and choice bias. Attention is also associated with a myriad of changes in sensory neural activity. Yet, the relationship between the behavioral components of attention and the accompanying changes in neural activity remains largely unresolved. We examined this relationship by quantifying sensitivity and bias in monkeys performing a task that dissociated eye movement responses from the focus of covert attention. Unexpectedly, bias, not sensitivity, increased at the focus of covert attention, whereas sensitivity increased at the location of planned eye movements. Furthermore, neuronal activity within visual area V4 varied robustly with bias, but not sensitivity, at the focus of covert attention. In contrast, correlated variability between neuronal pairs was lowest at the location of planned eye movements, and varied with sensitivity, but not bias. Thus, dissociable behavioral components of attention exhibit distinct neuronal signatures within the visual cortex.

Incorporation of a cost of deliberation time in perceptual decision making

Many decisions benefit from the accumulation of evidence obtained sequentially over time. In such circumstances, the decision maker must balance speed against accuracy, and the nature of this tradeoff mediates competing desiderata and costs, especially those associated with the passage of time. A neural mechanism to achieve this balance is to accumulate evidence in suitable units and to terminate the deliberation when enough evidence has accrued. To accommodate time costs, it has been hypothesized that the criterion to terminate a decision may become lax as a function of time. Here we tested this hypothesis by manipulating the cost of time in a perceptual choice-reaction time task. Participants discriminated the direction of motion in a dynamic random-dot display, which varied in difficulty across trials. After each trial, they received feedback in the form of points based on whether they made a correct or erroneous choice. They were instructed to maximize their points per unit of time. Unbeknownst to the participants, halfway through the experiment, we increased the time pressure by canceling a small fraction of trials if they had not made a decision by a provisional deadline. Although the manipulation canceled less than 5% of trials, it induced the participants to make faster decisions while lowering their decision accuracy. The pattern of choices and reaction times were explained by bounded drift-diffusion. In all phases of the experiment, stopping bounds were found to decline as a function of time, consistent with the optimal solution, and this decline was exaggerated in response to the time-cost manipulation.

Pre-saccadic Neural Enhancements in Marmoset Area MT

Each time we make an eye movement, attention moves before the eyes, resulting in a perceptual enhancement at the target. Recent psychophysical studies suggest that this pre-saccadic attention enhances the visual features at the saccade target, whereas covert attention causes only spatially selective enhancements. While previous nonhuman primate studies have found that pre-saccadic attention does enhance neural responses spatially, no studies have tested whether changes in neural tuning reflect an automatic feature enhancement. Here we examined pre-saccadic attention using a saccade foraging task developed for marmoset monkeys (one male and one female). We recorded from neurons in the middle temporal area with peripheral receptive fields that contained a motion stimulus, which would either be the target of a saccade or a distracter as a saccade was made to another location. We established that marmosets, like macaques, show enhanced pre-saccadic neural responses for saccades toward the receptive field, including increases in firing rate and motion information. We then examined if the specific changes in neural tuning might support feature enhancements for the target. Neurons exhibited diverse changes in tuning but predominantly showed additive and multiplicative increases that were uniformly applied across motion directions. These findings confirm that marmoset monkeys, like macaques, exhibit pre-saccadic neural enhancements during saccade foraging tasks with minimal training requirements. However, at the level of individual neurons, the lack of feature-tuned enhancements is similar to neural effects reported during covert spatial attention.

Cholinergic neuromodulation of prefrontal attractor dynamics controls performance in spatial working memory

The behavioral and neural effects of the endogenous release of acetylcholine following stimulation of the Nucleus Basalis of Meynert (NB) have been recently examined (Qi et al. 2021). Counterintuitively, NB stimulation enhanced behavioral performance while broadening neural tuning in the prefrontal cortex (PFC). The mechanism by which a weaker mnemonic neural code could lead to better performance remains unclear. Here, we show that increased neural excitability in a simple continuous bump attractor model can induce broader neural tuning and decrease bump diffusion, provided neural rates are saturated. Increased memory precision in the model overrides memory accuracy, improving overall task performance. Moreover, we show that bump attractor dynamics can account for the nonuniform impact of neuromodulation on distractibility, depending on distractor distance from the target. Finally, we delve into the conditions under which bump attractor tuning and diffusion balance in biologically plausible heterogeneous network models. In these discrete bump attractor networks, we show that reducing spatial correlations or enhancing excitatory transmission can improve memory precision. Altogether, we provide a mechanistic understanding of how cholinergic neuromodulation controls spatial working memory through perturbed attractor dynamics in PFC.

Information representation in an oscillating neural field model modulated by working memory signals

We study how stimulus information can be represented in the dynamical signatures of an oscillatory model of neural activity-a model whose activity can be modulated by input akin to signals involved in working memory (WM). We developed a neural field model, tuned near an oscillatory instability, in which the WM-like input can modulate the frequency and amplitude of the oscillation. Our neural field model has a spatial-like domain in which an input that preferentially targets a point-a stimulus feature-on the domain will induce feature-specific activity changes. These feature-specific activity changes affect both the mean rate of spikes and the relative timing of spiking activity to the global field oscillation-the phase of the spiking activity. From these two dynamical signatures, we define both a spike rate code and an oscillatory phase code. We assess the performance of these two codes to discriminate stimulus features using an information-theoretic analysis. We show that global WM input modulations can enhance phase code discrimination while simultaneously reducing rate code discrimination. Moreover, we find that the phase code performance is roughly two orders of magnitude larger than that of the rate code defined for the same model solutions. The results of our model have applications to sensory areas of the brain, to which prefrontal areas send inputs reflecting the content of WM. These WM inputs to sensory areas have been established to induce oscillatory changes similar to our model. Our model results suggest a mechanism by which WM signals may enhance sensory information represented in oscillatory activity beyond the comparatively weak representations based on the mean rate activity.

Transformations of sensory information in the brain suggest changing criteria for optimality

Neurons throughout the brain modulate their firing rate lawfully in response to sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization in which neurons aim to robustly and efficiently represent sensory information. Our understanding of how this optimization varies across different areas in the brain, however, is still in its infancy. Here, we show that neural sensory responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation towards optimizing for perceptual discrimination. Focusing on the representation of binocular disparities-the slight differences in the retinal images of the two eyes-we re-analyze measurements characterizing neuronal tuning curves in brain areas V1, V2, and MT (middle temporal) in the macaque monkey. We compare these to measurements of the statistics of binocular disparity typically encountered during natural behaviors using a Fisher Information framework. The differences in tuning curve characteristics across areas are consistent with a shift in optimization goals: V1 and V2 population-level responses are more consistent with maximizing the information encoded about naturally occurring binocular disparities, while MT responses shift towards maximizing the ability to support disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective areas of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings emphasize the need to consider not just information preservation and neural resources, but also relevance to behavior, when assessing the optimality of neural codes.

Orbitofrontal Cortex Modulates Auditory Cortical Sensitivity and Sound Perception

Sensory perception is dynamic, quickly adapting to sudden shifts in environmental or behavioral context. Though decades of work have established that these dynamics are mediated by rapid fluctuations in sensory cortical activity, we have a limited understanding of the brain regions and pathways that orchestrate these changes. Neurons in the orbitofrontal cortex (OFC) encode contextual information, and recent data suggest that some of these signals are transmitted to sensory cortices. Whether and how these signals shape sensory encoding and perceptual sensitivity remains uncertain. Here, we asked whether the OFC mediates context-dependent changes in auditory cortical sensitivity and sound perception by monitoring and manipulating OFC activity in freely moving animals under two behavioral contexts: passive sound exposure and engagement in an amplitude modulation (AM) detection task. We found that the majority of OFC neurons, including the specific subset that innervate the auditory cortex, were strongly modulated by task engagement. Pharmacological inactivation of the OFC prevented rapid context-dependent changes in auditory cortical firing, and significantly impaired behavioral AM detection. Our findings suggest that contextual information from the OFC mediates rapid plasticity in the auditory cortex and facilitates the perception of behaviorally relevant sounds.

Significance Statement

Sensory perception depends on the context in which stimuli are presented. For example, perception is enhanced when stimuli are informative, such as when they are important to solve a task. Perceptual enhancements result from an increase in the sensitivity of sensory cortical neurons; however, we do not fully understand how such changes are initiated in the brain. Here, we tested the role of the orbitofrontal cortex (OFC) in controlling auditory cortical sensitivity and sound perception. We found that OFC neurons change their activity when animals perform a sound detection task. Inactivating OFC impairs sound detection and prevents task-dependent increases in auditory cortical sensitivity. Our findings suggest that the OFC controls contextual modulations of the auditory cortex and sound perception.

How deep is the brain? The shallow brain hypothesis

Deep learning and predictive coding architectures commonly assume that inference in neural networks is hierarchical. However, largely neglected in deep learning and predictive coding architectures is the neurobiological evidence that all hierarchical cortical areas, higher or lower, project to and receive signals directly from subcortical areas. Given these neuroanatomical facts, today's dominance of cortico-centric, hierarchical architectures in deep learning and predictive coding networks is highly questionable; such architectures are likely to be missing essential computational principles the brain uses. In this Perspective, we present the shallow brain hypothesis: hierarchical cortical processing is integrated with a massively parallel process to which subcortical areas substantially contribute. This shallow architecture exploits the computational capacity of cortical microcircuits and thalamo-cortical loops that are not included in typical hierarchical deep learning and predictive coding networks. We argue that the shallow brain architecture provides several critical benefits over deep hierarchical structures and a more complete depiction of how mammalian brains achieve fast and flexible computational capabilities.

Silences, spikes and bursts: Three-part knot of the neural code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.

Targeted V1 comodulation supports task-adaptive sensory decisions

Sensory-guided behavior requires reliable encoding of stimulus information in neural populations, and flexible, task-specific readout. The former has been studied extensively, but the latter remains poorly understood. We introduce a theory for adaptive sensory processing based on functionally-targeted stochastic modulation. We show that responses of neurons in area V1 of monkeys performing a visual discrimination task exhibit low-dimensional, rapidly fluctuating gain modulation, which is stronger in task-informative neurons and can be used to decode from neural activity after few training trials, consistent with observed behavior. In a simulated hierarchical neural network model, such labels are learned quickly and can be used to adapt downstream readout, even after several intervening processing stages. Consistently, we find the modulatory signal estimated in V1 is also present in the activity of simultaneously recorded MT units, and is again strongest in task-informative neurons. These results support the idea that co-modulation facilitates task-adaptive hierarchical information routing.

Compact deep neural network models of visual cortex

A powerful approach to understanding the computations carried out in visual cortex is to develop models that predict neural responses to arbitrary images. Deep neural network (DNN) models have worked remarkably well at predicting neural responses [1, 2, 3], yet their underlying computations remain buried in millions of parameters. Have we simply replaced one complicated system in vivo with another in silico ? Here, we train a data-driven deep ensemble model that predicts macaque V4 responses ∼50% more accurately than currently-used task-driven DNN models. We then compress this deep ensemble to identify compact models that have 5,000x fewer parameters yet equivalent accuracy as the deep ensemble. We verified that the stimulus preferences of the compact models matched those of the real V4 neurons by measuring V4 responses to both 'maximizing' and adversarial images generated using compact models. We then analyzed the inner workings of the compact models and discovered a common circuit motif: Compact models share a similar set of filters in early stages of processing but then specialize by heavily consolidating this shared representation with a precise readout. This suggests that a V4 neuron's stimulus preference is determined entirely by its consolidation step. To demonstrate this, we investigated the compression step of a dot-detecting compact model and found a set of simple computations that may be carried out by dot-selective V4 neurons. Overall, our work demonstrates that the DNN models currently used in computational neuroscience are needlessly large; our approach provides a new way forward for obtaining explainable, high-accuracy models of visual cortical neurons.