Associative learning enhances population coding by inverting interneuronal correlation patterns

Network state changes in sensory thalamus represent learned outcomes

Thalamic brain areas play an important role in adaptive behaviors. Nevertheless, the population dynamics of thalamic relays during learning across sensory modalities remain unknown. Using a cross-modal sensory reward-associative learning paradigm combined with deep brain two-photon calcium imaging of large populations of auditory thalamus (medial geniculate body, MGB) neurons in male mice, we identified that MGB neurons are biased towards reward predictors independent of modality. Additionally, functional classes of MGB neurons aligned with distinct task periods and behavioral outcomes, both dependent and independent of sensory modality. During non-sensory delay periods, MGB ensembles developed coherent neuronal representation as well as distinct co-activity network states reflecting predicted task outcome. These results demonstrate flexible cross-modal ensemble coding in auditory thalamus during adaptive learning and highlight its importance in brain-wide cross-modal computations during complex behavior.

Recent visual experience reshapes V4 neuronal activity and improves perceptual performance

Recent visual experience heavily influences our visual perception, but how this is mediated by the reshaping of neuronal activity to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in mid-level visual cortex.

Cortical Processing of Conspecific Vocalizations in Zebra Finches Depends on the Early Acoustical Environment

Sensory experience during development has lasting effects on perception and neural processing. Exposing animals to artificial stimuli early in life influences the tuning and functional organization of the auditory cortex, but less is known about how the rich acoustical environments experienced by vocal communicators affect the processing of complex vocalizations. Here, we show that in zebra finches (Taeniopygia guttata), a colonial-breeding songbird species, exposure to a naturalistic social-acoustical environment during development has a profound impact on cortical-level auditory responses to conspecific song. Compared to birds raised by pairs in acoustic isolation, birds raised in a breeding colony had higher average firing rates, selectivity, and discriminability, especially in the narrow-spiking, putatively inhibitory neurons of a higher-order auditory area, the caudomedial nidopallium (NCM). Neurons in colony-reared birds were also less correlated in their tuning and more efficient at encoding the spectrotemporal structure of conspecific song. These results suggest that the auditory cortex adapts to noisy, complex acoustical environments by strengthening inhibitory circuitry, functionally decoupling excitatory neurons while maintaining overall excitatory-inhibitory balance.

Learning leaves a memory trace in motor cortex

How are we able to learn new behaviors without disrupting previously learned ones? To understand how the brain achieves this, we used a brain-computer interface (BCI) learning paradigm, which enables us to detect the presence of a memory of one behavior while performing another. We found that learning to use a new BCI map altered the neural activity that monkeys produced when they returned to using a familiar BCI map in a way that was specific to the learning experience. That is, learning left a "memory trace" in the primary motor cortex. This memory trace coexisted with proficient performance under the familiar map, primarily by altering neural activity in dimensions that did not impact behavior. Forming memory traces might be how the brain is able to provide for the joint learning of multiple behaviors without interference.

Signatures of task learning in neural representations

While neural plasticity has long been studied as the basis of learning, the growth of large-scale neural recording techniques provides a unique opportunity to study how learning-induced activity changes are coordinated across neurons within the same circuit. These distributed changes can be understood through an evolution of the geometry of neural manifolds and latent dynamics underlying new computations. In parallel, studies of multi-task and continual learning in artificial neural networks hint at a tradeoff between non-interference and compositionality as guiding principles to understand how neural circuits flexibly support multiple behaviors. In this review, we highlight recent findings from both biological and artificial circuits that together form a new framework for understanding task learning at the population level.

Specialized structure of neural population codes in parietal cortex outputs

Do cortical neurons that send axonal projections to the same target area form specialized population codes for transmitting information? We used calcium imaging in mouse posterior parietal cortex (PPC), retrograde labeling, and statistical multivariate models to address this question during a delayed match-to-sample task. We found that PPC broadcasts sensory, choice, and locomotion signals widely, but sensory information is enriched in the output to anterior cingulate cortex. Neurons projecting to the same area have elevated pairwise activity correlations. These correlations are structured as information-limiting and information-enhancing interaction networks that collectively enhance information levels. This network structure is unique to sub-populations projecting to the same target and strikingly absent in surrounding neural populations with unidentified projections. Furthermore, this structure is only present when mice make correct, but not incorrect, behavioral choices. Therefore, cortical neurons comprising an output pathway form uniquely structured population codes that enhance information transmission to guide accurate behavior.

Sparse ensemble neural code for a complete vocal repertoire

The categorization of animal vocalizations into distinct behaviorally relevant groups for communication is an essential operation that must be performed by the auditory system. This auditory object recognition is a difficult task that requires selectivity to the group identifying acoustic features and invariance to renditions within each group. We find that small ensembles of auditory neurons in the forebrain of a social songbird can code the bird's entire vocal repertoire (∼10 call types). Ensemble neural discrimination is not, however, correlated with single unit selectivity, but instead with how well the joint single unit tunings to characteristic spectro-temporal modulations span the acoustic subspace optimized for the discrimination of call types. Thus, akin to face recognition in the visual system, call type recognition in the auditory system is based on a sparse code representing a small number of high-level features and not on highly selective grandmother neurons.

A Redundant Cortical Code for Speech Envelope

Animal communication sounds exhibit complex temporal structure because of the amplitude fluctuations that comprise the sound envelope. In human speech, envelope modulations drive synchronized activity in auditory cortex (AC), which correlates strongly with comprehension (Giraud and Poeppel, 2012; Peelle and Davis, 2012; Haegens and Zion Golumbic, 2018). Studies of envelope coding in single neurons, performed in nonhuman animals, have focused on periodic amplitude modulation (AM) stimuli and use response metrics that are not easy to juxtapose with data from humans. In this study, we sought to bridge these fields. Specifically, we looked directly at the temporal relationship between stimulus envelope and spiking, and we assessed whether the apparent diversity across neurons' AM responses contributes to the population representation of speech-like sound envelopes. We gathered responses from single neurons to vocoded speech stimuli and compared them to sinusoidal AM responses in auditory cortex (AC) of alert, freely moving Mongolian gerbils of both sexes. While AC neurons displayed heterogeneous tuning to AM rate, their temporal dynamics were stereotyped. Preferred response phases accumulated near the onsets of sinusoidal AM periods for slower rates (<8 Hz), and an over-representation of amplitude edges was apparent in population responses to both sinusoidal AM and vocoded speech envelopes. Crucially, this encoding bias imparted a decoding benefit: a classifier could discriminate vocoded speech stimuli using summed population activity, while higher frequency modulations required a more sophisticated decoder that tracked spiking responses from individual cells. Together, our results imply that the envelope structure relevant to parsing an acoustic stream could be read-out from a distributed, redundant population code.SIGNIFICANCE STATEMENT Animal communication sounds have rich temporal structure and are often produced in extended sequences, including the syllabic structure of human speech. Although the auditory cortex (AC) is known to play a crucial role in representing speech syllables, the contribution of individual neurons remains uncertain. Here, we characterized the representations of both simple, amplitude-modulated sounds and complex, speech-like stimuli within a broad population of cortical neurons, and we found an overrepresentation of amplitude edges. Thus, a phasic, redundant code in auditory cortex can provide a mechanistic explanation for segmenting acoustic streams like human speech.

The structures and functions of correlations in neural population codes

The collective activity of a population of neurons, beyond the properties of individual cells, is crucial for many brain functions. A fundamental question is how activity correlations between neurons affect how neural populations process information. Over the past 30 years, major progress has been made on how the levels and structures of correlations shape the encoding of information in population codes. Correlations influence population coding through the organization of pairwise-activity correlations with respect to the similarity of tuning of individual neurons, by their stimulus modulation and by the presence of higher-order correlations. Recent work has shown that correlations also profoundly shape other important functions performed by neural populations, including generating codes across multiple timescales and facilitating information transmission to, and readout by, downstream brain areas to guide behaviour. Here, we review this recent work and discuss how the structures of correlations can have opposite effects on the different functions of neural populations, thus creating trade-offs and constraints for the structure-function relationships of population codes. Further, we present ideas on how to combine large-scale simultaneous recordings of neural populations, computational models, analyses of behaviour, optogenetics and anatomy to unravel how the structures of correlations might be optimized to serve multiple functions.

A general decoding strategy explains the relationship between behavior and correlated variability

Improvements in perception are frequently accompanied by decreases in correlated variability in sensory cortex. This relationship is puzzling because overall changes in correlated variability should minimally affect optimal information coding. We hypothesize that this relationship arises because instead of using optimal strategies for decoding the specific stimuli at hand, observers prioritize generality: a single set of neuronal weights to decode any stimuli. We tested this using a combination of multineuron recordings in the visual cortex of behaving rhesus monkeys and a cortical circuit model. We found that general decoders optimized for broad rather than narrow sets of visual stimuli better matched the animals’ decoding strategy, and that their performance was more related to the magnitude of correlated variability. In conclusion, the inverse relationship between perceptual performance and correlated variability can be explained by observers using a general decoding strategy, capable of decoding neuronal responses to the variety of stimuli encountered in natural vision.

Learning and attention increase visual response selectivity through distinct mechanisms

Selectivity of cortical neurons for sensory stimuli can increase across days as animals learn their behavioral relevance and across seconds when animals switch attention. While both phenomena occur in the same circuit, it is unknown whether they rely on similar mechanisms. We imaged primary visual cortex as mice learned a visual discrimination task and subsequently performed an attention switching task. Selectivity changes due to learning and attention were uncorrelated in individual neurons. Selectivity increases after learning mainly arose from selective suppression of responses to one of the stimuli but from selective enhancement and suppression during attention. Learning and attention differentially affected interactions between excitatory and PV, SOM, and VIP inhibitory cells. Circuit modeling revealed that cell class-specific top-down inputs best explained attentional modulation, while reorganization of local functional connectivity accounted for learning-related changes. Thus, distinct mechanisms underlie increased discriminability of relevant sensory stimuli across longer and shorter timescales.

Ablation of microRNAs in VIP+ interneurons impairs olfactory discrimination and decreases neural activity in the olfactory bulb

AIM

MicroRNAs (miRNAs) are abundantly expressed in vasoactive intestinal peptide expressing (VIP⁺ ) interneurons and are indispensable for their functional maintenance and survival. Here, we blocked miRNA biogenesis in postmitotic VIP⁺ interneurons in mice by selectively ablating Dicer, an enzyme essential for miRNA maturation, to study whether ablation of VIP⁺ miRNA affects olfactory function and neural activity in olfactory centres such as the olfactory bulb, which contains a large number of VIP⁺ interneurons.

METHODS

A go/no-go odour discrimination task and a food-seeking test were used to assess olfactory discrimination and olfactory detection. In vivo electrophysiological techniques were used to record single units and local field potentials.

RESULTS

Olfactory detection and olfactory discrimination behaviours were impaired in VIP⁺ -specific Dicer-knockout mice. In vivo electrophysiological recordings in awake, head-fixed mice showed that both spontaneous and odour-evoked firing rates were decreased in mitral/tufted cells in knockout mice. The power of ongoing and odour-evoked beta local field potentials response of the olfactory bulb and anterior piriform cortex were dramatically decreased. Furthermore, the coherence of theta oscillations between the olfactory bulb and anterior piriform cortex was decreased. Importantly, Dicer knockout restricted to olfactory bulb VIP⁺ interneurons recapitulated the behavioural and electrophysiological results of the global knockout.

CONCLUSIONS

VIP⁺ miRNAs are an important factor in sensory processing, affecting olfactory function and olfactory neural activity.

How learning unfolds in the brain: toward an optimization view

How do changes in the brain lead to learning? To answer this question, consider an artificial neural network (ANN), where learning proceeds by optimizing a given objective or cost function. This "optimization framework" may provide new insights into how the brain learns, as many idiosyncratic features of neural activity can be recapitulated by an ANN trained to perform the same task. Nevertheless, there are key features of how neural population activity changes throughout learning that cannot be readily explained in terms of optimization and are not typically features of ANNs. Here we detail three of these features: (1) the inflexibility of neural variability throughout learning, (2) the use of multiple learning processes even during simple tasks, and (3) the presence of large task-nonspecific activity changes. We propose that understanding the role of these features in the brain will be key to describing biological learning using an optimization framework.

Bridging neuronal correlations and dimensionality reduction

Two commonly used approaches to study interactions among neurons are spike count correlation, which describes pairs of neurons, and dimensionality reduction, applied to a population of neurons. Although both approaches have been used to study trial-to-trial neuronal variability correlated among neurons, they are often used in isolation and have not been directly related. We first established concrete mathematical and empirical relationships between pairwise correlation and metrics of population-wide covariability based on dimensionality reduction. Applying these insights to macaque V4 population recordings, we found that the previously reported decrease in mean pairwise correlation associated with attention stemmed from three distinct changes in population-wide covariability. Overall, our work builds the intuition and formalism to bridge between pairwise correlation and population-wide covariability and presents a cautionary tale about the inferences one can make about population activity by using a single statistic, whether it be mean pairwise correlation or dimensionality.

Learning is shaped by abrupt changes in neural engagement

Internal states such as arousal, attention and motivation modulate brain-wide neural activity, but how these processes interact with learning is not well understood. During learning, the brain modifies its neural activity to improve behavior. How do internal states affect this process? Using a brain-computer interface learning paradigm in monkeys, we identified large, abrupt fluctuations in neural population activity in motor cortex indicative of arousal-like internal state changes, which we term 'neural engagement.' In a brain-computer interface, the causal relationship between neural activity and behavior is known, allowing us to understand how neural engagement impacted behavioral performance for different task goals. We observed stereotyped changes in neural engagement that occurred regardless of how they impacted performance. This allowed us to predict how quickly different task goals were learned. These results suggest that changes in internal states, even those seemingly unrelated to goal-seeking behavior, can systematically influence how behavior improves with learning.

Population Coding of Natural Electrosensory Stimuli by Midbrain Neurons

Natural stimuli display spatiotemporal characteristics that typically vary over orders of magnitude, and their encoding by sensory neurons remains poorly understood. We investigated population coding of highly heterogeneous natural electrocommunication stimuli in Apteronotus leptorhynchus of either sex. Neuronal activities were positively correlated with one another in the absence of stimulation, and correlation magnitude decayed with increasing distance between recording sites. Under stimulation, we found that correlations between trial-averaged neuronal responses (i.e., signal correlations) were positive and higher in magnitude for neurons located close to another, but that correlations between the trial-to-trial variability (i.e., noise correlations) were independent of physical distance. Overall, signal and noise correlations were independent of stimulus waveform as well as of one another. To investigate how neuronal populations encoded natural electrocommunication stimuli, we considered a nonlinear decoder for which the activities were combined. Decoding performance was best for a timescale of 6 ms, indicating that midbrain neurons transmit information via precise spike timing. A simple summation of neuronal activities (equally weighted sum) revealed that noise correlations limited decoding performance by introducing redundancy. Using an evolution algorithm to optimize performance when considering instead unequally weighted sums of neuronal activities revealed much greater performance values, indicating that midbrain neuron populations transmit information that reliably enable discrimination between different stimulus waveforms. Interestingly, we found that different weight combinations gave rise to similar discriminability, suggesting robustness. Our results have important implications for understanding how natural stimuli are integrated by downstream brain areas to give rise to behavioral responses.SIGNIFICANCE STATEMENT We show that midbrain electrosensory neurons display correlations between their activities and that these can significantly impact performance of decoders. While noise correlations limited discrimination performance by introducing redundancy, considering unequally weighted sums of neuronal activities gave rise to much improved performance and mitigated the deleterious effects of noise correlations. Further analysis revealed that increased discriminability was achieved by making trial-averaged responses more separable, as well as by reducing trial-to-trial variability by eliminating noise correlations. We further found that multiple combinations of weights could give rise to similar discrimination performances, which suggests that such combinatorial codes could be achieved in the brain. We conclude that the activities of midbrain neuronal populations can be used to reliably discriminate between highly heterogeneous stimulus waveforms.

Spike Train Coactivity Encodes Learned Natural Stimulus Invariances in Songbird Auditory Cortex

The capacity for sensory systems to encode relevant information that is invariant to many stimulus changes is central to normal, real-world, cognitive function. This invariance is thought to be reflected in the complex spatiotemporal activity patterns of neural populations, but our understanding of population-level representational invariance remains coarse. Applied topology is a promising tool to discover invariant structure in large datasets. Here, we use topological techniques to characterize and compare the spatiotemporal pattern of coactive spiking within populations of simultaneously recorded neurons in the secondary auditory region caudal medial neostriatum of European starlings (Sturnus vulgaris). We show that the pattern of population spike train coactivity carries stimulus-specific structure that is not reducible to that of individual neurons. We then introduce a topology-based similarity measure for population coactivity that is sensitive to invariant stimulus structure and show that this measure captures invariant neural representations tied to the learned relationships between natural vocalizations. This demonstrates one mechanism whereby emergent stimulus properties can be encoded in population activity, and shows the potential of applied topology for understanding invariant representations in neural populations.SIGNIFICANCE STATEMENT Information in neural populations is carried by the temporal patterns of spikes. We applied novel mathematical tools from the field of algebraic topology to quantify the structure of these temporal patterns. We found that, in a secondary auditory region of a songbird, these patterns reflected invariant information about a learned stimulus relationship. These results demonstrate that topology provides a novel approach for characterizing neural responses that is sensitive to invariant relationships that are critical for the perception of natural stimuli.

Noise-Correlation Is Modulated by Reward Expectation in the Primary Motor Cortex Bilaterally During Manual and Observational Tasks in Primates

Reward modulation is represented in the motor cortex (M1) and could be used to implement more accurate decoding models to improve brain-computer interfaces (BCIs; Zhao et al., 2018). Analyzing trial-to-trial noise-correlations between neural units in the presence of rewarding (R) and non-rewarding (NR) stimuli adds to our understanding of cortical network dynamics. We utilized Pearson's correlation coefficient to measure shared variability between simultaneously recorded units (32-112) and found significantly higher noise-correlation and positive correlation between the populations' signal- and noise-correlation during NR trials as compared to R trials. This pattern is evident in data from two non-human primates (NHPs) during single-target center out reaching tasks, both manual and action observation versions. We conducted a mean matched noise-correlation analysis to decouple known interactions between event-triggered firing rate changes and neural correlations. Isolated reward discriminatory units demonstrated stronger correlational changes than units unresponsive to reward firing rate modulation, however, the qualitative response was similar, indicating correlational changes within the network as a whole can serve as another information channel to be exploited by BCIs that track the underlying cortical state, such as reward expectation, or attentional modulation. Reward expectation and attention in return can be utilized with reinforcement learning (RL) towards autonomous BCI updating.

High-capacity auditory memory for vocal communication in a social songbird

Effective vocal communication often requires the listener to recognize the identity of a vocalizer, and this recognition is dependent on the listener's ability to form auditory memories. We tested the memory capacity of a social songbird, the zebra finch, for vocalizer identities using conditioning experiments and found that male and female zebra finches can remember a large number of vocalizers (mean, 42) based solely on the individual signatures found in their songs and distance calls. These memories were formed within a few trials, were generalized to previously unheard renditions, and were maintained for up to a month. A fast and high-capacity auditory memory for vocalizer identity has not been demonstrated previously in any nonhuman animals and is an important component of vocal communication in social species.

Amplitude modulation encoding in the auditory cortex: comparisons between the primary and middle lateral belt regions

In macaques, the middle lateral auditory cortex (ML) is a belt region adjacent to the primary auditory cortex (A1) and believed to be at a hierarchically higher level. Although ML single-unit responses have been studied for several auditory stimuli, the ability of ML cells to encode amplitude modulation (AM)-an ability that has been widely studied in A1-has not yet been characterized. Here, we compared the responses of A1 and ML neurons to amplitude-modulated (AM) noise in awake macaques. Although several of the basic properties of A1 and ML responses to AM noise were similar, we found several key differences. ML neurons were less likely to phase lock, did not phase lock as strongly, and were more likely to respond in a nonsynchronized fashion than A1 cells, consistent with a temporal-to-rate transformation as information ascends the auditory hierarchy. ML neurons tended to have lower temporally (phase-locking) based best modulation frequencies than A1 neurons. Neurons that decreased their firing rate in response to AM noise relative to their firing rate in response to unmodulated noise became more common at the level of ML than they were in A1. In both A1 and ML, we found a prevalent class of neurons that usually have enhanced rate responses relative to responses to the unmodulated noise at lower modulation frequencies and suppressed rate responses relative to responses to the unmodulated noise at middle modulation frequencies.NEW & NOTEWORTHY ML neurons synchronized less than A1 neurons, consistent with a hierarchical temporal-to-rate transformation. Both A1 and ML had a class of modulation transfer functions previously unreported in the cortex with a low-modulation-frequency (MF) peak, a middle-MF trough, and responses similar to unmodulated noise responses at high MFs. The results support a hierarchical shift toward a two-pool opponent code, where subtraction of neural activity between two populations of oppositely tuned neurons encodes AM.

Principles of Corticocortical Communication: Proposed Schemes and Design Considerations

Nearly all brain functions involve routing neural activity among a distributed network of areas. Understanding this routing requires more than a description of interareal anatomical connectivity: it requires understanding what controls the flow of signals through interareal circuitry and how this communication might be modulated to allow flexible behavior. Here we review proposals of how communication, particularly between visual cortical areas, is instantiated and modulated, highlighting recent work that offers new perspectives. We suggest transitioning from a focus on assessing changes in the strength of interareal interactions, as often seen in studies of interareal communication, to a broader consideration of how different signaling schemes might contribute to computation. To this end, we discuss a set of features that might be desirable for a communication scheme.

Precise memory for pure tones is predicted by measures of learning-induced sensory system neurophysiological plasticity at cortical and subcortical levels

Despite identical learning experiences, individuals differ in the memory formed of those experiences. Molecular mechanisms that control the neurophysiological bases of long-term memory formation might control how precisely the memory formed reflects the actually perceived experience. Memory formed with sensory specificity determines its utility for selectively cueing subsequent behavior, even in novel situations. Here, a rodent model of auditory learning capitalized on individual differences in learning-induced auditory neuroplasticity to identify and characterize neural substrates for sound-specific (vs. general) memory of the training signal's acoustic frequency. Animals that behaviorally revealed a naturally induced signal-"specific" memory exhibited long-lasting signal-specific neurophysiological plasticity in auditory cortical and subcortical evoked responses. Animals with "general" memories did not exhibit learning-induced changes in these same measures. Manipulating a histone deacetylase during memory consolidation biased animals to have more signal-specific memory. Individual differences validated this brain-behavior relationship in both natural and manipulated memory formation, such that the degree of change in sensory cortical and subcortical neurophysiological responses could be used to predict the behavioral precision of memory.

The Basal Forebrain Modulates Neuronal Response in an Active Olfactory Discrimination Task

Successful completion of sensory decision-making requires focusing on relevant stimuli, adequate signal/noise ratio for stimulus discrimination, and stimulus valence evaluation. Different brain regions are postulated to play a role in these computations; however, evidence suggests that sensory and decision-making circuits are required to interact through a common neuronal pathway to elicit a context-adequate behavioral response. Recently, the basal forebrain (BF) region has emerged as a good candidate, since its heterogeneous projecting neurons innervate most of the cortical mantle and sensory processing circuits modulating different aspects of the sensory decision-making process. Moreover, evidence indicates that the BF plays an important role in attention and in fast modulation of neuronal activity that enhance visual and olfactory sensory perception. Here, we study in awake mice the involvement of BF in initiation and completion of trials in a reward-driven olfactory detection task. Using tetrode recordings, we find that BF neurons (including cholinergics) are recruited during sensory discrimination, reward, and interestingly slightly before trial initiation in successful discrimination trials. The precue neuronal activity was correlated with animal performance, indicating that this circuit could play an important role in adaptive context-dependent behavioral responses.

Plasticity of Sniffing Pattern and Neural Activity in the Olfactory Bulb of Behaving Mice During Odor Sampling, Anticipation, and Reward

The olfactory bulb (OB) is the first relay station in the olfactory system. In the OB, mitral/tufted cells (M/Ts), which are the main output neurons, play important roles in the processing and representation of odor information. Recent studies focusing on the function of M/Ts at the single-cell level in awake behaving mice have demonstrated that odor-evoked firing of single M/Ts displays transient/long-term plasticity during learning. Here, we tested whether the neural activity of M/Ts and sniffing patterns are dependent on anticipation and reward in awake behaving mice. We used an odor discrimination task combined with in vivo electrophysiological recordings in awake, head-fixed mice, and found that, while learning induced plasticity of spikes and beta oscillations during odor sampling, we also found plasticity of spikes, beta oscillation, sniffing pattern, and coherence between sniffing and theta oscillations during the periods of anticipation and/or reward. These results indicate that the activity of M/Ts plays important roles not only in odor representation but also in salience-related events such as anticipation and reward.

Altered functional interactions between neurons in primary visual cortex of macaque monkeys with experimental amblyopia

Amblyopia, a disorder in which vision through one of the eyes is degraded, arises because of defective processing of information by the visual system. Amblyopia often develops in humans after early misalignment of the eyes (strabismus) and can be simulated in macaque monkeys by artificially inducing strabismus. In such amblyopic animals, single-unit responses in primary visual cortex (V1) are appreciably reduced when evoked by the amblyopic eye compared with the other (fellow) eye. However, this degradation in single V1 neuron responsivity is not commensurate with the marked losses in visual sensitivity and resolution measured behaviorally. Here we explored the idea that changes in patterns of coordinated activity across populations of V1 neurons may contribute to degraded visual representations in amblyopia, potentially making it more difficult to read out evoked activity to support perceptual decisions. We studied the visually evoked activity of V1 neuronal populations in three macaques (Macaca nemestrina) with strabismic amblyopia and in one control animal. Activity driven through the amblyopic eye was diminished, and these responses also showed more interneuronal correlation at all stimulus contrasts than responses driven through the fellow eye or responses in the control animal. A decoding analysis showed that responses driven through the amblyopic eye carried less visual information than other responses. Our results suggest that part of the reduced visual capacity of amblyopes may be due to changes in the patterns of functional interaction among neurons in V1.NEW & NOTEWORTHY Previous work on the neurophysiological basis of amblyopia has largely focused on relating behavioral deficits to changes in visual processing by single neurons in visual cortex. In this study, we recorded simultaneously from populations of primary visual cortical (V1) neurons in macaques with amblyopia. We found changes in the strength and pattern of shared response variability between neurons. These changes in neuronal interactions could impair the visual representations of V1 populations driven by the amblyopic eye.

Weaker Inter-hemispheric and Local Functional Connectivity of the Somatomotor Cortex During a Motor Skill Acquisition Is Associated With Better Learning

Recently, an increasing interest in investigating interactions between brain regions using functional connectivity (FC) methods has shifted the initial focus of cognitive neuroimaging research from localizing functional circuits based on task activation to mapping brain networks based on intrinsic FC dynamics. Leveraging the advantages of the latter approach, it has been shown that despite primarily invariant intrinsic organization of the large-scale functional networks, interactions between and within these networks significantly differ between various behavioral and cognitive states. These differences presumably indicate transient reconfiguration of functional connections-an instantaneous process that flexibly mediates and calibrates human behavior according to momentary demands of the environment. Nevertheless, the specificity of these reconfigured FC patterns to the task at hand and their relevance to adaptive processes during learning remain elusive. To address this knowledge gap, we investigated (1) to what extent FC within the somatomotor network is reconfigured during motor skill practice, and (2) how these changes are related to learning. We applied a seed-driven FC approach to data collected during a continuous task-free condition, so-called resting state, and during a motor sequence learning task using functional magnetic resonance imaging. During the task, participants repeatedly performed a short five-element sequence with their non-dominant (left) hand. As predicted, such unimanual sequence production was associated with lateralized activation of the right somatomotor cortex (SMC). Using this "active" region as a seed, here we show that unimanual performance of the motor sequence relies on functional segregation between the two SMC and selective integration between the "active" SMC and supplementary motor area. Whereas, greater segregation between the two SMC was associated with gains in performance rate, greater segregation within the "active" SMC itself was associated with more consistent performance by the end of training. Nether the resting-state FC patterns within the somatomotor network nor their relative modulation by the task state predicted these behavioral benefits of learning. Our results suggest that task-induced FC changes reflect reconfiguration of the connectivity patterns within the somatomotor network rather than a simple amplification or silencing of its intrinsic dynamics. Such reconfiguration not only supports motor behavior but may also predict learning.

Arousal regulates frequency tuning in primary auditory cortex

Changes in brain state modulate how information is processed in sensory cortical areas. Here we use population imaging and intracellular recording to show that arousal regulates frequency tuning in layer 2/3 of primary auditory cortex. Increased arousal reduces lateral inhibition, broadens frequency tuning and enhances cortical representations of pure tones. Despite the arousal-dependent reduction in stimulus selectivity, frequency discrimination by cell ensembles improves due to a reduction in correlated variability (noise correlations).

Changes in arousal influence cortical sensory representations, but the synaptic mechanisms underlying arousal-dependent modulation of cortical processing are unclear. Here, we use 2-photon Ca²⁺ imaging in the auditory cortex of awake mice to show that heightened arousal, as indexed by pupil diameter, broadens frequency-tuned activity of layer 2/3 (L2/3) pyramidal cells. Sensory representations are less sparse, and the tuning of nearby cells more similar when arousal increases. Despite the reduction in selectivity, frequency discrimination by cell ensembles improves due to a decrease in shared trial-to-trial variability. In vivo whole-cell recordings reveal that mechanisms contributing to the effects of arousal on sensory representations include state-dependent modulation of membrane potential dynamics, spontaneous firing, and tone-evoked synaptic potentials. Surprisingly, changes in short-latency tone-evoked excitatory input cannot explain the effects of arousal on the broadness of frequency-tuned output. However, we show that arousal strongly modulates a slow tone-evoked suppression of recurrent excitation underlying lateral inhibition [H. K. Kato, S. K. Asinof, J. S. Isaacson, Neuron, 95, 412–423, (2017)]. This arousal-dependent “network suppression” gates the duration of tone-evoked responses and regulates the broadness of frequency tuning. Thus, arousal can shape tuning via modulation of indirect changes in recurrent network activity.

Excitatory and Inhibitory Subnetworks Are Equally Selective during Decision-Making and Emerge Simultaneously during Learning

Inhibitory neurons, which play a critical role in decision-making models, are often simplified as a single pool of non-selective neurons lacking connection specificity. This assumption is supported by observations in the primary visual cortex: inhibitory neurons are broadly tuned in vivo and show non-specific connectivity in slice. The selectivity of excitatory and inhibitory neurons within decision circuits and, hence, the validity of decision-making models are unknown. We simultaneously measured excitatory and inhibitory neurons in the posterior parietal cortex of mice judging multisensory stimuli. Surprisingly, excitatory and inhibitory neurons were equally selective for the animal's choice, both at the single-cell and population level. Further, both cell types exhibited similar changes in selectivity and temporal dynamics during learning, paralleling behavioral improvements. These observations, combined with modeling, argue against circuit architectures assuming non-selective inhibitory neurons. Instead, they argue for selective subnetworks of inhibitory and excitatory neurons that are shaped by experience to support expert decision-making.

Task-Demand-Dependent Neural Representation of Odor Information in the Olfactory Bulb and Posterior Piriform Cortex

In awake rodents, the neural representation of olfactory information in the olfactory bulb is largely dependent on brain state and behavioral context. Learning-modified neural plasticity has been observed in mitral/tufted cells, the main output neurons of the olfactory bulb. Here, we propose that the odor information encoded by mitral/tufted cell responses in awake mice is highly dependent on the behavioral task demands. We used fiber photometry to record calcium signals from the mitral/tufted cell population in awake, head-fixed male mice under different task demands. We found that the mitral/tufted cell population showed similar responses to two distinct odors when the odors were presented in the context of a go/go task, in which the mice received a water reward regardless of the identity of the odor presented. However, when the same odors were presented in a go/no-go task, in which one odor was rewarded and the other was not, then the mitral cell population responded very differently to the two odors, characterized by a robust reduction in the response to the nonrewarded odor. Thus, the representation of odors in the mitral/tufted cell population depends on whether the task requires discrimination of the odors. Strikingly, downstream of the olfactory bulb, pyramidal neurons in the posterior piriform cortex also displayed a task-demand-dependent neural representation of odors, but the anterior piriform cortex did not, indicating that these two important higher olfactory centers use different strategies for neural representation.SIGNIFICANCE STATEMENT The most important task of the olfactory system is to generate a precise representation of odor information under different brain states. Whether the representation of odors by neurons in olfactory centers such as the olfactory bulb and the piriform cortex depends on task demands remains elusive. We find that odor representation in the mitral/tufted cells of the olfactory bulb depends on whether the task requires odor discrimination. A similar neural representation is found in the posterior piriform cortex but not the anterior piriform cortex, indicating that these higher olfactory centers use different representational strategies. The task-demand-dependent representational strategy is likely important for facilitating information processing in higher brain centers responsible for decision making and encoding of salience.

New neural activity patterns emerge with long-term learning

Learning has been associated with changes in the brain at every level of organization. However, it remains difficult to establish a causal link between specific changes in the brain and new behavioral abilities. We establish that new neural activity patterns emerge with learning. We demonstrate that these new neural activity patterns cause the new behavior. Thus, the formation of new patterns of neural population activity can underlie the learning of new skills.

Coding Principles in Adaptation

Adaptation is a common principle that recurs throughout the nervous system at all stages of processing. This principle manifests in a variety of phenomena, from spike frequency adaptation, to apparent changes in receptive fields with changes in stimulus statistics, to enhanced responses to unexpected stimuli. The ubiquity of adaptation leads naturally to the question: What purpose do these different types of adaptation serve? A diverse set of theories, often highly overlapping, has been proposed to explain the functional role of adaptive phenomena. In this review, we discuss several of these theoretical frameworks, highlighting relationships among them and clarifying distinctions. We summarize observations of the varied manifestations of adaptation, particularly as they relate to these theoretical frameworks, focusing throughout on the visual system and making connections to other sensory systems.

Neuromodulation influences synchronization and intrinsic read-out

Background: The roles of neuromodulation in a neural network, such as in a cortical microcolumn, are still incompletely understood. Neuromodulation influences neural processing by presynaptic and postsynaptic regulation of synaptic efficacy. Neuromodulation also affects ion channels and intrinsic excitability.

Methods: Synaptic efficacy modulation is an effective way to rapidly alter network density and topology. We alter network topology and density to measure the effect on spike synchronization. We also operate with differently parameterized neuron models which alter the neuron's intrinsic excitability, i.e., activation function.

Results: We find that (a) fast synaptic efficacy modulation influences the amount of correlated spiking in a network. Also, (b) synchronization in a network influences the read-out of intrinsic properties. Highly synchronous input drives neurons, such that differences in intrinsic properties disappear, while asynchronous input lets intrinsic properties determine output behavior. Thus, altering network topology can alter the balance between intrinsically vs. synaptically driven network activity.

Conclusion: We conclude that neuromodulation may allow a network to shift between a more synchronized transmission mode and a more asynchronous intrinsic read-out mode. This has significant implications for our understanding of the flexibility of cortical computations.

Cortical Areas Interact through a Communication Subspace

Most brain functions involve interactions among multiple, distinct areas or nuclei. For instance, visual processing in primates requires the appropriate relaying of signals across many distinct cortical areas. Yet our understanding of how populations of neurons in interconnected brain areas communicate is in its infancy. Here we investigate how trial-to-trial fluctuations of population responses in primary visual cortex (V1) are related to simultaneously recorded population responses in area V2. Using dimensionality reduction methods, we find that V1-V2 interactions occur through a communication subspace: V2 fluctuations are related to a small subset of V1 population activity patterns, distinct from the largest fluctuations shared among neurons within V1. In contrast, interactions between subpopulations within V1 are less selective. We propose that the communication subspace may be a general, population-level mechanism by which activity can be selectively routed across brain areas.

Activity Correlations between Direction-Selective Retinal Ganglion Cells Synergistically Enhance Motion Decoding from Complex Visual Scenes

Neurons in sensory systems are often tuned to particular stimulus features. During complex naturalistic stimulation, however, multiple features may simultaneously affect neuronal responses, which complicates the readout of individual features. To investigate feature representation under complex stimulation, we studied how direction-selective ganglion cells in salamander retina respond to texture motion where direction, velocity, and spatial pattern inside the receptive field continuously change. We found that the cells preserve their direction preference under this stimulation, yet their direction encoding becomes ambiguous due to simultaneous activation by luminance changes. The ambiguities can be resolved by considering populations of direction-selective cells with different preferred directions. This gives rise to synergistic motion decoding, yielding more information from the population than the summed information from single-cell responses. Strong positive response correlations between cells with different preferred directions amplify this synergy. Our results show how correlated population activity can enhance feature extraction in complex visual scenes.

•

Direction-selective ganglion cells respond to motion as well as luminance changes

•

This obscures the readout of direction from single cells under complex texture motion

•

Population decoding improves direction readout supralinearly over individual cells

•

Strong spike correlations further enhance readout through increased synergy

Response properties of single neurons in higher level auditory cortex of adult songbirds

The caudomedial nidopallium (NCM) is a higher level region of auditory cortex in songbirds that has been implicated in encoding learned vocalizations and mediating perception of complex sounds. We made cell-attached recordings in awake adult male zebra finches ( Taeniopygia guttata) to characterize responses of single NCM neurons to playback of tones and songs. Neurons fell into two broad classes: narrow fast-spiking cells and broad sparsely firing cells. Virtually all narrow-spiking cells responded to playback of pure tones, compared with approximately half of broad-spiking cells. In addition, narrow-spiking cells tended to have lower thresholds and faster, less variable spike onset latencies than did broad-spiking cells, as well as higher firing rates. Tonal responses of narrow-spiking cells also showed broader ranges for both frequency and amplitude compared with broad-spiking neurons and were more apt to have V-shaped tuning curves compared with broad-spiking neurons, which tended to have complex (discontinuous), columnar, or O-shaped frequency response areas. In response to playback of conspecific songs, narrow-spiking neurons showed high firing rates and low levels of selectivity whereas broad-spiking neurons responded sparsely and selectively. Broad-spiking neurons in which tones failed to evoke a response showed greater song selectivity compared with those with a clear tuning curve. These results are consistent with the idea that narrow-spiking neurons represent putative fast-spiking interneurons, which may provide a source of intrinsic inhibition that contributes to the more selective tuning in broad-spiking cells. NEW & NOTEWORTHY The response properties of neurons in higher level regions of auditory cortex in songbirds are of fundamental interest because processing in such regions is essential for vocal learning and plasticity and for auditory perception of complex sounds. Within a region of secondary auditory cortex, neurons with narrow spikes exhibited high firing rates to playback of both tones and multiple conspecific songs, whereas broad-spiking neurons responded sparsely and selectively to both tones and songs.

Conditioning sharpens the spatial representation of rewarded stimuli in mouse primary visual cortex

Reward is often employed as reinforcement in behavioral paradigms but it is unclear how the visuospatial aspect of a stimulus-reward association affects the cortical representation of visual space. Using a head-fixed paradigm, we conditioned mice to associate the same visual pattern in adjacent retinotopic regions with availability and absence of reward. Time-lapse intrinsic optical signal imaging under anesthesia showed that conditioning increased the spatial separation of mesoscale cortical representations of reward predicting- and non-reward predicting stimuli. Subsequent in vivo two-photon calcium imaging revealed that this improved separation correlated with enhanced population coding for retinotopic location, specifically for the trained orientation and spatially confined to the V1 region where rewarded and non-rewarded stimulus representations bordered. These results are corroborated by conditioning-induced differences in the correlation structure of population activity. Thus, the cortical representation of visual space is sharpened as consequence of associative stimulus-reward learning while the overall retinotopic map remains unaltered.

Neuromodulation influences synchronization and intrinsic read-out

Background: The roles of neuromodulation in a neural network, such as in a cortical microcolumn, are still incompletely understood. Neuromodulation influences neural processing by presynaptic and postsynaptic regulation of synaptic efficacy. Neuromodulation also affects ion channels and intrinsic excitability. Methods: Synaptic efficacy modulation is an effective way to rapidly alter network density and topology. We alter network topology and density to measure the effect on spike synchronization. We also operate with differently parameterized neuron models which alter the neuron's intrinsic excitability, i.e., activation function. Results: We find that (a) fast synaptic efficacy modulation influences the amount of correlated spiking in a network. Also, (b) synchronization in a network influences the read-out of intrinsic properties. Highly synchronous input drives neurons, such that differences in intrinsic properties disappear, while asynchronous input lets intrinsic properties determine output behavior. Thus, altering network topology can alter the balance between intrinsically vs. synaptically driven network activity. Conclusion: We conclude that neuromodulation may allow a network to shift between a more synchronized transmission mode and a more asynchronous intrinsic read-out mode. This has significant implications for our understanding of the flexibility of cortical computations.

Cognition as a Window into Neuronal Population Space

Understanding how cognitive processes affect the responses of sensory neurons may clarify the relationship between neuronal population activity and behavior. However, tools for analyzing neuronal activity have not kept up with technological advances in recording from large neuronal populations. Here, we describe prevalent hypotheses of how cognitive processes affect sensory neurons, driven largely by a model based on the activity of single neurons or pools of neurons as the units of computation. We then use simple simulations to expand this model to a new conceptual framework that focuses on subspaces of population activity as the relevant units of computation, uses comparisons between brain areas or to behavior to guide analyses of these subspaces, and suggests that population activity is optimized to decode the large variety of stimuli and tasks that animals encounter in natural behavior. This framework provides new ways of understanding the ever-growing quantity of recorded population activity data.

Plasticity of population coding in primary sensory cortex

That experience shapes sensory tuning in primary sensory cortex is well understood. But effective neural population codes depend on more than just sensory tuning. Recent population imaging and recording studies have characterized population codes in sensory cortex, and tracked how they change with sensory manipulations and training on perceptual learning tasks. These studies confirm sensory tuning changes, but also reveal other features of plasticity, including sensory gain modulation, restructuring of firing correlations, and differential routing of information to output pathways. Unexpectedly strong day-to-day variation exists in single-neuron sensory tuning, which stabilizes during learning. These are novel dimensions of plasticity in sensory cortex, which refine population codes during learning, but whose mechanisms are unknown.

The Magnitude, But Not the Sign, of MT Single-Trial Spike-Time Correlations Predicts Motion Detection Performance

Spike-time correlations capture the short timescale covariance between the activity of neurons on a single trial. These correlations can significantly vary in magnitude and sign from trial to trial, and have been proposed to contribute to information encoding in visual cortex. While monkeys performed a motion-pulse detection task, we examined the behavioral impact of both the magnitude and sign of single-trial spike-time correlations between two nonoverlapping pools of middle temporal (MT) neurons. We applied three single-trial measures of spike-time correlation between our multiunit MT spike trains (Pearson's, absolute value of Pearson's, and mutual information), and examined the degree to which they predicted a subject's performance on a trial-by-trial basis. We found that on each trial, positive and negative spike-time correlations were almost equally likely, and, once the correlational sign was accounted for, all three measures were similarly predictive of behavior. Importantly, just before the behaviorally relevant motion pulse occurred, single-trial spike-time correlations were as predictive of the performance of the animal as single-trial firing rates. While firing rates were positively associated with behavioral outcomes, the presence of either strong positive or negative correlations had a detrimental effect on behavior. These correlations occurred on short timescales, and the strongest positive and negative correlations modulated behavioral performance by ∼9%, compared with trials with no correlations. We suggest a model where spike-time correlations are associated with a common noise source for the two MT pools, which in turn decreases the signal-to-noise ratio of the integrated signals that drive motion detection.SIGNIFICANCE STATEMENT Previous work has shown that spike-time correlations occurring on short timescales can affect the encoding of visual inputs. Although spike-time correlations significantly vary in both magnitude and sign across trials, their impact on trial-by-trial behavior is not fully understood. Using neural recordings from area MT (middle temporal) in monkeys performing a motion-detection task using a brief stimulus, we found that both positive and negative spike-time correlations predicted behavioral responses as well as firing rate on a trial-by-trial basis. We propose that strong positive and negative spike-time correlations decreased behavioral performance by reducing the signal-to-noise ratio of integrated MT neural signals.

Learning by neural reassociation

Behavior is driven by coordinated activity across a population of neurons. Learning requires the brain to change the neural population activity produced to achieve a given behavioral goal. How does population activity reorganize during learning? We studied intracortical population activity in the primary motor cortex of rhesus macaques during short-term learning in a brain-computer interface (BCI) task. In a BCI, the mapping between neural activity and behavior is exactly known, enabling us to rigorously define hypotheses about neural reorganization during learning. We found that changes in population activity followed a suboptimal neural strategy of Reassociation: animals relied on a fixed repertoire of activity patterns and associated those patterns with different movements after learning. These results indicate that the activity patterns that a neural population can generate are even more constrained than previously thought and might explain why it is often difficult to quickly learn to a high level of proficiency.

Early steps toward understanding neuronal communication

PURPOSE OF REVIEW

The computational power of the brain arises from the complex interactions between neurons. One straightforward method to quantify the strength of neuronal interactions is by measuring correlation and coherence. Efforts to measure correlation have been advancing rapidly of late, spurred by the development of advanced recording technologies enabling recording from many neurons and brain areas simultaneously. This review highlights recent results that provide clues into the principles of neural coordination, connections to cognitive and neurological phenomena, and key directions for future research.

RECENT FINDINGS

The correlation structure of neural activity in the brain has important consequences for the encoding properties of neural populations. Recent studies have shown that this correlation structure is not fixed, but adapts in a variety of contexts in ways that appear beneficial to task performance. By studying these changes in biological neural networks and computational models, researchers have improved our understanding of the principles guiding neural communication.

SUMMARY

Correlation and coherence are highly informative metrics for studying coding and communication in the brain. Recent findings have emphasized how the brain modifies correlation structure dynamically in order to improve information-processing in a goal-directed fashion. One key direction for future research concerns how to leverage these dynamic changes for therapeutic purposes.

Learning and attention reveal a general relationship between population activity and behavior

Prior studies have demonstrated that correlated variability changes with cognitive processes that improve perceptual performance. We tested whether correlated variability covaries with subjects' performance-whether performance improves quickly with attention or slowly with perceptual learning. We found a single, consistent relationship between correlated variability and behavioral performance, regardless of the time frame of correlated variability change. This correlated variability was oriented along the dimensions in population space used by the animal on a trial-by-trial basis to make decisions. That subjects' choices were predicted by specific dimensions that were aligned with the correlated variability axis clarifies long-standing paradoxes about the relationship between shared variability and behavior.

Modality general and modality specific coding of hedonic valence

The pleasant or unpleasant qualities that attach to our perceptions help to determine whether we approach or avoid environmental stimuli, shaping their affordances. How do brains create this affective perceptual dimension? The traditional answer is that sensory areas serve only as conduits for external impressions that are then modulated by heteromodal limbic structures in subsequent phases. Here we raise the possibility that, in addition to these well established gain control effects, sensory systems might also have a more direct role in representing the pleasantness component of perception, as supported by several strands of recent brain imaging evidence. In conjunction with a shared valence code that is independent of its sensory origins, valence representations interleaved within sensory brain areas may support finer grained experiential distinctions between how things look, sound, feel, taste and smell good or bad to us, offering a higher dimensional space of evaluative discriminations.

The Sensory Neocortex and Associative Memory

Most behaviors in mammals are directly or indirectly guided by prior experience and therefore depend on the ability of our brains to form memories. The ability to form an association between an initially possibly neutral sensory stimulus and its behavioral relevance is essential for our ability to navigate in a changing environment. The formation of a memory is a complex process involving many areas of the brain. In this chapter we review classic and recent work that has shed light on the specific contribution of sensory cortical areas to the formation of associative memories. We discuss synaptic and circuit mechanisms that mediate plastic adaptations of functional properties in individual neurons as well as larger neuronal populations forming topographically organized representations. Furthermore, we describe commonly used behavioral paradigms that are used to study the mechanisms of memory formation. We focus on the auditory modality that is receiving increasing attention for the study of associative memory in rodent model systems. We argue that sensory cortical areas may play an important role for the memory-dependent categorical recognition of previously encountered sensory stimuli.

Circuit Mechanisms of Sensorimotor Learning

The relationship between the brain and the environment is flexible, forming the foundation for our ability to learn. Here we review the current state of our understanding of the modifications in the sensorimotor pathway related to sensorimotor learning. We divide the process into three hierarchical levels with distinct goals: (1) sensory perceptual learning, (2) sensorimotor associative learning, and (3) motor skill learning. Perceptual learning optimizes the representations of important sensory stimuli. Associative learning and the initial phase of motor skill learning are ensured by feedback-based mechanisms that permit trial-and-error learning. The later phase of motor skill learning may primarily involve feedback-independent mechanisms operating under the classic Hebbian rule. With these changes under distinct constraints and mechanisms, sensorimotor learning establishes dedicated circuitry for the reproduction of stereotyped neural activity patterns and behavior.

Restoring Latent Visual Working Memory Representations in Human Cortex

Working memory (WM) enables the storage and manipulation of limited amounts of information over short periods. Prominent models posit that increasing the number of remembered items decreases the spiking activity dedicated to each item via mutual inhibition, which irreparably degrades the fidelity of each item's representation. We tested these models by determining if degraded memory representations could be recovered following a post-cue indicating which of several items in spatial WM would be recalled. Using an fMRI-based image reconstruction technique, we identified impaired behavioral performance and degraded mnemonic representations with elevated memory load. However, in several cortical regions, degraded mnemonic representations recovered substantially following a post-cue, and this recovery tracked behavioral performance. These results challenge pure spike-based models of WM and suggest that remembered items are additionally encoded within latent or hidden neural codes that can help reinvigorate active WM representations.

Distinct Correlation Structure Supporting a Rate-Code for Sound Localization in the Owl's Auditory Forebrain

While a topographic map of auditory space exists in the vertebrate midbrain, it is absent in the forebrain. Yet, both brain regions are implicated in sound localization. The heterogeneous spatial tuning of adjacent sites in the forebrain compared to the midbrain reflects different underlying circuitries, which is expected to affect the correlation structure, i.e., signal (similarity of tuning) and noise (trial-by-trial variability) correlations. Recent studies have drawn attention to the impact of response correlations on the information readout from a neural population. We thus analyzed the correlation structure in midbrain and forebrain regions of the barn owl’s auditory system. Tetrodes were used to record in the midbrain and two forebrain regions, Field L and the downstream auditory arcopallium (AAr), in anesthetized owls. Nearby neurons in the midbrain showed high signal and noise correlations (R_NCs), consistent with shared inputs. As previously reported, Field L was arranged in random clusters of similarly tuned neurons. Interestingly, AAr neurons displayed homogeneous monotonic azimuth tuning, while response variability of nearby neurons was significantly less correlated than the midbrain. Using a decoding approach, we demonstrate that low R_NC in AAr restricts the potentially detrimental effect it can have on information, assuming a rate code proposed for mammalian sound localization. This study harnesses the power of correlation structure analysis to investigate the coding of auditory space. Our findings demonstrate distinct correlation structures in the auditory midbrain and forebrain, which would be beneficial for a rate-code framework for sound localization in the nontopographic forebrain representation of auditory space.

Dual Coding Theory Explains Biphasic Collective Computation in Neural Decision-Making

A central question in cognitive neuroscience is how unitary, coherent decisions at the whole organism level can arise from the distributed behavior of a large population of neurons with only partially overlapping information. We address this issue by studying neural spiking behavior recorded from a multielectrode array with 169 channels during a visual motion direction discrimination task. It is well known that in this task there are two distinct phases in neural spiking behavior. Here we show Phase I is a distributed or incompressible phase in which uncertainty about the decision is substantially reduced by pooling information from many cells. Phase II is a redundant or compressible phase in which numerous single cells contain all the information present at the population level in Phase I, such that the firing behavior of a single cell is enough to predict the subject's decision. Using an empirically grounded dynamical modeling framework, we show that in Phase I large cell populations with low redundancy produce a slow timescale of information aggregation through critical slowing down near a symmetry-breaking transition. Our model indicates that increasing collective amplification in Phase II leads naturally to a faster timescale of information pooling and consensus formation. Based on our results and others in the literature, we propose that a general feature of collective computation is a "coding duality" in which there are accumulation and consensus formation processes distinguished by different timescales.

Learning Recruits Neurons Representing Previously Established Associations in the Corvid Endbrain

Crows quickly learn arbitrary associations. As a neuronal correlate of this behavior, single neurons in the corvid endbrain area nidopallium caudolaterale (NCL) change their response properties during association learning. In crows performing a delayed association task that required them to map both familiar and novel sample pictures to the same two choice pictures, NCL neurons established a common, prospective code for associations. Here, we report that neuronal tuning changes during learning were not distributed equally in the recorded population of NCL neurons. Instead, such learning-related changes relied almost exclusively on neurons which were already encoding familiar associations. Only in such neurons did behavioral improvements during learning of novel associations coincide with increasing selectivity over the learning process. The size and direction of selectivity for familiar and newly learned associations were highly correlated. These increases in selectivity for novel associations occurred only late in the delay period. Moreover, NCL neurons discriminated correct from erroneous trial outcome based on feedback signals at the end of the trial, particularly in newly learned associations. Our results indicate that task-relevant changes during association learning are not distributed within the population of corvid NCL neurons but rather are restricted to a specific group of association-selective neurons. Such association neurons in the multimodal cognitive integration area NCL likely play an important role during highly flexible behavior in corvids.