Learning strategy refinement reverses early sensory cortical map expansion but not behavior: Support for a theory of directed cortical substrates of learning and memory

Rapid emergence of latent knowledge in the sensory cortex drives learning

Rapid learning confers significant advantages to animals in ecological environments. Despite the need for speed, animals appear to only slowly learn to associate rewarded actions with predictive cues1-4. This slow learning is thought to be supported by a gradual expansion of predictive cue representation in the sensory cortex2,5. However, evidence is growing that animals learn more rapidly than classical performance measures suggest6-8, challenging the prevailing model of sensory cortical plasticity. Here, we investigated the relationship between learning and sensory cortical representations. We trained mice on an auditory go/no-go task that dissociated the rapid acquisition of task contingencies (learning) from its slower expression (performance)7. Optogenetic silencing demonstrated that the auditory cortex (AC) drives both rapid learning and slower performance gains but becomes dispensable at expert. Rather than enhancement or expansion of cue representations9, two-photon calcium imaging of AC excitatory neurons throughout learning revealed two higher-order signals that were causal to learning and performance. First, a reward prediction (RP) signal emerged rapidly within tens of trials, was present after action-related errors only early in training, and faded at expert levels. Strikingly, silencing at the time of the RP signal impaired rapid learning, suggesting it serves an associative and teaching role. Second, a distinct cell ensemble encoded and controlled licking suppression that drove the slower performance improvements. These two ensembles were spatially clustered but uncoupled from underlying sensory representations, indicating a higher-order functional segregation within AC. Our results reveal that the sensory cortex manifests higher-order computations that separably drive rapid learning and slower performance improvements, reshaping our understanding of the fundamental role of the sensory cortex.

Quantitative Fluorescence Analysis Reveals Dendrite-Specific Thalamocortical Plasticity in L5 Pyramidal Neurons during Learning

High-throughput anatomic data can stimulate and constrain new hypotheses about how neural circuits change in response to experience. Here, we use fluorescence-based reagents for presynaptic and postsynaptic labeling to monitor changes in thalamocortical synapses onto different compartments of layer 5 (L5) pyramidal (Pyr) neurons in somatosensory (barrel) cortex from mixed-sex mice during whisker-dependent learning (Audette et al., 2019). Using axonal fills and molecular-genetic tags for synapse identification in fixed tissue from Rbp4-Cre transgenic mice, we found that thalamocortical synapses from the higher-order posterior medial thalamic nucleus showed rapid morphologic changes in both presynaptic and postsynaptic structures at the earliest stages of sensory association training. Detected increases in thalamocortical synaptic size were compartment specific, occurring selectively in the proximal dendrites onto L5 Pyr and not at inputs onto their apical tufts in L1. Both axonal and dendritic changes were transient, normalizing back to baseline as animals became expert in the task. Anatomical measurements were corroborated by electrophysiological recordings at different stages of training. Thus, fluorescence-based analysis of input- and target-specific synapses can reveal compartment-specific changes in synapse properties during learning.SIGNIFICANCE STATEMENT Synaptic changes underlie the cellular basis of learning, experience, and neurologic diseases. Neuroanatomical methods to assess synaptic plasticity can provide critical spatial information necessary for building models of neuronal computations during learning and experience but are technically and fiscally intensive. Here, we describe a confocal fluorescence microscopy-based analytical method to assess input, cell type, and dendritic location-specific synaptic plasticity in a sensory learning assay. Our method not only confirms prior electrophysiological measurements but allows us to predict functional strength of synapses in a pathway-specific manner. Our findings also indicate that changes in primary sensory cortices are transient, occurring during early learning. Fluorescence-based synapse identification can be an efficient and easily adopted approach to study synaptic changes in a variety of experimental paradigms.

Memory Specific to Temporal Features of Sound Is Formed by Cue-Selective Enhancements in Temporal Coding Enabled by Inhibition of an Epigenetic Regulator

Recent investigation of memory-related functions in the auditory system have capitalized on the use of memory-modulating molecules to probe the relationship between memory and substrates of memory in auditory system coding. For example, epigenetic mechanisms, which regulate gene expression necessary for memory consolidation, are powerful modulators of learning-induced neuroplasticity and long-term memory (LTM) formation. Inhibition of the epigenetic regulator histone deacetylase 3 (HDAC3) promotes LTM, which is highly specific for spectral features of sound. The present work demonstrates for the first time that HDAC3 inhibition also enables memory for temporal features of sound. Adult male rats trained in an amplitude modulation (AM) rate discrimination task and treated with a selective inhibitor of HDAC3 formed memory that was highly specific to the AM rate paired with reward. Sound-specific memory revealed behaviorally was associated with a signal-specific enhancement in temporal coding in the auditory system; stronger phase locking that was specific to the rewarded AM rate was revealed in both the surface-recorded frequency following response and auditory cortical multiunit activity in rats treated with the HDAC3 inhibitor. Furthermore, HDAC3 inhibition increased trial-to-trial cortical response consistency (relative to naive and trained vehicle-treated rats), which generalized across different AM rates. Stronger signal-specific phase locking correlated with individual behavioral differences in memory specificity for the AM signal. These findings support that epigenetic mechanisms regulate activity-dependent processes that enhance discriminability of sensory cues encoded into LTM in both spectral and temporal domains, which may be important for remembering spectrotemporal features of sounds, for example, as in human voices and speech.SIGNIFICANCE STATEMENT Epigenetic mechanisms have recently been implicated in memory and information processing. Here, we use a pharmacological inhibitor of HDAC3 in a sensory model of learning to reveal the ability of HDAC3 to enable precise memory for amplitude-modulated sound cues. In so doing, we uncover neural substrates for memory's specificity for temporal sound cues. Memory specificity was supported by auditory cortical changes in temporal coding, including greater response consistency and stronger phase locking. HDAC3 appears to regulate effects across domains that determine specific cue saliency for behavior. Thus, epigenetic players may gate how sensory information is stored in long-term memory and can be leveraged to reveal the neural substrates of sensory details stored in memory.

Sensory cortical and subcortical auditory neurophysiological changes predict cue-specific extinction behavior enabled by the pharmacological inhibition of an epigenetic regulator during memory formation

Extinction learning and memory have been broadly investigated at both behavioral and neural levels, but sensory system contributions to extinction processes have been less explored. Using a sound-reward extinction paradigm in male rats, we reveal both cortical and subcortical forms of plasticity associated with the cue-specificity of behavioral extinction memory. In the auditory cortex, frequency tuning narrowed by up to two-thirds of an octave around the remembered extinguished sound cue. Subcortical signals revealed in the auditory brainstem response (ABR) in the same animals developed smaller amplitudes of some (but not all) ABR peaks evoked by the extinguished sound frequency. Interestingly, treatment with an inhibitor of histone deacetylase 3 (HDAC3-i) facilitated both auditory cortical tuning bandwidth changes and changes in subcortical peak amplitude evoked only by the extinguished sound frequency. These neurophysiological changes were correlated to each other, and to the highly precise extinction behavior enabled by HDAC3-i (compared to vehicle controls). Thus, we show for the first time that HDAC3 regulates the specificity of sensory features consolidated in extinction memory. Further, the sensory cortical changes in tuning bandwidth recapitulate known effects of blocking HDAC3 to enhance cue specificity in other behavioral tasks. Therefore, the findings demonstrate how some forms of sensory neuroplasticity may encode specific sensory features of learning experiences in order to enable cue-specific behaviors.

Cortical plasticity elicited by acoustically cued monetary losses: an ERP study

Both human and animal studies have demonstrated remarkable findings of experience-induced plasticity in the cortex. Here, we investigated whether the widely used monetary incentive delay (MID) task changes the neural processing of incentive cues that code expected monetary outcomes. We used a novel auditory version of the MID task, where participants responded to acoustic cues that coded expected monetary losses. To investigate task-induced brain plasticity, we presented incentive cues as deviants during passive oddball tasks before and after two sessions of the MID task. During the oddball task, we recorded the mismatch-related negativity (MMN) as an index of cortical plasticity. We found that two sessions of the MID task evoked a significant enhancement of MMN for incentive cues that predicted large monetary losses, specifically when monetary cue discrimination was essential for maximising monetary outcomes. The task-induced plasticity correlated with the learning-related neural activity recorded during the MID task. Thus, our results confirm that the processing of (loss)incentive auditory cues is dynamically modulated by previously learned monetary outcomes.

Spectral plasticity in monkey primary auditory cortex limits performance generalization in a temporal discrimination task

Auditory experience and behavioral training can modify perceptual performance. However, the consequences of temporal perceptual learning for temporal and spectral neural processing remain unclear. Specifically, the attributes of neural plasticity that underlie task generalization in behavioral performance remain uncertain. To assess the relationship between behavioral and neural plasticity, we evaluated neuronal temporal processing and spectral tuning in primary auditory cortex (AI) of anesthetized owl monkeys trained to discriminate increases in the envelope frequency (e.g., 4-Hz standard vs. >5-Hz targets) of sinusoidally amplitude-modulated (SAM) 1-kHz or 2-kHz carriers. Behavioral and neuronal performance generalization was evaluated for carriers ranging from 0.5 kHz to 8 kHz. Psychophysical thresholds revealed high SAM discrimination acuity for carriers from one octave below to ∼0.6 octave above the trained carrier frequency. However, generalization of SAM discrimination learning progressively declined for carrier frequencies >0.6 octave above the trained carrier frequency. Neural responses in AI showed that SAM discrimination training resulted in 1) increases in temporal modulation preference, especially at carriers close to the trained frequency, 2) narrowing of spectral tuning for neurons with characteristic frequencies near the trained carrier frequency, potentially limiting spectral generalization of temporal training effects, and 3) enhancement of firing-rate contrast for rewarded versus nonrewarded SAM frequencies, providing a potential cue for behavioral temporal discrimination near the trained carrier frequency. Our findings suggest that temporal training at a specific spectral location sharpens local frequency tuning, thus, confining the training effects to a narrow frequency range and limiting generalization of temporal discrimination learning across a wider frequency range.NEW & NOTEWORTHY Monkeys' ability to generalize amplitude modulation discrimination to nontrained carriers was limited to one octave below and 0.6 octave above the trained carrier frequency. Asymmetric generalization was paralleled by sharpening in cortical spectral tuning and enhanced firing-rate contrast between rewarded and nonrewarded SAM stimuli at carriers near the trained frequency. The spectral content of the training stimulus specified spectral and temporal plasticity that may provide a neural substrate for limitations in generalization of temporal discrimination learning.

Precise memory for pure tones is predicted by measures of learning-induced sensory system neurophysiological plasticity at cortical and subcortical levels

Despite identical learning experiences, individuals differ in the memory formed of those experiences. Molecular mechanisms that control the neurophysiological bases of long-term memory formation might control how precisely the memory formed reflects the actually perceived experience. Memory formed with sensory specificity determines its utility for selectively cueing subsequent behavior, even in novel situations. Here, a rodent model of auditory learning capitalized on individual differences in learning-induced auditory neuroplasticity to identify and characterize neural substrates for sound-specific (vs. general) memory of the training signal's acoustic frequency. Animals that behaviorally revealed a naturally induced signal-"specific" memory exhibited long-lasting signal-specific neurophysiological plasticity in auditory cortical and subcortical evoked responses. Animals with "general" memories did not exhibit learning-induced changes in these same measures. Manipulating a histone deacetylase during memory consolidation biased animals to have more signal-specific memory. Individual differences validated this brain-behavior relationship in both natural and manipulated memory formation, such that the degree of change in sensory cortical and subcortical neurophysiological responses could be used to predict the behavioral precision of memory.

Silencing cortical activity during sound-localization training impairs auditory perceptual learning

The brain has a remarkable capacity to adapt to changes in sensory inputs and to learn from experience. However, the neural circuits responsible for this flexible processing remain poorly understood. Using optogenetic silencing of ArchT-expressing neurons in adult ferrets, we show that within-trial activity in primary auditory cortex (A1) is required for training-dependent recovery in sound-localization accuracy following monaural deprivation. Because localization accuracy under normal-hearing conditions was unaffected, this highlights a specific role for cortical activity in learning. A1-dependent plasticity appears to leave a memory trace that can be retrieved, facilitating adaptation during a second period of monaural deprivation. However, in ferrets in which learning was initially disrupted by perturbing A1 activity, subsequent optogenetic suppression during training no longer affected localization accuracy when one ear was occluded. After the initial learning phase, the reweighting of spatial cues that primarily underpins this plasticity may therefore occur in A1 target neurons.

Recent advances in understanding the auditory cortex

Our ability to make sense of the auditory world results from neural processing that begins in the ear, goes through multiple subcortical areas, and continues in the cortex. The specific contribution of the auditory cortex to this chain of processing is far from understood. Although many of the properties of neurons in the auditory cortex resemble those of subcortical neurons, they show somewhat more complex selectivity for sound features, which is likely to be important for the analysis of natural sounds, such as speech, in real-life listening conditions. Furthermore, recent work has shown that auditory cortical processing is highly context-dependent, integrates auditory inputs with other sensory and motor signals, depends on experience, and is shaped by cognitive demands, such as attention. Thus, in addition to being the locus for more complex sound selectivity, the auditory cortex is increasingly understood to be an integral part of the network of brain regions responsible for prediction, auditory perceptual decision-making, and learning. In this review, we focus on three key areas that are contributing to this understanding: the sound features that are preferentially represented by cortical neurons, the spatial organization of those preferences, and the cognitive roles of the auditory cortex.

Inhibition of histone deacetylase 3 via RGFP966 facilitates cortical plasticity underlying unusually accurate auditory associative cue memory for excitatory and inhibitory cue-reward associations

Epigenetic mechanisms are key for regulating long-term memory (LTM) and are known to exert control on memory formation in multiple systems of the adult brain, including the sensory cortex. One epigenetic mechanism is chromatin modification by histone acetylation. Blocking the action of histone de-acetylases (HDACs) that normally negatively regulate LTM by repressing transcription has been shown to enable memory formation. Indeed, HDAC inhibition appears to facilitate memory by altering the dynamics of gene expression events important for memory consolidation. However, less understood are the ways in which molecular-level consolidation processes alter subsequent memory to enhance storage or facilitate retrieval. Here we used a sensory perspective to investigate whether the characteristics of memory formed with HDAC inhibitors are different from naturally-formed memory. One possibility is that HDAC inhibition enables memory to form with greater sensory detail than normal. Because the auditory system undergoes learning-induced remodeling that provides substrates for sound-specific LTM, we aimed to identify behavioral effects of HDAC inhibition on memory for specific sound features using a standard model of auditory associative cue-reward learning, memory, and cortical plasticity. We found that three systemic post-training treatments of an HDAC3-inhibitor (RGPF966, Abcam Inc.) in rats in the early phase of training facilitated auditory discriminative learning, changed auditory cortical tuning, and increased the specificity for acoustic frequency formed in memory of both excitatory (S+) and inhibitory (S-) associations for at least 2 weeks. The findings support that epigenetic mechanisms act on neural and behavioral sensory acuity to increase the precision of associative cue memory, which can be revealed by studying the sensory characteristics of long-term associative memory formation with HDAC inhibitors.