Changes in neural activity associated with a surprising change in the predictive validity of a conditioned stimulus

Secondary visual cortex is critical to the expression of surprise-induced enhancements in cue associability in rats

Considerable evidence indicates that reinforcement prediction error, the difference between the obtained and expected reinforcer values, modulates attention to potential cues for reinforcement. The surprising delivery or omission of a reinforcer enhances the associability of the stimuli that were present when the error was induced, so that they more readily enter into new associations in the future. Previous research from our laboratory identified brain circuit elements critical to the enhancement of stimulus associability by omission of an expected event and to the subsequent expression of that altered associability in more rapid learning. A key finding was that the rat posterior parietal cortex was essential during the encoding, consolidation and retrieval of associability memories that were altered by the surprising omission of an expected event in a serial prediction task. Here, we found that the function of adjacent secondary visual cortex was critical only to the expression of altered cue associability in that same task. This specialization of function is discussed in the context of broader cortical and subcortical networks for modulation of attention in associative learning, as well as recent anatomical investigations that suggest that the rodent posterior parietal cortex overlaps with and may subsume secondary visual cortex.

Toward a systems-oriented approach to the role of the extended amygdala in adaptive responding

Research into the structure and function of the basal forebrain macrostructure called the extended amygdala (EA) has recently seen considerable growth. This paper reviews that work, with the objectives of identifying underlying themes and developing a common goal towards which investigators of EA function might work. The paper begins with a brief review of the structure and the ontological and phylogenetic origins of the EA. It continues with a review of research into the role of the EA in both aversive and appetitive states, noting that these two seemingly disparate avenues of research converge on the concept of reinforcement - either negative or positive - of adaptive responding. These reviews lead to a proposal as to where the EA may fit in the organization of the basal forebrain, and an invitation to investigators to place their findings in a unifying conceptual framework of the EA as a collection of neural ensembles that mediate adaptive responding.

Direct reactivation of a coherent neocortical memory of context

Declarative memories are thought to be stored within anatomically distributed neuronal networks requiring the hippocampus; however, it is unclear how neocortical areas participate in memory at the time of encoding. Here, we use a c-fos-based genetic tagging system to selectively express the channelrhodopsin variant, ChEF, and optogenetically reactivate a specific neural ensemble in retrosplenial cortex (RSC) engaged by context fear conditioning. Artificial stimulation of RSC was sufficient to produce both context-specific behavior and downstream cellular activity commensurate with natural experience. Moreover, optogenetically but not contextually elicited responses were insensitive to hippocampal inactivation, suggesting that although the hippocampus is needed to coordinate activation by sensory cues, a higher-order cortical framework can independently subserve learned behavior, even shortly after learning.

Role of lateral hypothalamus in two aspects of attention in associative learning

Orexin (hypocretin) and melanin-concentrating hormone (MCH) neurons are unique to the lateral hypothalamic (LH) region, but project throughout the brain. These cell groups have been implicated in a variety of functions, including reward learning, responses to stimulants, and the modulation of attention, arousal and the sleep/wakefulness cycle. Here, we examined roles for LH in two aspects of attention in associative learning shown previously to depend on intact function in major targets of orexin and MCH neurons. In experiments 1 and 2, unilateral orexin-saporin lesions of LH impaired the acquisition of conditioned orienting responses (ORs) and bilaterally suppressed FOS expression in the amygdala central nucleus (CeA) normally observed in response to food cues that provoke conditioned ORs. Those cues also induced greater FOS expression than control cues in LH orexin neurons, but not in MCH neurons. In experiment 3, unilateral orexin-saporin lesions of LH eliminated the cue associability enhancements normally produced by the surprising omission of an expected event. The magnitude of that impairment was positively correlated with the amount of LH damage and with the loss of orexin neurons in particular, but not with the loss of MCH neurons. We suggest that the effects of the LH orexin-saporin lesions were mediated by their effect on information processing in the CeA, known to be critical to both behavioral phenomena examined here. The results imply close relations between LH motivational amplification functions and attention, and may inform our understanding of disorders in which motivational and attentional impairments co-occur.

Physical exercise during pregnancy improves object recognition memory in adult offspring

Exercising during pregnancy has been shown to improve spatial learning and short-term memory, as well as increase brain-derived neurotrophic factor mRNA levels and hippocampal cell survival in juvenile offspring. However, it remains unknown if these effects endure into adulthood. In addition, few studies have considered how maternal exercise can impact cognitive functions that do not rely on the hippocampus. To address these issues, the present study tested the effects of maternal exercise during pregnancy on object recognition memory, which relies on the perirhinal cortex (PER), in adult offspring. Pregnant rats were given access to a running wheel throughout gestation and the adult male offspring were subsequently tested in an object recognition memory task at three different time points, each spaced 2-weeks apart, beginning at 60 days of age. At each time point, offspring from exercising mothers were able to successfully discriminate between novel and familiar objects in that they spent more time exploring the novel object than the familiar object. The offspring of non-exercising mothers were not able to successfully discriminate between objects and spent an equal amount of time with both objects. A subset of rats was euthanized 1h after the final object recognition test to assess c-FOS expression in the PER. The offspring of exercising mothers had more c-FOS expression in the PER than the offspring of non-exercising mothers. By comparison, c-FOS levels in the adjacent auditory cortex did not differ between groups. These results indicate that maternal exercise during pregnancy can improve object recognition memory in adult male offspring and increase c-FOS expression in the PER; suggesting that exercise during the gestational period may enhance brain function of the offspring.

Detection of a temporal error triggers reconsolidation of amygdala-dependent memories

Updating memories is critical for adaptive behaviors, but the rules and mechanisms governing that process are still not well defined. During a limited time window, the reactivation of consolidated aversive memories triggers memory lability and induces a plasticity-dependent reconsolidation process in the lateral nucleus of amygdala (LA) [1-5]. However, whether new information is necessary for initiating reconsolidation is not known. Here we show that changing the temporal relationship between the conditioned stimulus (CS) and unconditioned stimulus (US) during reactivation is sufficient to trigger synaptic plasticity and reconsolidation of an aversive memory in the LA. These findings demonstrate that time is a core part of the CS-US association and that new information must be presented during reactivation in order to trigger LA-dependent reconsolidation processes. In sum, this study provides new basic knowledge about the precise rules governing memory reconsolidation of aversive memories that might be used to treat traumatic memories.

Damage to posterior parietal cortex impairs two forms of relational learning

The posterior parietal cortex (PPC) is a component of a major cortico-hippocampal circuit that is involved in relational learning, yet the specific contribution of PPC to hippocampal-dependent learning is unresolved. To address this, two experiments were carried out to test the effects of PPC damage on tasks that involve forming associations between multiple sensory stimuli. In Experiment 1, sham or electrolytic lesions of the PPC were made before rats were tested on a three-phase sensory preconditioning task. During the first phase, half of the training trials consisted of pairings of an auditory stimulus followed by a light. During the other trials, a second auditory stimulus was presented alone. In the next phase of training, the same light was paired with food, but no auditory stimuli were presented. During the final phase of the procedure both auditory stimuli were presented in the absence of reinforcement during a single test session. As is typically observed during the test session, control rats exhibited greater conditioned responding to the auditory cue that was previously paired with light compared to the unpaired cue. In contrast, PPC-lesioned rats responded equally to both auditory cues. In Experiment 2, PPC-lesioned and control rats were trained in a compound feature negative discrimination task consisting of reinforced presentations of a tone-alone and non-reinforced simultaneous presentations of a light-tone compound stimulus. Control rats but not rats with damage to the PPC successfully learned the discrimination. Collectively, these results support the idea that the PPC contributes to relational learning involving multimodal sensory stimuli, perhaps by regulating the attentional processing of conditioned stimuli.

Impact of size and delay on neural activity in the rat limbic corticostriatal system

A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short delay and big-reward conditions than under long delay and small reward conditions as measured by percent choice, accuracy, and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level.

Neural correlates of variations in event processing during learning in central nucleus of amygdala

Attention or variations in event processing help drive learning. Lesion studies have implicated the central nucleus of the amygdala (CeA) in this process, particularly when expected rewards are omitted. However, lesion studies cannot specify how information processing in CeA supports such learning. To address these questions, we recorded CeA neurons in rats performing a task in which rewards were delivered or omitted unexpectedly. We found that activity in CeA neurons increased selectively at the time of omission and declined again with learning. Increased firing correlated with CeA-inactivation sensitive measures of attention. Notably CeA neurons did not fire to the cues or in response to unexpected rewards. These results indicate that CeA contributes to learning in response to reward omission due to a specific role in signaling actual omission rather than a more general involvement in signaling expectancies, errors, or reward value.

The central amygdala projection to the substantia nigra reflects prediction error information in appetitive conditioning

The central amygdala nucleus (CeA) plays a critical role in cognitive processes beyond fear conditioning. For example, intact CeA function is essential for enhancing attention to conditioned stimuli (CSs). Furthermore, this enhanced attention depends on the CeA's connections to the nigrostriatal system. In the current study, we examined the role of the CeA's connections to two midbrain dopamine regions, the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA), in processing CS information when predictions of reward or nonreward were confirmed or disconfirmed. Initially, two different retrograde tracers were injected into the SNc and the VTA of rats, to label CeA cells. Different groups of rats then received a visual CS either paired or unpaired with food. Finally, Fos induction was assessed after a test session in which rats were exposed to the visual CS alone or paired with food. Colabeling of Fos and the retrograde tracer(s) showed that CeA neurons projecting to the SNc, but not to the VTA, were engaged in processing CS information when the training and testing conditions differed. These results suggest that the CeA-nigral pathway represents prediction error information during appetitive conditioning.

Cholinergic optimization of cue-evoked parietal activity during challenged attentional performance

The detection of salient or instrumental stimuli and the selection of cue-evoked responses are mediated by a fronto-parietal network that is modulated by cholinergic inputs originating from the basal forebrain. Visual cues that guide behavior are more strongly represented in the posterior parietal cortex (PPC) than are similar cues that are missed or task-irrelevant. Although the crucial role of cholinergic inputs in cue detection has been demonstrated by lesion studies, the role of PPC neurons in the cholinergic modulation of cue detection is unclear. We recorded extracellular spikes from PPC neurons of rats performing a sustained attention task, before and after selective removal of cholinergic inputs to the recording site. Visual cues that were subsequently detected evoked significant increases in the PPC firing rate. In the absence of cholinergic input, the activation of PPC neurons by detected cues was greatly diminished. When a visual distractor was introduced during task performance, a population of PPC neurons selectively responded to the distractor. As a result of cholinergic deafferentation, distractor-related neuronal activity was enhanced, and the detection-related activity was further suppressed. Thus, in deafferented subjects, the distractor lowered the signal-to-noise ratio of cue-evoked responses. This impairment in cue-evoked neuronal activity may have mediated the increased response latencies observed for detected cues in the presence of the distractor. Additional experiments demonstrated that the effects of cholinergic deafferentation were not confounded by extended practice or electrode depth. Collectively, these findings indicate that cholinergic inputs to PPC neurons amplify cue detection, and may also act to suppress irrelevant distractors.

Posterior parietal cortex: an interface between attention and learning?

The posterior parietal cortex (PPC) of rats has most recently been defined based on patterns of thalamic and cortical connectivity. The anatomical characteristics of this area suggest that it may be homologous to the PPC of primates and contribute to similar functions. This review summarizes evidence for and against a role for the rat PPC in attention and working memory and evaluates how the function of the rat PPC compares to that of primates on these dimensions. Theories of how the rat PPC contributes to behavior are presented, including the notion that PPC may serve as an interface between attention and learning. Finally, several avenues for future research are considered.

Temporally limited role of substantia nigra-central amygdala connections in surprise-induced enhancement of learning

Prediction error plays an important role in modern associative learning theories. For example, the omission of an expected event (surprise) can enhance attention to cues that accompany those omissions, such that subsequent new learning about those cues is more rapid. Many studies from our laboratories have demonstrated that circuitry that includes the amygdala central nucleus (CeA), the cholinergic neurons in the substantia innominata/nucleus basalis region and their innervation of the posterior parietal cortex is critical for this surprise-induced enhancement of attention in learning. We recently showed that midbrain dopamine neurons, known to code prediction error, are also important for surprise-induced enhancement of learning through their interaction with CeA. The present study examined whether in rats the communication between the substantia nigra pars compacta (SNc) and CeA is critical only at the time of surprise, for example to detect prediction error information, or is also needed to maintain and later express that information as enhanced learning. All animals received unilateral CeA lesions and unilateral cannula implants targeting the SNc located contralateral to the lesioned CeA. As the SNc-CeA connections are mainly ipsilateral, inactivating SNc contralateral to the lesioned CeA provided transient blockage of SNc and CeA communication. The results show that SNc-CeA communication is critical for processing prediction error information at the time of surprise, but neither SNc nor SNc-CeA communication is necessary to express that information as enhanced learning later.

Ethanol-induced alterations of c-Fos immunoreactivity in specific limbic brain regions following ethanol discrimination training

The discriminative stimulus properties of ethanol are functionally regulated by ionotropic GABA(A) and NMDA receptors in specific limbic brain regions including the nucleus accumbens, amygdala, and hippocampus, as determined by microinjection studies. The purpose of the present work was to further investigate potential neural substrates of ethanol's discriminative stimulus effects by examining if ethanol discrimination learning produces changes in brain regional response to ethanol. To accomplish this goal, immunohistochemistry was used to assess the effects of ethanol (2 g/kg) on c-Fos immunoreactivity (Fos-IR). Comparisons in ethanol-induced Fos-IR were made between a group of rats that was trained to discriminate the stimulus properties of ethanol (2 g/kg, IG) from water (IG) and a drug/behavior-matched control group that did not receive differential reinforcement for lever selection, which precluded acquisition of discriminative stimulus control by ethanol. In some brain regions discrimination training had no effect on ethanol-induced Fos-IR changes (caudate putamen, bed nucleus of the stria terminalis, and CA1 region of the hippocampus). In contrast, discrimination training altered the pattern of ethanol-induced Fos-IR in the nucleus accumbens (core), medial septum, and the hippocampus (dentate and CA3). These results indicate that having behavior under the stimulus control of ethanol can change ethanol-induced Fos-IR in some brain regions. This suggests that learning about the subjective properties of ethanol produces adaptive changes in how the brain responds to acute ethanol exposure.