Enhanced conditioning produced by surprising increases in reinforcer value are unaffected by lesions of the amygdala central nucleus

Effects of amygdala lesions on overexpectation phenomena in food cup approach and autoshaping procedures

Prediction error (PE) plays a critical role in most modern theories of associative learning, by determining the effectiveness of conditioned stimuli (CS) or unconditioned stimuli (US). Here, we examined the effects of lesions of central (CeA) or basolateral (BLA) amygdala on performance in overexpectation tasks. In 2 experiments, after 2 CSs were separately paired with the US, they were combined and followed by the same US. In a subsequent test, we observed losses in strength of both CSs, as expected if the negative PE generated on reinforced compound trials encouraged inhibitory learning. CeA lesions, known to interfere with PE-induced enhancements in CS effectiveness, reduced those losses, suggesting that normally the negative PE also enhances cue associability in this task. BLA lesions had no effect. When a novel cue accompanied the reinforced compound, it acquired net conditioned inhibition, despite its consistent pairings with the US, consonant with US effectiveness models. That acquisition was unaffected by either CeA or BLA lesions, suggesting different rules for assignment of credit of changes in cue strength and cue associability. Finally, we examined a puzzling autoshaping phenomenon previously attributed to overexpectation effects. When a previously food-paired auditory cue was combined with the insertion of a lever and paired with the same food US, the auditory cue not only failed to block conditioning to the lever, but also lost strength, as in an overexpectation experiment. This effect was abolished by BLA lesions but unaffected by CeA lesions, suggesting it was unrelated to other overexpectation effects. (PsycINFO Database Record

Mini-review: Prediction errors, attention and associative learning

Most modern theories of associative learning emphasize a critical role for prediction error (PE, the difference between received and expected events). One class of theories, exemplified by the Rescorla-Wagner (1972) model, asserts that PE determines the effectiveness of the reinforcer or unconditioned stimulus (US): surprising reinforcers are more effective than expected ones. A second class, represented by the Pearce-Hall (1980) model, argues that PE determines the associability of conditioned stimuli (CSs), the rate at which they may enter into new learning: the surprising delivery or omission of a reinforcer enhances subsequent processing of the CSs that were present when PE was induced. In this mini-review we describe evidence, mostly from our laboratory, for PE-induced changes in the associability of both CSs and USs, and the brain systems involved in the coding, storage and retrieval of these altered associability values. This evidence favors a number of modifications to behavioral models of how PE influences event processing, and suggests the involvement of widespread brain systems in animals' responses to PE.

Dorsolateral striatum is critical for the expression of surprise-induced enhancements in cue associability

The dorsolateral striatum (DLS) is frequently implicated in sensory-motor integration, including the performance of sensory orienting responses (ORs) and learned stimulus-response habits. Our laboratory previously identified a role for the DLS in rats' performance of conditioned ORs to Pavlovian cues for food delivery. Here, we considered whether DLS is also critical to another aspect of attention in associative learning, the surprise-induced enhancement of cue associability. A large behavioral literature shows that a cue present when an expected event is omitted enters into new associations more rapidly when that cue is subsequently paired with food. Research from our laboratory has shown that both cue associability enhancements and conditioned ORs depend on the function of a circuit that includes the amygdala central nucleus and the substantia nigra pars compacta. In three experiments, we explored the involvement of DLS in surprise-induced associability enhancements, using a three-stage serial prediction task that permitted separation of DLS function in registering surprise (prediction error) and enhancing cue associability, and in using that increased associability to learn more rapidly about that cue later. The results showed that DLS is critical to the expression, but not the establishment, of the enhanced cue associability normally produced by surprise in this task. They extend the role of DLS and the amygdalo-nigro-striatal circuit underlying learned orienting to more subtle aspects of attention in associative learning, but are consistent with the general notion that DLS is more important in the expression of previously acquired tendencies than in their acquisition.

The basolateral amygdala is necessary for negative prediction errors to enhance cue salience, but not to produce conditioned inhibition

Behavioral evidence shows that prediction errors (PEs) not only drive associative learning, but also enhance the salience of predictive cues, making them better able to capture attention when they are next encountered. Research from our laboratory suggests that this latter consequence of PEs depends on a neural circuit that includes the amygdala. Lesions of the basolateral complex of the amygdala (BLA), for instance, selectively disrupt enhancements in cue processing that are normally induced by positive PEs without compromising simple excitatory learning. This result is consistent with electrophysiological evidence showing that BLA neurons track positive PEs. Interestingly, the same neurons also seem to track negative PEs, suggesting the possibility that the BLA might also use these errors to drive enhancements in cue processing. Here, we examined the role of the BLA in the processing (Experiment 1) and utilization (Experiment 2) of negative PEs in increasing cue salience in an unblocking procedure. Using FOS expression as an index of neural activity, Experiment 1 confirmed that BLA neurons track negative PEs with reinforcement downshifts. This tracking was evident both when these errors were generated by decreasing the concentration of a sucrose reinforcer (which encourages the development of conditioned inhibition) and when they were generated by decreasing the number of sucrose reinforcers (which encourages excitatory learning - unblocking - and allows the detection of enhancements in cue processing). Experiment 2 demonstrated that BLA lesions abolished enhancements in cue processing while sparing inhibitory learning. These results suggest a general role of the BLA in utilizing PEs, whatever their sign, for boosting cue processing.

The effects of basolateral amygdala lesions on unblocking

Prior reinforcement of a neutral stimulus often blocks subsequent conditioning of a new stimulus if a compound of the original and new cues is paired with the same reinforcer. However, if the value of the reinforcer is altered when the compound is presented, the new cue typically acquires conditioning, a result called unblocking. Blocking, unblocking, and related phenomena have been attributed to variations in processing of either the reinforcer, for example, the Rescorla-Wagner (1972) model, or cues, for example, the Pearce-Hall (1980) model. Here, we examined the effects of lesions of the basolateral amygdala on the occurrence of unblocking when the food reinforcer was increased in quantity at the time of introduction of the new cue. The lesions had no effects on unblocking in a simple design (Experiment 1), which did not distinguish between unblocking produced by variations in reward or cue processing. However, in a procedure that distinguished between unblocking due to direct conditioning by the added reinforcer, consistent with the Rescorla-Wagner (1972) model, and that due to increases in conditioning to the original reinforcer, consistent with the Pearce-Hall (1980) and other models of learning, the lesions prevented unblocking of the latter type. These results were discussed in the context of roles of the basolateral amygdala in coding and using reward prediction error information in associative learning.

Effects of reward timing information on cue associability are mediated by amygdala central nucleus

The central nucleus of the amygdala (CeA) has been implicated in a range of associative learning phenomena often attributed to changes in attentional processing of events. Experiments using a number of behavioral tasks have shown that rats with lesions of CeA fail to show the enhancements of stimulus associability that are normally induced by the surprising omission of expected events. By contrast, in other tasks, rats with lesions of CeA show normal enhancements of associability when events are presented unexpectedly. In this experiment, we examined the effects of CeA lesions on changes in cue associability in a reward timing task. In sham-lesioned rats, the associability of cues that were followed by stimuli that provided reward timing information was maintained at higher levels than that of cues that were followed by uninformative stimuli. Rats with lesions of CeA failed to show this advantage. These results indicate that the role of CeA in the modulation of associability is not limited to cases of event omission. (PsycINFO Database Record (c) 2011 APA, all rights reserved).

Neural correlates of variations in event processing during learning in central nucleus of amygdala

Attention or variations in event processing help drive learning. Lesion studies have implicated the central nucleus of the amygdala (CeA) in this process, particularly when expected rewards are omitted. However, lesion studies cannot specify how information processing in CeA supports such learning. To address these questions, we recorded CeA neurons in rats performing a task in which rewards were delivered or omitted unexpectedly. We found that activity in CeA neurons increased selectively at the time of omission and declined again with learning. Increased firing correlated with CeA-inactivation sensitive measures of attention. Notably CeA neurons did not fire to the cues or in response to unexpected rewards. These results indicate that CeA contributes to learning in response to reward omission due to a specific role in signaling actual omission rather than a more general involvement in signaling expectancies, errors, or reward value.

The central amygdala projection to the substantia nigra reflects prediction error information in appetitive conditioning

The central amygdala nucleus (CeA) plays a critical role in cognitive processes beyond fear conditioning. For example, intact CeA function is essential for enhancing attention to conditioned stimuli (CSs). Furthermore, this enhanced attention depends on the CeA's connections to the nigrostriatal system. In the current study, we examined the role of the CeA's connections to two midbrain dopamine regions, the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA), in processing CS information when predictions of reward or nonreward were confirmed or disconfirmed. Initially, two different retrograde tracers were injected into the SNc and the VTA of rats, to label CeA cells. Different groups of rats then received a visual CS either paired or unpaired with food. Finally, Fos induction was assessed after a test session in which rats were exposed to the visual CS alone or paired with food. Colabeling of Fos and the retrograde tracer(s) showed that CeA neurons projecting to the SNc, but not to the VTA, were engaged in processing CS information when the training and testing conditions differed. These results suggest that the CeA-nigral pathway represents prediction error information during appetitive conditioning.

Functional internal complexity of amygdala: focus on gene activity mapping after behavioral training and drugs of abuse

The amygdala is a heterogeneous brain structure implicated in processing of emotions and storing the emotional aspects of memories. Gene activity markers such as c-Fos have been shown to reflect both neuronal activation and neuronal plasticity. Herein, we analyze the expression patterns of gene activity markers in the amygdala in response to either behavioral training or treatment with drugs of abuse and then we confront the results with data on other approaches to internal complexity of the amygdala. c-Fos has been the most often studied in the amygdala, showing specific expression patterns in response to various treatments, most probably reflecting functional specializations among amygdala subdivisions. In the basolateral amygdala, c-Fos expression appears to be consistent with the proposed role of this nucleus in a plasticity of the current stimulus-value associations. Within the medial part of the central amygdala, c-Fos correlates with acquisition of alimentary/gustatory behaviors. On the other hand, in the lateral subdivision of the central amygdala, c-Fos expression relates to attention and vigilance. In the medial amygdala, c-Fos appears to be evoked by emotional novelty of the experimental situation. The data on the other major subdivisions of the amygdala are scarce. In conclusion, the studies on the gene activity markers, confronted with other approaches involving neuroanatomy, physiology, and the lesion method, have revealed novel aspects of the amygdala, especially pointing to functional heterogeneity of this brain region that does not fit very well into contemporarily active debate on serial versus parallel information processing within the amygdala.