Amygdalo-striatal interaction in the enhancement of stimulus salience in associative learning

Thalamic Regulation of Sucrose Seeking during Unexpected Reward Omission

The paraventricular nucleus of the thalamus (PVT) is thought to regulate behavioral responses under emotionally arousing conditions. Reward-associated cues activate PVT neurons; however, the specific PVT efferents regulating reward seeking remain elusive. Using a cued sucrose-seeking task, we manipulated PVT activity under two emotionally distinct conditions: (1) when reward was available during the cue as expected or (2) when reward was unexpectedly omitted during the cue. Pharmacological inactivation of the anterior PVT (aPVT), but not the posterior PVT, increased sucrose seeking only when reward was omitted. Consistent with this, photoactivation of aPVT neurons abolished sucrose seeking, and the firing of aPVT neurons differentiated reward availability. Photoinhibition of aPVT projections to the nucleus accumbens or to the amygdala increased or decreased, respectively, sucrose seeking only when reward was omitted. Our findings suggest that PVT bidirectionally modulates sucrose seeking under the negative (frustrative) conditions of reward omission.

Secondary visual cortex is critical to the expression of surprise-induced enhancements in cue associability in rats

Considerable evidence indicates that reinforcement prediction error, the difference between the obtained and expected reinforcer values, modulates attention to potential cues for reinforcement. The surprising delivery or omission of a reinforcer enhances the associability of the stimuli that were present when the error was induced, so that they more readily enter into new associations in the future. Previous research from our laboratory identified brain circuit elements critical to the enhancement of stimulus associability by omission of an expected event and to the subsequent expression of that altered associability in more rapid learning. A key finding was that the rat posterior parietal cortex was essential during the encoding, consolidation and retrieval of associability memories that were altered by the surprising omission of an expected event in a serial prediction task. Here, we found that the function of adjacent secondary visual cortex was critical only to the expression of altered cue associability in that same task. This specialization of function is discussed in the context of broader cortical and subcortical networks for modulation of attention in associative learning, as well as recent anatomical investigations that suggest that the rodent posterior parietal cortex overlaps with and may subsume secondary visual cortex.

Dorsolateral neostriatum contribution to incentive salience: opioid or dopamine stimulation makes one reward cue more motivationally attractive than another

Pavlovian cues for rewards can become attractive incentives: approached and 'wanted' as the rewards themselves. The motivational attractiveness of a previously learned cue is not fixed, but can be dynamically amplified during re-encounter by simultaneous activation of brain limbic circuitry. Here it was reported that opioid or dopamine microinjections in the dorsolateral quadrant of the neostriatum (DLS) of rats selectively amplify attraction toward a previously learned Pavlovian cue in an individualized fashion, at the expense of a competing cue. In an autoshaping (sign-tracking vs. goal-tracking) paradigm, microinjection of the mu opioid receptor agonist (DAMGO) or dopamine indirect agonist (amphetamine) in the DLS of sign-tracker individuals selectively enhanced their sign-tracking attraction toward the reward-predictive lever cue. By contrast, DAMGO or amphetamine in the DLS of goal-trackers selectively enhanced prepotent attraction toward the reward-proximal cue of sucrose dish. Amphetamine also enhanced goal-tracking in some sign-tracker individuals (if they ever defected to the dish even once). That DLS enhancement of cue attraction was due to stronger motivation, not stronger habits, was suggested by: (i) sign-trackers flexibly followed their cue to a new location when the lever was suddenly moved after DLS DAMGO microinjection; and (ii) DAMGO in the DLS also made sign-trackers work harder on a new instrumental nose-poke response required to earn presentations of their Pavlovian lever cue (instrumental conditioned reinforcement). Altogether, the current results suggest that DLS circuitry can enhance the incentive salience of a Pavlovian reward cue, selectively making that cue a stronger motivational magnet.

Mini-review: Prediction errors, attention and associative learning

Most modern theories of associative learning emphasize a critical role for prediction error (PE, the difference between received and expected events). One class of theories, exemplified by the Rescorla-Wagner (1972) model, asserts that PE determines the effectiveness of the reinforcer or unconditioned stimulus (US): surprising reinforcers are more effective than expected ones. A second class, represented by the Pearce-Hall (1980) model, argues that PE determines the associability of conditioned stimuli (CSs), the rate at which they may enter into new learning: the surprising delivery or omission of a reinforcer enhances subsequent processing of the CSs that were present when PE was induced. In this mini-review we describe evidence, mostly from our laboratory, for PE-induced changes in the associability of both CSs and USs, and the brain systems involved in the coding, storage and retrieval of these altered associability values. This evidence favors a number of modifications to behavioral models of how PE influences event processing, and suggests the involvement of widespread brain systems in animals' responses to PE.

Dorsolateral striatum is critical for the expression of surprise-induced enhancements in cue associability

The dorsolateral striatum (DLS) is frequently implicated in sensory-motor integration, including the performance of sensory orienting responses (ORs) and learned stimulus-response habits. Our laboratory previously identified a role for the DLS in rats' performance of conditioned ORs to Pavlovian cues for food delivery. Here, we considered whether DLS is also critical to another aspect of attention in associative learning, the surprise-induced enhancement of cue associability. A large behavioral literature shows that a cue present when an expected event is omitted enters into new associations more rapidly when that cue is subsequently paired with food. Research from our laboratory has shown that both cue associability enhancements and conditioned ORs depend on the function of a circuit that includes the amygdala central nucleus and the substantia nigra pars compacta. In three experiments, we explored the involvement of DLS in surprise-induced associability enhancements, using a three-stage serial prediction task that permitted separation of DLS function in registering surprise (prediction error) and enhancing cue associability, and in using that increased associability to learn more rapidly about that cue later. The results showed that DLS is critical to the expression, but not the establishment, of the enhanced cue associability normally produced by surprise in this task. They extend the role of DLS and the amygdalo-nigro-striatal circuit underlying learned orienting to more subtle aspects of attention in associative learning, but are consistent with the general notion that DLS is more important in the expression of previously acquired tendencies than in their acquisition.