Occasion setting

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Dissociating task acquisition from expression during learning reveals latent knowledge

Performance on cognitive tasks during learning is used to measure knowledge, yet it remains controversial since such testing is susceptible to contextual factors. To what extent does performance during learning depend on the testing context, rather than underlying knowledge? We trained mice, rats and ferrets on a range of tasks to examine how testing context impacts the acquisition of knowledge versus its expression. We interleaved reinforced trials with probe trials in which we omitted reinforcement. Across tasks, each animal species performed remarkably better in probe trials during learning and inter-animal variability was strikingly reduced. Reinforcement feedback is thus critical for learning-related behavioral improvements but, paradoxically masks the expression of underlying knowledge. We capture these results with a network model in which learning occurs during reinforced trials while context modulates only the read-out parameters. Probing learning by omitting reinforcement thus uncovers latent knowledge and identifies context- not “smartness”- as the major source of individual variability.

Performance is generally used as a metric to assay whether an animal has learnt a particular perceptual task. Here the authors demonstrate that in the context of probe trials without the possibility of reward, animals perform the correct instrumental response suggesting a latent knowledge of the task much before it is manifest in their performance.

Consolidation of altered associability information by amygdala central nucleus

The surprising omission of a reinforcer can enhance the associability of the stimuli that were present when the reward prediction error was induced, so that they more readily enter into new associations in the future. Previous research from this laboratory identified brain circuit elements critical to the enhancement of stimulus associability by the omission of an expected event and to the subsequent expression of that altered associability in more rapid learning. These elements include the amygdala, the midbrain substantia nigra, the basal forebrain substantia innominata, the dorsolateral striatum, the secondary visual cortex, and the posterior parietal cortex. Here, we found that consolidation of a surprise-enhanced associability memory in a serial prediction task depends on processing in the amygdala central nucleus (CeA) after completion of sessions that included the surprising omission of an expected event. Post-surprise infusions of anisomycin, lidocaine, or muscimol prevented subsequent display of surprise-enhanced associability. Because previous studies indicated that CeA function is unnecessary for the expression of associability enhancements that were induced previously when CeA function was intact (Holland & Gallagher, 2006), we interpreted these results as indicating that post-surprise activity of CeA ("surprise replay") is necessary for the consolidation of altered associability memories elsewhere in the brain, such as the posterior parietal cortex (Schiffino et al., 2014a).

Secondary visual cortex is critical to the expression of surprise-induced enhancements in cue associability in rats

Considerable evidence indicates that reinforcement prediction error, the difference between the obtained and expected reinforcer values, modulates attention to potential cues for reinforcement. The surprising delivery or omission of a reinforcer enhances the associability of the stimuli that were present when the error was induced, so that they more readily enter into new associations in the future. Previous research from our laboratory identified brain circuit elements critical to the enhancement of stimulus associability by omission of an expected event and to the subsequent expression of that altered associability in more rapid learning. A key finding was that the rat posterior parietal cortex was essential during the encoding, consolidation and retrieval of associability memories that were altered by the surprising omission of an expected event in a serial prediction task. Here, we found that the function of adjacent secondary visual cortex was critical only to the expression of altered cue associability in that same task. This specialization of function is discussed in the context of broader cortical and subcortical networks for modulation of attention in associative learning, as well as recent anatomical investigations that suggest that the rodent posterior parietal cortex overlaps with and may subsume secondary visual cortex.

Effects of amygdala lesions on overexpectation phenomena in food cup approach and autoshaping procedures

Prediction error (PE) plays a critical role in most modern theories of associative learning, by determining the effectiveness of conditioned stimuli (CS) or unconditioned stimuli (US). Here, we examined the effects of lesions of central (CeA) or basolateral (BLA) amygdala on performance in overexpectation tasks. In 2 experiments, after 2 CSs were separately paired with the US, they were combined and followed by the same US. In a subsequent test, we observed losses in strength of both CSs, as expected if the negative PE generated on reinforced compound trials encouraged inhibitory learning. CeA lesions, known to interfere with PE-induced enhancements in CS effectiveness, reduced those losses, suggesting that normally the negative PE also enhances cue associability in this task. BLA lesions had no effect. When a novel cue accompanied the reinforced compound, it acquired net conditioned inhibition, despite its consistent pairings with the US, consonant with US effectiveness models. That acquisition was unaffected by either CeA or BLA lesions, suggesting different rules for assignment of credit of changes in cue strength and cue associability. Finally, we examined a puzzling autoshaping phenomenon previously attributed to overexpectation effects. When a previously food-paired auditory cue was combined with the insertion of a lever and paired with the same food US, the auditory cue not only failed to block conditioning to the lever, but also lost strength, as in an overexpectation experiment. This effect was abolished by BLA lesions but unaffected by CeA lesions, suggesting it was unrelated to other overexpectation effects. (PsycINFO Database Record

Mediating the effects of drug abuse: the role of Narp in synaptic plasticity

There has been remarkable progress in deciphering the molecular mechanisms that mediate synaptic plasticity. Advances have stimulated interest in determining whether these plasticity mechanisms also mediate the long-lasting behavioral effects induced by drugs of abuse. The observation that drugs of abuse, such as cocaine or morphine, can elicit robust immediate early gene (IEG) responses similar to those induced by long-term potentiation stimulation has provided important support for this hypothesis. Evidence that repeated administration of cocaine produces alterations in expression and trafficking of AMPA receptors, processes that play a central role in synaptic plasticity, has also bolstered this view. Neuronal activity-regulated pentraxin (Narp), an IEG, has emerged as an attractive candidate to mediate long-term effects of drugs of abuse because it encodes a secreted protein that binds to the extracellular surface of AMPA receptors and regulates their trafficking. In this review we provide background information on Narp and closely related proteins, the neuronal pentraxins, and summarize studies of Narp knockout mice demonstrating that this IEG modulates long-term behavioral responses to drugs of abuse.

Mini-review: Prediction errors, attention and associative learning

Most modern theories of associative learning emphasize a critical role for prediction error (PE, the difference between received and expected events). One class of theories, exemplified by the Rescorla-Wagner (1972) model, asserts that PE determines the effectiveness of the reinforcer or unconditioned stimulus (US): surprising reinforcers are more effective than expected ones. A second class, represented by the Pearce-Hall (1980) model, argues that PE determines the associability of conditioned stimuli (CSs), the rate at which they may enter into new learning: the surprising delivery or omission of a reinforcer enhances subsequent processing of the CSs that were present when PE was induced. In this mini-review we describe evidence, mostly from our laboratory, for PE-induced changes in the associability of both CSs and USs, and the brain systems involved in the coding, storage and retrieval of these altered associability values. This evidence favors a number of modifications to behavioral models of how PE influences event processing, and suggests the involvement of widespread brain systems in animals' responses to PE.

Enhancing second-order conditioning with lesions of the basolateral amygdala

Because the occurrence of primary reinforcers in natural environments is relatively rare, conditioned reinforcement plays an important role in many accounts of behavior, including pathological behaviors such as the abuse of alcohol or drugs. As a result of pairing with natural or drug reinforcers, initially neutral cues acquire the ability to serve as reinforcers for subsequent learning. Accepting a major role for conditioned reinforcement in everyday learning is complicated by the often-evanescent nature of this phenomenon in the laboratory, especially when primary reinforcers are entirely absent from the test situation. Here, I found that under certain conditions, the impact of conditioned reinforcement could be extended by lesions of the basolateral amygdala (BLA). Rats received first-order Pavlovian conditioning pairings of 1 visual conditioned stimulus (CS) with food prior to receiving excitotoxic or sham lesions of the BLA, and first-order pairings of another visual CS with food after that surgery. Finally, each rat received second-order pairings of a different auditory cue with each visual first-order CS. As in prior studies, relative to sham-lesioned control rats, lesioned rats were impaired in their acquisition of second-order conditioning to the auditory cue paired with the first-order CS that was trained after surgery. However, lesioned rats showed enhanced and prolonged second-order conditioning to the auditory cue paired with the first-order CS that was trained before amygdala damage was made. Implications for an enhanced role for conditioned reinforcement by drug-related cues after drug-induced alterations in neural plasticity are discussed. (PsycINFO Database Record

The antagonism of ghrelin alters the appetitive response to learned cues associated with food

The rapid increase in obesity may be partly mediated by an increase in the exposure to cues for food. Food-paired cues play a role in food procurement and intake under conditions of satiety. The mechanism by which this occurs requires characterization, but may involve ghrelin. This orexigenic peptide alters the response to food-paired conditioned stimuli, and neural responses to food images in reward nuclei. Therefore, we tested whether a ghrelin receptor antagonist alters the influence of food-paired cues on the performance of instrumental responses that earn food and the consumption of food itself using tests of Pavlovian-to-instrumental transfer (PIT) and cue potentiated feeding (CPF), respectively. Food-deprived rats received Pavlovian conditioning where an auditory cue was paired with delivery of sucrose solution followed by instrumental conditioning to lever press for sucrose. Following training, rats were given ad libitum access to chow. On test day, rats were injected with the ghrelin receptor antagonist GHRP-6 [D-Lys3] and then tested for PIT or CPF. Disrupting ghrelin signaling enhanced expression of PIT. In addition, GHRP-6 [D-Lys3] impaired the initiation of feeding behavior in CPF without influencing overall intake of sucrose. Finally, in PIT tested rats, enhanced FOS immunoreactivity was revealed following the antagonist in regions thought to underlie PIT; however, the antagonist had no effect on FOS immunoreactivity in CPF tested rats.

Dorsolateral striatum is critical for the expression of surprise-induced enhancements in cue associability

The dorsolateral striatum (DLS) is frequently implicated in sensory-motor integration, including the performance of sensory orienting responses (ORs) and learned stimulus-response habits. Our laboratory previously identified a role for the DLS in rats' performance of conditioned ORs to Pavlovian cues for food delivery. Here, we considered whether DLS is also critical to another aspect of attention in associative learning, the surprise-induced enhancement of cue associability. A large behavioral literature shows that a cue present when an expected event is omitted enters into new associations more rapidly when that cue is subsequently paired with food. Research from our laboratory has shown that both cue associability enhancements and conditioned ORs depend on the function of a circuit that includes the amygdala central nucleus and the substantia nigra pars compacta. In three experiments, we explored the involvement of DLS in surprise-induced associability enhancements, using a three-stage serial prediction task that permitted separation of DLS function in registering surprise (prediction error) and enhancing cue associability, and in using that increased associability to learn more rapidly about that cue later. The results showed that DLS is critical to the expression, but not the establishment, of the enhanced cue associability normally produced by surprise in this task. They extend the role of DLS and the amygdalo-nigro-striatal circuit underlying learned orienting to more subtle aspects of attention in associative learning, but are consistent with the general notion that DLS is more important in the expression of previously acquired tendencies than in their acquisition.

Dorsolateral striatum implicated in the acquisition, but not expression, of immediate response learning in rodent submerged T-maze

Animals can use multiple strategies when learning about, and navigating within, their environment. Typically, in the frequently-studied food-rewarded T-maze, rats initially adopt a flexible, hippocampal-dependent place strategy. However, as learning progresses, rats switch to an automatic, striatal-dependent response strategy (Packard & McGaugh, 1996). Interestingly, in a similar but aversively motivating water-submerged T-maze, rats exhibit the opposite behavioral pattern, initially adopting a response strategy but switching to a place strategy with extended training (Asem & Holland, 2013). Here, we examined the effects of transient lidocaine inactivation of the dorsolateral striatum (DLS) on rats' acquisition and expression of place and response strategies in the submerged T-maze. DLS inactivation prior to probe tests had no effect on rats' initial expression of a response strategy nor on their transition to the use of a place strategy with further training. Nevertheless, in a second experiment using the same rats, identical inactivation parameters significantly affected performance in an appetitively motivating positive control task, which required a response strategy. Furthermore, in a third experiment, DLS inactivation prior to early learning trials interfered with the acquisition of the response strategy in the submerged T-maze. These differences in DLS inactivation effects across appetitive and aversive tasks support the view that task motivation plays crucial roles in guiding learning, memory, and behavior. Additionally, differences in DLS inactivation effects between tests of acquisition and expression suggest that the DLS is required during early acquisition but not expression of the response learning strategy.

Amygdalo-striatal interaction in the enhancement of stimulus salience in associative learning

Function of the central nucleus of the amygdala (CeA) is critical to 2 aspects of attention in associative learning: the conditioning of orienting responses (ORs) to cues paired with food, and the enhancement of cue salience by the surprising omission of expected events. Such salience enhancements have been found to depend on interactions within a circuit that includes CeA, the substantia nigra pars compacta (SNc), the substantia innominata (SI), and the posterior parietal cortex (PPC). The acquisition and expression of conditioned ORs requires interactions among CeA, SNc, and the dorsal lateral striatum (DLS), but not SI or PPC. Here, we considered whether CeA-DLS interactions are also important in surprise-induced salience enhancements in a serial prediction task. Rats received unilateral lesions of CeA and DLS, either contralaterally, which disrupted interactions between those structures, or ipsilaterally, which produced comparable damage to each structure but permitted interactions between them in 1 hemisphere. Rats with ipsilateral lesions of CeA and DLS showed the salience enhancements normally observed in this task, but rats with contralateral lesions of those structures did not. Thus, convergence of information processing by CeA and DLS is essential for surprise-induced salience enhancements, as well as for conditioned ORs.

Role of amygdala central nucleus in the potentiation of consuming and instrumental lever-pressing for sucrose by cues for the presentation or interruption of sucrose delivery in rats

Initially neutral conditioned stimuli (CSs) paired with food often acquire motivating properties. For example, CS presentations may enhance the rate of instrumental responding that normally earns that food reward (Pavlovian-instrumental transfer), or potentiate consumption of that food when the animal is food-sated. Recent evidence suggests that cues associated with the withdrawal of food and food cues (interruption stimuli or ISs) may also potentiate feeding, despite exhibiting some characteristics of conditioned inhibition. Here, we compared the ability of CSs and ISs to modulate both eating food and working for it. If CSs and ISs potentiate eating food by controlling a similar incentive state, both types of cues might also be expected to enhance instrumental responding for food. Although we found substantial potentiation of feeding by both CSs and ISs, and powerful enhancement of instrumental responding by a CS, we found no evidence for such instrumental enhancement by an IS. Furthermore, although an IS produced more FOS expression in the amygdala central nucleus (CeA) than either a previously reinforced CS or a control stimulus after a test for potentiated feeding, an intact CeA was unnecessary for potentiation of feeding by either a CS or an IS. Nevertheless, as in previous studies, CeA was critical to the ability of a CS to enhance instrumental responding. Implications for understanding the nature and basis for incentive learning are discussed.

The basolateral amygdala is necessary for negative prediction errors to enhance cue salience, but not to produce conditioned inhibition

Behavioral evidence shows that prediction errors (PEs) not only drive associative learning, but also enhance the salience of predictive cues, making them better able to capture attention when they are next encountered. Research from our laboratory suggests that this latter consequence of PEs depends on a neural circuit that includes the amygdala. Lesions of the basolateral complex of the amygdala (BLA), for instance, selectively disrupt enhancements in cue processing that are normally induced by positive PEs without compromising simple excitatory learning. This result is consistent with electrophysiological evidence showing that BLA neurons track positive PEs. Interestingly, the same neurons also seem to track negative PEs, suggesting the possibility that the BLA might also use these errors to drive enhancements in cue processing. Here, we examined the role of the BLA in the processing (Experiment 1) and utilization (Experiment 2) of negative PEs in increasing cue salience in an unblocking procedure. Using FOS expression as an index of neural activity, Experiment 1 confirmed that BLA neurons track negative PEs with reinforcement downshifts. This tracking was evident both when these errors were generated by decreasing the concentration of a sucrose reinforcer (which encourages the development of conditioned inhibition) and when they were generated by decreasing the number of sucrose reinforcers (which encourages excitatory learning - unblocking - and allows the detection of enhancements in cue processing). Experiment 2 demonstrated that BLA lesions abolished enhancements in cue processing while sparing inhibitory learning. These results suggest a general role of the BLA in utilizing PEs, whatever their sign, for boosting cue processing.

Role of lateral hypothalamus in two aspects of attention in associative learning

Orexin (hypocretin) and melanin-concentrating hormone (MCH) neurons are unique to the lateral hypothalamic (LH) region, but project throughout the brain. These cell groups have been implicated in a variety of functions, including reward learning, responses to stimulants, and the modulation of attention, arousal and the sleep/wakefulness cycle. Here, we examined roles for LH in two aspects of attention in associative learning shown previously to depend on intact function in major targets of orexin and MCH neurons. In experiments 1 and 2, unilateral orexin-saporin lesions of LH impaired the acquisition of conditioned orienting responses (ORs) and bilaterally suppressed FOS expression in the amygdala central nucleus (CeA) normally observed in response to food cues that provoke conditioned ORs. Those cues also induced greater FOS expression than control cues in LH orexin neurons, but not in MCH neurons. In experiment 3, unilateral orexin-saporin lesions of LH eliminated the cue associability enhancements normally produced by the surprising omission of an expected event. The magnitude of that impairment was positively correlated with the amount of LH damage and with the loss of orexin neurons in particular, but not with the loss of MCH neurons. We suggest that the effects of the LH orexin-saporin lesions were mediated by their effect on information processing in the CeA, known to be critical to both behavioral phenomena examined here. The results imply close relations between LH motivational amplification functions and attention, and may inform our understanding of disorders in which motivational and attentional impairments co-occur.

Posterior parietal cortex is critical for the encoding, consolidation, and retrieval of a memory that guides attention for learning

Within most contemporary learning theories, reinforcement prediction error, the difference between the obtained and expected reinforcer value, critically influences associative learning. In some theories, this prediction error determines the momentary effectiveness of the reinforcer itself, such that the same physical event produces more learning when its presentation is surprising than when it is expected. In other theories, prediction error enhances attention to potential cues for that reinforcer by adjusting cue-specific associability parameters, biasing the processing of those stimuli so that they more readily enter into new associations in the future. A unique feature of these latter theories is that such alterations in stimulus associability must be represented in memory in an enduring fashion. Indeed, considerable data indicate that altered associability may be expressed days after its induction. Previous research from our laboratory identified brain circuit elements critical to the enhancement of stimulus associability by the omission of an expected event, and to the subsequent expression of that altered associability in more rapid learning. Here, for the first time, we identified a brain region, the posterior parietal cortex, as a potential site for a memorial representation of altered stimulus associability. In three experiments using rats and a serial prediction task, we found that intact posterior parietal cortex function was essential during the encoding, consolidation, and retrieval of an associability memory enhanced by surprising omissions. We discuss these new results in the context of our previous findings and additional plausible frontoparietal and subcortical networks.

Effects of nucleus accumbens core and shell lesions on autoshaped lever-pressing

Certain Pavlovian conditioned stimuli (CSs) paired with food unconditioned stimuli (USs) come to elicit approach and even consumption-like behaviors in rats (sign-tracking). We investigated the effects of lesions of the nucleus accumbens core (ACbC) or shell (ACbS) on the acquisition of sign-tracking in a discriminative autoshaping procedure in which presentation of one lever CS was followed by delivery of sucrose, and another was not. Although we previously found that bilateral lesions of the whole ACb disrupted the initial acquisition of sign-tracking, neither ACbC or ACbS lesions affected the rate or percentage of trials in which rats pressed the CS+. In addition, detailed video analysis showed no effect of either lesion on the topography of the sign-tracking conditioned response (CR). These and other results from lesion studies of autoshaping contrast with those from previous sign-tracking experiments that used purely visual cues (Parkinson et al., 2000a,b), suggesting that the neural circuitry involved in assigning incentive value depends upon the nature of the CS.

Effects of ventral striatal lesions on first- and second-order appetitive conditioning

Rats with bilateral lesions of the ventral striatal nucleus accumbens failed to acquire Pavlovian second-order conditioning to auditory stimuli paired with visual stimuli that had previously received first-order pairings with food. This deficit in second-order conditioning was specific to learning driven by incentive properties of the first-order cues, and was observed whether the first-order training had occurred prior to or after lesion surgery. Lesions also produced deficits in the display of conditioned responses to the first-order conditioned stimulus, but only when they were made after first-order training. These results suggest a specific role for the ventral striatum in acquiring and expressing incentive properties of conditioned stimuli through second-order conditioning, as well as a more general role in expressing previously acquired Pavlovian conditioned responses.

Odor-mediated taste learning requires dorsal hippocampus, but not basolateral amygdala activity

Mediated learning is a unique cognitive phenomenon in which mental representations of physically absent stimuli enter into associations with directly-activated representations of physically present stimuli. Three experiments investigated the functional physiology of mediated learning involving the use of odor-taste associations. In Experiments 1a and 1b, basolateral amygdala lesions failed to attenuate mediated taste aversion learning. In Experiment 2, dorsal hippocampus inactivation impaired mediated learning, but left direct learning intact. Considered with past studies, the results implicate the dorsal hippocampus in mediated learning generally, and suggest a limit on the importance of the basolateral amygdala.

Role of medial prefrontal cortex Narp in the extinction of morphine conditioned place preference

Narp knockout (KO) mice demonstrate an impaired extinction of morphine conditioned place preference (CPP). Because the medial prefrontal cortex (mPFC) has been implicated in extinction learning, we tested whether Narp cells in this region play a role in the extinction of morphine CPP. We found that intracranial injections of adenoassociated virus (AAV) expressing wild-type (WT) Narp into the mPFC of Narp KO mice rescued the extinction and the injection of AAV expressing a dominant negative form of Narp (NarpN) into the mPFC of WT mice impaired the extinction of morphine CPP. These findings suggest that Narp in the mPFC mediates the extinction of morphine CPP.

Attention-related Pearce-Kaye-Hall signals in basolateral amygdala require the midbrain dopaminergic system

BACKGROUND

Neural activity in basolateral amygdala has recently been shown to reflect surprise or attention as predicted by the Pearce-Kaye-Hall model (PKH)--an influential model of associative learning. Theoretically, a PKH attentional signal originates in prediction errors of the kind associated with phasic firing of dopamine neurons. This requirement for prediction errors, coupled with projections from the midbrain dopamine system into basolateral amygdala, suggests that the PKH signal in amygdala may depend on dopaminergic input.

METHODS

To test this, we recorded single unit activity in basolateral amygdala in rats with 6-hydroxydopamine or sham lesions of the ipsilateral midbrain region. Neurons were recorded as the rats performed a task previously used to demonstrate both dopaminergic reward prediction errors and attentional signals in basolateral amygdala neurons.

RESULTS

We found that neurons recorded in sham lesioned rats exhibited the same attention-related PKH signal observed in previous studies. By contrast, neurons recorded in rats with ipsilateral 6-hydroxydopamine lesions failed to show attentional signaling.

CONCLUSIONS

These results indicate a linkage between the neural instantiations of the basolateral complex of the amygdala attentional signal and dopaminergic prediction errors. Such a linkage would have important implications for understanding both normal and aberrant learning and behavior, particularly in diseases thought to have a primary effect on dopamine systems, such as addiction and schizophrenia.

Role of amygdala central nucleus in feature negative discriminations

Consistent with a popular theory of associative learning, the Pearce-Hall (1980) model, the surprising omission of expected events enhances cue associability (the ease with which a cue may enter into new associations), across a wide variety of behavioral training procedures. Furthermore, previous experiments from this laboratory showed that these enhancements are absent in rats with impaired function of the amygdala central nucleus (CeA). A notable exception to these assertions is found in feature negative (FN) discrimination learning, in which a "target" stimulus is reinforced when it is presented alone but nonreinforced when it is presented in compound with another, "feature" stimulus. According to the Pearce-Hall model, reinforcer omission on compound trials should enhance the associability of the feature relative to control training conditions. However, prior experiments have shown no evidence that CeA lesions affect FN discrimination learning. Here we explored this apparent contradiction by evaluating the hypothesis that the surprising omission of an event confers enhanced associability on a cue only if that cue itself generates the disconfirmed prediction. Thus, in a FN discrimination, the surprising omission of the reinforcer on compound trials would enhance the associability of the target stimulus but not that of the feature. Our data confirmed this hypothesis and showed this enhancement to depend on intact CeA function, as in other procedures. The results are consistent with modern reformulations of both cue and reward processing theories that assign roles for both individual and aggregate error terms in associative learning.

The role of melanin-concentrating hormone in conditioned reward learning

The orexigenic neuropeptide melanin-concentrating hormone (MCH) is well positioned to play a key role in connecting brain reward and homeostatic systems due to its synthesis in hypothalamic circuitry and receptor expression throughout the cortico-striatal reward circuit. Here we examined whether targeted-deletion of the MCH receptor (MCH-1R) in gene-targeted heterozygote and knockout mice (KO), or systemic treatment with pharmacological agents designed to antagonise MCH-1R in C57BL/6J mice would disrupt two putative consequences of reward learning that rely on different neural circuitries: conditioned reinforcement (CRf) and Pavlovian-instrumental transfer (PIT). Mice were trained to discriminate between presentations of a reward-paired cue (CS+) and an unpaired CS-. Following normal acquisition of the Pavlovian discrimination in all mice, we assessed the capacity for the CS+ to act as a reinforcer for new nose-poke learning (CRf). Pharmacological disruption in control mice and genetic deletion in KO mice impaired CRf test performance, suggesting MCH-1R is necessary for initiating and maintaining behaviors that are under the control of conditioned reinforcers. To examine a dissociable form of reward learning (PIT), a naïve group of mice were trained in separate Pavlovian and instrumental lever training sessions followed by the PIT test. For all mice the CS+ was capable of augmenting ongoing lever responding relative to CS- periods. These results suggest a role for MCH in guiding behavior based on the conditioned reinforcing value of a cue, but not on its incentive motivational value.

The effects of basolateral amygdala lesions on unblocking

Prior reinforcement of a neutral stimulus often blocks subsequent conditioning of a new stimulus if a compound of the original and new cues is paired with the same reinforcer. However, if the value of the reinforcer is altered when the compound is presented, the new cue typically acquires conditioning, a result called unblocking. Blocking, unblocking, and related phenomena have been attributed to variations in processing of either the reinforcer, for example, the Rescorla-Wagner (1972) model, or cues, for example, the Pearce-Hall (1980) model. Here, we examined the effects of lesions of the basolateral amygdala on the occurrence of unblocking when the food reinforcer was increased in quantity at the time of introduction of the new cue. The lesions had no effects on unblocking in a simple design (Experiment 1), which did not distinguish between unblocking produced by variations in reward or cue processing. However, in a procedure that distinguished between unblocking due to direct conditioning by the added reinforcer, consistent with the Rescorla-Wagner (1972) model, and that due to increases in conditioning to the original reinforcer, consistent with the Pearce-Hall (1980) and other models of learning, the lesions prevented unblocking of the latter type. These results were discussed in the context of roles of the basolateral amygdala in coding and using reward prediction error information in associative learning.

Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing

Initially-neutral cues paired with rewards are thought to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues may serve as secondary reinforcers to establish new learning, modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the ventral striatal nucleus accumbens (ACb) and the basolateral amygdala (BLA) on the acquisition of discriminative autoshaped lever-pressing in rats. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose was delivered independently of the rats' behavior, sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Bilateral ACb lesions impaired the initial acquisition of sign-tracking but not its terminal levels. In contrast, BLA lesions produced substantial deficits in terminal levels of sign-tracking. Furthermore, whereas ACb lesions primarily affected the probability of lever press responses, BLA lesions mostly affected the rate of responding once it occurred. Finally, disconnection lesions that disrupted communication between ACb and BLA produced both sets of deficits. We suggest that ACb is important for initial acquisition of consummatory-like responses that incorporate hedonic aspects of the reward, while BLA serves to enhance such incentive salience once it is acquired.

Effects of reward timing information on cue associability are mediated by amygdala central nucleus

The central nucleus of the amygdala (CeA) has been implicated in a range of associative learning phenomena often attributed to changes in attentional processing of events. Experiments using a number of behavioral tasks have shown that rats with lesions of CeA fail to show the enhancements of stimulus associability that are normally induced by the surprising omission of expected events. By contrast, in other tasks, rats with lesions of CeA show normal enhancements of associability when events are presented unexpectedly. In this experiment, we examined the effects of CeA lesions on changes in cue associability in a reward timing task. In sham-lesioned rats, the associability of cues that were followed by stimuli that provided reward timing information was maintained at higher levels than that of cues that were followed by uninformative stimuli. Rats with lesions of CeA failed to show this advantage. These results indicate that the role of CeA in the modulation of associability is not limited to cases of event omission. (PsycINFO Database Record (c) 2011 APA, all rights reserved).

Dissociations between medial prefrontal cortical subregions in the modulation of learning and action

The medial prefrontal cortex (mPFC) has been implicated in various attentional functions. This experiment examined the involvement of mPFC subregions in the allocation of attention in learning and action as a function of the predictive accuracy of cues. Rats with dorsal (encompassing anterior cingulate, prelimbic, and infralimbic cortices) or ventral (encompassing mainly infralimbic and dorsopeduncular cortices and tenia tecta) mPFC lesions were trained in a multiple-choice discrimination task in which operant nosepoke responses to some visual cues were consistently (100%) reinforced (CRF) with food, whereas responses to other visual cues were partially (50%) reinforced (PRF). In challenge tests designed to assess attention in the control of action, responding was directed more to CRF cues than to PRF cues in sham and dorsal mPFC-lesioned rats, but ventral mPFC-lesioned rats showed similar levels of responding to both CRF and PRF cues. Nevertheless, when given a choice between simultaneously presented CRF and PRF cues in a cue competition test, all groups responded more to CRF cues. In a subsequent Pavlovian overshadowing phase designed to assess attention in the acquisition of new learning, previously trained CRF cues overshadowed conditioning to novel auditory cues more than did PRF cues in dorsal mPFC-lesioned rats, whereas the opposite pattern was observed in sham and ventral mPFC-lesioned rats. These results suggest a dissociation within the mPFC in the use of reinforcement prediction information to allocate attention for new learning and for the control of action.

Interactions between amygdala central nucleus and the ventral tegmental area in the acquisition of conditioned cue-directed behavior in rats

Rats orient to and approach localizable visual cues paired with food delivery. Previous studies from this laboratory show that the acquisition and expression of these learned cue-directed responses depend on integrity of a system including the central nucleus of the amygdala (CeA), the substantia nigra pars compacta (SNc) and the dorsolateral striatum (DLS). Other investigators have suggested that cue-directed behaviors may also depend on interaction between CeA and the ventral striatum, perhaps via CeA projections to the ventral tegmental area (VTA). In Experiment 1, we examined the effects of unilateral lesions of CeA and/or VTA on rats' acquisition of conditioned responses to visual cues paired with food. Contrary to the results of previous studies that examined interactions of CeA with either SNc or DLS, rats with contralateral disconnection lesions of CeA and VTA were unimpaired in their acquisition of cue-directed responses. By contrast, rats with lesions of both structures in the same hemisphere failed to learn cue-directed responses, but were normal in their acquisition of conditioned responses directed to the food cup. In Experiment 2, we attempted to characterize the influence of VTA on CeA by examining FOS induction in CeA by a visual cue for food in rats with unilateral lesions of VTA. The results suggested an excitatory influence of VTA on CeA in the presence of food cues. Implications of these results for brain circuits involved in learned orienting and incentive motivation are discussed.

Effects of dorsal or ventral medial prefrontal cortical lesions on five-choice serial reaction time performance in rats

Lesions of the rat medial prefrontal cortex (mPFC) produce behavioral impairments in the 5-choice serial reaction time (5CSRT) task, a widely used measure of sustained and selective visual attention. This experiment compared the effects of "dorsal" (centered on prelimbic and infralimbic cortices) and "ventral" (centered on dorsal peduncular cortex and tenia tecta) mPFC lesions on performance in a variant of the 5CSRT task. Because in some associative learning theories, the predictive validity of events determines the allocation of attention to them, we also examined the effects of cue validity in this task. Operant nosepoke responses to some briefly illuminated ports were consistently (100%) reinforced (CRF) with food, whereas for other ports, responding was reinforced on only 50% of the trials (partial reinforcement, PRF). Different patterns of impairment emerged depending on lesion location within the mPFC. Dorsal- and sham-lesioned rats responded more to CRF than to PRF cues, but ventral-lesioned rats responded similarly to CRF and PRF cues. Additionally, under some conditions of increased attentional demands, dorsal-lesioned rats failed to respond on many trials, whereas the impairment in ventral-lesioned rats was manifested as an increase in response errors. These results demonstrate separable roles for dorsal and ventral mPFC subregions in controlling attention.

Neural correlates of variations in event processing during learning in central nucleus of amygdala

Attention or variations in event processing help drive learning. Lesion studies have implicated the central nucleus of the amygdala (CeA) in this process, particularly when expected rewards are omitted. However, lesion studies cannot specify how information processing in CeA supports such learning. To address these questions, we recorded CeA neurons in rats performing a task in which rewards were delivered or omitted unexpectedly. We found that activity in CeA neurons increased selectively at the time of omission and declined again with learning. Increased firing correlated with CeA-inactivation sensitive measures of attention. Notably CeA neurons did not fire to the cues or in response to unexpected rewards. These results indicate that CeA contributes to learning in response to reward omission due to a specific role in signaling actual omission rather than a more general involvement in signaling expectancies, errors, or reward value.

The central amygdala projection to the substantia nigra reflects prediction error information in appetitive conditioning

The central amygdala nucleus (CeA) plays a critical role in cognitive processes beyond fear conditioning. For example, intact CeA function is essential for enhancing attention to conditioned stimuli (CSs). Furthermore, this enhanced attention depends on the CeA's connections to the nigrostriatal system. In the current study, we examined the role of the CeA's connections to two midbrain dopamine regions, the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA), in processing CS information when predictions of reward or nonreward were confirmed or disconfirmed. Initially, two different retrograde tracers were injected into the SNc and the VTA of rats, to label CeA cells. Different groups of rats then received a visual CS either paired or unpaired with food. Finally, Fos induction was assessed after a test session in which rats were exposed to the visual CS alone or paired with food. Colabeling of Fos and the retrograde tracer(s) showed that CeA neurons projecting to the SNc, but not to the VTA, were engaged in processing CS information when the training and testing conditions differed. These results suggest that the CeA-nigral pathway represents prediction error information during appetitive conditioning.

Estimation of the fructose diphosphatase-phosphofructokinase substrate cycle in the flight muscle of Bombus affinis

1. Substrate cycling of fructose 6-phosphate through reactions catalysed by phosphofructokinase and fructose diphosphatase was estimated in bumble-bee (Bombus affinis) flight muscle in vivo. 2. Estimations of substrate cycling of fructose 6-phosphate and of glycolysis were made from the equilibrium value of the (3)H/(14)C ratio in glucose 6-phosphate as well as the rate of (3)H release to water after the metabolism of [5-(3)H,U-(14)C]glucose. 3. In flight, the metabolism of glucose proceeded exclusively through glycolysis (20.4mumol/min per g fresh wt.) and there was no evidence for substrate cycling. 4. In the resting bumble-bee exposed to low temperatures (5 degrees C), the pattern of glucose metabolism in the flight muscle was altered so that substrate cycling was high (10.4mumol/min per g fresh wt.) and glycolysis was decreased (5.8mumol/min per g fresh wt.). 5. The rate of substrate cycling in the resting bumble-bee flight muscle was inversely related to the ambient temperature, since at 27 degrees , 21 degrees and 5 degrees C the rates of substrate cycling were 0, 0.48 and 10.4mumol/min per g fresh wt. respectively. 6. Calcium ions inhibited fructose diphosphatase of the bumble-bee flight muscle at concentrations that were without effect on phosphofructokinase. The inhibition was reversed by the presence of a Ca(2+)-chelating compound. It is proposed that the rate of fructose 6-phosphate substrate cycling could be regulated by changes in the sarcoplasmic Ca(2+) concentration associated with the contractile process.

A model study of the fructose diphosphatase-phosphofructokinase substrate cycle

A fructose diphosphatase-phosphofructokinase substrate cycle has been reconstructed in vitro to provide a system that recycles fructose 6-phosphate and hydrolyses ATP to ADP and P(i). The concerted actions of glucose phosphate isomerase, phosphofructokinase, aldolase and triose phosphate isomerase catalysed the loss of (3)H from [5-(3)H,U-(14)C]glucose 6-phosphate. This was used as the basis of a method for the estimation of the fructose diphosphatase-phosphofructokinase substrate cycle. For the reconstructed cycle, the rate of decrease of the (3)H/(14)C ratio in [5-(3)H,U-(14)C]hexose 6-phosphate was proportional to the rate of fructose 6-phosphate substrate cycling. A detailed theoretical treatment of this relationship is developed, which enables the rate of substrate cycling to be determined in vivo.

The basolateral amygdala mediates the effects of cues associated with meal interruption on feeding behavior

Considerable evidence shows that environmental cues that signal food delivery when rats are food-deprived can substantially potentiate feeding later when rats are food-sated. Similarly, cues associated with meal interruption, food removal or impending food scarcity may also induce increased eating. For example, after learning the association between a discrete "interruption" stimulus and the unexpected termination of food trials, sated rats show enhanced food consumption when exposed to that stimulus. In Experiment 1, unlike sham-lesioned controls, rats with bilateral excitotoxic lesions of the basolateral amygdala (BLA) failed to display such cue-potentiated feeding. In Experiment 2, potentiation of feeding by an interruption signal was found to be food-specific. That is, a stimulus that signaled interruption of trials with one food but not trials with a second food later only facilitated consumption of the first food. These studies extend our knowledge of the psychological and neural processes underlying cue-induced feeding. Understanding these mechanisms may contribute our understanding of the etiology and treatment of binge eating disorders.

Assessing the role of the growth hormone secretagogue receptor in motivational learning and food intake

The orexigenic neuropeptide ghrelin is an endogeneous ligand for the growth hormone secretagogue receptor (GHS-R). This orexigen is expressed in both the periphery and in the central system, including portions of mesolimbic dopaminergic circuitry that play a role in affective behaviors. Here we examined pharmacological antagonism of GHS-R in motivational incentive learning, as reflected in Pavlovian-to-instrumental transfer (PIT). Furthermore, it is currently unclear whether the previous effects of ghrelin on food intake are mediated by pre- and/or postingestive influences on ingestive behavior. Thus, the authors also conducted detailed analyses of the temporal dynamics of sucrose licking. Mice received low (50 nmol), moderate (100 nmol), and high (200 nmol) intraperitoneal injections of the GHS-R antagonist GHRP-6 [D-Lys3] prior to subsequent transfer and sucrose consumption tests. Low and moderate doses led to an augmentation of PIT, while high dose injections led to generalized performance deficits. In addition, moderate and high doses of the antagonist resulted in reductions in sucrose intake by reducing palatability of the sucrose. These results suggest dissociable functions of GHS-R in its influence over motivational learning and ingestive behavior.

The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses

Separate studies have implicated the lateral habenula (LHb) or amygdala-related regions in processing aversive stimuli, but their relationships to each other and to appetitive motivational systems are poorly understood. We show that neurons in the recently identified GABAergic rostromedial tegmental nucleus (RMTg), which receive a major LHb input, project heavily to midbrain dopamine neurons, and show phasic activations and/or Fos induction after aversive stimuli (footshocks, shock-predictive cues, food deprivation, or reward omission) and inhibitions after rewards or reward-predictive stimuli. RMTg lesions markedly reduce passive fear behaviors (freezing, open-arm avoidance) dependent on the extended amygdala, periaqueductal gray, or septum, all regions that project directly to the RMTg. In contrast, RMTg lesions spare or enhance active fear responses (treading, escape) in these same paradigms. These findings suggest that aversive inputs from widespread brain regions and stimulus modalities converge onto the RMTg, which opposes reward and motor-activating functions of midbrain dopamine neurons.

Effects of cues associated with meal interruption on feeding behavior

Food consumption is controlled by both internal and external factors. Environmental signals associated with food may prepare an animal to forage, consume and digest more effectively. Furthermore, environmental cues that provide information about food availability enable animals to make predictions about future food resources and act upon that knowledge in appropriate fashion. For example, when exposed to a cue that signals the presence of food, animals can eat beyond their present needs to cope with predicted future famine. Interestingly, cues previously paired with meal interruption have a similar effect. In two experiments, food-deprived rats learned to associate one conditioned stimulus (CS+) with delivery of a food unconditioned stimulus (US), and another stimulus (IS) with an unexpected termination of CS-US trials. Subsequently, both CS+ and IS enhanced consumption of the US food by sated rats. The results of Experiment 2 indicated that IS's ability to potentiate feeding of sated rats in test depended more on its accompanying CS+ termination in training than on its signaling reductions in US frequency. These experiments may provide a novel animal model of binge-like behaviors in sated rats induced by external cues paired with meal interruption.

Narp regulates long-term aversive effects of morphine withdrawal

Although long-lasting effects of drug withdrawal are thought to play a key role in motivating continued drug use, the mechanisms mediating this type of drug-induced plasticity are unclear. Because Narp is an immediate early gene product that is secreted at synaptic sites and binds to alpha-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptors, it has been implicated in mediating enduring forms of synaptic plasticity. In previous studies, the authors found that Narp is selectively induced by morphine withdrawal in the extended amygdala, a group of limbic nuclei that mediate aversive behavioral responses. Accordingly, in this study, the authors evaluate whether long-term aversive effects of morphine withdrawal are altered in Narp knockout (KO) mice. The authors found that acute physical signs of morphine withdrawal are unaffected by Narp deletion. However, Narp KO mice acquire and sustain more aversive responses to the environment conditioned with morphine withdrawal than do wild type (WT) controls. Paradoxically, Narp KO mice undergo accelerated extinction of this heightened aversive response. Taken together, these studies suggest that Narp modulates both acquisition and extinction of aversive responses to morphine withdrawal and, therefore, may regulate plasticity processes underlying drug addiction.

A comparison of two methods of assessing representation-mediated food aversions based on shock or illness

In experiments that measured food consumption, Holland (1981; Learning and Motivation, 12, 1-18) found that food aversions were formed when an exteroceptive associate of food was paired with illness, but not when such an associate was paired with shock. By contrast, measuring the ability of food to reinforce instrumental responding, Ward-Robinson and Hall (1999; Quarterly Journal of Experimental Psychology, 52B, 335-350) found that pairing an associatively-activated representation of food with shock readily established an aversion to that food. Two experiments considered the origins of these apparently discrepant results. The results did not support either the possibility that instrumental reinforcement power is a more sensitive measure of aversion learning than consumption, nor the hypothesis that illness particularly devalues properties of food representations that determine consumption (such as palatability) whereas shock devalues more general properties critical to reinforcement. The results suggested instead that whereas the effects of pairings of a food associate with illness are mediated by changes in the value of the food itself, the effects of pairings with shock are mediated by the conditioning of fear or other competing responses to the site of food delivery, and not by modification of the value of food itself.

A role for alpha-amino-3-hydroxy-5-methylisoxazole-4-propionic acid GluR1 phosphorylation in the modulatory effects of appetitive reward cues on goal-directed behavior

Alpha-amino-3-hydroxy-5-methylisoxazole-4-propionic acid (AMPA) receptor regulation has been shown to be critically involved in synaptic plasticity underlying learning and memory. This regulation occurs through trafficking of the receptor and modulation of the receptor's channel properties, both of which depend on protein phosphorylation. Using homologous recombination (knock-in) techniques we targeted two phosphorylation sites on the AMPA-GluR1 receptor: the Ser831 site, phosphorylated by calcium calmodulin-dependent protein kinase II/protein kinase C, and the Ser845 site, phosphorylated by protein kinase A. Mice with mutations that prevented phosphorylation at one or both of these sites were tested on a single-outcome Pavlovian-instrumental transfer task often used to assess the acquisition of incentive motivation by cues for food reinforcement. Mice were separately trained to associate a Pavlovian cue with food and to perform an instrumental lever-press response to earn that same reward. During a transfer test, the cue was presented while the mice were lever-pressing under extinction conditions. Whereas wild-type control mice showed substantial enhancement of lever-pressing when the cue was presented (i.e. showed Pavlovian-instrumental transfer), mice with mutations at both of these phosphorylation sites showed no evidence of such transfer. By contrast, mice with either serine site mutated alone showed normal transfer. These results suggest critical roles for GluR1 phosphorylation pathways in a form of incentive learning that can play an important part in regulating normal motivated behavior as well as maladaptive behaviors such as addiction and eating disorders.

Temporally limited role of substantia nigra-central amygdala connections in surprise-induced enhancement of learning

Prediction error plays an important role in modern associative learning theories. For example, the omission of an expected event (surprise) can enhance attention to cues that accompany those omissions, such that subsequent new learning about those cues is more rapid. Many studies from our laboratories have demonstrated that circuitry that includes the amygdala central nucleus (CeA), the cholinergic neurons in the substantia innominata/nucleus basalis region and their innervation of the posterior parietal cortex is critical for this surprise-induced enhancement of attention in learning. We recently showed that midbrain dopamine neurons, known to code prediction error, are also important for surprise-induced enhancement of learning through their interaction with CeA. The present study examined whether in rats the communication between the substantia nigra pars compacta (SNc) and CeA is critical only at the time of surprise, for example to detect prediction error information, or is also needed to maintain and later express that information as enhanced learning. All animals received unilateral CeA lesions and unilateral cannula implants targeting the SNc located contralateral to the lesioned CeA. As the SNc-CeA connections are mainly ipsilateral, inactivating SNc contralateral to the lesioned CeA provided transient blockage of SNc and CeA communication. The results show that SNc-CeA communication is critical for processing prediction error information at the time of surprise, but neither SNc nor SNc-CeA communication is necessary to express that information as enhanced learning later.

Cognitive versus stimulus-response theories of learning

In his 1948 address to the Division of Theoretical-Experimental Psychology of the American Psychological Association, Kenneth W. Spence discussed six distinctions between cognitive and stimulus-response (S-R) theories of learning. In this article, I first review these six distinctions and then focus on two of them in the context of my own research. This research concerns the specification of stimulus-stimulus associations in associative learning and the characterization of the neural systems underlying those associations. In the course of describing Spence's views and my research, I hope to communicate some of the richness of Spence's S-R psychology and its currency within modern scientific analyses of behavior.

The brain-derived neurotrophic factor receptor TrkB is critical for the acquisition but not expression of conditioned incentive value

Stimuli paired with reward acquire incentive properties that are important for many aspects of motivated behavior, such as feeding and drug-seeking. Here we used a novel chemical-genetic strategy to determine the role of the brain-derived neurotrophic factor (BDNF) receptor TrkB, known to be critical to many aspects of neural development and plasticity, during acquisition and expression of positive incentive value by a cue paired with food. We assessed that cue's learned incentive value in a conditioned reinforcement task, in which its ability to reinforce instrumental responding later, in the absence of food itself, was examined. In TrkB (F616A) knock-in mice, TrkB kinase activity was suppressed by administering the TrkB inhibitor 1NMPP1 during the period of initial cue incentive learning only (i.e. Pavlovian training), during nose-poke conditioned reinforcement testing only, during both phases, or during neither phase. All mice acquired cue-food associations as indexed by approach responses. However, TrkB (F616A) mice that received 1NMPP1 during initial cue incentive learning failed to show conditioned reinforcement of nose-poking, regardless of their treatment in testing, whereas administration of 1NMMP1 only during the testing phase had no effect. The effects of 1NMPP1 administration were due to inhibition of TrkB(F616A), because the performance of wild-type mice was unaffected by administration of the compound during either phase. These data indicate that BDNF or NT4 signaling through TrkB receptors is required for the acquisition of positive incentive value, but is not needed for the expression of previously acquired incentive value in the reinforcement of instrumental behavior.

Formation of excitatory and inhibitory associations between absent events

Considerable evidence indicates that associations may be formed between two events even when one or both of them is absent at the time of learning. Previously, some researchers asserted that excitatory associations are formed when associatively activated representations for two events are paired, whereas others claimed that inhibitory associations are formed. In three experiments, the authors investigated the nature of tone-sucrose learning when associatively activated representations of those events were paired in the absence of either of the events themselves. Experiment 1 found substantial excitatory learning when the tone surrogate preceded the sucrose surrogate in training. Experiment 2 evaluated other accounts for the results of Experiment 1, and Experiment 3 found evidence for inhibitory tone-sucrose learning when the tone and sucrose surrogates were presented in simultaneous or backward order. The results indicated that the nature of representation-mediated learning is influenced by some of the same variables as more standard associative learning.

The influence of CS-US interval on several different indices of learning in appetitive conditioning

Four experiments examined the effects of varying the conditioned stimulus-unconditioned stimulus (CS-US) interval (and US density) on learning in an appetitive magazine approach task with rats. Learning was assessed with conditioned response (CR) measures, as well as measures of sensory-specific stimulus-outcome associations (Pavlovian-instrumental transfer, potentiated feeding, and US devaluation). The results from these studies indicate that there exists an inverse relation between CS-US interval and magazine approach CRs, but that sensory-specific stimulus-outcome associations are established over a wide range of relatively long, but not short, CS-US intervals. These data suggest that simple CR measures provide different information about what is learned than measures of the specific stimulus-outcome association, and that time is a more critical variable for the former than latter component of learning.