Stress as a context: Stress causes relapse of inhibited food seeking if it has been associated with prior food seeking

Perceived stress and renewal: The effects of long-term stress on the renewal effect

Two online experiments evaluated the relationship between long-term stress, as measured with the Perceived Stress Scale-10, and the Renewal Effect. In the first experiment renewal was assessed with a behavioral suppression task in a science-fiction based video game. Participants learned to suppress mouse clicking during a signal for an upcoming attack to avoid losing points. The signal was first paired with an attack in Context A and extinguished in Context B and tested back in Context A. The contexts were different space galaxies where the gameplay took place. Experiment 2 used a food/illness predictive-learning paradigm. Two food items were paired with stomachache in one restaurant (A) and extinguished in Context B prior to testing in both contexts without feedback. Positive correlations were obtained between renewal and stress in each experiment. Unlike acute stress (Drexler et al., 2017), long term stress was associated with greater renewal. The effects of stress, both chronic and punctual, on renewal are discussed.

Acute stress facilitates habitual behavior in female rats

Instrumental behavior can reflect the influence of goal-directed and habitual systems. Contemporary research suggests that stress may facilitate control by the habitual system under conditions where the behavior would otherwise reflect control by the goal-directed system. However, it is unclear how stress modulates the influence of these systems on instrumental responding to achieve this effect, particularly in females. Here, we examine whether a mild psychogenic stressor experienced before acquisition training (Experiment 1), or prior to the test of expression (Experiment 2) would influence goal-directed and habitual control of instrumental responding in female rats. In both experiments, rats acquired an instrumental nose-poke response for a sucrose reward. This was followed by a reinforcer devaluation phase in which half the rats in Stressed and Non-Stressed conditions received pairings of the sucrose pellet with illness induced by lithium chloride until they rejected the pellet when offered. The remaining rats received a control treatment consisting of pellets and illness on separate days (Unpaired). Control by goal-directed and habitual systems was evaluated in a subsequent nonreinforced test of nose poking. The results of Experiment 1 indicated that the Non-Stressed Paired group reduced nose-poking compared to the Unpaired controls, identifying the response as goal directed, whereas the Stressed Paired and Unpaired groups made a similar number of nose pokes identifying the response as habitual despite a similar amount of training. Results from Experiment 2 indicated habitual control of nose-poke responding was present when stress was experienced just prior to the test. Collectively, these data suggest that stress may facilitate habitual control by altering the relative influence of goal-directed and habitual processes underpinning instrumental behavior. These results may be clinically relevant for understanding the contributions of stress to dysregulated instrumental behavior in compulsive pathologies.

Prelimbic cortex inactivation prevents ABA renewal based on stress state

Our recent research suggests that the interoceptive state associated with stress can function as a contextual stimulus for operant behavior. In the present experiment, we investigated the role of the rodent prelimbic cortex (PL), a brain region that is critical in contextual control of operant behavior, in the ability of a stressed state to produce ABA renewal of an extinguished operant response. Rats were trained to perform a lever press response for a food pellet reward during daily sessions that followed exposure to a stressor that changed each day. The response was then extinguished in the absence of stress. ABA renewal of extinguished responding occurred following exposure to another stressor (different from any used during acquisition) in control rats but not in rats that received a PL-inactivating infusion (baclofen/muscimol). Results confirm that the interoceptive state of stress can play the role of a contextual stimulus and initiate renewal (relapse) of an inhibited behavior when stress has previously been associated with the behavior. In conjunction with our previous work, the present results support the hypothesis that the PL is important for contexts, both exteroceptive and interoceptive, to exert such control over operant behavior. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Stress, associative learning, and decision-making

Exposure to acute and chronic stress has significant effects on the basic mechanisms of associative learning and memory. Stress can both impair and enhance associative learning depending on type, intensity, and persistence of the stressor, the subject's sex, the context that the stress and behavior is experienced in, and the type of associative learning taking place. In some cases, stress can cause or exacerbate the maladaptive behavior that underlies numerous psychiatric conditions including anxiety disorders, obsessive-compulsive disorder, post-traumatic stress disorder, substance use disorder, and others. Therefore, it is critical to understand how the varied effects of stress, which may normally facilitate adaptive behavior, can also become maladaptive and even harmful. In this review, we highlight several findings of associative learning and decision-making processes that are affected by stress in both human and non-human subjects and how they are related to one another. An emerging theme from this work is that stress biases behavior towards less flexible strategies that may reflect a cautious insensitivity to changing contingencies. We consider how this inflexibility has been observed in different associative learning procedures and suggest that a goal for the field should be to clarify how factors such as sex and previous experience influence this inflexibility.

Pharmacological activation of the amygdala, but not single prolonged footshock-induced acute stress, interferes with cue-induced motivation toward food rewards in rats

In the face of threats, animals adapt their behaviors to cope with the situation. Under such circumstances, irrelevant behaviors are usually suppressed. In this study, we examined whether food-seeking motivation would decrease under activation of the amygdala, an important nucleus in the regulation of stress response in the central nervous system, or after a physical acute stress session. In Experiment 1, we pharmacologically activated the basolateral nucleus (BLA) or the central nucleus of the amygdala (CeA) before a cue-induced reinstatement test in rats. Our results showed that activation of the BLA or the CeA abolished cue-induced motivation toward food rewards, while locomotor activity and free food intake were not affected. In Experiments 2 and 3, we further assessed anxiety and despair levels, as well as cue-induced reinstatement, after a single prolonged footshock-induced acute stress in rats. Behaviorally, acute stress did not affect anxiety level, despair level, or cue-induced motivation toward food rewards. Physiologically, there was no difference in cellular activities of the amygdala immediately after acute stress. To conclude, our results suggested that pharmacological activation of the amygdala decreased cue-induced motivation toward food reward. However, physiological acute stress did not immediately interfere with the negative emotions, motivation, or amygdala activities of the animals.

Prelimbic cortex inactivation prevents ABA renewal based on satiety state

We have previously shown that the rat prelimbic cortex (PL) is necessary for contexts to promote the performance of instrumental behaviors that have been learned in them, whether the context is physical (operant chamber) or behavioral (recent performance of a behavior that has historically preceded the target in a behavior chain). In the present experiment, we investigated the role of the PL in satiety level as an interoceptive acquisition context. Rats were trained to lever-press for sweet/fat pellets while sated (22 hrs continuous food access) followed by the extinction of the response while hungry (22 hrs food deprived). Pharmacological inactivation of the PL (with baclofen/muscimol infusion) attenuated renewal of the response that occurred upon a return to the sated context. In contrast, animals that received a vehicle (saline) infusion showed renewal of the previously extinguished response. These results support the hypothesis that the PL monitors the relevant contextual elements (physical, behavioral, or satiety state) associated with reinforcement of a response and promotes the subsequent performance of that response in their presence.

Acute food deprivation-induced relapse to heroin seeking after short and long punishment-imposed abstinence in male rats

RATIONAL

Stress is a major trigger for drug relapse in humans and animal models, even after prolonged abstinence. However, animal models for stress-induced relapse were criticized for the lack of predictive and face validity.

OBJECTIVES

Here we investigated the effect of acute food deprivation stress in a novel stress-induced relapse model using voluntary, punishment-imposed abstinence from heroin. We also performed a detailed characterization of the development of punishment-imposed abstinence.

METHODS

Male rats were trained to self-administered heroin (0.1 mg/kg/infusion) for 2 weeks, using the seeking-taking chained schedule. Pressing the 'seeking' lever led to the insertion of the 'taking' lever and pressing the take lever resulted in heroin infusion. Following self-administration training, rats were exposed to 8 or 21 days of heroin-seeking punishment. During punishment, 30% of the completed seek links resulted in a mild escalating footshock instead of take lever presentation. Next, rats were tested for heroin seeking under extinction conditions after 24 h of food deprivation and sated conditions.

RESULTS

Probabilistic punishment of seeking lever responses resulted in gradual suppression of heroin seeking and taking. Exposure to food-deprivation stress induced a robust relapse to heroin seeking after short and long punishment-imposed abstinence periods, without significant effects of time, i.e., no incubation of heroin seeking. Individual differences were observed in the development of punishment-induced abstinence and stress-induced relapse.

CONCLUSIONS

These results suggest that stress is a reliable trigger to relapse even after a prolonged period of punishment-induced, voluntary abstinence.

Learning to stop responding

Learning to stop responding is an important process that allows behavior to adapt to a changing and variable environment. This article reviews recent research in this laboratory and others that has studied how animals learn to stop responding in operant extinction, punishment, and feature-negative learning. Extinction and punishment are shown to be similar in two fundamental ways. First, the response-suppressing effects of both are highly context-specific. Second, the response-suppressing effects of both can be remarkably response-specific: Inhibition of one response transfers little to other responses. Learning to inhibit the response so specifically may result from the correction of "response error," the difference between the level of responding and what the current reinforcer supports. In contrast, the inhibition of responding that develops in feature-negative learning, where the response is reinforced during one discriminative stimulus (A) but not in a compound of A and stimulus B, is less response-specific: The inhibition of responding by stimulus B transfers and inhibits a second response, especially if the second response has itself been inhibited before. The results thus indicate both response-specific and response-general forms of behavioral inhibition. One possibility is that response-specific inhibition is learned when the circumstances encourage the organism to pay attention to the response-to what it is actually doing-as behavioral suppression is learned.

Reinstatement of Pavlovian responses to alcohol cues by stress

RATIONALE

Stress may contribute to relapse to alcohol use in part by enhancing reactivity to cues previously paired with alcohol. Yet, standard models of stress-induced reinstatement generally use contingent presentations of alcohol-paired cues to reinforce instrumental behaviors, making it difficult to isolate the ability of cues to invigorate alcohol-seeking.

OBJECTIVE

Here we sought to test the impact of stress on behavioral responses to alcohol-paired cues, using a model of stress-induced reinstatement of Pavlovian conditioned approach, inspired by Nadia Chaudhri's work on context-induced reinstatement.

METHODS

Long Evans rats were trained to associate one auditory cue with delivery of alcohol or sucrose and an alternative auditory cue with no reward. Following extinction training, rats were exposed to a stressor prior to being re-exposed to the cues under extinction conditions. We assessed the effects of yohimbine, intermittent footshock and olfactory cues paired with social defeat on responses to alcohol-paired cues and the effects of yohimbine on responses to sucrose-paired cues.

RESULTS

The pharmacological stressor, yohimbine, enhanced alcohol seeking in a Pavlovian setting, but not in a cue-selective manner. Intermittent footshock and social defeat cues did not enhance alcohol seeking in this paradigm.

CONCLUSIONS

While yohimbine elicited reinstatement of reward-seeking in a Pavlovian setting, these effects may be unrelated to activation of stress systems or to interactions with specific cues.

Motivational state-dependent renewal and reinstatement of operant responding under food and water deprivation states

Most studies of operant relapse phenomena have studied the role of exteroceptive discriminative features of context in the recovery of behavior after extinction. Interoceptive stimuli (i.e., stimuli arising from the bodies of organisms) may also serve as a part of learning contexts and contribute to relapse. Recent studies have demonstrated that events that function as motivating operations (MOs) may contribute to relapse both by a) eliciting interoceptive conditions that serve as a discriminative context for relapse (i.e., discriminative function) and b) altering the amount of operant responding in the presence of discriminative stimuli associated with reinforcers (i.e., motivational function). The current study examined interactions between these functions of food and water deprivation MOs in the relapse of operant behavior. During acquisition of an operant response, one group of mice was food-deprived and another was water-deprived. The groups then received extinction sessions under the opposite condition. Renewal and reinstatement tests were conducted under both conditions, and more renewal and reinstatement were observed in the motivational states in which acquisition occurred for each. These results are discussed in the context of state-dependent learning.

Contextual control of conditioned pain tolerance and endogenous analgesic systems

The mechanisms underlying the transition from acute to chronic pain are unclear but may involve the persistence or strengthening of pain memories acquired in part through associative learning. Contextual cues, which comprise the environment in which events occur, were recently described as a critical regulator of pain memory; both male rodents and humans exhibit increased pain sensitivity in environments recently associated with a single painful experience. It is unknown, however, how repeated exposure to an acute painful unconditioned stimulus in a distinct context modifies pain sensitivity or the expectation of pain in that environment. To answer this question, we conditioned mice to associate distinct contexts with either repeated administration of a mild visceral pain stimulus (intraperitoneal injection of acetic acid) or vehicle injection over the course of 3 days. On the final day of experiments, animals received either an acid injection or vehicle injection prior to being placed into both contexts. In this way, contextual control of pain sensitivity and pain expectation could be tested respectively. When re-exposed to the noxious stimulus in a familiar environment, both male and female mice exhibited context-dependent conditioned analgesia, a phenomenon mediated by endogenous opioid signaling. However, when expecting the presentation of a painful stimulus in a given context, males exhibited conditioned hypersensitivity whereas females exhibited endogenous opioid-mediated conditioned analgesia. These results are evidence that pain perception and engagement of endogenous opioid systems can be modified through their psychological association with environmental cues. Successful determination of the brain circuits involved in this sexually dimorphic anticipatory response may allow for the manipulation of pain memories, which may contribute to the development of chronic pain states.

New functions of the rodent prelimbic and infralimbic cortex in instrumental behavior

The prelimbic and infralimbic cortices of the rodent medial prefrontal cortex mediate the effects of context and goals on instrumental behavior. Recent work from our laboratory has expanded this understanding. Results have shown that the prelimbic cortex is important for the modulation of instrumental behavior by the context in which the behavior is learned (but not other contexts), with context potentially being broadly defined (to include at least previous behaviors). We have also shown that the infralimbic cortex is important in the expression of extensively-trained instrumental behavior, regardless of whether that behavior is expressed as a stimulus-response habit or a goal-directed action. Some of the most recent data suggest that infralimbic cortex may control the currently active behavioral state (e.g., habit vs. action or acquisition vs. extinction) when two states have been learned. We have also begun to examine prelimbic and infralimbic cortex function as key nodes of discrete circuits and have shown that prelimbic cortex projections to an anterior region of the dorsomedial striatum are important for expression of minimally-trained instrumental behavior. Overall, the use of an associative learning perspective on instrumental learning has allowed the research to provide new perspectives on how these two "cognitive" brain regions contribute to instrumental behavior.

Altering Perceived Context: Transportation Cues Influence Novelty-Induced Context Exploration

Context is the milieu in which everything occurs. Many research studies consider context, or even explicitly manipulate it; yet it remains challenging to characterize. We know that a context surrounds and influences tasks; however, the boundaries of its influence are difficult to define. In behavioral science, context is often operationalized by the physical environment in which the experiment takes place, and the boundaries of the context are assumed to begin at the entrance to that of the room or apparatus. Experiences during transportation to the testing space have been shown to impact rodent behavior and memory, but transportation's relationship with novelty and physical environment is not fully understood. The current study explored how familiar vs. novel cues, both within a physical environment and preceding it, impact the perception of a context. We manipulated context on three levels: physical testing environment, object cues within that environment, and transportation cues preceding entrance to the testing environment. We found that novel transportation cues can change rats' perception of both familiar and novel contexts. The effects of transportation on perceived context may be affected by the length of the retention interval, testing environment, and behavioral range. These data suggest that context is a broad concept that includes cues across time and is sensitive to small differences in experience.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Positive affective states can play the role of context to renew extinguished instrumental behavior in rats

In one experiment with rats, we examined whether positive affective states can serve as contexts in a between-subjects ABA renewal design using appetitive instrumental conditioning. Two groups of rats received training to press a lever for food where each acquisition session was preceded by administration of a tickling procedure (Context A) known to induce positive affective states. Then, lever pressing underwent extinction where rats received a pure handling treatment (Context B) before each session. During a final test session, we found stronger responding when the session was preceded by tickling (Group ABA) compared to handling (Group ABB), indicating an ABA renewal effect. Furthermore, test performance in Group ABB was not different from that in a third group where handling preceded acquisition sessions, and tickling extinction and test sessions (Group BAA), showing that tickling did not elevate instrumental responding during the test if it had been unrelated to initial acquisition. We discuss implications of our results for understanding the role of positive affective states in relapse of problem behavior.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

Reward-Related Attentional Capture Moderates the Association between Fear-Driven Motives and Heavy Drinking

BACKGROUND

To date, there has been little investigation on how motivational and cognitive mechanisms interact to influence problematic drinking behaviours. Towards this aim, the current study examined whether reward-related attentional capture is associated with reward, fear (relief), and habit drinking motives, and further, whether it interacts with these motives in relation to problematic drinking patterns.

METHODS

Ninety participants (mean age = 34.8 years, SD = 9.1, 54% male) who reported having consumed alcohol in the past month completed an online visual search task that measured reward-related attentional capture as well as the Habit Reward Fear Scale, a measure of drinking motives. Participants also completed measures of psychological distress, impulsivity, compulsive drinking, and consumption items of Alcohol Use Disorders Identification Test. Regression analyses examined the associations between motives for alcohol consumption and reward-related attentional capture, as well as the associations between reward-related attentional capture, motives, and their interaction, with alcohol consumption and problems.

RESULTS

Greater reward-related attentional capture was associated with greater reward motives. Further, reward-related attentional capture also interacted with fear motives in relation to alcohol consumption. Follow-up analyses showed that this interaction was driven by greater fear motives being associated with heavier drinking among those with lower reward-related attentional capture (i.e., "goal-trackers").

CONCLUSION

These findings have implications for understanding how cognition may interact with motives in association with problematic drinking. Specifically, the findings highlight different potential pathways to problematic drinking according to an individual's cognitive-motivational profile and may inform tailored interventions to target profile-specific mechanisms. Finally, these findings offer support for contemporary models of addiction that view excessive goal-directed behaviour under negative affect as a critical contributor to addictive behaviours.

Renewal of conditioned tentacle lowering by circadian contextual cues in snails Cornu aspersum

Previous experiments using tentacle lowering conditioning in terrestrial snails Cornu aspersum have shown extinction and recovery of the conditioned response (CR) as a consequence of both inserting a delay between the extinction and test (spontaneous recovery) and of re-exposing the animal to the unconditioned stimulus after extinction (reinstatement). Two experiments that examined recovery of the CR due to a change in context (renewal effect) were carried out to continue this line of research. In Experiment 1, subjects received conditioning with an odour (CS) followed by extinction in the presence of another odour (CS + C), before being exposed to the original one (CS). In Experiment 2, conditioning and extinction of an odour CS took place in the presence of different circadian contextual cues (hour of the day and presence of light). The results showed that a return to the original context of conditioned training, after the extinction in a different context, either defined by an odour (Experiment 1) or by circadian cues (Experiment 2), produce a recovery of the CR compared to suitable control groups. These results can be interpreted as an instance of ABA renewal effect and they provide information about psychological mechanisms involved in extinction processes.

Considering Drug-Associated Contexts in Substance Use Disorders and Treatment Development

Environmental contexts that are reliably associated with the use of pharmacologically active substances are hypothesized to contribute to substance use disorders. In this review, we provide an updated summary of parallel preclinical and human studies that support this hypothesis. Research conducted in rats shows that environmental contexts that are reliably paired with drug use can renew extinguished drug-seeking behavior and amplify responding elicited by discrete, drug-predictive cues. Akin to drug-associated contexts, interoceptive drug stimuli produced by the psychopharmacological effects of drugs can also influence learning and memory processes that play a role in substance use disorders. Findings from human laboratory studies show that drug-associated contexts, including social stimuli, can have profound effects on cue reactivity, drug use, and drug-related cognitive expectancies. This translationally relevant research supports the idea that treatments for substance use disorders could be improved by considering drug-associated contexts as a factor in treatment interventions. We conclude this review with ideas for how to integrate drug-associated contexts into treatment-oriented research based on 4 approaches: pharmacology, brain stimulation, mindfulness-based relapse prevention, and cognitive behavioral group therapy. Throughout, we focus on alcohol- and tobacco-related research, which are two of the most prevalent and commonly misused drugs worldwide for which there are known treatments.

Overexpression of corticotropin-releasing factor in the nucleus accumbens enhances the reinforcing effects of nicotine in intact female versus male and ovariectomized female rats

This study assessed the role of stress systems in the nucleus accumbens (NAc) in promoting sex differences in the reinforcing effects of nicotine. Intravenous self-administration (IVSA) of various doses of nicotine was compared following overexpression of corticotropin-releasing factor (CRF) in the NAc of female and male rats. Ovariectomized (OVX) females were also included to assess the role of ovarian hormones in promoting nicotine reinforcement. Rats received intra-NAc administration of an adeno-associated vector that overexpressed CRF (AAV2/5-CRF) or green fluorescent protein (AAV2/5-GFP). All rats were then given extended access (23 h/day) to an inactive and an active lever that delivered nicotine. Separate groups of rats received intra-NAc AAV2/5-CRF and saline IVSA. Rats were also allowed to nose-poke for food and water during IVSA testing. At the end of the study, the NAc was dissected and rt-qPCR methods were used to estimate CRF overexpression and changes in CRF receptors (CRFr1, CRFr2) and the CRF receptor internalizing protein, β-arrestin2 (Arrb2). Overexpression of CRF in the NAc increased nicotine IVSA to a larger extent in intact female versus male and OVX females. Food intake was increased to a larger extent in intact and OVX females as compared to males. The increase in CRF gene expression was similar across all groups; however, in females, overexpression of CRF resulted in a larger increase in CRFr1 and CRFr2 relative to males. In males, overexpression of CRF produced a larger increase in Arrb2 than females, suggesting greater CRF receptor internalization. Our results suggest that stress systems in the NAc promote the reinforcing effectiveness of nicotine in female rats in an ovarian hormone-dependent manner.

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.