Behaviorally conditioned effects of psychoactive drugs in experimental animals: What we have learned from nearly a century of research and what remains to be learned

Continuous treatment with drugs is a crucial requirement for managing various clinical conditions, including chronic pain and neuropsychiatric disorders such as depression or schizophrenia. Associative learning processes, i.e. Pavlovian conditioning, can play an important role for the effects of drugs and could open new avenues for optimizing patient treatment. In this narrative literature review, we summarize available data in experimental animals regarding the behaviorally conditioned effects of psychostimulants such as d-amphetamine and cocaine, the dopamine receptor agonist apomorphine, the dopamine receptor antagonist haloperidol, morphine and antidepressant drugs. In each section, the drug under discussion is briefly introduced, followed by a detailed examination of conditioning features, including doses and dosing regimens, characteristics of the conditioning process such as test environments or specific conditioned stimuli, testing and conditioned response characteristics, possible extinction or reconditioning or reversal training, neural mechanisms, and finally, the potential clinical relevance of the research area related to the drug. We focus on key outcomes, delve into methodical issues, identify gaps in current knowledge, and suggest future research directions.

Cocaine-induced plasticity, motivation, and cue responsivity do not differ in obesity-prone vs obesity-resistant rats; implications for food addiction

RATIONALE

Compared to obesity-resistant rats, obesity-prone rats consume more food, work harder to obtain food, show greater motivational responses to food-cues, and show greater striatal plasticity in response to eating sugary/fatty foods. Therefore, it is possible that obesity-prone rats may also be more sensitive to the motivational properties of cocaine and cocaine-paired cues, and to plasticity induced by cocaine.

OBJECTIVE

To examine baseline differences in motivation for cocaine and effects of intermittent access (IntA) cocaine self-administration on cocaine motivation, neurobehavioral responsivity to cocaine-paired cues, and locomotor sensitization in male obesity-prone vs obesity-resistant rats.

METHODS

Intravenous cocaine self-administration was used to examine drug-taking and drug-seeking in males. Motivation for cocaine was measured using a within session threshold procedure. Cue-induced c-Fos expression in mesocorticolimbic regions was measured.

RESULTS

Drug-taking and drug-seeking, cue-induced c-Fos, locomotor sensitization, and preferred level of cocaine consumption (Q0) were similar between obesity-prone and obesity-resistant groups. Maximal responding during demand testing (Rmax) was lower in obesity-prone rats. IntA experience enhanced motivation for cocaine (Pmax) in obesity-prone rats.

CONCLUSIONS

The results do not support robust inherent differences in motivation for cocaine, cue-induced cocaine seeking, or neurobehavioral plasticity induced by IntA in obesity-prone vs obesity-resistant rats. This contrasts with previously established differences seen for food and food cues in these populations and shows that inherent enhancements in motivation for food and food-paired cues do not necessarily transfer to drugs and drug-paired cues.

Distinctive Neuroanatomic Regions Involved in Cocaine-Induced Behavioral Sensitization in Mice

The present study aimed to characterize the phenomenon of behavioral sensitization to cocaine and to identify neuroanatomical structures involved in the induction and expression phases of this phenomenon. For this, in experiment 1 (induction phase), mice were treated with saline or cocaine every second day for 15 days (conditioning period), in the open-field or in their home-cages. In experiment 2 (expression phase), the same protocol was followed, except that after the conditioning period the animals were not manipulated for 10 days, and after this interval, animals were challenged with cocaine. Neuroanatomical structures involved in the induction and expression phases were identified by stereological quantification of c-Fos staining in the dorsomedial prefrontal cortex (dmPFC), nucleus accumbens core (NAc core and shell (NAc shell), basolateral amygdala (BLA), and ventral tegmental area (VTA). Neuroanatomical analysis indicated that in the induction phase, cocaine-conditioned animals had higher expression of c-Fos in the dmPFC, NAc core, BLA, and VTA, whereas in the expression phase, almost all areas had higher expression except for the VTA. Therefore, environmental context plays a major role in the induction and expression of behavioral sensitization, although not all structures that compose the mesolimbic system contribute to this phenomenon.

Dorsolateral caudate nucleus differentiates cocaine from natural reward-associated contextual cues

Chronic drug administration induces neuroplastic changes within brain circuits regulating cognitive control and/or emotions. Following repeated pairings between drug intake and environmental cues, increased sensitivity to or salience of these contextual cues provoke conscious or unconscious craving and enhance susceptibility to relapse. To explore brain circuits participating in such experience-induced plasticity, we combined functional MRI with a preclinical drug vs. food self-administration (SA) withdrawal model. Specifically, two groups of rats were trained to associate odor cues with the availability of i.v. cocaine or oral sucrose, respectively. After 20 d of cocaine or sucrose SA followed by prolonged (30 d) forced abstinence, animals were presented with odor cues previously associated with or without (S+/S-) reinforcer (cocaine/sucrose) availability while undergoing functional MRI scans. ANOVA results demonstrate that a learning effect distinguishing S+ from S- was seen in the insula and nucleus accumbens, with the insula response reflecting the individual history of cocaine SA intake. A main effect of group, distinguishing cocaine from sucrose, was seen in the medial prefrontal cortex (infralimbic, prelimbic, and cingulate cortex) and dorsolateral striatum. Critically, only the dorsomedial striatum demonstrated a double dissociation between the two SA groups and learning (S+ vs. S-). These findings demonstrate altered cortico-limbic-striatal reward-related processing to learned, environment reward-associated contextual odor cues, which may serve as potential biomarkers for therapeutic interventions.

Cue-induced conditioned activity does not incubate but is mediated by the basolateral amygdala

Re-exposure to drug-associated cues causes significant drug craving in recovering addicts, which may precipitate relapse. In animal models of craving, drug-seeking responses for contingent delivery of drug-associated cues sensitizes or "incubates" across drug withdrawal. To date there is limited evidence supporting an incubation effect for behaviors mediated by non-contingent presentation of drug-associated cues. Here we used a model of cue-induced conditioned activity to determine if the conditioned locomotor response to a non-contingent presentation of a drug-associated cue sensitizes across drug withdrawal. In addition, because cue-induced drug-seeking responses are mediated by the rostral basolateral amygdala (BLA), we investigated whether this structure is critical for the expression of cue-induced conditioned activity. A conditioned association between cocaine (15mg/kg) and a compound discrete cue (flashing bicycle light+a metronome) was established over 12 conditioning sessions in male Sprague-Dawley rats. In experiment 1, cue-induced conditioned activity was assessed on 3 occasions: 3, 14 and 28days following the final drug-cue conditioning session. Cocaine-conditioned rats demonstrated reliable cue-induced conditioned activity across all 3 test sessions, however there was no evidence of an incubation effect. To determine whether repeated testing prevented the observation of an incubation effect, rats in experiment 2 were tested either 3days or 28days following conditioning; again no incubation effect was observed. In experiment 3, either saline or the GABAA receptor agonist muscimol was infused prior to testing. Intra-BLA infusions of muscimol prevented the expression of cue-induced conditioned activity. These data support the role of the rBLA in mediating conditioned responses to drug-associated cues. The failure to observe an incubation effect for cue-induced conditioned activity may point to a fundamental difference in the manner by which contingent and non-contingent presentations of drug-associated cues influence behavior.

5-HT(2A) receptor blockade and 5-HT(2C) receptor activation interact to reduce cocaine hyperlocomotion and Fos protein expression in the caudate-putamen

Both the 5-HT(2A) receptor (R) antagonist M100907 and the 5-HT(2C) R agonist MK212 attenuate cocaine-induced dopamine release and hyperlocomotion. This study examined whether these drugs interact to reduce cocaine hyperlocomotion and Fos expression in the striatum and prefrontal cortex. We first determined from dose-effect functions a low dose of both M100907 and MK212 that failed to alter cocaine (15 mg/kg, i.p.) hyperlocomotion. Subsequently, we examined whether these subthreshold doses given together would attenuate cocaine hyperlocomotion, consistent with a 5-HT(2A)/5-HT(2C) R interaction. Separate groups of rats received two sequential drug injections 5 min apart immediately before a 1-h locomotion test as follows: (1) saline + saline, (2) saline + cocaine, (3) 0.025 mg/kg M100907 + cocaine, (4) 0.125 mg/kg MK212 + cocaine, or (5) cocktail combination of 0.025 mg/kg M100907 and 0.125 mg/kg MK212 + cocaine. Brains were extracted for Fos immunohistochemistry 90 min after the second injection. We next examined the effects of 0.025 mg/kg M100907 and 0.125 mg/kg MK212, alone and in combination, on spontaneous locomotor activity. While neither drug given alone produced any effects, the M100907/MK212 cocktail attenuated cocaine hyperlocomotion as well as cocaine-induced Fos expression in the dorsolateral caudate-putamen (CPu), but had no effect on spontaneous locomotion. The findings suggest that 5-HT(2A) Rs and 5-HT(2C) Rs interact to attenuate cocaine hyperlocomotion and Fos expression in the CPu, and that the CPu is a potential locus of the interactive effects between these 5-HT(2) R subtypes on behavior. Further research investigating combined 5-HT(2A) R antagonism and 5-HT(2C) R agonism as a treatment for cocaine dependence is warranted.

Novel cues reinstate cocaine-seeking behavior and induce Fos protein expression as effectively as conditioned cues

Cue reinstatement of extinguished cocaine-seeking behavior is a widely used model of cue-elicited craving in abstinent human addicts. This study examined Fos protein expression in response to cocaine cues or to novel cues as a control for activation produced by test novelty. Rats were trained to self-administer cocaine paired with either a light or a tone cue, or received yoked saline and cue presentations, and then underwent daily extinction training. They were then tested for reinstatement of extinguished cocaine-seeking behavior elicited by response-contingent presentations of either the cocaine-paired cue or a novel cue (that is, tone for those trained with a light or vice versa). Surprisingly, conditioned and novel cues both reinstated responding and increased Fos similarly in most brain regions. Exceptions included the anterior cingulate, which was sensitive to test cue modality in saline controls and the dorsomedial caudate-putamen, where Fos was correlated with responding in the novel, but not conditioned, cue groups. In subsequent experiments, we observed a similar pattern of reinstatement in rats trained and tested for sucrose-seeking behavior, whereas rats trained and tested with the cues only reinstated to a novel, and not a familiar, light or tone. The results suggest that novel cues reinstate responding to a similar extent as conditioned cues regardless of whether animals have a reinforcement history with cocaine or sucrose, and that both types of cues activate similar brain circuits. Several explanations as to why converging processes may drive drug and novel cue reinforcement and seeking behavior are discussed.

Environmental living conditions introduced during forced abstinence alter cocaine-seeking behavior and Fos protein expression

Environmental enrichment (EE) introduced during abstinence from cocaine self-administration is protective in reducing cue-elicited incentive motivation for cocaine in rats. This study examined neural activation associated with this protective effect of EE using Fos protein expression as a marker. Rats were trained to press a lever reinforced by cocaine (0.75 mg/kg/0.1 mL infusion) and light and tone cues across 15 consecutive days during which they were all housed in isolated conditions (IC). Rats were then assigned to either remain in IC, or to live in pair-housed conditions (PC) or EE for 30 days of forced abstinence from cocaine. Subsequently, cocaine-seeking behavior (lever presses without cocaine reinforcement) elicited by response-contingent cue presentations was assessed for 90 min, after which the rats' brains were immediately harvested for Fos protein immunohistochemistry. EE attenuated, whereas IC enhanced, cue-elicited cocaine-seeking behavior relative to PC. Also, within the prelimbic and orbitofrontal cortices and basolateral amygdala, IC enhanced, whereas EE reduced, Fos expression relative to PC. Furthermore, EE attenuated Fos expression in the infralimbic and anterior cingulate cortices, the nucleus accumbens (core and shell), bed nucleus of the stria terminalis, and ventral tegmental area, evident as a reduction relative to both PC and IC. In contrast, IC enhanced Fos expression in the dorsal caudate putamen, substantia nigra, and central amygdala, evident as an increase relative to both PC and EE. These results suggest that EE blunts neural activation throughout the mesocorticolimbic circuitry involved in cue-elicited incentive motivation for cocaine, whereas IC enhances activation primarily within the nigrostriatal dopamine pathway. These findings have important implications for understanding and treating drug-conditioned craving in humans.

c-Fos expression associated with reinstatement of cocaine-seeking behavior by response-contingent conditioned cues

The capability of cocaine cues to generate craving in cocaine-dependent humans, even after extended abstinence, is modeled in rats using cue reinstatement of extinguished cocaine-seeking behavior. We investigated neural activity associated with incentive motivational effects of cocaine cues using c-fos mRNA and Fos protein expression as markers. Unlike preceding studies, we used response-contingent presentation of discrete cues to elicit cocaine seeking. Rats were first trained to press a lever, resulting in cocaine reinforcement and light and tone cues. Rats then underwent extinction training, during which lever presses decreased. On the test day, rats either received response-contingent cocaine cues or received no cues. The cues reinstated extinguished cocaine-seeking behavior on the test day. In general, cue-elicited c-fos mRNA and protein expression were similar and both were enhanced in the prefrontal cortex, ventral tegmental area (VTA), dorsal striatum, and nucleus accumbens. Cues elicited more widespread Fos protein expression relative to our previous research in which cues were presented noncontingently without prior extinction training, including increases in the VTA, substantia nigra, ventral subiculum, and lateral entorhinal cortex. We also observed a correlation between cocaine-seeking behavior and Fos in the agranular insula (AgI) and basolateral amygdala (BLA). The findings suggest that connections between BLA and AgI play a role in cue-elicited incentive motivation for cocaine and that reinstatement of cocaine seeking by response-contingent cues activates a similar corticolimbic circuit as that observed with other modes of cue presentation; however, activation of midbrain and ventral hippocampal regions may be unique to reinstatement by response-contingent cues.

Context-specific sensitization of cocaine-induced locomotor activity and associated neuronal ensembles in rat nucleus accumbens

Repeated cocaine administration to rats outside their home cage induces behavioral sensitization that is strongly modulated by the drug administration environment. We hypothesized that stimuli in the drug administration environment activate specific sets of striatal neurons, called neuronal ensembles, for further cocaine-enhanced activation, and that repeated activation of these neuronal ensembles underlies context-specific sensitization. In the present study, we repeatedly administered cocaine or saline to rats on alternate days in two distinct environments outside the home cage, one paired with cocaine and the other with saline. On test day, cocaine challenge injections in the cocaine-paired environment produced strongly enhanced levels of locomotor activity, while cocaine challenge injections in the saline-paired environment did not. The corresponding record of past neuronal activation in nucleus accumbens and caudate-putamen during repeated drug administration was assessed using FosB immunohistochemistry, while acute neuronal activation on test day was assessed using c-fos in situ hybridization. Although only 2% of striatal neurons were FosB labeled, 87% of these FosB-labeled neurons were co-labeled with c-fos when cocaine was injected in the cocaine-paired environment. The degree of co-labeling was significantly less following cocaine or saline challenge injections in the saline-paired environment. Furthermore, the total number of c-fos-labeled neurons was greater with either cocaine or saline challenge injections in the cocaine-paired environment than in the saline-paired environment. These findings demonstrate that the drug administration environment partly determines which striatal neuronal ensembles are activated, and to what extent, following context-specific sensitization to cocaine.

Cocaine withdrawal enhances long-term potentiation induced by corticotropin-releasing factor at central amygdala glutamatergic synapses via CRF1, NMDA receptors and PKA

Cocaine addiction is an enduring, relapsing, behavioural disorder in which stressors reinstate cocaine-seeking even after prolonged abstinence. Evidence suggests that the 'anxiety-like' behaviour and stress associated with protracted withdrawal may be mediated by increased corticotropin-releasing factor (CRF) in the central nucleus of the amygdala (CeA), a part of the limbic circuitry engaged in the coding and transmission of stimulus-reward associations. In the present study we describe a long-lasting potentiation of glutamatergic transmission induced at lateral amygdala (LA)-to-CeA synapses by rat/human CRF. After 2 weeks of withdrawal from repeated intermittent exposure to cocaine, CRF-induced long-term potentiation (LTP) was greatly enhanced compared to the respective saline control group while, after short-term withdrawal (24 h), there was no significant difference between the two treatment groups, indicating alterations in CRF systems during protracted withdrawal from chronic cocaine. After prolonged withdrawal, CRF-induced LTP was dependent on activation of CRF2, CaV2.3 (R-type) calcium channels and intracellular signalling through protein kinase C in both saline- and cocaine-treated groups. The enhanced CRF-induced LTP after 2 weeks of withdrawal was mediated through augmented CRF1 receptor function, associated with an increased signalling through protein kinase A, and required N-methyl-D-aspartate (NMDA) receptors. Accordingly, single-cell recordings revealed a significantly increased NMDA/AMPA ratio after prolonged withdrawal from the cocaine treatment. These results support a role for CRF1 receptor antagonists as plausible treatment options during withdrawal from chronic cocaine and suggest Ca(V)2.3 blockers as potential candidates for pharmaceutical modulation of CRF systems.

6-Hydroxydopamine lesions of nucleus accumbens core abolish amphetamine-induced conditioned activity

Environmental cues associated with drug experiences appear to play a critical role in drug dependence. We have previously reported that dopamine-depleting lesions of the nucleus accumbens medial shell inhibit amphetamine-conditioned place preference. Here, we examined the effects of analogous lesions on amphetamine-conditioned locomotor activity. Bilateral core, but not medial shell, lesions attenuated unconditioned locomotion and abolished the conditioned locomotor response. Taken with our previous results, these findings confirm a role for accumbens core in amphetamine-induced locomotor activity and suggest that the role of medial shell DA transmission in conditioned place preference is related to reward processing rather than conditioning in general.

Serotonin2C receptors (5-HT2C R) control expression of cocaine-induced conditioned hyperactivity

Environmental cues can become classically conditioned to cocaine exposure and are known to contribute to drug craving and relapse in addicts. The 5-HT2C receptor (5-HT2C R) has been shown to control the behavioral effects of acute cocaine administration and, in the present study, we investigated the role of this receptor in the expression of cocaine-induced conditioned hyperactivity. Rats received repeated pairings of a distinct test environment with either saline or cocaine (15 mg/kg, i.p.) for 7 days. In a drug-free test 2 days after the last pairing, expression of conditioned hyperactivity was seen in the rats previously exposed to cocaine in the test environment. The 5-HT2C R agonist MK 212 (0.0625-0.5 mg/kg, i.p., 5 min before test) significantly decreased, while the 5-HT2C R antagonist SB 242084 (0.5-1 mg/kg, i.p. 30 min prior to test) enhanced, expression of cocaine-induced conditioned hyperactivity. The effective doses of MK 212 and SB 242084 did not alter basal activity on the test session. These results suggest that the 5-HT2C R controls expression of cocaine-induced conditioned hyperactivity and suggest that such ligands may be useful in preventing relapse and promoting abstinence in cocaine-dependent individuals.

Characterization of the rapid-onset type of behavioral sensitization to amphetamine in mice: role of drug-environment conditioning

A rapid-onset type of behavioral sensitization (ROBS) has been demonstrated in rats treated with a single 'priming' injection of amphetamine (AMP). In that species, however, this phenomenon was restricted to AMP-induced stereotyped behavior (SB), not occurring for the locomotor-stimulant effect (LSE) of AMP and not reflecting environment-specific sensitization. In the present study, the ROBS was characterized in the mouse. Mice received a single 'priming' intraperitoneal injection of 5.0 mg/kg AMP which was paired or not with environment. At different intervals (3, 4 or 5 h) subgroups were tested for AMP (1.5 or 5.0 mg/kg)-induced SB or AMP (1.5 mg/kg)-induced open-field LSE. Results showed that: (1) in the absence of drug-environment association, a priming injection of AMP increased the SB induced by a 1.5 mg/kg AMP challenge injection given 3 h (but not 4 or 5 h) later; (2) when the dose of AMP challenge injection was increased to 5.0 mg/kg, an enhancement of SB was verified at all the intervals tested (3, 4, and 5 h); (3) when animals were tested in an open field, the priming injection of AMP produced an increase in the LSE of a 1.5 mg/kg AMP challenge injection, given 4 h later; (4) drug-environment association increased both SB and locomotion after a saline challenge injection and potentiated the rapid-onset sensitization of both behaviors in AMP-challenged mice. Collectively, these results demonstrate that the ROBS phenomenon also occurs in mice, is extended to AMP-induced LSE, and is markedly potentiated by (but does not depend on) environmental conditioning.

Memory and addiction: shared neural circuitry and molecular mechanisms

An important conceptual advance in the past decade has been the understanding that the process of drug addiction shares striking commonalities with neural plasticity associated with natural reward learning and memory. Basic mechanisms involving dopamine, glutamate, and their intracellular and genomic targets have been the focus of attention in this research area. These two neurotransmitter systems, widely distributed in many regions of cortex, limbic system, and basal ganglia, appear to play a key integrative role in motivation, learning, and memory, thus modulating adaptive behavior. However, many drugs of abuse exert their primary effects precisely on these pathways and are able to induce enduring cellular alterations in motivational networks, thus leading to maladaptive behaviors. Current theories and research on this topic are reviewed from an integrative systems perspective, with special emphasis on cellular, molecular, and behavioral aspects of dopamine D-1 and glutamate NMDA signaling, instrumental learning, and drug cue conditioning.

Baclofen attenuates conditioned locomotion to cues associated with cocaine administration and stabilizes extracellular glutamate levels in rat nucleus accumbens

We have used cocaine-conditioned locomotion in rats as an animal model for cocaine-conditioned responses that contribute to drug craving and relapse in human addicts. The purpose of the present study was to examine the ability of the GABA(B) agonist, baclofen, to attenuate such associative responses. First, experiments were conducted to identify a dose range of baclofen that did not impede exploratory or spontaneous behavior. This dose range was used during testing for conditioned locomotion specific to a flashing light and metronome, which were previously associated with administration of cocaine (PAIRED group) or saline (UNPAIRED group). At 2.0 mg/kg, baclofen attenuated conditioned locomotion in PAIRED subjects to the level of UNPAIRED subjects receiving saline or 2.0 mg/kg baclofen. Considering the importance of glutamate transmission in the nucleus accumbens (NAc) during associative responses to reward-related stimuli, the effect of baclofen on extracellular levels of glutamate in the NAc was tested with microdialysis. Baclofen (2.0 mg/kg) did not alter basal glutamate levels. However, baclofen pretreatment prevented the predatory odor, 2,5-dihydro-2,4,5-trimethylthiazoline, from increasing glutamate levels. This is the first report of baclofen modulating extracellular levels of glutamate in the NAc. Baclofen may prove to have general utility for suppressing stimulus-evoked increases in NAc glutamate levels. This could explain its ability to prevent cocaine-conditioned responses. In summary, our results suggest that enhancing GABA(B) transmission inhibits cocaine-conditioned responses, possibly by suppressing glutamate transmission in the NAc. A better understanding of interactions between GABA and glutamate transmission in the NAc may lead to the development of pharmacotherapies for cocaine craving.

Compartment-specific changes in striatal neuronal activity during expression of amphetamine sensitization are the result of drug hypersensitivity

Repeated exposure to drugs of abuse induces behavioural sensitization, i.e. a persistent hypersensitivity to the psychomotor stimulant effects of these drugs. This may be the result of increased responsiveness, to drugs, of mesostriatal dopamine systems and their projections, but it has also been suggested that acute and sensitized behavioural responses to psychostimulant drugs involve activation of distinct neuronal circuits. In order to distinguish between these possibilities, we studied amphetamine-induced c-fos immunoreactivity in subregions of rat striatum (patch and matrix compartments of caudate-putamen and nucleus accumbens core and shell) in drug-naive rats, as well as during long-term expression of amphetamine sensitization. We found that, in sensitized animals, amphetamine (1.0 mg/kg) evoked an increase in the ratio of c-fos-immunopositive cells in striatal patch and matrix compartments, suggesting a preferential involvement of striatal patches in the sensitized response to amphetamine. In drug-naive rats, amphetamine (0.5-5.0 mg/kg) dose-dependently increased c-fos expression in all striatal subregions. Remarkably, the highest dose of amphetamine also evoked an increase in patch : matrix ratio of c-fos immunoreactivity. In nucleus accumbens core and shell of amphetamine- and saline-pretreated animals, amphetamine (1.0 mg/kg) evoked comparable increases in c-fos expression. These data indicate that distinct striatal compartments display a differential sensitivity to amphetamine in both drug-naive and amphetamine-sensitized animals. In addition, they suggest that the shift in amphetamine-induced c-fos expression from striatal matrix to patches in sensitized animals is the consequence of a change in the sensitivity to amphetamine, rather than a long-term circuitry reorganization that is exclusive to the sensitized state.