The acquisition of responding with conditioned reinforcement: effects of cocaine, (+)-amphetamine and pipradrol

Targeting Nr2e3 to Modulate Tet2 Expression: Therapeutic Potential for Depression Treatment

Epigenetic mechanisms such as DNA methylation and hydroxymethylation play a significant role in depression. This research has shown that Ten-eleven translocation 2 (Tet2) deficiency prompts depression-like behaviors, but Tet2's transcriptional regulation remains unclear. In the study, bioinformatics is used to identify nuclear receptor subfamily 2 group E member 3 (Nr2e3) as a potential Tet2 regulator. Nr2e3 is found to enhance Tet2's transcriptional activity by binding to its promoter region. Nr2e3 knockdown in mouse hippocampus leads to reduced Tet2 expression, depression-like behaviors, decreased hydroxymethylation of synaptic genes, and downregulation of synaptic proteins like postsynaptic density 95 KDa (PSD95) and N-methy-d-aspartate receptor 1 (NMDAR1). Fewer dendritic spines are also observed. Nr2e3 thus appears to play an antidepressant role under stress. In search of potential treatments, small molecule compounds to increase Nr2e3 expression are screened. Azacyclonal (AZA) is found to enhance the Nr2e3/Tet2 pathway and exhibited antidepressant effects in stressed mice, increasing PSD95 and NMDAR1 expression and dendritic spine density. This study illuminates Tet2's upstream regulatory mechanism, providing a new target for identifying early depression biomarkers and developing treatments.

Anticipation: An Essential Feature of Anhedonia

The following essay addresses the evolution of the term "anhedonia" as a key construct in biological psychiatry, especially as it pertains to positive emotional and motivational states central to mental health and well-being. In its strictest definition, anhedonia was intended to convey an inability to experience "pleasure" derived from ingestion of sweet tastes or the experience of pleasant odors and tactile sensations, among a host of positive sensations. However, this definition has proved to be too restrictive to capture the complexity of key psychological factors linked to major depression, schizophrenia, and substance use disorders it was originally intended to address. Despite the appeal of the elegant simplicity of the term anhedonia, its limitations soon became apparent when used to explain psychological constructs including aspects of learning, memory, and incentive motivation that are major determinants of success in securing the necessities of life. Accordingly, the definition of anhedonia has morphed into a much broader term that includes key roles in the disturbance of motivation in the form of anergia, impaired incentive motivation, along with deficits in associative learning and key aspects of memory, on which the ability to predict the consequences of one's actions are based. Here we argue that it is this latter capacity, namely predicting the likely consequences of motivated behavior, which can be termed "anticipation," that is especially important in the key deficits implied by the general term anhedonia in the context of neuropsychiatric conditions.

The pharmacological stressor yohimbine, but not U50,488, increases responding for conditioned reinforcers paired with ethanol or sucrose

RATIONALE

Environmental stimuli paired with alcohol can function as conditioned reinforcers (CRfs) and trigger relapse to alcohol-seeking. In animal models, pharmacological stressors can enhance alcohol consumption and reinstate alcohol-seeking, but it is unknown whether stress can potentiate the conditioned reinforcing properties of alcohol-paired stimuli.

OBJECTIVES

We examined whether the pharmacological stressors, the α-2 adrenoreceptor antagonist yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) and the K-opioid receptor agonist U50,488 (vehicle, 1.25, 2.5 mg/kg; SC), increase responding for conditioned reinforcement, and if their effects interact with the nature of the reward (alcohol vs. sucrose). We subsequently examined the effects of yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) on responding for sensory reinforcement.

METHODS

Male Long-Evans underwent Pavlovian conditioning, wherein a tone-light conditioned stimulus (CS) was repeatedly paired with 12% EtOH or 21.7% sucrose. Next, tests of responding for a CRf were conducted. Responding on the CRf lever delivered the CS, whereas responding on the other lever had no consequences. In a separate cohort of rats, the effects of yohimbine on responding just for the sensory reinforcer were examined.

RESULTS

Both doses of yohimbine, but not U50,488, increased responding for conditioned reinforcement. This enhancement occurred independently of the nature of the reward used during Pavlovian conditioning. Yohimbine-enhanced responding for a CRf was reproducible and stable over five tests; it even persisted when the CS was omitted. Both doses of yohimbine also increased responding for sensory reinforcement.

CONCLUSIONS

Yohimbine increases operant responding for a variety of sensory and conditioned reinforcers. This enhancement may be independent of its stress-like effects.

Activation of Dopamine D1-D2 Receptor Complex Attenuates Cocaine Reward and Reinstatement of Cocaine-Seeking through Inhibition of DARPP-32, ERK, and ΔFosB

A significant subpopulation of neurons in rat nucleus accumbens (NAc) coexpress dopamine D1 and D2 receptors, which can form a D1-D2 receptor complex, but their relevance in addiction is not known. The existence of the D1-D2 heteromer in the striatum of rat and monkey was established using in situ PLA, in situ FRET and co-immunoprecipitation. In rat, D1-D2 receptor heteromer activation led to place aversion and abolished cocaine CPP and locomotor sensitization, cocaine intravenous self-administration and reinstatement of cocaine seeking, as well as inhibited sucrose preference and abolished the motivation to seek palatable food. Selective disruption of this heteromer by a specific interfering peptide induced reward-like effects and enhanced the above cocaine-induced effects, including at a subthreshold dose of cocaine. The D1-D2 heteromer activated Cdk5/Thr75-DARPP-32 and attenuated cocaine-induced pERK and ΔFosB accumulation, together with inhibition of cocaine-enhanced local field potentials in NAc, blocking thus the signaling pathway activated by cocaine: D1R/cAMP/PKA/Thr34-DARPP-32/pERK with ΔFosB accumulation. In conclusion, our results show that the D1-D2 heteromer exerted tonic inhibitory control of basal natural and cocaine reward, and therefore initiates a fundamental physiologic function that limits the liability to develop cocaine addiction.

Stimuli previously associated with reinforcement mitigate resurgence

Resurgence refers to the recurrence of an extinguished target behavior following subsequent suspension of alternative reinforcement. Delivery of reinforcers during extinction of alternative behavior has been shown to mitigate resurgence. The present experiment aimed to determine whether delivering stimuli associated with reinforcers during resurgence testing similarly mitigates resurgence. Three groups of rats pressed target levers for food according to variable-interval 15-s schedules during Phase 1. In Phase 2, lever pressing was extinguished, and an alternative nose-poke response produced alternative reinforcement according to a variable-interval 15-s schedule. Food reinforcement was always associated with illumination of the food aperture and an audible click from the pellet dispenser during Phases 1 and 2. Phase 3 treatments differed between groups. For one group, nose poking continued to produce food and food-correlated stimuli. Both of these consequences were suspended for a second group. Finally, nose poking produced food-correlated stimuli but not food for a third group. Target-lever pressing resurged in the group that received no consequences and in the group that received only food-correlated stimuli for nose poking. Resurgence, however, was smaller for the group that received food-correlated stimuli than for the group that received no consequences for nose poking. Target-lever pressing did not increase between phases in the group that continued to receive food and associated stimuli. Thus, delivery of stimuli associated with food reinforcement after suspension of food reduced but did not eliminate resurgence of extinguished lever pressing. These findings contribute to potential methodologies for preventing relapse of extinguished problem behavior in clinical settings.

Examining the reinforcement-enhancement effects of phencyclidine and its interactions with nicotine on lever-pressing for a visual stimulus

Nicotine is a widely-abused drug, yet its primary reinforcing effect does not seem potent as other stimulants such as cocaine. Recent research on the contributing factors toward chronic use of nicotine-containing products has implicated the role of reinforcement-enhancing effects of nicotine. The present study investigates whether phencyclidine (PCP) may also possess a reinforcement-enhancement effect and how this may interact with the reinforcement-enhancement effect of nicotine. PCP was tested for two reasons: (1) it produces discrepant results on overall reward, similar to that seen with nicotine and (2) it may elucidate how other compounds may interact with the reinforcement-enhancement of nicotine. Adult male Sprague-Dawley rats were trained to lever press for brief visual stimulus presentations under fixed-ratio (FR) schedules of reinforcement and then were tested with nicotine (0.2 or 0.4 mg/kg) and/or PCP (2.0mg/kg) over six increasing FR values. A selective increase in active lever-pressing for the visual stimulus with drug treatment was considered evidence of a reinforcement-enhancement effect. PCP and nicotine separately increased active lever pressing for a visual stimulus in a dose-dependent manner and across the different FR schedules. The addition of PCP to nicotine did not increase lever-pressing for the visual stimulus, possibly due to a ceiling effect. The effect of PCP may be driven largely by its locomotor stimulant effects, whereas the effect of nicotine was independent of locomotor stimulation. This dissociation emphasizes that distinct pharmacological properties contribute to the reinforcement-enhancement effects of substances.

Behavioral mechanisms underlying nicotine reinforcement

Cigarette smoking is the leading cause of preventable deaths worldwide, and nicotine, the primary psychoactive constituent in tobacco, drives sustained use. The behavioral actions of nicotine are complex and extend well beyond the actions of the drug as a primary reinforcer. Stimuli that are consistently paired with nicotine can, through associative learning, take on reinforcing properties as conditioned stimuli. These conditioned stimuli can then impact the rate and probability of behavior and even function as conditioning reinforcers that maintain behavior in the absence of nicotine. Nicotine can also act as a conditioned stimulus (CS), predicting the delivery of other reinforcers, which may allow nicotine to acquire value as a conditioned reinforcer. These associative effects, establishing non-nicotine stimuli as conditioned stimuli with discriminative stimulus and conditioned reinforcing properties as well as establishing nicotine as a CS, are predicted by basic conditioning principles. However, nicotine can also act non-associatively. Nicotine directly enhances the reinforcing efficacy of other reinforcing stimuli in the environment, an effect that does not require a temporal or predictive relationship between nicotine and either the stimulus or the behavior. Hence, the reinforcing actions of nicotine stem both from the primary reinforcing actions of the drug (and the subsequent associative learning effects) as well as the reinforcement enhancement action of nicotine which is non-associative in nature. Gaining a better understanding of how nicotine impacts behavior will allow for maximally effective tobacco control efforts aimed at reducing the harm associated with tobacco use by reducing and/or treating its addictiveness.

The form of a conditioned stimulus can influence the degree to which it acquires incentive motivational properties

There is considerable individual variation in the extent to which food- and drug-associated cues (conditioned stimuli, CSs) acquire incentive salience, as indicated by whether they elicit approach towards them, and/or act as conditioned reinforcers. Here we asked whether this variation is influenced by properties of the CS itself. In rats, we assessed both the attractiveness and conditioned reinforcing properties of two CSs: a manipulable lever CS versus an auditory (tone) CS. There was considerable individual variation in the extent to which a lever CS acquired incentive motivational properties, as indicated by whether it became attractive (evoked a sign-tracking or goal-tracking conditioned response) or acted as a conditioned reinforcer. However, with a tone CS all rats learned a goal-tracking response, and the tone CS was an equally effective conditioned reinforcer in sign-trackers and goal-trackers. Even when presented in compound (a lever-tone CS), the two elements of the compound differentially acquired motivational properties. In contrast, amphetamine and stress potentiated the conditioned reinforcing properties of both visual and auditory CSs similarly in rats that primarily sign-tracked or goal-tracked. We conclude that variation in the to the ability of CSs to acquire incentive salience, and thus their ability to act as incentive stimuli capable of motivating behavior, is determined in part by properties of the CS itself.

On the motivational properties of reward cues: Individual differences

Cues associated with rewards, such as food or drugs of abuse, can themselves acquire motivational properties. Acting as incentive stimuli, such cues can exert powerful control over motivated behavior, and in the case of cues associated with drugs, they can goad continued drug-seeking behavior and relapse. However, recent studies reviewed here suggest that there are large individual differences in the extent to which food and drug cues are attributed with incentive salience. Rats prone to approach reward cues (sign-trackers) attribute greater motivational value to discrete localizable cues and interoceptive cues than do rats less prone to approach reward cues (goal-trackers). In contrast, contextual cues appear to exert greater control over motivated behavior in goal-trackers than sign-trackers. It is possible to predict, therefore, before any experience with drugs, in which animals specific classes of drug cues will most likely reinstate drug-seeking behavior. The finding that different individuals may be sensitive to different triggers capable of motivating behavior and producing relapse suggests there may be different pathways to addiction, and has implications for thinking about individualized treatment. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Effects of novelty and methamphetamine on conditioned and sensory reinforcement

BACKGROUND

Light onset can be both a sensory reinforcer (SR) with intrinsic reinforcing properties, and a conditioned reinforcer (CR) which predicts a biologically important reinforcer. Stimulant drugs, such as methamphetamine (METH), may increase the reinforcing effectiveness of CRs by enhancing the predictive properties of the CR. In contrast, METH-induced increases in the reinforcing effectiveness of SRs, are mediated by the immediate sensory consequences of the light.

METHODS

The effects of novelty (on SRs) and METH (on both CRs and SRs) were tested. Experiment 1: rats were pre-exposed to 5 s light and water pairings presented according to a variable-time (VT) 2 min schedule or unpaired water and light presented according to independent, concurrent VT 2 min schedules. Experiment 2: rats were pre-exposed to 5 s light presented according to a VT 2 min schedule, or no stimuli. In both experiments, the pre-exposure phase was followed by a test phase in which 5 s light onset was made response-contingent on a variable-interval (VI) 2 min schedule and the effects of METH (0.5 mg/kg) were determined.

RESULTS

Novel light onset was a more effective reinforcer than familiar light onset. METH increased the absolute rate of responding without increasing the relative frequency of responding for both CRs and SRs.

CONCLUSION

Novelty plays a role in determining the reinforcing effectiveness of SRs. The results are consistent with the interpretation that METH-induced increases in reinforcer effectiveness of CRs and SRs may be mediated by immediate sensory consequences, rather than prediction.

Effects of pramipexole on the reinforcing effectiveness of stimuli that were previously paired with cocaine reinforcement in rats

RATIONALE

Dopamine D(2)-like agonists maintain responding when substituted for cocaine in laboratory animals. However, these effects appear to be mediated by an interaction with stimuli that were previously paired with cocaine reinforcement (CS).

OBJECTIVES

To evaluate the extent to which the pramipexole-maintained and pramipexole-induced responding are influenced by cocaine-paired stimuli.

METHODS

Rats were trained to nosepoke for cocaine under fixed ratio 1 (FR1) or progressive ratio (PR) schedules of reinforcement. In FR1-trained rats, pramipexole was substituted for cocaine with injections either paired with CSs, or delivered in their absence. The capacity of experimenter-administered pramipexole to induce FR1 and PR responding for CS presentation was evaluated. The effects of altering stimulus conditions, as well as pretreatments with D(2)- (L: -741,626) and D(3)-preferring (PG01037) antagonists on pramipexole-induced PR responding were also evaluated.

RESULTS

When substituted for cocaine, pramipexole maintained responding at high rates when injections were paired with CSs, but low rates when CSs were omitted. Similarly, experimenter-administered pramipexole induced dose-dependent increases in FR1 or PR responding, with high rates of responding observed when the CS was presented, and low rates of responding when CS presentation was omitted. D(2) and D(3) antagonists differentially affected pramipexole-induced PR responding, with L: -741,626 and PG01037 producing rightward, and downward shifts in the dose-response curve for CS-maintained responding, respectively.

CONCLUSIONS

These data indicate that pramipexole is capable of enhancing the reinforcing effectiveness of conditioned stimuli, and raise the possibility that similar mechanisms are responsible for the increased occurrence of impulse control disorders in patients being treated with pramipexole.

Individual variation in the motivational properties of cocaine

Cues in the environment associated with drug use draw the attention of addicts, elicit approach, and motivate drug-seeking and drug-taking behavior, making abstinence difficult. However, preclinical studies have identified large individual differences in the extent to which reward cues acquire these incentive motivational properties. For example, only in some rats does a spatially discrete food cue become attractive, eliciting approach and engagement with it, and acts as an effective conditioned reinforcer. Moreover, a discrete cocaine cue also acquires greater motivational control over behavior in rats prone to attribute incentive salience to a food cue. In this study, we asked whether there is similar individual variation in the extent to which interoceptive cues produced by cocaine itself instigate cocaine-seeking behavior. After quantifying individual variation in the propensity to attribute incentive salience to a food cue, rats were trained to self-administer cocaine in the absence of an explicit conditional stimulus. We then assessed motivation for cocaine by: (1) performance on a progressive ratio schedule, and (2) the degree to which a cocaine 'prime' reinstated cocaine-seeking following extinction of self-administration behavior. We found that rats prone to attribute incentive salience to a food cue worked harder for cocaine, and showed more robust cocaine-induced reinstatement. We conclude that there is considerable individual variation in the motivational properties of cocaine itself, and this can be predicted by the propensity to attribute incentive salience to reward cues.

Dopamine modulates reward expectancy during performance of a slot machine task in rats: evidence for a 'near-miss' effect

Cognitive accounts of gambling suggest that the experience of almost winning-so-called 'near-misses'-encourage continued play and accelerate the development of pathological gambling (PG) in vulnerable individuals. One explanation for this effect is that near-misses signal imminent winning outcomes and heighten reward expectancy, galvanizing further play. Determining the neurochemical processes underlying the drive to gamble could facilitate the development of more effective treatments for PG. With this aim in mind, we evaluated rats' performance on a novel model of slot machine play, a form of gambling in which near-miss events are particularly salient. Subjects responded to a series of three flashing lights, loosely analogous to the wheels of a slot machine, causing the lights to set to 'on' or 'off'. A winning outcome was signaled if all three lights were illuminated. At the end of each trial, rats chose between responding on the 'collect' lever, resulting in reward on win trials, but a time penalty on loss trials, or starting a new trial. Rats showed a marked preference for the collect lever when both two and three lights were illuminated, indicating heightened reward expectancy following near-misses similar to wins. Erroneous collect responses were increased by amphetamine and the D(2) receptor agonist quinpirole, but not by the D(1) receptor agonist SKF 81297 or receptor subtype selective antagonists. These data suggest that dopamine modulates reward expectancy following the experience of almost winning during slot machine play, via activity at D(2) receptors, and this may result in an enhancement of the near-miss effect and facilitate further gambling.

Influence of conditioned reinforcement on the response-maintaining effects of quinpirole in rats

D2-like agonists, such as quinpirole, maintain responding in monkeys, rats, and mice when they are substituted for cocaine. This study examined the influence of operant history and cocaine-paired stimuli (CS) on quinpirole-maintained responding in rats trained to nose poke for cocaine. Upon acquisition of responding for cocaine, substitutions were performed in the presence or absence of injection-CS pairings. Although cocaine maintained responding regardless of whether injections were accompanied by CS, quinpirole maintained responding only when CS were paired with injections. To assess the influence of operant history, injections of cocaine, quinpirole, remifentanil, nicotine, or saline were made available on a previously inactive lever, while nose pokes continued to result in CS presentation. Although responding was reallocated from the nose poke to the lever when cocaine or remifentanil was available, lever presses remained low, and nose poking persisted when quinpirole or nicotine was made contingent upon lever presses. Finally, quinpirole pretreatments resulted in high rates of nose poking when nose pokes resulted in CS presentation alone, but failed to maintain nose poking when the CS was omitted. Taken together, these results suggest that the response-maintaining effects of quinpirole are primarily mediated by an enhancement of the conditioned reinforcing effects of earlier CS, rather than by a reinforcing effect of quinpirole.

The role of impulsive behavior in drug abuse

BACKGROUND

Impulsivity is a multifaceted construct that has recently been recognized as a factor contributing to enhanced vulnerability to drug abuse.

OBJECTIVES

In the present review, we focus on two facets of impulsivity (and tasks that measure them): (1) impulsive choice (delay discounting task) and (2) inhibitory failure (go/no-go, stop signal reaction time, and five-choice serial reaction time tasks). We also describe how performance on each of these tasks is associated with drug-related behavior during phases of drug abuse that capture the essential features of addiction (acquisition, escalation, and reinstatement of drug-seeking after drug access has terminated). Three hypotheses (H) regarding the relationship between impulsivity and drug abuse are discussed: (1) increased levels of impulsivity lead to drug abuse (H1), (2) drugs of abuse increase impulsivity (H2), and (3) impulsivity and drug abuse are associated through a common third factor (H3).

CONCLUSION

Impulsivity expressed as impulsive choice or inhibitory failure plays a role in several key transition phases of drug abuse. There is evidence to support all three nonexclusive hypotheses. Increased levels of impulsivity lead to acquisition of drug abuse (H1) and subsequent escalation or dysregulation of drug intake. Drugs of abuse may increase impulsivity (H2), which is an additional contributor to escalation/dysregulation. Abstinence, relapse, and treatment may be influenced by both H1 and H2. In addition, there is a relationship between impulsivity and other drug abuse vulnerability factors, such as sex, hormonal status, reactivity to nondrug rewards, and early environmental experiences that may impact drug intake during all phases of addiction (H3). Relating drug abuse and impulsivity in phases of addiction via these three hypotheses provides a heuristic model from which future experimental questions can be addressed.

From Malthus to motive: how the HPA axis engineers the phenotype, yoking needs to wants

The hypothalamo-pituitary-adrenal (HPA) axis is the critical mediator of the vertebrate stress response system, responding to environmental stressors by maintaining internal homeostasis and coupling the needs of the body to the wants of the mind. The HPA axis has numerous complex drivers and highly flexible operating characterisitics. Major drivers include two circadian drivers, two extra-hypothalamic networks controlling top-down (psychogenic) and bottom-up (systemic) threats, and two intra-hypothalamic networks coordinating behavioral, autonomic, and neuroendocrine outflows. These various networks jointly and flexibly control HPA axis output of periodic (oscillatory) functions and a range of adventitious systemic or psychological threats, including predictable daily cycles of energy flow, actual metabolic deficits over many time scales, predicted metabolic deficits, and the state-dependent management of post-prandial responses to feeding. Evidence is provided that reparation of metabolic derangement by either food or glucocorticoids results in a metabolic signal that inhibits HPA activity. In short, the HPA axis is intimately involved in managing and remodeling peripheral energy fluxes, which appear to provide an unidentified metabolic inhibitory feedback signal to the HPA axis via glucocorticoids. In a complementary and perhaps a less appreciated role, adrenocortical hormones also act on brain to provide not only feedback, but feedforward control over the HPA axis itself and its various drivers, as well as coordinating behavioral and autonomic outflows, and mounting central incentive and memorial networks that are adaptive in both appetitive and aversive motivational modes. By centrally remodeling the phenotype, the HPA axis provides ballistic and predictive control over motor outflows relevant to the type of stressor. Evidence is examined concerning the global hypothesis that the HPA axis comprehensively induces integrative phenotypic plasticity, thus remodeling the body and its governor, the brain, to yoke the needs of the body to the wants of the mind. Adverse side effects of this yoking under conditions of glucocorticoid excess are discussed.

A method for single-session cocaine self-administration in the mouse

RATIONALE

Drug self-administration is a powerful method to measure the reinforcing effects of a drug, as well as to investigate behavioral, biochemical, and physiological effects of a drug specific to contingent delivery. With the spectrum of genetically modified mice available, there is a need for well-designed drug self-administration studies tailored for rapid completion of studies in mice.

OBJECTIVES

We set out to develop a methodology in mice for obtaining high levels of cocaine self-administration during the first exposure to the drug.

MATERIALS AND METHODS

C57Bl/6J mice were trained to lever press for liquid reinforcer on a fixed ratio 1, then a progressive ratio (PR) schedule of reinforcement before intravenous self-administration of cocaine on a PR schedule.

RESULTS

Within a single 16-h session, each mouse self-administered either saline or 0.1, 0.3, 0.6, or 1.2 mg kg(-1) infusion(-1) of cocaine during four distinct 4-h subsessions. Mice showed a strong preference for cocaine vs saline, as demonstrated by higher breakpoints and greater preference for the active lever. Likewise, there was a dose-dependent increase in breakpoints obtained and in drug intake. Finally, animals receiving noncontingent cocaine pressed significantly less than mice self-administering the same dose of cocaine, indicating that a significant amount of active lever pressing is driven by drug-seeking and not the psychomotor-activating effects of cocaine alone.

CONCLUSIONS

Mice will reach high breakpoints and cocaine intake during an initial exposure to cocaine. This method is well-suited to rapidly obtain progressive ratio cocaine self-administration in mice.

Operant responding for a visual reinforcer in rats is enhanced by noncontingent nicotine: implications for nicotine self-administration and reinforcement

RATIONALE

Current conceptualizations of drug reinforcement assume that drug-taking behavior is a consequence of the contingent, temporal relationship between the behavior and drug reward. However, stimulant drugs also potentiate the rewarding effects of other reinforcers when administered noncontingently.

OBJECTIVES

These studies were designed to determine whether noncontingent nicotine enhances the reinforcing properties of a nonpharmacological reinforcer and whether this direct effect facilitates operant behavior within the context of a nicotine self-administration procedure.

METHODS

Rats self-administered nicotine or food, or received noncontingent nicotine, saline, or food either with or without a response-contingent, unconditioned reinforcing visual stimulus (VS).

RESULTS

Noncontingent nicotine, whether delivered as discrete injections based on a pattern of self-administered nicotine or as a continuous infusion, increased response rates maintained by the VS. There were no significant differences in responding by animals that received contingent compared with noncontingent nicotine when a VS was available. This increase was not observed in the absence of the VS or as a consequence of noncontingent food delivery. Operant behavior was equally attenuated and reinstated by the removal and subsequent replacement of contingent and noncontingent nicotine. Nicotine supported self-administration in the absence of response-contingent, nicotine-paired stimuli; however, response rates were drastically reduced compared with nicotine self-administration with the VS.

CONCLUSIONS

Nicotine influences operant behavior in two ways: by acting as a primary reinforcer when it is contingent upon behavior, and by directly potentiating the reinforcing properties of other stimuli through a nonassociative mechanism. Nicotine self-administration and smoking may be largely dependent upon this later action.

Immunohistochemical assessment of mesotelencephalic dopamine activity during the acquisition and expression of Pavlovian versus instrumental behaviours

Dopaminergic activity during Pavlovian or instrumental learning in key target regions of the mesotelencephalic dopamine system was investigated immunohistochemically using antibodies raised against glutaraldehyde-conjugated dopamine. Experiment 1 examined dopamine immunoreactivity during acquisition of a Pavlovian conditioned-approach response. Observations were taken at three stages of learning: initial, intermediate and asymptotic; each with a conditioned stimulus+ (CS+) group for whom visual or auditory stimuli immediately preceded an unconditioned stimulus (sucrose), and a conditioned stimulus- (CS-) group for whom stimuli and the unconditioned stimulus were unpaired. Animals learned to approach the alcove during CS+ presentations, whilst approach behaviour of the CS- group remained low. In general, target regions exhibiting a dopaminergic reaction responded maximally during the intermediate stage of acquisition, and were less responsive initially, and not responsive at all at asymptote. Specifically, the pattern of dopaminergic response was: shell more than core of the nucleus accumbens; prefrontal cortex, central and basolateral nuclei of the amygdala also significantly responsive. Mediodorsal and laterodorsal striatal regions were reactive only very early in training. Experiment 2 examined dopaminergic reaction following acquisition of a novel conditioned instrumental response. The conditioned response+ (CR+) group responded at a much higher rate on the lever for which unconditioned stimulus-associated stimuli were presented, than on the control lever. The conditioned response- (CR-) group responded at a low rate on both levers. In contrast with experiment 1, the most responsive regions were the core of the nucleus accumbens, medial prefrontal cortex and basolateral area of the amygdala. Thus, the acquisition, but not expression of Pavlovian associations activated dopamine within several key target regions of the mesotelencephalic dopamine system, and preferentially within the shell rather than core of the nucleus accumbens. By contrast, acquisition of a novel instrumental response preferentially activated the core of the nucleus accumbens, and basolateral area of the amygdala. These data carry significant implications for the potential role of these regions in learning and memory.

Enhanced food-related motivation after bilateral lesions of the subthalamic nucleus

Although inactivation of the subthalamic nucleus (STN) has beneficial effects on motor symptoms of parkinsonism, little is known of possible actions on nonmotor symptoms of cognition or mood. Here, we used several forms of converging evidence to show that STN lesions can enhance behavioral motivation. Thus, bilateral fiber-sparing lesions of the STN in rats reduced the time required to eat a standard number of food reward pellets, without affecting food intake, and altered performance on a number of behavioral measures consistent with enhanced motivation for food. Thus, STN-lesioned rats showed greater levels of locomotor activity conditioned to food presentation, enhanced control over responding by food-related conditioned reinforcers, and a higher breaking point associated with elevated rate of lever press under a progressive ratio schedule of reinforcement. These results reveal a new functional role schedule for STN, possibly because of its involvement in ventral, as well as dorsal, striatal circuitry and are relevant to the therapeutic effects of STN stimulation in Parkinson's disease.

Enhanced food-related motivation after bilateral lesions of the subthalamic nucleus

Although inactivation of the subthalamic nucleus (STN) has beneficial effects on motor symptoms of parkinsonism, little is known of possible actions on nonmotor symptoms of cognition or mood. Here, we used several forms of converging evidence to show that STN lesions can enhance behavioral motivation. Thus, bilateral fiber-sparing lesions of the STN in rats reduced the time required to eat a standard number of food reward pellets, without affecting food intake, and altered performance on a number of behavioral measures consistent with enhanced motivation for food. Thus, STN-lesioned rats showed greater levels of locomotor activity conditioned to food presentation, enhanced control over responding by food-related conditioned reinforcers, and a higher breaking point associated with elevated rate of lever press under a progressive ratio schedule of reinforcement. These results reveal a new functional role schedule for STN, possibly because of its involvement in ventral, as well as dorsal, striatal circuitry and are relevant to the therapeutic effects of STN stimulation in Parkinson's disease.

Enhancement of locomotor activity and conditioned reward to cocaine by brain-derived neurotrophic factor

The mesolimbic dopamine (DA) system has been implicated in drug reward, locomotor sensitization, and responding for reward-related stimuli [termed conditioned reinforcers (CR)]. Here, we investigated the effect of brain-derived neurotrophic factor (BDNF), which enhances the survival and function of dopaminergic neurons, on stimulant-induced locomotor sensitization and responding for CR. In experiment 1, BDNF was infused into the nucleus accumbens (NAc) or ventral tegmental area over 2 weeks via chronically implanted minipumps (1-2.5 microgram/d), and the psychomotor stimulant effects of cocaine (5-15 mg/kg, i.p.) were studied. We found that BDNF enhanced the initial stimulant effects of cocaine and seemed to facilitate the development of sensitization to repeated cocaine doses. In experiment 2, we studied the effects of intra-NAc BDNF infusions on responding for CR. BDNF-treated rats showed twice as many CR responses compared with controls when saline was first administered. BDNF enhanced responding on the CR lever more than four times that seen in control animals after a cocaine injection (10 mg/kg, i.p.). The enhanced response to cocaine in BDNF-treated animals persisted for more than a month after the BDNF infusions had stopped, indicating long-lasting changes in the mesolimbic DA system caused by BDNF administration. In experiment 3, we examined locomotor sensitization to cocaine in heterozygous BDNF knock-out mice and found that the development of sensitization was delayed compared with wild-type littermates. These results demonstrate the profound effects of BDNF on the enhancement of both cocaine-induced locomotion and facilitation of CR and suggest a possible role for BDNF in long-term adaptations of the brain to cocaine.

Enhancement of locomotor activity and conditioned reward to cocaine by brain-derived neurotrophic factor

The mesolimbic dopamine (DA) system has been implicated in drug reward, locomotor sensitization, and responding for reward-related stimuli [termed conditioned reinforcers (CR)]. Here, we investigated the effect of brain-derived neurotrophic factor (BDNF), which enhances the survival and function of dopaminergic neurons, on stimulant-induced locomotor sensitization and responding for CR. In experiment 1, BDNF was infused into the nucleus accumbens (NAc) or ventral tegmental area over 2 weeks via chronically implanted minipumps (1-2.5 microgram/d), and the psychomotor stimulant effects of cocaine (5-15 mg/kg, i.p.) were studied. We found that BDNF enhanced the initial stimulant effects of cocaine and seemed to facilitate the development of sensitization to repeated cocaine doses. In experiment 2, we studied the effects of intra-NAc BDNF infusions on responding for CR. BDNF-treated rats showed twice as many CR responses compared with controls when saline was first administered. BDNF enhanced responding on the CR lever more than four times that seen in control animals after a cocaine injection (10 mg/kg, i.p.). The enhanced response to cocaine in BDNF-treated animals persisted for more than a month after the BDNF infusions had stopped, indicating long-lasting changes in the mesolimbic DA system caused by BDNF administration. In experiment 3, we examined locomotor sensitization to cocaine in heterozygous BDNF knock-out mice and found that the development of sensitization was delayed compared with wild-type littermates. These results demonstrate the profound effects of BDNF on the enhancement of both cocaine-induced locomotion and facilitation of CR and suggest a possible role for BDNF in long-term adaptations of the brain to cocaine.

A motivational learning hypothesis of the role of mesolimbic dopamine in compulsive drug use

The effects of drugs and substances of abuse on central dopamine (DA) transmission studied by in vivo monitoring techniques have been examined and compared with those of conventional reinforcers and in particular with food. The similarities and differences in the action of drugs and conventional reinforcers on DA transmission can provide the basis for an hypothesis of the mechanism of drug addiction and compulsive drug use. This hypothesis states that drug addiction is due to excessive control over behaviour exerted by drug-related stimuli as a result of abnormal motivational learning induced by repeated drug exposure. Such abnormal motivational learning would derive from the repetitive non-habituating property of drugs of abuse to activate DA transmission phasically in the nucleus accumbens (NAc) 'shell'. Thus, activation of DA transmission by conventional reinforcers is under strong inhibitory control by previous exposure to the reinforcer (habituation); this, however, is not the case with drug reinforcers. Repetitive, non-adaptive release of DA in the NAc 'shell' by drugs of abuse would result in abnormal strengthening of stimulus-reward (incentive learning) and stimulus-response associations (habit learning) that constitute the basis for craving and compulsive drug use.

Bidirectional effects of dopamine D2 receptor antagonists on responding for a conditioned reinforcer

In general, the administration of dopamine (DA) antagonists has been shown to result in the attenuation of reward processes. Recently, however, it has been suggested that low doses of DA antagonists can enhance the incentive value of a primary reinforcer. The present study examined the effect of DA receptor antagonists on responding for a conditioned stimulus (CS) and compared their effects to that produced by d-amphetamine. For 12 days, food-deprived rats were trained to associate a CS with a food reward. In the test phase, the CS was presented following a response on one of two levers (CR), whereas responding on the other lever (NCR) had no consequence. Low doses of d-amphetamine (0.5 mg/kg), sulpiride (4 mg/kg), pimozide (0.025 mg/kg), and raclopride (0.05 mg/kg) selectively enhanced responding on CR. A low dose of haloperidol (0.01 mg/kg) led to a nonspecific increase in lever responding. Treatment with larger doses of these compounds as well as with the D1 antagonist SCH23390 attenuated responding on CR. Both CR and NCR responding were reduced following administration of higher doses of d-amphetamine. Results indicate that responding for a conditioned reinforcer is potentiated following administration of low doses of D2 receptor antagonists, suggesting that D2 receptor blockade can facilitate incentive motivation.

Enhanced reward-related responding following cholera toxin infusion into the nucleus accumbens

In recent years, considerable focus has been directed to understanding how drugs of abuse affect neuronal function at the molecular level. For example, repeated administration of stimulants or opiates can induce long-lasting alterations in gene expression, transcription factors, and signal transduction pathways. Our laboratory previously showed that intraaccumbens infusion of cholera toxin (CTX), which alters the Gs protein such that production of cyclic Adenosine Monophosphate (AMP) is upregulated, causes pronounced, long-lasting motor activation and sensitization to stimulants. In the present experiments, the effect of intraaccumbens infusion of cholera toxin on reward-related responding was investigated. The conditioned reinforcement (CR) paradigm was employed, which measures an animal's instrumental response to obtain presentation of a stimulus previously paired with a primary reward. When this stimulus supports acquisition of a new operant response (lever-pressing), it is termed a conditioned reinforcer (CR). In the first experiment, the effects of bilateral intraaccumbens infusion of CTX (100 ng/1 microliter) were examined on previously-established responding. CTX treatment resulted in enhanced responding for the CR. This enhancement developed over several days and reached its peak 3 days following infusion. In the second experiment, the influence of CTX was examined on acquisition of responding for the CR. The group treated with CTX (100 ng) discriminated between the CR and control (NCR) lever earlier than the vehicle-infused group, and showed greater levels of responding on the CR lever. In the third experiment, it was determined that infusion of CTX (300 ng bilaterally) into the anterior dorsal striatum did not affect levels of responding, although a later test with cocaine in these animals (25 mg/kg, intraperitoneally) (i.p.) indicated that they were capable of potentiated responding. These data are interpreted as evidence that the G(S) protein-cyclic AMP second messenger system within the nucleus accumbens is directly involved in reward-related behavior.

The D1 agonist SKF 38393 attenuates amphetamine-produced enhancement of responding for conditioned reward in rats

The present study investigated the hypothesis that the D1 subtype of DA receptors is critically involved in reward-related learning. The effects of SKF 38393, a D1-specific agonist, on amphetamine-produced enhancement of responding for conditioned reward were tested. We exposed 69 male Wistar rats to an experimental design consisting of three phases. The preexposure phase consisted of five sessions during which the rats were exposed to an operant chamber containing two levers. One lever produced a lights-off stimulus (3 s) and the other a tone stimulus (3 s). This was followed by four conditioning sessions during which the levers were removed and the rats were exposed to pairings of the lights-off stimulus with food. This phase was followed by two test sessions during which the levers were present and the number of responses made on each lever was calculated as a ratio of the number of responses made during the preexposure phase. A group receiving saline during the test sessions showed a higher ratio of responding for the lights off stimulus than the tone stimulus, demonstrating that the lights-off stimulus had become a conditioned reward. Amphetamine [2.0 mg/kg, intraperitoneally (i.p.), 5 min before the test] enhanced responding specifically on the lever producing the conditioned reward. Groups receiving SKF 38393 (5.0, 10.0, and 20.0 mg/kg, i.p., 5 min before the test) failed to show significantly greater responding for the lights-off stimulus than the tone, indicating a reduction or elimination of the conditioned reward effect. Moreover, SKF 38393 dose dependently reduced the amphetamine-produced enhancement of responding for conditioned reward.(ABSTRACT TRUNCATED AT 250 WORDS)

The role of dopamine in drug abuse viewed from the perspective of its role in motivation

Drugs of abuse share with conventional reinforcers the activation of specific neural pathways in the CNS that are the substrate of their motivational properties. Dopamine is recognized as the transmitter of one such neural pathway, being involved in at least three major aspects of motivation: modulation of motivational state, acquisition (incentive learning) and expression of incentive properties by motivational stimuli. Drugs of abuse of different pharmacological classes stimulate in the low dose range dopamine transmission particularly in the ventral striatum. Apart from psychostimulants, the evidence that stimulation of dopamine transmission by drugs of abuse provides the primary motivational stimulus for drug self-administration is either unconvincing or negative. However, stimulation of dopamine transmission is essential for the activational properties of drugs of abuse and might be instrumental for the acquisition of responding to drug-related incentive stimuli (incentive learning). Dopamine is involved in the induction and in the expression of behavioural sensitization by repeated exposure to various drugs of abuse. Sensitization to the dopamine-stimulant properties of specific drug classes leading to facilitation of incentive learning of drug-related stimuli might account for the strong control over behaviour exerted by these stimuli in the addiction state. Withdrawal from drugs of abuse results in a reduction in basal dopamine transmission in vivo and in reduced responding for conventional reinforcers. Although these changes are likely to be the expression of a state of dependence of the dopamine system their contribution to the motivational state of drug addiction is unclear.

Interaction of CCKB receptors with amphetamine in responding for conditioned rewards

Cholecystokinin (CCK) has been localized in the nucleus accumbens (NAC) where it may interact with dopamine neurotransmission. NAC dopamine is involved in the control over behavior produced by conditioned rewards. The present experiment tested the whether blockade of endogenous CCKB receptors with L-365,260 (0.1 mg/kg, IP) potentiates bar pressing for stimuli previously associated with food reward. Intra-accumbens amphetamine (20 micrograms) facilitated bar pressing for conditioned rewards. Systemic administration of L-365,260 potentiated this amphetamine response but produced no effect on responding when administered alone. These findings suggest that endogenous CCKB mechanisms may normally inhibit DA function in reward-related behaviors.

Dopamine D1 and D2 antagonists attenuate amphetamine-produced enhancement of responding for conditioned reward in rats

It has been suggested that the dopamine D1 receptor may play an important role in reward. The present study was undertaken to investigate the roles of dopamine D1 and D2 receptor subtypes in responding for conditioned reward. This was done by examining the effects of the D1 antagonist SCH 23390 and the D2 antagonists pimozide and metoclopramide on amphetamine-produced enhancement of responding for conditioned reward. The procedure consisted of three distinct phases. During the pre-exposure phase the rats were exposed to an operant chamber containing two levers. One lever produced a lights-off stimulus (3 s) and the other a tone stimulus (3 s). This was followed by four conditioning sessions during which the levers were removed and the rats were exposed to pairings of the lights-off stimulus with food. This phase was followed by two test sessions during which the levers were present and the number of responses made on each was calculated as a ratio of the number of responses made during the pre-exposure phase. A group receiving the vehicle during the test sessions showed a greater ratio of responding for the lights-off stimulus than the tone stimulus, indicating that the lights-off stimulus had become a conditioned reward. Amphetamine (0.1, 1.0, 2.0 and 5.0 mg/kg, IP, 5 min prior to test) specifically enhanced responding on the lever producing conditioned reward. SCH 23390 (5.0 and 10.0 micrograms/kg, SC, 2 h before test) and pimozide (0.1 and 0.2 mg/kg, IP, 4 h before test) dose-dependently shifted the peak in the amphetamine dose-response function to the right, indicating an attenuation of conditioned reward.(ABSTRACT TRUNCATED AT 250 WORDS)

Evidence for opiate-dopamine cross-sensitization in nucleus accumbens: studies of conditioned reward

We investigated opiate-amphetamine interactions within the nucleus accumbens in responding for conditioned reward. Separate groups of animals received 4-day intra-accumbens treatment with either saline, morphine (0.5 microgram/0.5 microliter), [D-Ala2 NMe-Phe4 Gly-ol5]-Enkephalin (DAMGO; 1.0 micrograms/0.5 microliter), or [D-Pen2,5]-Enkephalin (DPEN; 2.0 micrograms/0.5 microliter). One two subsequent test days, these rats were given a challenge of d-amphetamine (2.0 and 10.0 micrograms/0.5 microliter) and responding for conditioned reward was measured. In the conditioned reinforcement (CR) procedure, food-deprived animals were trained in an initial phase to associate a food reward (primary reinforcement) with a compound stimulus (light/click). In the next phase, a lever was introduced and responding on the lever produced the compound stimulus alone (secondary reinforcement). Previous evidence shows that psychostimulants but not opiates markedly potentiate responding for conditioned reward. In the present design, animals previously treated with either morphine or DAMGO (preferential mu agonists) showed potentiated lever responding following amphetamine challenges, relative to either DPEN- or saline-treated animals. These findings show that prior exposure of nucleus accumbens neurons to mu-selective opiates induces sensitization to the effects of amphetamine. The results are discussed in terms of opioid effects on dopamine transmission and second messenger systems.

Food-paired stimuli as conditioned reinforcers: effects of d-amphetamine

Seven pigeons were studied in two experiments in which key pecks were reinforced under a second-order schedule wherein satisfaction of variable-interval schedule requirements produced food or a brief stimulus. In the second part of each session, responses produced only the brief stimulus according to a variable-interval schedule (food extinction). For the 4 pigeons in Experiment 1, the response key was red throughout the session. In separate phases, the brief stimulus was either paired with food, not paired with food, or not presented during extinction. d-Amphetamine (0.3 to 10.0 mg/kg) dose-dependently reduced food-maintained responding during the first part of the session and, at intermediate dosages, increased responding during the extinction portion of the session. The magnitude of these increases, however, did not consistently depend on whether the brief stimulus was paired, not paired, or not presented. It was also true that under nondrug conditions, response rates during extinction did not differ reliably depending on pairing operations for the brief stimulus. In Experiment 2, 3 different pigeons responded under a procedure wherein the key was red in the component with food presentations and blue in the extinction component (i.e., multiple schedule). Again, d-amphetamine produced dose-related decreases in responding during the first part of a session and increases in responding in the second part of the session. These increases, however, were related to the pairing operations; larger increases were observed when the brief stimulus was paired with food than when it was not or when it was not presented at all. Under nondrug conditions, the paired brief stimulus controlled higher response rates during extinction than did a nonpaired stimulus or no stimulus. These findings suggest that d-amphetamine can enhance the efficacy of conditioned reinforcers, and that this effect may be more robust if conditioned reinforcers occur in the context of a signaled period of extinction.

Tolerance to and residual effects of cocaine in squirrel monkeys depend on reinforcement-schedule parameter

Lever pressing by 4 squirrel monkeys was maintained under a three-component multiple fixed-ratio schedule of food presentation; components differed with respect to ratio size. For each monkey, acute administration of cocaine (0.03 to 1.3 mg/kg, i.m.) produced dose-dependent decreases in overall response rate in each component. During repeated daily administration of 1.0 mg/kg of cocaine, tolerance developed to the rate-decreasing effects under each of the ratio contingencies, but developed to a greater extent and was evident in earlier parts of sessions for performance under the smaller ratios. Response rates of 2 monkeys increased above nondrug control levels despite the putative reinforcer not being consumed during the session. When saline or a smaller dose of cocaine was substituted for 1.0 mg/kg, response rates often were suppressed below nondrug control-level responding. This suppressive effect was observed in each monkey and was more likely to be observed and/or to be of greater magnitude in large-ratio components for 3 of the 4 monkeys. When saline was administered chronically at the end of the chronic-drug phase, response rates remained suppressed in the large-ratio component for 2 of the monkeys. There was, therefore, a schedule-dependent dissociation between behavioral tolerance and the residual effects: Tolerance was greater when small ratios were arranged, whereas the residual effects were more pronounced when larger ratios were arranged.

Dopamine and conditioned reinforcement. I. Differential effects of amphetamine microinjections into striatal subregions

In the conditioned reinforcement paradigm, animals learn a new instrumental response reinforced solely by conditioned reward (a stimulus that has previously been associated with primary reward). It has been shown that psychostimulants potentiate responding for conditioned reward and there is evidence that the nucleus accumbens is involved in this effect. The present experiments extend this work and examine the roles of various striatal subregions in the enhancement of responding for conditioned reward. In the conditioning phase, hungry rats were trained to associate a light/click stimulus with food delivery, with no levers present in the operant chamber. In the test phase, two levers were present and responding on one provided conditioned reward (presentation of the compound stimulus but no food). During this phase, microinjections of d-amphetamine (0, 0.2, 2.0, 20.0 micrograms/0.5 microliters) were made into seven striatal subregions in separate groups of rats. Injection of amphetamine into the nucleus accumbens elicited a dose-dependent, selective increase in responding for CR. Injections into posterior regions of the striatum had no effect. Significant and selective increases in CR responding were noted after injections into two regions neighboring the nucleus accumbens, the anterior dorsal and the ventromedial striatum, although the magnitude of these effects was considerably less than that following accumbens injections. Injections into ventrolateral regions increased responding in some rats, but this effect was very variable and not selective for the CR lever. These results are interpreted as evidence for functional heterogeneity of the striatum with regard to enhancement of conditioned reinforcement. The findings are discussed in relation to the theory that increased dopaminergic activity in the nucleus accumbens results in amplification of the response to a previously learned reward-related signal.

Effects of GBR 12909, a selective dopamine uptake inhibitor, on motor activity and operant behavior in the rat

GBR 12909, an aryl 1,4-dialkylpiperazine derivative, is a potent and selective inhibitor of the presynaptic dopamine uptake complex. The behavioral effects of this compound were studied in rats using several different paradigms. GBR 12909 (1, 10, 20 mg/kg i.p.) elicited a dose-dependent, long-lasting behavioral activation characterized by locomotion, rearing, sniffing and stereotypies at the highest dose. A second experiment investigated the consequences of subchronic treatment (one injection every 2 days for 14 days) with a high dose (20 mg/kg) of GBR 12909. Evidence was obtained for sensitization to GBR 12909, indicated by progressively more intense stereotypy induced by the high dose of GBR 12909, and also by an enhanced locomotor response to subthreshold doses of the drug, which lasted up to 7 weeks following the end of subchronic treatment. In a test of fixed-interval responding for food reward, GBR 12909 strongly enhanced lever pressing and lowered quarter-life. Low rates of responding were affected more than high rates. GBR 12909 also potentiated responding for a conditioned reinforcer (a stimulus which had previously been paired with food), suggesting that the rewarding impact of the stimulus was increased. It is concluded that the behavioral profile of GBR 12909 is similar to other dopamine-enhancing psychostimulants, and the sensitization may involve long-term changes in the dopamine uptake site.

Behavioral tolerance to cocaine in squirrel monkeys: acute and chronic effects on complex operant behavior

Four food-deprived squirrel monkeys were trained to emit complex sequences of responses. The sequences involved pressing lighted response keys in orders dictated by colors that illuminated the keys, and ranged in length from two to five responses. Appropriate completion of these behavioral chains could be followed by food presentation. Acute administration of a range of doses (0.1-1.7 mg/kg) of cocaine hydrochloride produced dose-related decreases in the rate of completing chains and in accuracy of performance during chains. There was little evidence that the drug's effects on overall accuracy were related to the length of the chain. Three of the monkeys were exposed to daily administration of a large dose of cocaine, first after daily sessions and then prior to sessions. Daily postsession administration did not alter the dose-effect curves, but daily presession injection did, indicating the development of behavioral or "contingent" tolerance. In all cases, tolerance was accompanied by an increase in reinforcement frequency relative to the frequency observed following acute administration. Omission of the daily dose during presession drug administration resulted in performance near original control levels indicating essentially no withdrawal effect. The findings illustrate the importance of behavioral factors in the development of tolerance to cocaine in a primate.

The effects of (+)-amphetamine and apomorphine on responding for a conditioned reinforcer

Two psychomotor stimulants, (+)-amphetamine and apomorphine, were examined for effects on associative learning and responding for a conditioned reinforcer. The experimental phases included: preexposure to an operant test chamber with two levers, each of which produced a neutral stimulus when pressed; pairings of one stimulus with food; and a subsequent test of lever pressing for the two stimuli. Groups of food deprived rats (n = 8-12) were given IP injections of one stimulant prior to each pairing or testing session. Given during pairings, (+)-amphetamine produced a dose-related attenuation of responding for the conditioned stimulus in the test; doses of 0.5, 1.0 and 2.0, but not 0.25 or 4.0 mg/kg, given during the test enhanced responding, as did 0.5 mg/kg given in both phases. Apomorphine did not significantly alter responding during testing when administered in either the pairing (0 0.75 mg/kg) or test (0.5 1.0 mg/kg) phase. The results suggest that the modulation of conditioned reinforcement by psychomotor stimulants may occur through a presynaptic influence. Furthermore, the results with (+)-amphetamine suggest that this drug differentially affects the learning of an association between a conditioned and unconditioned stimulus versus the acquisition of responding for that conditioned stimulus.

Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens

Stimulant drugs have been shown to enhance the control over behaviour exerted by stimuli previously correlated with primary reinforcers, termed conditioned reinforcers (CR). Experiment 1 examined the possible neuroanatomical specificity of the enhancement of conditioned reinforcement following intracerebral injections of d-amphetamine. Thirsty rats were trained to associate a light with water. In the test phase, water was no longer presented but the light (CR) was intermittently produced by responding on one of two novel levers. Rats with bilateral guide cannulae aimed at the nucleus accumbens, posterior caudate nucleus, or medio-dorsal nucleus of the thalamus received four counterbalanced microinfusions of d-amphetamine (10, 20, 30 micrograms/2 microliters) or vehicle (control) over 4 test days. There was a dose-dependent selective increase in responding on the lever that produced the light (CR) with intra-accumbens d-amphetamine infusions. Quantitatively similar, but much more variable effects were found with intra-caudate infusions and no effects following intra-thalamic d-amphetamine. Experiment 2 provided evidence that the enhanced control over responding by a CR with intra-accumbens d-amphetamine is behaviourally specific. Three groups of rats received a compound tone--plus--light stimulus that was positively, negatively or randomly correlated with water during training. Intra-accumbens d-amphetamine produced selective increases in responding only if the contingent stimulus had been positively correlated. The results suggest that the nucleus accumbens may play an important role in d-amphetamine's enhanced control over behaviour exerted by conditioned reinforcers.

The role of dopamine in locomotor activity and learning

The discovery that the brain contains neurons utilizing dopamine (DA) as their transmitter has led to studies of the behavioral function of these neurons. Changes in overall level of activity of DA neurons appear to produce parallel changes in locomotor activity. Additionally, DA neurons seem to mediate in part the effects of biologically significant (reinforcing) stimuli on learning. One way in which reinforcing stimuli produce learning is to increase the incentive motivational (response-eliciting) properties of neutral stimuli associated with them; also, reinforcing stimuli maintain the incentive motivational properties of previously conditioned incentive stimuli. Normal DA functioning appears to be required for the establishment and maintenance of incentive learning in naive animals. Previous incentive learning in trained animals can influence behavior for a time even when the function of DA neurons is disrupted; however, with continued testing in the absence of normal DA functioning, previously established conditioned incentive stimuli cease to influence behavior. From these observations and recent physiological, anatomical and biochemical studies of DA systems it is suggested that the biological substrate of DA-mediated incentive learning is a heterosynaptic facilitation of muscarinic cholinergic synapses. This model has important clinical implications since it has been suggested that DA hyperfunctioning underlies the development of schizophrenia.

The progressive ratio schedule as a model for studying the psychomotor stimulant activity of drugs in the rat

Male Wistar rats were trained to press a lever with food reinforcement according to a continuously reinforced schedule (CRF). Afterwards, rats were subjected to three experimental sessions (30 min each) during which responding was rewarded according to a progressive ratio schedule (following an initial 2-min CRF period, the number of presses necessary for the pellet delivery was doubled every second minute). Responding during the first half of each session, i.e., pressing for food, was maintained at a significant level, whereas it was almost suppressed during the second part of the session. As compared to controls (200 +/- 20 presses/30 min) animals given amfonelic acid (0.5, 1 mg/kg IP), methylphenidate (4, 8 mg/kg IP), caffeine (16 mg/kg IP), cocaine (4 mg/kg IP), oxolinic acid (32 mg/kg IP), nomifensine (4 mg/kg IP), DR 250 (2, 4 mg/kg IP) and d-amphetamine (0.25, 0.5, 1 mg/kg IP) showed an increased rate of responding ranging from 400 to 950 presses/30 min. In contrast, apomorphine, MK 486 + L-dopa, trihexyphenidyl, imipramine, salbutamol and diazepam did not increase responding. These results suggested that this test is highly sensitive for psychomotor stimulants and perhaps for their ability to enhance the reinforcing value of the reward or stimuli associated with the reward. Such activity seemed related to a catecholaminergic substrate since the increase of responding induced by amphetamine was blocked by pimozide, d,l-propranolol and prazosin.

Contrasting interactions of pipradrol, d-amphetamine, cocaine, cocaine analogues, apomorphine and other drugs with conditioned reinforcement

The effects of various psychomotor stimulant drugs and drugs outside this class were examined on the efficacy of stimuli previously paired with reinforcement or reward (conditioned reinforcers, CR) in controlling responding. Pipradrol (5-45 mumol/kg), d-amphetamine (1.25-15.0 mumol/kg), and the cocaine analogues WIN 35,428 (0.1-30.0 mumol/kg) and in one of two determinations WIN 35,065-2 (0.1-29.0 mumol/kg) all generally increased responding on a lever providing CR, but did not change or decreased responding on a lever providing no CR (NCR). Cocaine (5-125 mumol/kg) and chlordiazepoxide (3.75-60.0 mumol/kg) had no significant effects. Morphine (3.2-32.0 mumol/kg) and alpha-flupenthixol (0.02-2.0 mumol/kg) generally reduced responding on both levers. Apomorphine (0.1-1.0 mumol/kg) generally increased responding on both levers. Neurochemical data showed that d-amphetamine was generally more potent than pipradrol in its effects on in vitro monoamine uptake and release.