Firing rate of nucleus accumbens neurons is dopamine-dependent and reflects the timing of cocaine-seeking behavior in rats on a progressive ratio schedule of reinforcement

The nucleus accumbens as part of a basal ganglia action selection circuit

BACKGROUND

The nucleus accumbens is the ventral extent of the striatum, the main input nucleus of the basal ganglia. Recent hypotheses propose that the accumbens and its dopamine projection from the midbrain contribute to appetitive behaviors required to obtain reward. However, the specific nature of this contribution is unclear. In contrast, significant advances have been made in understanding the role of the dorsal striatum in action selection and decision making.

OBJECTIVE

In order to develop a hypothesis of the role of nucleus accumbens dopamine in action selection, the physiology and behavioral pharmacology of the nucleus accumbens are compared to those of the dorsal striatum.

HYPOTHESES

Three hypotheses concerning the role of dopamine in these structures are proposed: (1) that dopamine release in the dorsal striatum serves to facilitate the ability to respond appropriately to temporally predictable stimuli (that is, stimuli that are so predictable that animals engage in anticipatory behavior just prior to the stimulus); (2) that dopamine in the nucleus accumbens facilitates the ability to respond to temporally unpredictable stimuli (which require interruption of ongoing behavior); and (3) that accumbens neurons participate in action selection in response to such stimuli by virtue of their direct (monosynaptic inhibitory) and indirect (polysynaptic excitatory) projections to basal ganglia output nuclei.

Self-administered and noncontingent nicotine enhance reinforced operant responding in rats: impact of nicotine dose and reinforcement schedule

RATIONALE

Nicotine infusions that are self-administered (contingent) or response-independent (noncontingent) increase lever pressing for a reinforcing nonpharmacological stimulus in rats, suggesting that in addition to primary reinforcement, nicotine self-administration may result from nicotine enhancing the reinforcement derived from nonnicotine stimuli.

OBJECTIVES

Based on our previous research, in this study, we tested the hypothesis that contingent and noncontingent nicotine would equally elevate responding for a moderately reinforcing visual stimulus, across a range of nicotine doses on both fixed ratio and progressive ratio reinforcement schedules.

MATERIALS AND METHODS

The rats lever pressed for a visual stimulus with contingent nicotine, noncontingent nicotine, or contingent saline. Separate groups responded for saline or nicotine without the visual stimulus. Three doses of nicotine (0.01, 0.03, and 0.09 mg/kg per infusion, free base) were tested in a between-groups design. After responding on an escalating fixed ratio reinforcement schedule, the rats were tested on a progressive ratio schedule.

RESULTS

Compared to responding for the visual stimulus with saline, both contingent and noncontingent nicotine equally elevated lever pressing for the stimulus at each dose on fixed and progressive ratio schedules. In the absence of the stimulus, only the highest nicotine dose sustained self-administration.

CONCLUSIONS

The ability of noncontingent nicotine to elevate responding for a moderately reinforcing visual stimulus occurs across a range of doses, and both self-administered and noncontingent nicotine equally increase motivation to obtain the stimulus, as reflected by performance on a progressive ratio schedule. In the absence of a contingent stimulus, primary reinforcement from nicotine only supports self-administration at high nicotine doses in rats.

Peri-response pharmacokinetics of remifentanil during a self-administration session indicates that neither blood nor brain levels are titrated

An individual's drug abuse pattern is determined by a multitude of factors. Among these, simple pharmacological determinants of within-binge drug consumption are sorely underinvestigated. We therefore determined if within-session operant responsing to the ultra-short-acting mu opioid agonist remifentanil (RMF) was determined by blood or brain RMF levels or changes thereof. Our peri-response analysis did not detect any "threshold" RMF level, either in blood or in the nucleus accumbens (NAc) core as a deep brain region that might determine a rat's "decision" to re-emit a response during a multiple-injection drug self-administration session. The peri-response analysis also failed to find any peak RMF level, either in blood or in the NAc core, which could serve as a "ceiling" level. Thus, our findings strongly suggest that titration of blood or brain RMF levels does not determine a rat's intra-session operant response.

Neuronal substrates of relapse to cocaine-seeking behavior: role of prefrontal cortex

The return to drug seeking, even after prolonged periods of abstinence, is a defining feature of cocaine addiction. The neural circuitry underlying relapse has been identified in neuropharmacological studies of experimental animals, typically rats, and supported in brain imaging studies of human addicts. Although the nucleus accumbens (NAcc), which has long been implicated in goal-directed behavior, plays a critical role in this circuit, the prefrontal cortex (PFC) appears to process the events that directly trigger relapse: exposure to acute stress, cues previously associated with the drug, and the drug itself. In this paper, we review animal models of relapse and what they have revealed about the mechanisms underlying the involvement of the NAcc and PFC in cocaine-seeking behavior. We also present electrophysiological data from PFC illustrating how the hedonic, motor, motivational, and reinforcing effects of cocaine can be analyzed at the neuronal level. Our preliminary findings suggest a role for PFC in processing information related to cocaine seeking but not the hedonic effects of the drug. Further use of this recording technology can help dissect the functions of PFC and other components of the neural circuitry underlying relapse.

Firing Patterns of Accumbal Neurons During a Pavlovian-Conditioned Approach Task

The nucleus accumbens (NAc) is necessary for the expression of Pavlovian-conditioned approach behavior but not for the expression of instrumental behavior conditioned in sessions that set a low response requirement. Although numerous studies have characterized firing patterns of NAc neurons in relation to instrumental behavior, very little is known about how NAc neurons encode information in Pavlovian tasks. In the present study, recordings of accumbal firing patterns were made during sessions in which rats performed a Pavlovian-conditioned approach task. Most of the recorded neurons (74/83, 89%) exhibited significant responses during the conditioned stimulus (CS) presentation and/or the reward exposure. The reward responses were prevalent, predominantly inhibitory, and comparable to reward responses observed in various types of behavioral paradigms, including instrumental tasks. The CS responses could be segregated into multiple subtypes on the basis of directionality, onset latency, and duration. Several characteristics of the CS firing patterns were unique relative to cue responses observed previously during alternative types of conditioning sessions. It is possible that the novel firing patterns correspond to the differential contributions of the accumbens to Pavlovian-conditioned approach behavior and instrumentally conditioned behavior. Regardless, the novel patterns of firing add to existing evidence that characterization of accumbal firing patterns in Pavlovian tasks may provide additional information about the neurophysiological mechanisms that mediate accumbal contributions to behavior.

Higher magnitude accumbal phasic firing changes among core neurons exhibiting tonic firing increases during cocaine self-administration

Studies using i.v. cocaine self-administration in rats have documented rapid-phasic changes in the firing rate of nucleus accumbens neurons within seconds of cocaine-reinforced lever presses, as well as changes that occur over the course of the cocaine self-administration experiment, i.e. tonic changes in firing rate. During the self-administration period of the experiment, individual neurons exhibit either a tonic increase, a tonic decrease, or no tonic change in firing rate, relative to the neuron's firing rate during the pre-drug period. We evaluated whether rapid-phasic changes in firing were differentially associated with tonically reduced or tonically elevated firing of nucleus accumbens core and shell neurons in cocaine self-administering rats. Rapid-phasic firing patterns within seconds of the cocaine-reinforced lever press were exhibited predominantly by core neurons that also exhibited tonic increases in firing. Conversely, core neurons that did not exhibit such rapid-phasic firing patterns were more likely to show tonically reduced firing. Moreover, core neurons were more likely than shell neurons to exhibit: 1) tonic increases in firing and 2) rapid-phasic increases in firing preceding the cocaine-reinforced lever press. These differences between accumbens subterritories may be related to their distinct involvement in operant responding; the present findings are consistent with an emerging literature which implicates shell in contextual stimulus-induced responding, and core in processing the instrumental response via its discrete output to classic basal ganglia structures. The distinct tendency of the core to exhibit increased firing, coupled with its dichotomous firing outputs (i.e. tonic decreases without rapid phasic responses or tonic increases with rapid phasic responses), may reflect particular sensitivity of these neurons to excitatory limbic afferent signaling involved in instrumental responding. Enhanced phasic responsivity in the core may be an integral component of the mechanism inherent in normal reward processing which is subverted by chronic drug exposure.

Imbalance between drug and non-drug reward availability: A major risk factor for addiction

Laboratory animals self-administer most, though not all, drugs of abuse. Recent evidence shows that with increased drug availability, most laboratory rats develop all the major behavioral signs of addiction, including: 1) drug intake escalation, 2) increased motivation for the drug, 3) difficulty to abstain, 4) decreased reward function, and 5) inflexible drug use. The large prevalence of addicted rats may suggest that they are particularly vulnerable to develop compulsive drug use. I review evidence showing that this apparent vulnerability results in large part from the lack of positive (i.e., alternative non-drug rewards) and negative (i.e., costs) incentives capable of turning animals away from the pursuit of drugs. In particular, most animals seem to take drugs and eventually become addicted, not because drugs are intrinsically addictive, but more likely because drugs are the only significant sources of reward available in the laboratory. Laboratory animals would therefore represent more of a model of high-risk human groups than of the general population. Consequently, they should be more suited for searching factors that protect from, rather than predispose to, drug addiction. Reconsidering the environmental background of drug self-administration experiments in laboratory animals raises intriguing implications for understanding the initial demand for drug consumption and the transition to drug addiction, and for extrapolation from laboratory animals to humans.

Nucleus accumbens neurons in the rat exhibit differential activity to conditioned reinforcers and primary reinforcers within a second-order schedule of saccharin reinforcement

The nucleus accumbens has been associated with processing information related to primary reinforcement and reward. Most neurophysiological studies report that nucleus accumbens neurons are phasically excited in response to the onsets of salient events during the seeking of reinforcement and to the delivery of primary reinforcers. However, a minority of studies report inhibition during primary reinforcement. We recorded from 65 neurons in the nucleus accumbens whilst thirsty rats performed under a second-order schedule of saccharin reinforcement. This allowed us to analyse neural activity and behaviour during reinforcer-seeking in the presence of conditioned reinforcers (second-order stimuli, also called 'conditioned stimuli'), and during primary reinforcer consumption. Specifically, we sought to examine the valence of potential neural responses to primary reinforcement, to compare these responses to second-order stimulus-evoked responses, and to determine whether responses were differential to second-order stimuli presented at different time points within the schedule. Fifty out of 65 neurons we sampled responded to the second-order stimulus and/or consumption of the primary reinforcer. Most neurons in our sample exhibited excitation following the second-order stimulus and inhibition to the primary reinforcer, a pattern also present over the average response of the neural population. However, there was no systematic variation in neural responses evoked by second-order stimuli presented at different temporal proximities to primary reinforcement. Our results provide evidence that partially overlapping mechanisms within the nucleus accumbens differentially process conditioned reinforcers and primary reinforcers.

D1-like and D2 dopamine receptor antagonists administered into the shell subregion of the rat nucleus accumbens decrease cocaine, but not food, reinforcement

Cocaine self-administration experiments were designed to assess the respective roles of D1-like and D2-like dopamine receptors in the ventral forebrain in cocaine reinforcement. D1-like or D2-like dopamine receptor antagonists were microinjected into the nucleus accumbens core, nucleus accumbens shell, neostriatum or lateral septum prior to sessions in which cocaine was self-administered under a progressive ratio schedule by rats. The results indicated that administration of a D1/5 (SCH-23390) or a D2/D3/D4 (eticlopride), but not a D3 (U99194A) or D4 (L-750,667), dopamine receptor antagonist into the core and shell of the nucleus accumbens decreased the reinforcing efficacy of cocaine. However, in control experiments intra-accumbal core administration of SCH-23390 or eticlopride decreased food self-administration, whereas administration of these drugs into the accumbens shell had no effect on food reinforcement. Neither SCH-23390 nor eticlopride influenced cocaine reinforcement when administered into the neostriatum or lateral septum. Collectively, these results indicate that D1-like and D2 dopamine receptors in the nucleus accumbens shell selectively modulate the reinforcing efficacy of cocaine, whereas D1-like and D2 dopamine receptors in the accumbens core have a more general influence on reinforced behaviors.

Nucleus accumbens cell firing and rapid dopamine signaling during goal-directed behaviors in rats

The nucleus accumbens (Acb) is a key neural substrate underlying goal-directed behaviors for both drugs of abuse as well as 'natural' rewards. Here, I review electrophysiological and electrochemical studies completed in our laboratory that examined Acb cell firing and rapid dopamine signaling during behaviors directed toward reward procurement. Electrophysiological studies are reviewed showing that Acb neurons exhibit patterned discharges relative to operant responding for intravenous self-administration of cocaine versus 'natural' reinforcement in rodents. Importantly, subsequent studies showed that discrete subsets of Acb neurons are selectively activated during multiple schedules for a natural reward (water or food) versus cocaine self-administration. These later findings indicate that separate neural circuits selectively process information about goal-directed behaviors for cocaine versus natural reward. In addition, recent findings are reviewed showing that reinforcer selective firing of Acb neurons is not a direct consequence of chronic drug exposure. Next, electrochemical studies are summarized that used fast scan cyclic voltammetry to measure rapid (subsecond) changes in dopamine in the Acb during cocaine self-administration as well as 'natural' reinforcement in rodents. These findings are considered with respect to the role of dopamine in modulating the activity of Acb neurons that encode goal-directed behaviors, the functional organization of the Acb on a microcircuit level, and proposed directions for future studies.

Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task

The nucleus accumbens (NAc) has long been thought of as a limbic-motor interface. Despite behavioral and anatomical evidence in favor of this idea, little is known about how NAc neurons encode information about motivationally relevant environmental cues and use this information to affect motor action. We therefore investigated the firing of these neurons during the performance of a discriminative stimulus (DS) task using simultaneous multiple single-unit recordings in rats. In this task, two stimuli are randomly presented to the animal: a DS, which signals the availability of a sucrose reward contingent on an operant response, and a similar but nonrewarded stimulus (NS). Subpopulations of NAc neurons increased or decreased their firing in association with several distinct components of the task. In this paper, we investigate cue- and operant-responsive neurons. Neurons excited and inhibited by cues showed larger firing changes in response to the DS than the NS and larger changes when the animal made an operant response to the cue than when the animal failed to respond. Excitations during operant responding were not modulated by the information contained by the cue, whereas inhibitions during operant responding were somewhat larger if the operant response occurred during the DS and somewhat smaller if they occurred in the absence of a cue. These results are consistent with the hypothesis that the firing of subpopulations of NAc neurons encode both the predictive value of environmental stimuli and the specific motor behaviors required to respond to them.

Accumbal Neural Responses During the Initiation and Maintenance of Intravenous Cocaine Self-Administration

During a chronic extracellular recording session, animals with a history of cocaine self-administration were allowed to initiate drug seeking under drug-free conditions. Later, in the same recording session, animals engaged in intravenous cocaine self-administration. During the drug-free period, 31% of 70 accumbal neurons showed a significant increase in average firing rate in association with either or both the exposure to cues that signaled the onset of cocaine availability and the subsequent onset of drug-seeking behavior. The neurons that showed an average excitatory response during the drug-free period were the only group of neurons that showed an average excitatory phasic response to cocaine-reinforced lever presses during the drug self-administration session. A majority of the neurons that were activated during the drug-free period, like the majority of other neurons, showed decreases in average firing in response to self-administered cocaine. However, the neurons that were activated during the drug-free period maintained a higher rate of firing throughout the self-administration session than did other accumbal neurons. The data of the present study are consistent with the conclusion that accumbal neurons contribute to, or otherwise process, initiation of drug seeking under drug-free conditions and that they do so via primarily excitatory responses. Furthermore, there is continuity between the drug-free and -exposed conditions in neural responses associated with drug seeking. Finally, the data have potential implications for understanding mechanisms that transduce accumbal-mediated drug effects that contribute to drug addiction.

Reward, memory and substance abuse: functional neuronal circuits in the nucleus accumbens

The firing patterns of neurons in the nucleus accumbens (NA) are examined and discussed with respect to different types of rewards and reward conditions. Comparisons and contrasts between individually identified NA neuron responses to cocaine self-administration and water reinforcement are presented with an emphasis on the fact that the same neurons do not respond in a phasic manner to both types of rewards. However, the phasic firing patterns, even though segregated for each reinforcer, are quite similar, suggesting that the method of differentiation between rewarding stimuli in the NA is by sorting cell populations into distinct ensembles or networks for each type of reinforcer. These neural networks appear to be 'tuned' to respond to particular associative behavioral contexts that couple response execution to reward delivery, and in the process acquire a reciprocity to firing within reward contexts. This maintains the specificity of each reinforcer for the response and associated stimuli that produce it and, makes it possible to attach different NA networks to different reinforcing circumstances. Comparisons of cocaine and water reinforced NA cell firing patterns during rapid switching between these two reinforcers suggests that the networks are negatively coupled and mutually inhibit each other to maintain accurate encoding of immediately experienced, as well as expected (i.e. future) reward contingencies.

Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues

The nucleus accumbens (NAc) plays an important role in both appetitive and consummatory behavior. To examine how NAc neurons encode information during reward consumption, we recorded the firing activity of rat NAc neurons during the performance of a discriminative stimulus task. In this task, the animal must make an operant response to an intermittently presented cue to obtain a sucrose reward delivered in a reward receptacle. Uncued entries to the receptacle were not rewarded. Both excitations and inhibitions during reward consumption were observed, but substantially more neurons were inhibited than excited. These excitations and inhibitions began when the animal entered the reward receptacle and ended when the animal exited the receptacle. Both excitations and inhibitions were much smaller or nonexistent when the animal made uncued entries into the reward receptacle. In one set of experiments, we randomly withheld the reward in some cued trials that would otherwise have been rewarded. Excitations and inhibitions were of similar magnitude whether or not the reward was delivered. This indicates that the sensory stimulus of reward does not drive these phasic responses; instead, the reward-associated responses may be driven by the conditioned stimuli associated with reward, or they may encode information about consummatory motor activity. Another population of NAc neurons was excited on exit from the reward receptacle. Many of these excitations persisted for tens of seconds after the receptacle exit and showed a significant inverse correlation with the rate of uncued operant responding. These findings are consistent with a contribution of NAc neurons to both reward consummatory and reward seeking behavior.

Basolateral amygdala neurons encode cocaine self-administration and cocaine-associated cues

Electrophysiological recording procedures were used to examine basolateral amygdala (BLA) cell firing during cocaine self-administration and relative to response-independent presentations of cocaine-associated stimuli. Of 72 neurons (n = 10 rats), 31 cells (43%) were classified as phasically active, exhibiting one of three types of patterned discharges relative to the drug-reinforced response, similar to that previously described for nucleus accumbens (Acb) neurons (Carelli, 2002). Briefly, neurons exhibited increased firing rates within seconds preceding the response [termed preresponse (PR)], increased activity within seconds after the response [termed reinforcement excitation (RFe)] or an inhibition in cell firing before and/or after the response for intravenous cocaine [termed reinforcement inhibition (RFi)]. To examine the responsiveness of these same neurons to cocaine-associated stimuli, the stimulus "probe" procedure was used. Specifically, probe trials (18-20) were presented in which the audiovisual (tone-house light) stimulus associated with intravenous cocaine delivery during self-administration was randomly presented by the computer, interspersed between reinforced lever press responses. Neurons classified as type PR or type RFi were not activated by the stimulus. In contrast, neurons that exhibited increased firing immediately after the response (type RFe neurons) were significantly activated by the audiovisual cue. These findings are discussed with respect to the role of the BLA in cocaine addiction as well as previous studies characterizing Acb cell firing during cocaine self-administration.

Persistent cue-evoked activity of accumbens neurons after prolonged abstinence from self-administered cocaine

Persistent neural processing of information regarding drug-predictive environmental stimuli may be involved in motivating drug abusers to engage in drug seeking after abstinence. The addictive effects of various drugs depend on the mesocorticolimbic dopamine system innervating the nucleus accumbens. We used single-unit recording in rats to test whether accumbens neurons exhibit responses to a discriminative stimulus (SD) tone previously paired with cocaine availability during cocaine self-administration. Presentation of the tone after 3-4 weeks of abstinence resulted in a cue-induced relapse of drug seeking under extinction conditions. Accumbens neurons did not exhibit tone-evoked activity before cocaine self-administration training but exhibited significant SD tone-evoked activity during extinction. Under extinction conditions, shell neurons exhibited significantly greater activity evoked by the SD tone than that evoked by a neutral tone (i.e., never paired with reinforcement). In contrast, core neurons responded indiscriminately to presentations of the SD tone or the neutral tone. Accumbens shell neurons exhibited significantly greater SD tone-evoked activity than did accumbens core neurons. Although the onset of SD tone-evoked activity occurred well before the earliest movements commenced (150 msec), this activity often persisted beyond the onset of tone-evoked movements. These results indicate that accumbens shell neurons exhibit persistent processing of information regarding reward-related stimuli after prolonged drug abstinence. Moreover, the accumbens shell appears to be involved in discriminating the motivational value of reward-related associative stimuli, whereas the accumbens core does not.

Differential changes in signal and background firing of accumbal neurons during cocaine self-administration

Learning theories of drug addiction propose that the disorder is, at least in part, attributable to drug effects on accumbal mechanisms that are normally involved in reward-related learning. The neurophysiological mechanisms that might transduce such a drug effect on accumbal mechanisms have yet to be identified. Previous studies showed that a population of accumbal neurons exhibit phasic excitatory responses time locked to cocaine-reinforced lever presses during intravenous cocaine self-administration sessions (neurons referred to as lever-press neurons). Most of the same neurons, like the majority of accumbal neurons, also show a decrease in average firing rate during the drug self-administration session. Evidence indicates that the phasic firing patterns transmit information related to drug-reward-related events. On the other hand, the decreases in average firing reflect a primary pharmacological effect of self-administered cocaine. In the present study, we tested the hypothesis that the phasic firing associated with drug seeking (i.e., signal) is less sensitive than other accumbal firing (i.e., background) to the inhibitory effect of cocaine. During intravenous cocaine self-administration sessions, 45 of 68 neurons showed a decrease in average firing during the self-administration session relative to a predrug baseline period. Fourteen neurons showed both an inhibition in average firing and an excitatory phasic response. For these 14 neurons, signal either remained equal to the average predrug firing rate or exceeded the predrug firing rate during the self-administration session. For the same neurons, background firing generally fell below average predrug firing. The differential changes in signal and background were associated with an increase in the ratio of signal-to-background for the individual neurons. Moreover, the relatively unique resistance of signal to inhibition was associated with an increase in the ratio of signal firing of all lever-press neurons relative to the background firing of all recorded neurons. This type of differential inhibition in signal and background firing might be expected to increase the relative influence of the drug-reward-related signals on accumbal-related neural circuits and differentially influence susceptibility of drug- and non-drug-reward-related synaptic and neural responses to neuroplasticity. It thus represents a mechanism by which inhibitory effects of self-administered drug might amplify the accumbal contribution to behavior and learning and potentially contribute to drug addiction.

Escalation of cocaine self-administration does not depend on altered cocaine-induced nucleus accumbens dopamine levels

Previous studies showed that prolonged access to cocaine or heroin self-administration (long access, or LgA) produces an escalation in drug intake not observed with limited access to the drug (short access, or ShA). The present experiment employed in vivo microdialysis to test the role of alterations in drug pharmacokinetics and/or efficacy in increasing dopamine (DA) levels in the nucleus accumbens (NAcc) during cocaine intake escalation. In experiment 1, both ShA and LgA rats were challenged with passive intravenous administration of cocaine (0.125-1 mg/injection). Regardless of the doses tested, there was no difference between groups in the ability of cocaine to increase NAcc DA levels and no group differences in the temporal profile of dialysate cocaine levels. In experiment 2, cocaine and DA concentrations were measured during cocaine self-administration. Self-administration produced sustained increases of DA in the NAcc with LgA rats maintaining greater steady levels of DA (750% of baseline) than ShA rats (400% of baseline). The difference in the LgA versus ShA rats was not due to differences in the efficacy of cocaine to elevate DA levels, or in the rate of cocaine metabolism, but was directly related to the amount of self-administered cocaine. These findings show that changes in cocaine efficacy or pharmacokinetics do not play a critical role in cocaine intake escalation.

Brain circuitry and the reinstatement of cocaine-seeking behavior

RATIONALE

Recent studies have attempted to identify the neuroanatomical substrates underlying primed reinstatement of drug-seeking behavior. Identification of neuronal substrates will provide a logical rationale for designing pharmacological interventions in treating drug relapse.

OBJECTIVE

The objective was to identify brain circuitry that is shared between cue-, drug- and stress-primed reinstatement, as well as identifying aspects of brain circuitry that are distinct for each stimulus modality. The resulting circuit offers theoretical interpretations for consideration in future studies.

RESULTS

Aspects of the circuitry mediating reinstatement can be identified with reasonable confidence. The role of the basolateral amygdala in cue-primed reinstatement, the role of the ventral tegmental area in drug-primed reinstatement and the role of adrenergic innervation of the extended amygdala in stress-primed reinstatement are well characterized. Also, all three modes for priming reinstatement may converge on the anterior cingulate cortex and have a final common output through the core of the nucleus accumbens. Lacunae in our understanding of the circuit were identified, especially with regard to how stress priming is conveyed from the extended amygdala to the shared anterior cingulate accumbens core circuit.

CONCLUSIONS

The proposed convergence of priming stimuli into the glutamatergic projection from anterior cingulate to the accumbens core combined with the changes in glutamate transmission and signaling that accompany repeated psychostimulant administration points to the potential value of pharmacological agents that manipulate glutamate release or postsynaptic glutamate receptor signaling and trafficking in treating primed relapse in addicts.

Variability of drug self-administration in rats

RATIONALE

Although temporal patterns of drug self-administration in animals are known to be highly regular, this regularity has rarely been quantified or systematically compared across reinforcers.

OBJECTIVES

Over a range of unit doses, this study assessed: (1) the within-subject variability of inter-infusion intervals (latencies); (2) the estimated whole-body drug level at the time of self-infusion; (3) the within-subject variability of these drug levels; and (4) the statistical dependence between successive latencies, to determine whether regularity is maintained by compensatory, moment-to-moment adjustment of latencies.

METHODS

Rats were trained with cocaine (10-1000 microg/kg per infusion, IV), remifentanil (an ultra-short acting opioid; 0.25-32 microg/kg per infusion, IV), or food (20-180 mg/delivery).

RESULTS

Within subjects, latencies were most consistent from infusion to infusion at unit doses on the descending limb of the dose-response curve. However, the drug level at the time an infusion was initiated was actually least consistent at these doses. Sequential latencies showed only a weak autocorrelation for both drugs.

CONCLUSION

These results suggest that highly consistent response patterns are not simply a product of precise titration of drug levels. The weak autocorrelation between sequential latencies suggests that temporal regularity of responding is not maintained through compensatory adjustments of post-infusion pauses.

Effects of nicotine in the dopaminergic system of mice lacking the alpha4 subunit of neuronal nicotinic acetylcholine receptors

The mesostriatal dopaminergic system influences locomotor activity and the reinforcing properties of many drugs of abuse including nicotine. Here we investigate the role of the alpha4 nicotinic acetylcholine receptor (nAChR) subunit in mediating the effects of nicotine in the mesolimbic dopamine system in mice lacking the alpha4 subunit. We show that there are two distinct populations of receptors in the substantia nigra and striatum by using autoradiographic labelling with 125I alpha-conotoxin MII. These receptors are comprised of the alpha4, beta2 and alpha6 nAChR subunits and non-alpha4, beta2, and alpha6 nAChR subunits. Non-alpha4 subunit-containing nAChRs are located on dopaminergic neurons, are functional and respond to nicotine as demonstrated by patch clamp recordings. In vivo microdialysis performed in awake, freely moving mice reveal that mutant mice have basal striatal dopamine levels which are twice as high as those observed in wild-type mice. Despite the fact that both wild-type and alpha4 null mutant mice show a similar increase in dopamine release in response to intrastriatal KCl perfusion, a nicotine-elicited increase in dopamine levels is not observed in mutant mice. Locomotor activity experiments show that there is no difference between wild-type and mutant mice in basal activity in both habituated and non-habituated environments. Interestingly, mutant mice sustain an increase in cocaine-elicited locomotor activity longer than wild-type mice. In addition, mutant mice recover from depressant locomotor activity in response to nicotine at a faster rate. Our results indicate that alpha4-containing nAChRs exert a tonic control on striatal basal dopamine release, which is mediated by a heterogeneous population of nAChRs.

Stimulus control of cocaine self-administration

Environmental stimuli that set the occasion wherein drugs are acquired can "trigger" drug-related behavior. Investigating the stimulus control of drug self-administration in laboratory animals should help us better understand this aspect of human drug abuse. Stimulus control of cocaine self-administration was generated here for the first time using multiple and chained schedules with short, frequently-alternating components--like those typically used to study food-maintained responding. The procedures and results are presented along with case histories to illustrate the strategies used to produce this stimulus control. All these multicomponent schedules contained variable-interval (VI) components as well as differential-reinforcement-of-other-behavior (DRO) or extinction components. Schedule parameters and unit dose were adjusted for each rat to produce stable, moderate rates in VI components, with minimal postreinforcement (infusion) pausing, and response cessation in extinction and DRO components. Whole-body drug levels on terminal baselines calculated retrospectively revealed that all rats maintained fairly stable drug levels (mean, 2.3 to 3.4 mg/kg) and molar rates of intake (approximately 6.0 mg/kg/hr). Within this range, no relation between local VI response rates and drug level was found. The stimulus control revealed in cumulative records was indistinguishable from that achieved with food under these schedules, suggesting that common mechanisms may underlie the control of cocaine- and food-maintained behavior.

Cocaine is self-administered into the shell but not the core of the nucleus accumbens of Wistar rats

The rewarding properties of cocaine have been postulated to be regulated, in part, by the mesolimbic dopamine system. However, the possibility that the rewarding properties of cocaine are mediated by direct activation of this system has yielded contradictory findings. The intracranial self-administration technique is used to identify specific brain regions involved in the initiation of response-contingent behaviors for the delivery of a reinforcer. The present study assessed whether adult Wistar rats would self-administer cocaine directly into the nucleus accumbens shell (AcbSh) and core (AcbC). For each subregion, subjects were placed in standard two-lever operant chambers and randomly assigned to one of five groups for each site that were given either artificial cerebrospinal fluid (aCSF), or 400, 800, 1200, or 1600 pmol of cocaine/100 nl to self-administer. The data indicate that rats with placements within the AcbSh readily self-administered 800 to 1600 pmol of cocaine/100 nl and responded significantly more on the active than inactive lever. These subjects also decreased responding on the active lever when aCSF was substituted for cocaine and reinstated responding on the active lever when cocaine was reintroduced. Coinfusion of the D2-like receptor antagonist sulpiride inhibited cocaine self-infusion in the AcbSh. In contrast to the AcbSh data, rats failed to self-administer any tested dose of cocaine into the AcbC or areas ventral to the AcbSh. These findings suggest that the AcbSh is a neuroanatomical substrate for the reinforcing effects of cocaine and that activation of D2-like receptors is involved.

Metabolic mapping of the effects of cocaine during the initial phases of self-administration in the nonhuman primate

Because most human studies of the neurobiological substrates of the effects of cocaine have been performed with drug-dependent subjects, little information is available about the effects of cocaine in the initial phases of drug use before neuroadaptations to chronic exposure have developed. The purpose of the present study, therefore, was to define the substrates that mediate the initial effects of cocaine in a nonhuman primate model of cocaine self-administration using the 2-[14C]deoxyglucose method. Rhesus monkeys were trained to self-administer 0.03 mg/kg per injection (N = 4) or 0.3 mg/kg per injection (N = 4) cocaine and compared with monkeys trained to respond under an identical schedule of food reinforcement (N = 4). Monkeys received 30 reinforcers per session, and metabolic mapping was conducted at the end of the fifth self-administration session. Cocaine self-administration reduced glucose utilization in the mesolimbic system, including the ventral tegmental area, ventral striatum, and medial prefrontal cortex. In addition, metabolic activity was increased in the dorsolateral and dorsomedial prefrontal cortex, as well as in the mediodorsal nucleus of the thalamus. These latter effects are distinctly different from those seen after the noncontingent administration of cocaine, suggesting that self-administration engages circuits beyond those engaged merely by the pharmacological actions of cocaine. The involvement of cortical areas subserving working memory suggests that strong associations between cocaine and the internal and external environment are formed from the very outset of cocaine self-administration. The assessment of the effects of cocaine at a time not readily evaluated in humans provides a baseline from which the effects of chronic cocaine exposure can be investigated.

Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. 'natural' reinforcement

Numerous investigations indicate that the nucleus accumbens (Acb) is an important neural substrate mediating the reinforcing properties of 'natural' rewards (food or water) as well as abused substances. Here, our electrophysiological studies that examined Acb cell firing within seconds of lever press responding for intravenous cocaine vs. water or food reinforcement in rats are reviewed. Initial investigations revealed that a subset of Acb neurons exhibits four types of firing patterns within seconds of the reinforced response for intravenous cocaine during self-administration sessions. Three of those four cell types were also observed during water reinforcement sessions. In a subsequent study, the activity of the same Acb neurons was examined in rats responding on multiple schedules for either two distinct 'natural' reinforcers (water and food), or one of those 'natural' reinforcers and the intravenous self-administration of cocaine. The results showed that the majority of neurons tested exhibited similar, overlapping neuronal firing patterns across the two 'natural' reinforcer conditions. In contrast, the majority of neurons examined displayed differential, nonoverlapping firing patterns relative to operant responding for water (or food) vs. cocaine reinforcement. Additional studies that examined the role of associative factors on Acb cell firing during cocaine self-administration sessions are reviewed. Collectively, these findings illustrate the dynamic nature of Acb cell firing in behaving animals, and provide insight into how Acb neurons process information about goal-directed behaviors for 'natural' reinforcers vs. abused substances.

Neurodevelopmental liabilities in alcohol dependence: central serotonin and dopamine dysfunction

Alcoholism is a complex disorder with symptoms ranging from abuse to dependence, often comorbid with depression, antisocial personality, or anxiety. Neurodevelopmental causes of the disorder are unknown but inferences are possible from current knowledge. Neurobiological studies implicate multiple brain changes, which may be characterized as premorbid or morbid. These studies have also examined specific aspects of the alcohol dependence syndrome, including alcohol reinforcement and craving. Here, we review the evidence for vulnerability factors in alcohol dependence, with an emphasis on central serotonin (5-HT) and dopamine (DA). Serotonin dysfunction likely contributes to the development of alcoholism since studies of alcohol-preferring rodents show decreased 5-HT function on many measures. We have shown that serotonin-enhancing drugs reduce consumption and craving in mild to moderate alcoholics, yet similar studies in severely dependent individuals remain inconclusive. Studies indicate that serotonin dysfunction may contribute to the development of dependence via impaired impulse control and/or mood regulation. The mesocorticolimbic dopamine pathway represents another important pathophysiological target in alcoholism. Differences in D(2) receptor density, dopamine sensitivity, and gene expression have been linked to consumption, reinforcement, craving, and relapse. However, while DA agonists reduce self-administration in animals, we found no effect in humans with long-acting bromocriptine, a D(2) agonist. Dopamine may contribute differentially to the development of dependence via its effects on alcohol wanting, reinforcement, and reward memory. Although animal experiments show consistent roles for serotonin and dopamine in alcohol dependence, human studies are not always concordant. Such discrepancies highlight the complexity of dependence-related behaviors in humans and of identifying vulnerabilities to alcoholism.

Comparison of cocaine- and methamphetamine-evoked dopamine and glutamate overflow in somatodendritic and terminal field regions of the rat brain during acute, chronic, and early withdrawal conditions

Methamphetamine and cocaine are among the most commonly abused psychostimulants. Repeated injections of psychostimulants produce behavioral sensitization or augmented locomotion in rats. Behavioral sensitization to methamphetamine and cocaine is long lasting and persists after cessation of drug treatment. Because dopamine and glutamate are major neurotransmitters of the neostriatum, we evaluated the profile of cocaine- or methamphetamine-evoked dopamine and glutamate overflow in the caudate putamen, nucleus accumbens, ventral tegmental area, and substantia nigra compacta of the rat brain. We also compared acute exposure to these drugs with chronic treatment and early withdrawal. Acute injection of methamphetamine (1 mg/kg of body weight) or cocaine (10 mg/kg) resulted in elevated levels of extracellular dopamine in all brain regions measured, although the magnitude of increase varied between brain regions. Overall, methamphetamine caused more dopamine to accumulate in the extracellular space than did cocaine when administered to animals during early withdrawal (7 days of daily injections and challenge on day 11). For example, a challenge injection of methamphetamine produced a greater elevation of extracellular dopamine in the caudate putamen when compared to acute (naïve) exposure. By contrast, a challenge injection of cocaine resulted in dopamine levels in the caudate putamen that were lower than those observed for acute exposure. In the ventral tegmental area and the substantia nigra compacta, a challenge injection of methamphetamine or cocaine resulted in extracellular dopamine levels that were lower than those for acute exposure. Thus, it appears that behavioral sensitization to cocaine can be sustained during early withdrawal in the absence of augmented drug-evoked dopamine overflow. Acute injection of methamphetamine or cocaine did not change extracellular levels of glutamate in the neostriatum. Cocaine challenge (early withdrawal) increased glutamate overflow in the caudate putamen and the nucleus accumbens. In contrast, methamphetamine challenge increased glutamate overflow in the caudate putamen, but it decreased glutamate in the nucleus accumbens. In the ventral tegmental area and the substantia nigra compacta, acute methamphetamine exposure decreased glutamate overflow, but acute cocaine exposure increased it. Although amphetamines and cocaine induce similar behavioral responses, the results presented here demonstrate that at the neurochemical level (neurotransmitter release) they sometimes evoke opposite effects depending on the brain region studied and the duration of drug treatment. Moreover, the sensitized augmentation of locomotor activity observed by us and others in response to a challenge injection of cocaine is not dependent on elevation of the extracellular concentration of dopamine in the neostriatum. We are currently investigating the hypothesis that cocaine activates peptidergic systems of the neostriatum and that these systems modulate the synaptic release of dopamine in response to psychostimulants.

The role of the brain reward system in depression

The goal of this review is to familiarize the reader about the potential involvement of the brain reward system (BRS) in symptoms of Major Depressive Disorder (MDD). The authors introduce a novel approach to study the pathophysiology of MDD that includes pharmacological probing of BRS pathways (e.g. d-amphetamine, hydromorphone) together with an elicited and measurable behavioral component (e.g. pleasant effects, increased energy, altered cognition). To this date, the major focus of MDD pathophysiology studies has been to characterize biological differences between healthy subjects and depressed patients such as alteration in the monoaminergic and endocrine systems. The relative importance of the various biological changes has not been elucidated, that is, linking these with specific behavioral manifestations in MDD have rarely been attempted. One core symptom of MDD is a decreased experience of pleasure or interest in previously enjoyed activities (i.e. anhedonia) such as work or hobbies, and is accompanied by decreased motivation or drive. The BRS consists of the neural pathways involved in eliciting rewarding experiences in animals and humans. The hypothesis is that altered BRS function may be an underlying brain mechanism of the loss of pleasure/interest experienced in MDD, and will be manifested through an altered response to a BRS probe. The authors have examined BRS function in MDD by introducing a pharmacological probe (i.e. d-amphetamine/d-amph). Amphetamine is defined as a probe due to its ability to release dopamine within major components of the BRS (i.e. the mesocorticolimbic dopamine system.) In addition to the objective pharmacological effects (e.g. altered heart rate), BRS probes like d-amph elicit reliable and measurable behavior, that is, the hedonic effects. A review of the neurobiology of MDD, the BRS, the rationale for implicating the BRS in depressive symptoms, and preliminary data, are presented in this article.

[Animal models of drug dependence using the drug self-administration method]

This paper will review 1) experimental models of drug-seeking behavior and 2) mechanisms underlying the behavior, focusing on cocaine self-administration. After the acquisition of self-administration, vigorous lever-pressing is generally observable after the drug was replaced by saline. This lever-pressing behavior under saline infusion can be considered "drug-seeking behavior". Drug-seeking behavior is reinstated by non-contingent injection of the drug, stress exposure and presentation of drug-associated stimuli even after extinction. This is called a relapse/reinstatement model. Electrophysiological studies showed that the majority of accumbal neurons is tonically inhibited during cocaine self-administration and exhibited phasic increases in firing time-locked to cocaine self-infusion, which might represent the craving state or drive animals to drug-seeking behavior. Voltammetry and microdialysis studies indicated that the timing of drug-seeking responses can be predicted from fluctuations in accumbal extracellular dopamine concentration. Whereas dopamine D2-like agonists reinstated extinguished cocaine-seeking behavior, D1-like agonists prevented the relapse in cocaine-seeking behavior induced by cocaine itself. Given that an AMPA receptor antagonist, but not dopamine antagonist, prevented cocaine-seeking behavior induced by cocaine, glutamate transmission in the nucleus accumbens is thought to be important for expression of craving or drug-seeking behavior.