Firing rate of nucleus accumbens neurons is dopamine-dependent and reflects the timing of cocaine-seeking behavior in rats on a progressive ratio schedule of reinforcement

Nucleus accumbens shell neurons' early sensitivity to cocaine is associated with future increases in drug intake

The striatum, both dorsal and ventral, is strongly implicated in substance use disorder. Chronic consumption of abused substances, such as cocaine, can cause an oversaturation of mesostriatal dopamine, which results in alterations in the firing of striatal neurons. While most preclinical studies of drug self-administration (S-A) are focused on these alterations, individual differences in a subject's early responses to drugs can also account for substantial differences in addiction susceptibility. In this study, we modeled longitudinal pharmacokinetics using data from a previous longitudinal study (Coffey et al., 2015) and aimed to determine if firing in specific dorsal and ventral striatal subregions was subject to changes across chronic cocaine S-A, and if individual animal differences in striatal firing in response to early drug exposure correlated with increases in drug intake. We observed that the firing patterns of nucleus accumbens (NAc) core and shell neurons exhibited increasing sensitivity to cocaine over the first 6 S-A sessions and maintained a strong negative correlation between drug intake and neuronal firing rates across chronic S-A. Moreover, we observed that the early sensitivity of NAc shell neurons to cocaine correlated with future increases in drug intake. Specifically, rats whose NAc shell neurons were most inhibited by increasing levels of cocaine upon first exposure exhibited the strongest increases in cocaine intake over time. If this difference can be linked to a genetic difference, or druggable targets, it may be possible to screen for similar addiction susceptibility in humans or develop novel preemptive pharmacotherapies.

The influence of insight on risky decision making and nucleus accumbens activation

During insightful problem solving, the solution appears unexpectedly and is accompanied by the feeling of an AHA!. Research suggests that this affective component of insight can have consequences beyond the solution itself by motivating future behavior, such as risky (high reward and high uncertainty) decision making. Here, we investigate the behavioral and neural support for the motivational role of AHA in decision making involving monetary choices. The positive affect of the AHA! experience has been linked to internal reward. Reward in turn has been linked to dopaminergic signal transmission in the Nucleus Accumbens (NAcc) and risky decision making. Therefore, we hypothesized that insight activates reward-related brain areas, modulating risky decision making. We tested this hypothesis in two studies. First, in a pre-registered online study (Study 1), we demonstrated the behavioral effect of insight-related increase in risky decision making using a visual Mooney identification paradigm. Participants were more likely to choose the riskier monetary payout when they had previously solved the Mooney image with high compared to low accompanied AHA!. Second, in an fMRI study (Study 2), we measured the effects of insight on NAcc activity using a similar Mooney identification paradigm to the one of Study 1. Greater NAcc activity was found when participants solved the Mooney image with high vs low AHA!. Taken together, our results link insight to enhanced NAcc activity and a preference for high but uncertain rewards, suggesting that insight enhances reward-related brain areas possibly via dopaminergic signal transmission, promoting risky decision making.

Nucleus Accumbens D1 Receptor-Expressing Spiny Projection Neurons Control Food Motivation and Obesity

BACKGROUND

Obesity is a chronic relapsing disorder that is caused by an excess of caloric intake relative to energy expenditure. There is growing recognition that food motivation is altered in people with obesity. However, it remains unclear how brain circuits that control food motivation are altered in obese animals.

METHODS

Using a novel behavioral assay that quantifies work during food seeking, in vivo and ex vivo cell-specific recordings, and a synaptic blocking technique, we tested the hypothesis that activity of circuits promoting appetitive behavior in the core of the nucleus accumbens (NAc) is enhanced in the obese state, particularly during food seeking.

RESULTS

We first confirmed that mice made obese with ad libitum exposure to a high fat diet work harder than lean mice to obtain food, consistent with an increase in food motivation in obese mice. We observed greater activation of D₁ receptor-expressing NAc spiny projection neurons (NAc D1^SPNs) during food seeking in obese mice relative to lean mice. This enhanced activity was not observed in D₂ receptor-expressing neurons (D2^SPNs). Consistent with these in vivo findings, both intrinsic excitability and excitatory drive onto D1^SPNs were enhanced in obese mice relative to lean mice, and these measures were selective for D1^SPNs. Finally, blocking synaptic transmission from D1^SPNs, but not D2^SPNs, in the NAc core decreased physical work during food seeking and, critically, attenuated high fat diet-induced weight gain.

CONCLUSIONS

These experiments demonstrate the necessity of NAc core D1^SPNs in food motivation and the development of diet-induced obesity, establishing these neurons as a potential therapeutic target for preventing obesity.

L-Type Calcium Channel Blockers: A Potential Novel Therapeutic Approach to Drug Dependence

This review describes interactions between compounds, primarily dihydropyridines, that block L-type calcium channels and drugs that cause dependence, and the potential importance of these interactions. The main dependence-inducing drugs covered are alcohol, psychostimulants, opioids, and nicotine. In preclinical studies, L-type calcium channel blockers prevent or reduce important components of dependence on these drugs, particularly their reinforcing actions and the withdrawal syndromes. The channel blockers also reduce the development of tolerance and/or sensitization, and they have no intrinsic dependence liability. In some instances, their effects include reversal of brain changes established during drug dependence. Prolonged treatment with alcohol, opioids, psychostimulant drugs, or nicotine causes upregulation of dihydropyridine binding sites. Few clinical studies have been carried out so far, and reports are conflicting, although there is some evidence of effectiveness of L-channel blockers in opioid withdrawal. However, the doses of L-type channel blockers used clinically so far have necessarily been limited by potential cardiovascular problems and may not have provided sufficient central levels of the drugs to affect neuronal dihydropyridine binding sites. New L-type calcium channel blocking compounds are being developed with more selective actions on subtypes of L-channel. The preclinical evidence suggests that L-type calcium channels may play a crucial role in the development of dependence to different types of drugs. Mechanisms for this are proposed, including changes in the activity of mesolimbic dopamine neurons, genomic effects, and alterations in synaptic plasticity. Newly developed, more selective L-type calcium channel blockers could be of considerable value in the treatment of drug dependence. SIGNIFICANCE STATEMENT: Dependence on drugs is a very serious health problem with little effective treatment. Preclinical evidence shows drugs that block particular calcium channels, the L-type, reduce dependence-related effects of alcohol, opioids, psychostimulants, and nicotine. Clinical studies have been restricted by potential cardiovascular side effects, but new, more selective L-channel blockers are becoming available. L-channel blockers have no intrinsic dependence liability, and laboratory evidence suggests they reverse previously developed effects of dependence-inducing drugs. They could provide a novel approach to addiction treatment.

Diazepam attenuates the effects of cocaine on locomotion, 50-kHz ultrasonic vocalizations and phasic dopamine in the nucleus accumbens of rats

BACKGROUND AND PURPOSE

Currently, there is no effective drug to treat cocaine-use disorder, which affects millions of people worldwide. Benzodiazepines are potential therapeutic candidates, as microdialysis and voltammetry studies have shown that they can decrease dopamine concentrations in the nucleus accumbens of rodents and block the increase in dopamine levels and appetitive 50-kHz ultrasonic vocalizations (USVs) induced by amphetamine in rats.

EXPERIMENTAL APPROACH

Here, we tested whether administration of 2.5-mg·kg^-1 diazepam (i.p.) in adult male rats could block the effects of 20-mg·kg^-1 cocaine (i.p.) on electrically evoked phasic dopamine signals in the nucleus accumbens measured by fast-scan cyclic voltammetry, as well as 50-kHz USV and locomotor activity.

KEY RESULTS

Cocaine injection increased evoked dopamine signals up to threefold within 5 min, and the increase was significantly higher than baseline for at least 75 min. The injection of diazepam, 5 min after cocaine, attenuated the cocaine effect by nearly 50%, and this attenuation was maintained for at least 40 min. Behaviourally, cocaine increased the number of appetitive 50-kHz calls by about 12-fold. Diazepam significantly blocked this effect for the entire duration of the session. Also, cocaine-treated rats were more active than controls and diazepam significantly attenuated cocaine-induced locomotion, by up to 50%.

CONCLUSION AND IMPLICATIONS

These results suggest that the neurochemical and psychostimulant effects of cocaine can be mitigated by diazepam.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Methodological and analytical issues of progressive ratio schedules: Definition and scaling of breakpoint

BACKGROUND

The break point (BP) of the progressive ratio (PR) schedule of drug delivery is a well-recognized parameter in self-administration studies. Nonetheless, two problems remain unresolved: there is no rationally justified criterion for the last response at BP; the both commonly used definitions of BP as the number of deliveries or the last complete progressive ratio requirement are not the best assuming that BP is a measure of motivation.

NEW METHOD

A criterion for the last lever press is proposed in this study using intravenous cocaine self-administration in rats. The rationale is based on the finding that long inter-press intervals have initially very low probability to occur during the self-administration phase of the session under the PR schedule. But this probability dramatically increases when inter-injection intervals increase due to high ratio requirements.

RESULTS

For cocaine these critical inter-press intervals were 7.5 min and longer. This novel criterion was applied to measure BP according to all four theoretically plausible definitions of BP including the new one: the higher of the two numbers of presses before or after the last delivery of the reinforcer.

COMPARISON WITH EXISTING METHOD

The conventionally defined BP is significantly lower (by 12 %) than BP defined according to the new proposed definition. The new definition of BP provides not only a more accurate value of BP but now the variance of BP at different cocaine doses is homogeneous as required by many statistical tests.

CONCLUSION

These new definitions of the last press and BP provide more accurate and statistically homogenous measure of BP.

Amphetamine maintenance therapy during intermittent cocaine self-administration in rats attenuates psychomotor and dopamine sensitization and reduces addiction-like behavior

D-amphetamine maintenance therapy shows promise as a treatment for people with cocaine addiction. Preclinical studies using Long Access (LgA) cocaine self-administration procedures suggest D-amphetamine may act by preventing tolerance to cocaine's effects at the dopamine transporter (DAT). However, Intermittent Access (IntA) cocaine self-administration better reflects human patterns of use, is especially effective in promoting addiction-relevant behaviors, and instead of tolerance, produces psychomotor, incentive, and neural sensitization. We asked, therefore, how D-amphetamine maintenance during IntA influences cocaine use and cocaine's potency at the DAT. Male rats self-administered cocaine intermittently (5 min ON, 25 min OFF x10; 5-h/session) for 14 sessions, with or without concomitant D-amphetamine maintenance therapy during these 14 sessions (5 mg/kg/day via s.c. osmotic minipump). We then assessed responding for cocaine under a progressive ratio schedule, responding under extinction and cocaine-primed reinstatement of drug seeking. We also assessed the ability of cocaine to inhibit dopamine uptake in the nucleus accumbens core using fast scan cyclic voltammetry ex vivo. IntA cocaine self-administration produced psychomotor (locomotor) sensitization, strong motivation to take and seek cocaine, and it increased cocaine's potency at the DAT. D-amphetamine co-administration suppressed the psychomotor sensitization produced by IntA cocaine experience. After cessation of D-amphetamine treatment, the motivation to take and seek cocaine was also reduced, and sensitization of cocaine's actions at the DAT was reversed. Thus, treatment with D-amphetamine might reduce cocaine use by preventing sensitization-related changes in cocaine potency at the DAT, consistent with an incentive-sensitization view of addiction.

Effort-reward balance and work motivation in rats: Effects of context and order of experience

Being motivated means exerting effort toward a goal. The 'law of least work' emphasizes a preference for exerting relatively less effort. The law crosses boundaries among species and between physical and mental work. Organisms should be highly sensitive to shifts in effort-reward balance (ERB) in order to make optimal choices. We used a free operant-foraging task to investigate changes in ERB on choice between options requiring more or less effort. Results showed a consistent preference for the option with less effort and insensitivity to shifts in ERB. A second aim explored the influence of order of experience on effort choice. Choice for the more effortful option significantly increased after experiencing an equal effort-reward relationship during the initial free operant-foraging session. This relative increase in choice for the effortful option persisted even after effort-reward imbalance. The findings highlight the importance of contextual factors such as order of experience when examining the impact of shifting effort-reward associations. Instead of ignoring or reducing order effects, the sequence of experience (e.g. for shifts in ERB) could be manipulated to enhance or reduce value of outcomes or effort itself.

Hold-down as an alternative to unit dose in cocaine self-administration experiments: Characterization using a progressive ratio schedule

RATIONALE

Virtually all cocaine self-administration studies have used a "unit dose" as a reinforcing stimulus; the subject is a passive recipient of an experimenter-selected dose.

OBJECTIVES

The present experiments examined the consequence of requiring the subject to actively determine the dose and speed of each injection.

METHODS

A two-lever procedure was used in which responding on a progressive ratio (PR) schedule provided access to cocaine on a hold down (HD) schedule. With HD, the pump is turned on for the duration that the lever is held down, thus the dose and speed of injection is determined by the behavior of the subject. The procedure allows for the evaluation of both drug taking and drug seeking responses.

RESULTS

The results were qualitatively different from PR self-administration studies using unit dose. The self-administered HD dose varied across the session; the self-administered dose was found to inversely correlate with drug levels at the time of access. Importantly, the 2 L-PR-HD procedure identified a subpopulation of subjects that showed extremes in both drug seeking and drug taking. Subjects at the top end of the distribution displayed unprecedented final ratios (> 900) and rapidly self-administered very large doses (> 1.4 mg; ~ 4.2 mg/kg). Manipulation of drug-taking variables (HD access duration and concentration of drug in the pump) showed that the immediacy of a cocaine bolus, not the duration of access, is the major determinant of drug seeking.

CONCLUSIONS

Incorporating a consummatory response into a PR procedure provides a unique perspective on the interactions of drug-seeking and drug-taking.

Dose-dependent effects of estrogen on prediction error related neural activity in the nucleus accumbens of healthy young women

RATIONALE

Whereas the effect of the sex steroid 17-beta-estradiol (E2) on dopaminergic (DA) transmission in the nucleus accumbens (NAc) is well evidenced in female rats, studies in humans are inconsistent. Moreover, linear and inverted u-shaped dose response curves have been observed for E2's effects on hippocampal plasticity, but the shape of dose response curves for E2's effects on the NAc is much less characterized.

OBJECTIVES

Investigation of dose response curves for E2's effects on DA-related neural activity in the human NAc.

METHODS

Placebo or E2 valerate in doses of 2, 4, 6 or 12 mg was orally administered to 125 naturally cycling young women during the low-hormone menstruation phase on two consecutive days using a randomized, double-blinded design. The E2 treatment regimen induced a wide range of E2 levels, from physiological (2- and 4-mg groups; equivalent to cycle peak) to supraphysiological levels (6- and 12-mg groups; equivalent to early pregnancy). This made it possible to study different dose response functions for E2's effects on NAc activity. During E2 peak, participants performed a well-established reversal learning paradigm. We used trial-wise prediction errors (PE) estimated via a computational reinforcement learning model as a proxy for dopaminergic activity. Linear and quadratic regression analyses predicting PE-related NAc activity from salivary E2 levels were calculated.

RESULTS

There was a positive linear relationship between PE-associated NAc activity and salivary E2 increases.

CONCLUSIONS

The randomized, placebo-controlled elevation of E2 levels stimulates NAc activity in the human brain, likely mediated by dopaminergic processes.

Own or dam's genotype? Classical colony breeding may bias spontaneous and stress-challenged activity in DAT-mutant rats

There is considerable interest in understanding what makes an individual vulnerable or resilient to the deleterious effects of stressful events. From candidate genes, dopamine (DA) and dopamine transporter (DAT) have been linked to anxiety, depression, and post-traumatic stress disorder. We investigated role of DAT using the new DAT heterozygous (DAT-HET) and homozygous mutant (DAT-KO) rat models of hyperdopaminergia. We studied the impact of two breeding conditions in spontaneous locomotor behavior of female rats. The classical colony, through mating DAT-HET males × DAT-HET females (breeding HET-HET), was used. A second WT colony was derived and maintained (breeding WT-WT). Additionally, a subgroup of rats was bred through mating DAT-KO males × WT females (atypical HET, breeding KO-WT). We studied the effects of genotype and its interaction with maternal care (depending by breeding condition). HET-HET breeding led to reduced activity in HET females compared to WT rats (from WT-WT breeding). However, HET females from KO-WT breeding did not differ so much from WT rats (WT-WT breeding). The maternal-care impact was then confirmed: HET mothers (breeding HET-HET) showed reduced liking/grooming of pups and increased digging away from nest, compared to WT mothers (breeding WT-WT). In their female offspring (HET, breeding HET-HET vs. WT, breeding WT-WT), isolation plus wet bedding induced higher and more persistent impact on activity of HET rats, even when the stressor was removed. Our results highlight the importance of epigenetic factors (e.g., maternal care) in responses to stress expressed by offspring at adulthood, quite independently of genotype. DAT hypofunction could determinate vulnerability to stressful agents via altered maternal care.

Effects of inactivation of the ventral tegmental area on prefronto-accumbens activity and sexual motivation in male rats

Sexual motivation requires the processing of sexual stimuli. The prefrontal cortex (PFC) and nucleus accumbens (NAcc) receive dopaminergic innervation from the ventral tegmental area (VTA). Both structures participate in processing stimuli, and their adequate functioning is modulated by dopamine and other neurotransmitters. This study was designed to determine the effect of inactivation of the VTA on sexual motivation, relative power (RP) and electroencephalographic (EEG) correlation of the PFC and NAcc in male rats. A total of 20 rats implanted with electrodes in the left medial prefrontal cortex (mPFC) and NAcc, and with bilateral cannulae in the VTA, were divided into two groups of 10 rats each, one injected with tetrodotoxin (TTX), the other with a vehicle solution (VEH). EEGs from the mPFC and NAcc were recorded during the awake-quiet state in the presence of either a receptive or non-receptive female. The TTX group showed a lower preference for the receptive female accompanied by a lower RP of the 8-13 and 14-30 Hz bands in the mPFC. Also, in the presence of the receptive female, the TTX group had a lower RP of the 8-13 Hz band in the NAcc, but a higher prefronto-accumbens correlation in the same band. These results provide evidence that VTA activity is necessary for the adequate functioning of the mPFC and NAcc and, therefore, also for the adequate processing of sexually-relevant stimuli that allows the induction and maintenance of sexual motivation in male rats.

Altered gating of Kv1.4 in the nucleus accumbens suppresses motivation for reward

Deficient motivation contributes to numerous psychiatric disorders, including withdrawal from drug use, depression, schizophrenia, and others. Nucleus accumbens (NAc) has been implicated in motivated behavior, but it remains unclear whether motivational drive is linked to discrete neurobiological mechanisms within the NAc. To examine this, we profiled cohorts of Sprague-Dawley rats in a test of motivation to consume sucrose. We found that substantial variability in willingness to exert effort for reward was not associated with operant responding under low-effort conditions or stress levels. Instead, effort-based motivation was mirrored by a divergent NAc shell transcriptome with differential regulation at potassium and dopamine signaling genes. Functionally, motivation was inversely related to excitability of NAc principal neurons. Furthermore, neuronal and behavioral outputs associated with low motivation were linked to faster inactivation of a voltage-gated potassium channel, Kv1.4. These results raise the prospect of targeting Kv1.4 gating in psychiatric conditions associated with motivational dysfunction.

Incentive and dopamine sensitization produced by intermittent but not long access cocaine self-administration

The temporal pattern of drug use (pharmacokinetics) has a profound effect on the ability of self-administered cocaine to produce addiction-like behavior in rodents, and to change the brain. To further address this issue, we compared the effects of long access (LgA) cocaine self-administration, which is widely used to model the transition to addiction, with intermittent access (IntA), which is thought to better reflect the pattern of drug use in humans, on the ability of a single, self-administered injection of cocaine to increase dopamine (DA) overflow in the core of the nucleus accumbens (using in vivo microdialysis), and to produce addiction-like behavior. IntA experience was more effective than LgA in producing addiction-like behavior-a drug experience-dependent increase in motivation for cocaine assessed using behavioral economic procedures, and cue-induced reinstatement-despite much less total drug consumption. There were no group differences in basal levels of DA in dialysate [DA], but a single self-administered IV injection of cocaine increased [DA] in the core of the nucleus accumbens to a greater extent in rats with prior IntA experience than those with LgA or limited access experience, and the latter two groups did not differ. Furthermore, high motivation for cocaine was associated with a high [DA] response. Thus, IntA, but not LgA, produced both incentive and DA sensitization. This is consistent with the notion that a hyper-responsive dopaminergic system may contribute to the transition from casual patterns of drug use to the problematic patterns that define addiction.

Leveraging calcium imaging to illuminate circuit dysfunction in addiction

Alcohol and drug use can dysregulate neural circuit function to produce a wide range of neuropsychiatric disorders, including addiction. To understand the neural circuit computations that mediate behavior, and how substances of abuse may transform them, we must first be able to observe the activity of circuits. While many techniques have been utilized to measure activity in specific brain regions, these regions are made up of heterogeneous sub-populations, and assessing activity from neuronal populations of interest has been an ongoing challenge. To fully understand how neural circuits mediate addiction-related behavior, we must be able to reveal the cellular granularity within brain regions and circuits by overlaying functional information with the genetic and anatomical identity of the cells involved. The development of genetically encoded calcium indicators, which can be targeted to populations of interest, allows for in vivo visualization of calcium dynamics, a proxy for neuronal activity, thus providing an avenue for real-time assessment of activity in genetically and anatomically defined populations during behavior. Here, we highlight recent advances in calcium imaging technology, compare the current technology with other state-of-the-art approaches for in vivo monitoring of neural activity, and discuss the strengths, limitations, and practical concerns for observing neural circuit activity in preclinical addiction models.

Sex differences in incentive-sensitization produced by intermittent access cocaine self-administration

RATIONALE

Intermittent Access (IntA) cocaine self-administration, which models intermittent patterns of cocaine use in humans during the transition to addiction, is especially effective in producing incentive-sensitization and other addiction-like behavior in male rats. However, female rats show more robust psychomotor sensitization than males, and following initial use, women develop problematic patterns of drug use more readily than men. We hypothesized, therefore, that female rats might be more susceptible to the incentive-sensitization produced by IntA experience.

OBJECTIVE

To assess changes in motivation for cocaine, using a behavioral economic indicator of cocaine demand ("elasticity" of demand curves), and other addiction-like behavior, as a function of IntA cocaine self-administration experience in male and female rats.

RESULTS

IntA experience produced a progressive increase in motivation for cocaine in both males and females, as indicated by a decrease in the elasticity of cocaine demand curves, and this persisted undiminished following 14 days of abstinence. However, IntA produced a more rapid and greater increase in motivation for cocaine (incentive-sensitization) in females than males. Females also consumed more cocaine than males, although this did not predict changes in motivation. On the other hand, there were no sex differences in the preferred level of cocaine consumption when cost was low (Q₀), nor in cocaine- or cue-induced reinstatement of drug-seeking behavior.

CONCLUSIONS

The observation that females are more susceptible to incentive-sensitization when intermittently exposed to cocaine may provide a mechanism for the more rapid development of problematic drug use in females ("telescoping effect") reported in clinical studies.

High and escalating levels of cocaine intake are dissociable from subsequent incentive motivation for the drug in rats

RATIONALE

Taking high and increasing amounts of cocaine is thought to be necessary for the development of addiction. Consequently, a widely used animal model of drug self-administration involves giving animals continuous drug access during long sessions (LgA), as this produces high and escalating levels of intake. However, human cocaine addicts likely use the drug with an intermittent rather than continuous pattern, producing spiking brain cocaine levels.

OBJECTIVES

Using an intermittent-access (IntA) cocaine self-administration procedure in rats, we studied the relationship between escalation of cocaine intake and later incentive motivation for the drug, as measured by responding under a progressive ratio schedule of cocaine reinforcement.

RESULTS

First, under IntA, rats escalated their cocaine use both within and between sessions. However, escalation did not predict later incentive motivation for the drug. Second, incentive motivation for cocaine was similar in IntA-rats limited to low- and non-escalating levels of drug intake (IntA-Lim) and in IntA-rats that took high and escalating levels of drug. Finally, IntA-Lim rats took much less cocaine than rats given continuous drug access during each self-administration session (LgA-rats). However, IntA-Lim rats later responded more for cocaine under a progressive ratio schedule of reinforcement.

CONCLUSIONS

Taking large and escalating quantities of cocaine does not appear necessary to increase incentive motivation for the drug. Taking cocaine in an intermittent pattern-even in small amounts-is more effective in producing this addiction-relevant change. Thus, beyond the amount of drug taken, the temporal kinetics of drug use predict change in drug use over time.

Blockade of dopamine D1-family receptors attenuates the mania-like hyperactive, risk-preferring, and high motivation behavioral profile of mice with low dopamine transporter levels

BACKGROUND

Patients with bipolar disorder mania exhibit poor cognition, impulsivity, risk-taking, and goal-directed activity that negatively impact their quality of life. To date, existing treatments for bipolar disorder do not adequately remediate cognitive dysfunction. Reducing dopamine transporter expression recreates many bipolar disorder mania-relevant behaviors (i.e. hyperactivity and risk-taking). The current study investigated whether dopamine D1-family receptor blockade would attenuate the risk-taking, hypermotivation, and hyperactivity of dopamine transporter knockdown mice.

METHODS

Dopamine transporter knockdown and wild-type littermate mice were tested in mouse versions of the Iowa Gambling Task (risk-taking), Progressive Ratio Breakpoint Test (effortful motivation), and Behavioral Pattern Monitor (activity). Prior to testing, the mice were treated with the dopamine D1-family receptor antagonist SCH 23390 hydrochloride (0.03, 0.1, or 0.3 mg/kg), or vehicle.

RESULTS

Dopamine transporter knockdown mice exhibited hyperactivity and hyperexploration, hypermotivation, and risk-taking preference compared with wild-type littermates. SCH 23390 hydrochloride treatment decreased premature responding in dopamine transporter knockdown mice and attenuated their hypermotivation. SCH 23390 hydrochloride flattened the safe/risk preference, while reducing activity and exploratory levels of both genotypes similarly.

CONCLUSIONS

Dopamine transporter knockdown mice exhibited mania-relevant behavior compared to wild-type mice. Systemic dopamine D1-family receptor antagonism attenuated these behaviors in dopamine transporter knockdown, but not all effects were specific to only the knockdown mice. The normalization of behavior via blockade of dopamine D1-family receptors supports the hypothesis that D1 and/or D5 receptors could contribute to the mania-relevant behaviors of dopamine transporter knockdown mice.

The effects of reduced dopamine transporter function and chronic lithium on motivation, probabilistic learning, and neurochemistry in mice: Modeling bipolar mania

BACKGROUND

Bipolar disorder (BD) mania patients exhibit poor cognition and reward-seeking/hypermotivation, negatively impacting a patient's quality of life. Current treatments (e.g., lithium), do not treat such deficits. Treatment development has been limited due to a poor understanding of the neural mechanisms underlying these behaviors. Here, we investigated putative mechanisms underlying cognition and reward-seeking/motivational changes relevant to BD mania patients using two validated mouse models and neurochemical analyses.

METHODS

The effects of reducing dopamine transporter (DAT) functioning via genetic (knockdown vs. wild-type littermates), or pharmacological (GBR12909- vs. vehicle-treated C57BL/6J mice) means were assessed in the probabilistic reversal learning task (PRLT), and progressive ratio breakpoint (PRB) test, during either water or chronic lithium treatment. These tasks quantify reward learning and effortful motivation, respectively. Neurochemistry was performed on brain samples of DAT mutants ± chronic lithium using high performance liquid chromatography.

RESULTS

Reduced DAT functioning increased reversals in the PRLT, an effect partially attenuated by chronic lithium. Chronic lithium alone slowed PRLT acquisition. Reduced DAT functioning increased motivation (PRB), an effect attenuated by lithium in GBR12909-treated mice. Neurochemical analyses revealed that DAT knockdown mice exhibited elevated homovanillic acid levels, but that lithium had no effect on these elevated levels.

CONCLUSIONS

Reducing DAT functioning recreates many aspects of BD mania including hypermotivation and improved reversal learning (switching), as well as elevated homovanillic acid levels. Chronic lithium only exerted main effects, impairing learning and elevating norepinephrine and serotonin levels of mice, not specifically treating the underlying mechanisms identified in these models.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Hypocretin receptor 1 blockade preferentially reduces high effort responding for cocaine without promoting sleep

Recent evidence suggests that blockade of the hypocretin receptor 1 may act as a useful pharmacotherapy for cocaine abuse. Here we investigated the extent to which various doses of a hypocretin receptor 1 antagonist, SB-334867, affect cocaine self-administration at varying doses of cocaine and across a range of effort requirements, and tested if these SB-334867 doses produce sedative effects. First, we trained animals to self-administer one of three doses of cocaine on a progressive ratio schedule, and then tested the effects of three doses of SB-334867. Responding for cocaine was then analyzed to segregate features of relatively high and low effort requirements across the progressive ratio session. In another set of experiments, we tested potential sleep-promoting effects of the same doses of SB-334867. Our data indicate that blockade of hypocretin receptor 1 preferentially reduces high effort responding for cocaine at levels that do not promote sedation.

Conditioned Aversion for a Cocaine-Predictive Cue is Associated with Cocaine Seeking and Taking in Rats

Rats emit aversive taste reactivity (TR) behavior (i.e., gapes) following intraoral delivery of a cocaine-paired taste cue, and greater conditioned aversive TR in well-trained rats predicts greater drug-taking. Here, we used a between-groups design and tracked the development of this conditioned aversive TR behavior on a trial by trial basis in an effort to determine when the change in behavior occurs and at what point individual differences in cue reactivity become predictive of cocaine-seeking and cocaine-taking. The results demonstrate that conditioned aversive TR to a cocaine-predictive flavor cue appears very early in training (i.e., following as few as 1 to 2 taste-drug pairings), stabilizes quickly, and becomes predictive of terminal self-administration within 3 to 4 trials. Indeed, rats exhibiting high conditioned aversive TR to the cocaine-paired cue also exhibited greater goal-directed behavior, were faster to take drug, self-administered more cocaine, and exhibited greater seeking during periods of drug non-availability. High conditioned aversive TR, then, develops quickly and is associated with a greater motivation for drug.

Sign-tracking predicts increased choice of cocaine over food in rats

The purpose of this study was to determine whether the tendency to sign-track to a food cue was predictive of rats' choice of cocaine over food. First, rats were trained on a procedure where insertion of a retractable lever was paired with food. A sub-group of rats - sign-trackers - primarily approached and contacted the lever, while another sub-group - goal-trackers - approached the site of food delivery. Rats were then trained on a choice task where they could choose between an infusion of cocaine (1.0 mg/kg) and a food pellet (45 mg). Sign-trackers chose cocaine over food significantly more often than did goal-trackers. These results support the incentive-salience theory of addiction and add to a growing number of studies which suggest that sign-trackers may model an addiction-prone phenotype.

Striatal direct and indirect pathways control decision-making behavior

Despite our ever-changing environment, animals are remarkably adept at selecting courses of action that are predictive of optimal outcomes. While requiring the contribution of a number of brain regions, a vast body of evidence implicates striatal mechanisms of associative learning and action selection to be critical to this ability. While numerous models of striatal-based decision-making have been developed, it is only recently that we have begun to understand the precise contributions of specific subpopulations of striatal neurons. Studies utilizing contemporary cell-type-specific technologies indicate that striatal output pathways play distinct roles in controlling goal-directed and social behaviors. Here we review current models of striatal-based decision-making, discuss recent developments in defining the functional roles of striatal output pathways, and assess how striatal dysfunction may contribute to the etiology of various neuropathologies.

Influence of depressive symptoms on dopaminergic treatment of Parkinson's disease

Introduction: Depressive symptoms are very common in patients with Parkinson’s disease (PD) and have a significant impact on the quality of life. Dopaminergic medication has been shown to have an influence on the development of depressive symptoms.

Materials and methods: The present study analyzed two groups of non-demented patients with PD, with and without depressive symptoms, and reported the correlations between antiparkinsonian medication [specifically levodopa (l-DOPA) and dopaminergic agonists] with depressive symptoms.

Results: A strong statistically significant positive correlation between l-DOPA dosages and the level of depressive symptoms has been revealed, suggesting that higher l-DOPA dosages correlate with a worsening of depressive status. No significant correlation was found with dopamine agonists.

Discussion: The results of this study show that in patients with PD, higher l-DOPA dosages correlate with worse depressive symptoms. From this point of view, PD patients need to be better diagnosed with respect to depressive symptoms and need additional treatment adjustment when clinical manifestations of depression are present. Clinicians must be aware that dopaminergic drugs are not sufficient to alleviate depressive symptoms.

Cocaine inhibition of nicotinic acetylcholine receptors influences dopamine release

Nicotinic acetylcholine receptors (nAChRs) potently regulate dopamine (DA) release in the striatum and alter cocaine's ability to reinforce behaviors. Since cocaine is a weak nAChR inhibitor, we hypothesized that cocaine may alter DA release by inhibiting the nAChRs in DA terminals in the striatum and thus contribute to cocaine's reinforcing properties primarily associated with the inhibition of DA transporters. We found that biologically relevant concentrations of cocaine can mildly inhibit nAChR-mediated currents in midbrain DA neurons and consequently alter DA release in the dorsal and ventral striatum. At very high concentrations, cocaine also inhibits voltage-gated Na channels in DA neurons. Furthermore, our results show that partial inhibition of nAChRs by cocaine reduces evoked DA release. This diminution of DA release via nAChR inhibition more strongly influences release evoked at low or tonic stimulation frequencies than at higher (phasic) stimulation frequencies, particularly in the dorsolateral striatum. This cocaine-induced shift favoring phasic DA release may contribute to the enhanced saliency and motivational value of cocaine-associated memories and behaviors.

Sensitivity to self-administered cocaine within the lateral preoptic-rostral lateral hypothalamic continuum

The lateral preoptic-rostral lateral hypothalamic continuum (LPH) receives projections from the nucleus accumbens and is believed to be one route by which nucleus accumbens signaling affects motivated behaviors. While accumbens firing patterns are known to be modulated by fluctuating levels of cocaine, studies of the LPH's drug-related firing are absent from the literature. The present study sought to electrophysiologically test whether drug-related tonic and slow-phasic patterns exist in the firing of LPH neurons during a free-access cocaine self-administration task. Results demonstrated that a majority of neurons in the LPH exhibited changes in both tonic and slow-phasic firing rates during fluctuating drug levels. During the maintenance phase of self-administration, 69.6% of neurons exhibited at least a twofold change in tonic firing rate when compared to their pre-drug firing rates. Moreover, 54.4% of LPH neurons demonstrated slow-phasic patterns, specifically "progressive reversal" patterns, which have been shown to be related to pharmacological changes across the inter-infusion interval. Firing rate was correlated with calculated drug level in 58.7% of recorded cells. Typically, a negative correlation between drug level and firing rate was observed, with a majority of neurons showing decreases in firing during cocaine self-administration. A small percentage of LPH neurons also exhibited correlations between locomotor behavior and firing rate; however, correlations with drug level in these same neurons were always stronger. Thus, the weak relationships between LPH firing and locomotor behaviors during cocaine self-administration do not account for the observed changes in firing. Overall, these findings suggest that a proportion of LPH neurons are sensitive to fluctuations in cocaine concentration and may contribute to neural activity that controls drug taking.

Conflation of cocaine seeking and cocaine taking responses in IV self-administration experiments in rats: methodological and interpretational considerations

IV drug self-administration is a special case of an operant task. In most operant experiments, the instrumental response that completes the schedule requirement is separate and distinct from the consumptive response (e.g. eating or drinking) that follows the delivery of the reinforcing stimulus. In most IV self-administration studies drug seeking and drug taking responses are conflated. The instrumental lever press or nose poke is also a consumptive response. The conflation of these two response classes has important implications for interpretation of the data as they are differentially regulated by dose and price. The types of pharmacological pretreatments that affect appetitive responses are not necessarily the same as those that affect consumptive responses suggesting that the neurobiology of the two response classes are to some extent controlled by different mechanisms. This review discusses how schedules of reinforcement and behavioral economic analyses can be used to assess the regulation of drug seeking and drug taking separately. New methods are described that allow the examination of appetitive or consumptive responding in isolation and provide subjects with greater control over the self-administered dose. These procedures provide novel insights into the regulation of drug intake. Cocaine intake patterns that result in large, intermittent spikes in cocaine levels are shown to produce increases in appetitive responding (i.e. drug seeking). The mechanisms that control drug intake should be considered distinct from appetitive and motivational processes and should be taken into consideration in future IV self-administration studies.

Examination of behavioral strategies regulating cocaine intake in rats

RATIONALE

It has long been observed that rats self-administer psychostimulants in a highly regular pattern. The inverse relationship between dose and rate of drug intake has been interpreted as a titration phenomenon wherein brain-cocaine levels are maintained within a range. Most studies examining this phenomenon have used fixed, unit doses in which case the only titration strategy available to the animal is to adjust inter-infusion intervals.

OBJECTIVES

In this study, we examined whether selection of dose size could also be a factor in regulation of intake. We used a schedule of reinforcement, under which the dose can vary through a wide range and is determined by the behavior of the animal.

METHODS

Rats self-administered cocaine using a behaviorally dependent dosing schedule of reinforcement, under which the size of each dose was determined by the length of time the lever was held down. The concentration of cocaine was changed across sessions.

RESULTS

Total pump-time self-administered decreased by 56 % following each doubling of the concentration, which led to an average 11 % increase in total intake. Similarly, estimated brain levels of cocaine increased by 12 % for each doubling of concentration. These adjustments were the result of manipulation of both the size and spacing of infusions.

CONCLUSIONS

In agreement with previous studies, the regular pattern of intake appears to be the result of a titration mechanism in which animals maintain brain levels of cocaine above some threshold. Compensatory regulation appeared to involve both the selection of dose size and inter-infusion intervals.

The motivation to self-administer is increased after a history of spiking brain levels of cocaine

Recent attempts to model the addiction process in rodents have focused on cocaine self-administration procedures that provide extended daily access. Such procedures produce a characteristic loading phase during which blood levels rapidly rise and then are maintained within an elevated range for the duration of the session. The present experiments tested the hypothesis that multiple fast-rising spikes in cocaine levels contribute to the addiction process more robustly than constant, maintained drug levels. Here, we compared the effects of various cocaine self-administration procedures that produced very different patterns of drug intake and drug dynamics on Pmax, a behavioral economic measure of the motivation to self-administer drug. Two groups received intermittent access (IntA) to cocaine during daily 6-h sessions. Access was limited to twelve 5-min trials that alternated with 25-min timeout periods, using either a hold-down procedure or a fixed ratio 1 (FR1). Cocaine levels could not be maintained with this procedure; instead the animals experienced 12 fast-rising spikes in cocaine levels each day. The IntA groups were compared with groups given 6-h FR1 long access and 2-h short access sessions and two other control groups. Here, we report that cocaine self-administration procedures resulting in repeatedly spiking drug levels produce more robust increases in Pmax than procedures resulting in maintained high levels of cocaine. These results suggest that rapid spiking of brain-cocaine levels is sufficient to increase the motivation to self-administer cocaine.

Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum

Phasic changes in dopamine activity play a critical role in learning and goal-directed behavior. Unpredicted reward and reward-predictive cues evoke phasic increases in the firing rate of the majority of midbrain dopamine neurons--results that predict uniformly broadcast increases in dopamine concentration throughout the striatum. However, measurement of dopamine concentration changes during reward has cast doubt on this prediction. We systematically measured phasic changes in dopamine in four striatal subregions [nucleus accumbens shell and core (Core), dorsomedial (DMS) and dorsolateral striatum] in response to stimuli known to activate a majority of dopamine neurons. We used fast-scan cyclic voltammetry in awake and behaving rats, which measures changes in dopamine on a similar timescale to the electrophysiological recordings that established a relationship between phasic dopamine activity and reward. Unlike the responses of midbrain dopamine neurons, unpredicted food reward and reward-predictive cues evoked a phasic increase in dopamine that was subregion specific. In rats with limited experience, unpredicted food reward evoked an increase exclusively in the Core. In rats trained on a discriminative stimulus paradigm, both unpredicted reward and reward-predictive cues evoked robust phasic dopamine in the Core and DMS. Thus, phasic dopamine release in select target structures is dynamic and dependent on context and experience. Because the four subregions assayed receive different inputs and have differential projection targets, the regional selectivity of phasic changes in dopamine has important implications for information flow through the striatum and plasticity that underlies learning and goal-directed behavior.

Brain-cocaine concentrations determine the dose self-administered by rats on a novel behaviorally dependent dosing schedule

A novel behaviorally dependent dosing (BDD) schedule was used to examine the relationship between doses of cocaine self-administered by rats and brain drug levels within a session. The BDD schedule used a hold-down response to activate a syringe pump. The length of time the lever was held down determined the duration that the syringe pump was activated. In the first experiment, rats self-administered cocaine for daily 3 h sessions and brain levels of cocaine were modeled using well-established parameters. Although analysis revealed that rats self-administered doses within a predicted range, one extremely large dose was consistently observed at the beginning of each session when brain levels of cocaine were low. In the second experiment, we introduced a range of timeout periods (10-25 min) in order to produce variability in brain-cocaine concentrations. Animals self-administered larger doses immediately following each timeout period and the dose size was inversely correlated with the length of the timeout. These results show that the dose of cocaine that rats self-administer within a session is inversely related to the amount of drug on board.

Slow phasic and tonic activity of ventral pallidal neurons during cocaine self-administration

Ventral pallidal (VP) neurons exhibit rapid phasic firing patterns within seconds of cocaine-reinforced responses. The present investigation examined whether VP neurons exhibited firing rate changes: (1) over minutes during the inter-infusion interval (slow phasic patterns) and/or (2) over the course of the several-hour self-administration session (tonic firing patterns) relative to pre-session firing. Approximately three-quarters (43/54) of VP neurons exhibited slow phasic firing patterns. The most common pattern was a post-infusion decrease in firing followed by a progressive reversal of firing over minutes (51.16%; 22/43). Early reversals were predominantly observed anteriorly whereas progressive and late reversals were observed more posteriorly. Approximately half (51.85%; 28/54) of the neurons exhibited tonic firing patterns consisting of at least a two-fold change in firing. Most cells decreased firing during drug loading, remained low over self-administration maintenance, and reversed following lever removal. Over a whole experiment (tonic) timescale, the majority of neurons exhibited an inverse relationship between calculated drug level and firing rates during loading and post-self-administration behaviors. Fewer neurons exhibited an inverse relationship of calculated drug level and tonic firing rate during self-administration maintenance but, among those that did, nearly all were progressive reversal neurons. The present results show that, similar to its main afferent the nucleus accumbens, VP exhibits both slow phasic and tonic firing patterns during cocaine self-administration. Given that VP neurons are principally GABAergic, the predominant slow phasic decrease and tonic decrease firing patterns within the VP may indicate a disinhibitory influence upon its thalamocortical, mesolimbic, and nigrostriatal targets during cocaine self-administration.

Acute effects of nicotine amplify accumbal neural responses during nicotine-taking behavior and nicotine-paired environmental cues

Nicotine self-administration (SA) is maintained by several variables, including the reinforcing properties of nicotine-paired cues and the nicotine-induced amplification of those cue properties. The nucleus accumbens (NAc) is implicated in mediating the influence of these variables, though the underlying neurophysiological mechanisms are not yet understood. In the present study, Long-Evans rats were trained to self-administer nicotine. During SA sessions each press of a lever was followed by an intravenous infusion of nicotine (30 µg/kg) paired with a combined light-tone cue. Extracellular recordings of single-neuron activity showed that 20% of neurons exhibited a phasic change in firing during the nicotine-directed operant, the light-tone cue, or both. The phasic change in firing for 98% of neurons was an increase. Sixty-two percent of NAc neurons additionally or alternatively showed a sustained decrease in average firing during the SA session relative to a presession baseline period. These session decreases in firing were significantly less prevalent in a group of neurons that were activated during either the operant or the cue than in a group of neurons that were nonresponsive during those events (referred to as task-activated and task-nonactivated neurons, respectively). Moreover, the session decrease in firing was dose-dependent for only the task-nonactivated neurons. The data of the present investigation provide supportive correlational evidence for two hypotheses: (1) excitatory neurophysiological mechanisms mediate the NAc role in cue-maintenance of nicotine SA, and (2) a differential nicotine-induced inhibition of task-activated and task-nonactivated neurons mediates the NAc role in nicotine-induced amplification of cue effects on nicotine SA.

A novel IV cocaine self-administration procedure in rats: differential effects of dopamine, serotonin, and GABA drug pre-treatments on cocaine consumption and maximal price paid

RATIONALE

Behavior occurring during cocaine self-administration can be classified as either consummatory or appetitive. These two concepts are usually addressed independently using separate reinforcement schedules. For example, appetitive behavior can be assessed with a progressive ratio schedule, whereas consummatory behavior is typically measured using a fixed ratio schedule.

OBJECTIVES

Depending on the schedule used, it is often difficult to determine whether a particular drug pretreatment is affecting self-administration through an effect on appetitive responding, consummatory responding, or perhaps both. In the present study, we tested the effect of pretreating rats with four different drugs on appetitive and consummatory behaviors.

MATERIALS AND METHODS

We recently developed a technique that provides an independent assessment of both behavioral concepts within the same experimental session. In this threshold procedure, rats are offered a descending series of 11 unit doses (422-1.3 μg/injection) during consecutive timed intervals under a fixed-ratio schedule. Consummatory behavior can be analyzed by assessing intake at high unit doses; an estimate of appetitive responding can be determined from responding occurring at the threshold dose. Applying behavioral economics to these data provides dependent measures of consumption when minimally constrained by price and the maximal price paid (P (max)) for cocaine.

RESULTS

Haloperidol increased cocaine consumption when minimally constrained by price but decreased P (max). In contrast, D: -amphetamine increased P (max). Fluoxetine decreased P (max) and consumption when minimally constrained by price. Baclofen selectively decreased P (max).

CONCLUSIONS

These data suggest that drug pretreatments can alter consummatory and appetitive behavior differently because each concept involves distinct neural mechanisms.

Electrophysiological evidence of mediolateral functional dichotomy in the rat nucleus accumbens during cocaine self-administration II: phasic firing patterns

In the cocaine self-administering rat, individual nucleus accumbens (NAcc) neurons exhibit phasic changes in firing rate within minutes and/or seconds of lever presses (i.e. slow phasic and rapid phasic changes, respectively). To determine whether neurons that demonstrate these changes during self-administration sessions are differentially distributed in the NAcc, rats were implanted with jugular catheters and microwire arrays in different NAcc subregions (core, dorsal shell, ventromedial shell, ventrolateral shell, or rostral pole). Neural recording sessions were typically conducted on days 13-17 of cocaine self-administration (0.77 mg/kg per 0.2-mL infusion; fixed-ratio 1 schedule of reinforcement; 6-h daily sessions). Pre-press rapid phasic firing rate changes were greater in lateral accumbal (core and ventrolateral shell) than in medial accumbal (dorsal shell and rostral pole shell) subregions. Slow phasic pattern analysis revealed that reversal latencies of neurons that exhibited change + reversal patterns differed mediolaterally: medial NAcc neurons exhibited more early reversals and fewer progressive/late reversals than lateral NAcc neurons. Comparisons of firing patterns within individual neurons across time bases indicated that lateral NAcc pre-press rapid phasic increases were correlated with tonic increases. Tonic decreases were correlated with slow phasic patterns in individual medial NAcc neurons, indicative of greater pharmacological sensitivity of neurons in this region. On the other hand, the bias of the lateral NAcc towards increased pre-press rapid phasic activity, coupled with a greater prevalence of tonic increase firing, may reflect particular sensitivity of these neurons to excitatory afferent signaling and perhaps differential pharmacological influences on firing rates between regions.

Electrical and pharmacological manipulations of the nucleus accumbens core impair synaptic plasticity in the dentate gyrus of the rat

The interest on the physiology of the nucleus accumbens (NAcc) has grown in recent years given its relationship to addictive behaviours, and the possibility to treat them by interacting with NAcc function. We have shown that the prior stimulation of the core region blocks induction of long-term potentiation (LTP) at the dentate gyrus in anaesthetized rats, while the shell facilitated it. In the present study we have confirmed and expanded those results testing the effects of core and shell stimulation in freely moving rats, as well as the effect of blocking D1 receptors in the NAcc. Our results show that shell stimulation had no effect on baseline recordings of the field excitatory postsynaptic potential (fEPSP) or the population spike amplitude (PSA) for 24 h. Core stimulation did not modify baseline-fEPSP, but significantly depressed PSA up to 8 h. LTP maintenance was not modified; neither by core nor shell stimulation after its induction, but LTP induction was impaired (both in the fEPSP and PSA) by core stimulation 15 min before induction. Shell stimulation showed a slight facilitating effect. Previous, topical application of a dopaminergic-receptor antagonist (SCH23390) into the NAcc produced a significantly depressed baseline fEPSP and PSA, as well as LTP measured in both components of the evoked potentials. Our results confirm a dual role of stimulation of NAcc sub-regions on hippocampal baseline synaptic transmission, and LTP induction when activated before induction. In contrast, stimulation of the NAcc had no influence on an already ongoing dentate gyrus LTP. A role for dopaminergic innervation to the NAcc, modifying susceptibility for synaptic plasticity outside the NAcc is also suggested by our results.

The uncertainty processing theory of motivation

Most theories describe motivation using basic terminology (drive, 'wanting', goal, pleasure, etc.) that fails to inform well about the psychological mechanisms controlling its expression. This leads to a conception of motivation as a mere psychological state 'emerging' from neurophysiological substrates. However, the involvement of motivation in a large number of behavioural parameters (triggering, intensity, duration, and directedness) and cognitive abilities (learning, memory, decision, etc.) suggest that it should be viewed as an information processing system. The uncertainty processing theory (UPT) presented here suggests that motivation is the set of cognitive processes allowing organisms to extract information from the environment by reducing uncertainty about the occurrence of psychologically significant events. This processing of information is shown to naturally result in the highlighting of specific stimuli. The UPT attempts to solve three major problems: (i) how motivations can affect behaviour and cognition so widely, (ii) how motivational specificity for objects and events can result from nonspecific neuropharmacological causal factors (such as mesolimbic dopamine), and (iii) how motivational interactions can be conceived in psychological terms, irrespective of their biological correlates. The UPT is in keeping with the conceptual tradition of the incentive salience hypothesis while trying to overcome the shortcomings inherent to this view.

Effect of rate of delivery of intravenous cocaine on self-administration in rats

Many studies of drug self-administration in primates have shown that faster infusions of a drug are more reinforcing than slower infusions. Similar effects have not been shown in rats. We assessed the influence of delivery rate by allowing rats to choose between the same doses of intravenous cocaine delivered over two different infusion speeds. Rats were trained in chambers containing two nose-poke response devices. In Experiment 1, responses in one nose-poke delivered 0.3 mg/kg/injection of cocaine over 10 s, and responses in the other delivered the same dose over 100 s. In Experiment 2, the same procedure was used, but with 1.0 mg/kg/injection dose delivered over 1.7 versus 100 s. During acquisition, most rats preferred the faster infusion. When the delivery rates associated with the nose pokes were reversed, rats trained with 0.3 mg/kg/injection failed to switch nose-poke preference, but half the rats trained with 1.0 mg/kg/injection did switch. In Experiment 3, the choice was between 1 mg/kg cocaine delivered over 1.7 s and no reinforcement. Here, rats quickly learned to respond in the nose-poke associated with cocaine and quickly switched their choice during reversal. In Experiment 4, two groups of rats were allowed to choose between food delivered with a delay of 1 versus 5 s or 1 versus 10 s, respectively. Rats preferred the shorter delay during initial training. In reversal, some rats in the 1 vs 5 s group failed to reverse, while all the rats in the 1 vs 10 s group reversed. These results show that faster infusions of cocaine are clearly more reinforcing during acquisition, but delivery rate may not be as important to the maintenance of self-administration once it has been established. The results with food suggest that these findings represent general principles of behavior and are not unique to drug self-administration.

Timing-dependent regulation of evoked spiking in nucleus accumbens neurons by integration of limbic and prefrontal cortical inputs

Single nucleus accumbens (NAcc) neurons receive excitatory synaptic input from cortical and limbic structures, and the integration of converging goal- and motivation-related signals in these neurons influences reward-directed actions. While limbic/cortical synaptic input summation has been characterized at subthreshold intensities, the manner in which multiple inputs govern NAcc neuron spike discharge has not been measured and is poorly understood. Single NAcc neurons were recorded in urethane-anesthetized rats, and spiking was evoked by coincident stimulation of two major NAcc afferent regions: the basolateral amygdala (BLA) and medial prefrontal cortex (mPFC). BLA input increased NAcc spiking elicited by mPFC stimulation depending on the timing of the stimulation pulses, consistent with the summation of monosynaptically evoked excitatory activity. When mPFC input intensity was below threshold for evoked spiking, the addition of BLA input produced the largest facilitation of evoked spiking, and the latency of the evoked spikes reflected the latency of the individual inputs. When mPFC inputs were stimulated at higher intensities, BLA-mediated facilitation was weaker, and the spike latency reflected only the mPFC input. Thus NAcc neurons integrate both the magnitude and timing of afferent synaptic activity, suggesting that NAcc neuron output is strongly dependent on the comparative magnitude of synaptic activity in its afferent structures. These interactions may be crucial integrative mechanisms that allow motivational and cognitive information to produce appropriate reward-directed actions.

Certain or uncertain cocaine expectations influence accumbens dopamine responses to self-administered cocaine and non-rewarded operant behavior

Uncertainty and errors in predicting natural rewards influence associative learning and dopamine activity. The present study was conducted to determine the influence of cue-induced cocaine uncertainty, certainty and prediction error on nucleus accumbens dopamine (NAcc DA) in rats. For Certainty training, distinctive sensory cues were present during cocaine availability and alternate cues were paired with non-reinforced (saline) operant sessions. For Uncertainty training, all cues were equally associated with both cocaine and non-reinforcement. After training, animals self-administered cocaine or saline in the presence of conditioned cues while NAcc DA responses were assessed using in vivo microdialysis. Findings revealed cocaine-stimulated NAcc DA increased significantly less in Certainty--compared to Uncertainty-trained animals, and cocaine-paired cues in the absence of cocaine (Negative Prediction Error) resulted in a significant depression of baseline NAcc DA. These findings provide support for enhanced DA activity during cocaine uncertainty or the development of conditioned cocaine tolerance in subjects certain of a cocaine outcome.

D2R DNA transfer into the nucleus accumbens attenuates cocaine self-administration in rats

Dopamine (DA) D2 receptor (D2R) agonists and antagonists can modulate self-administration behavior, conditioned place preference, and locomotor responses to cocaine. Low levels of D2R have also been observed in cocaine addicted subjects and in non human primates after chronic cocaine exposures. Prior studies had shown that D2R upregulation in the nucleus accumbens (NAc) in rodents trained to self-administer alcohol markedly attenuated alcohol preference and intake. Here we assess the effects of D2R upregulation in the NAc on cocaine intake in rats trained to self-administer cocaine. Following 2 weeks of i.v. cocaine self-administration (CSA), rats were stereotaxically treated with an adenovirus that carried the D2R gene to upregulate D2R in the NAc. D2R vector treatment resulted in a significant decrease (75%) in cocaine infusions and lever presses (70%) for cocaine. This effect lasted 6 days before cocaine consumption returned to baseline levels, which corresponds roughly to the time it takes D2R to return to baseline levels. These findings show that CSA and D2R in the NAc are negatively correlated and suggest that cocaine intake is modulated in part by D2R levels in NAc. Thus strategies aimed at increasing D2R expression in NAc may be beneficial in treating cocaine abuse and addiction.

Expectation modulates human brain responses to acute cocaine: a functional magnetic resonance imaging study

BACKGROUND

Human expectation of psychoactive drugs significantly alters drug effects and behavioral responses. However, their neurophysiological mechanisms are not clear. This study investigates how cocaine expectation modulates human brain responses to acute cocaine administration.

METHODS

Twenty-six right-handed non-treatment-seeking regular cocaine abusers participated in this study. Changes in blood oxygenation level-dependent (BOLD) signals were measured, and online behavioral ratings during cocaine expectation and acute cocaine administration were recorded.

RESULTS

Distinct regional characteristics in BOLD responses to expected and unexpected cocaine infusions were observed in the medial orbitofrontal gyrus (Brodmann area [BA] 11), frontal pole (BA 10), and anterior cingulate gyrus regions. Active engagement in the amygdala and the lateral orbitofrontal cortex (OFC; BA 47) by unexpected but not expected cocaine infusion was discovered. Cocaine expectation did not change BOLD responses to acute cocaine administration in a set of subcortical substrates, the nucleus accumbens, ventral putamen, ventral tegmental area, and thalamus.

CONCLUSIONS

These results suggest that cocaine expectation modulates neural-sensitivity adaptation between the expected events and the actual outcomes but did not modulate the pharmacological characteristics of cocaine. In addition, the amygdala-lateral OFC circuitry plays an important role in mediating stimulus-outcome relations and contextual factors of drug abuse.

Behavioral functions of the mesolimbic dopaminergic system: an affective neuroethological perspective

The mesolimbic dopaminergic (ML-DA) system has been recognized for its central role in motivated behaviors, various types of reward, and, more recently, in cognitive processes. Functional theories have emphasized DA's involvement in the orchestration of goal-directed behaviors and in the promotion and reinforcement of learning. The affective neuroethological perspective presented here views the ML-DA system in terms of its ability to activate an instinctual emotional appetitive state (SEEKING) evolved to induce organisms to search for all varieties of life-supporting stimuli and to avoid harms. A description of the anatomical framework in which the ML system is embedded is followed by the argument that the SEEKING disposition emerges through functional integration of ventral basal ganglia (BG) into thalamocortical activities. Filtering cortical and limbic input that spreads into BG, DA transmission promotes the "release" of neural activity patterns that induce active SEEKING behaviors when expressed at the motor level. Reverberation of these patterns constitutes a neurodynamic process for the inclusion of cognitive and perceptual representations within the extended networks of the SEEKING urge. In this way, the SEEKING disposition influences attention, incentive salience, associative learning, and anticipatory predictions. In our view, the rewarding properties of drugs of abuse are, in part, caused by the activation of the SEEKING disposition, ranging from appetitive drive to persistent craving depending on the intensity of the affect. The implications of such a view for understanding addiction are considered, with particular emphasis on factors predisposing individuals to develop compulsive drug seeking behaviors.

The nucleus accumbens and reward: neurophysiological investigations in behaving animals

The nucleus accumbens (Acb) is a crucial component of the brain reward system. This report reviews electrophysiological studies that examined Acb cell firing during goal-directed behaviors for natural reinforcers (food, water, sucrose) and drugs of abuse (cocaine, heroin, ethanol). Studies that examined the role of environmental stimuli and operant contingencies on Acb activity during behavior are also explored. Given the extensive literature that links dopamine in the Acb with drug reinforcement, experiments are considered that examined the influence of dopamine in modulating Acb cell firing during drug-seeking behaviors. Finally, because the Acb is one neural substrate of a larger brain reward circuit, the influence of afferent input (hippocampus and prefrontal cortex) on Acb cell firing during behavior is also discussed. These findings provide a unique insight into the cellular mechanisms underlying reward-related processing and goal-directed behaviors and reveal a level of functional organization in the Acb not identified by other experimental approaches.