Phasic firing time locked to cocaine self-infusion and locomotion: dissociable firing patterns of single nucleus accumbens neurons in the rat

Acquired Alterations in Nucleus Accumbens Responsiveness to a Cocaine-Paired Discriminative Stimulus Preceding Rats' Daily Cocaine Consumption

Resumption of drug taking is a primary focus for substance use disorder research and can be triggered by drug-associated environmental stimuli. The Nucleus Accumbens (NAc) is a key brain region which guides motivated behavior and is implicated in resumption. There remains a pressing need to characterize NAc neurons' responsiveness to drug associated stimuli during withdrawal and abstinence. We recorded discriminative stimulus (DS) induced NAc activity via in vivo single-unit electrophysiology in rats that self-administered cocaine. Male and female rats implanted with a jugular catheter and a microwire array in NAc Core and Shell self-administered cocaine under control of a 30s auditory DS for 6 hours per session across 14 consecutive days. Rats acquired tone discrimination within 4 sessions. To exclude pharmacological effects of circulating cocaine from all neural analyses, we studied changes in DS-induced firing only for trials preceding the first infusion of cocaine in each of the 14 sessions, which were defined as "pre-drug trials." NAc neuron responses were assessed prior to tone-evoked movement onset. Responsiveness to the DS tone was exhibited throughout all sessions by the NAc Core population, but only during Early sessions by the NAc Shell population. Both Core and Shell responded selectively to the DS, i.e., more strongly on drug taking trials, or Hits, than on Missed opportunities. These findings suggest that NAc Core and Shell play distinct roles in initiating cocaine seeking prior to daily cocaine consumption, and align with reports suggesting that as drug use becomes chronic, cue-evoked activity shifts from NAc Shell to NAc Core.

Circuit Investigation of Social Interaction and Substance Use Disorder Using Miniscopes

Substance use disorder (SUD) is comorbid with devastating health issues, social withdrawal, and isolation. Successful clinical treatments for SUD have used social interventions. Neurons can encode drug cues, and drug cues can trigger relapse. It is important to study how the activity in circuits and embedded cell types that encode drug cues develop in SUD. Exploring shared neurobiology between social interaction (SI) and SUD may explain why humans with access to social treatments still experience relapse. However, circuitry remains poorly characterized due to technical challenges in studying the complicated nature of SI and SUD. To understand the neural correlates of SI and SUD, it is important to: (1) identify cell types and circuits associated with SI and SUD, (2) record and manipulate neural activity encoding drug and social rewards over time, (3) monitor unrestrained animal behavior that allows reliable drug self-administration (SA) and SI. Miniaturized fluorescence microscopes (miniscopes) are ideally suited to meet these requirements. They can be used with gradient index (GRIN) lenses to image from deep brain structures implicated in SUD. Miniscopes can be combined with genetically encoded reporters to extract cell-type specific information. In this mini-review, we explore how miniscopes can be leveraged to uncover neural components of SI and SUD and advance potential therapeutic interventions.

Cerebellum Transcriptome of Mice Bred for High Voluntary Activity Offers Insights into Locomotor Control and Reward-Dependent Behaviors

The role of the cerebellum in motivation and addictive behaviors is less understood than that in control and coordination of movements. High running can be a self-rewarding behavior exhibiting addictive properties. Changes in the cerebellum transcriptional networks of mice from a line selectively bred for High voluntary running (H) were profiled relative to an unselected Control (C) line. The environmental modulation of these changes was assessed both in activity environments corresponding to 7 days of Free (F) access to running wheel and to Blocked (B) access on day 7. Overall, 457 genes exhibited a significant (FDR-adjusted P-value < 0.05) genotype-by-environment interaction effect, indicating that activity genotype differences in gene expression depend on environmental access to running. Among these genes, network analysis highlighted 6 genes (Nrgn, Drd2, Rxrg, Gda, Adora2a, and Rab40b) connected by their products that displayed opposite expression patterns in the activity genotype contrast within the B and F environments. The comparison of network expression topologies suggests that selection for high voluntary running is linked to a predominant dysregulation of hub genes in the F environment that enables running whereas a dysregulation of ancillary genes is favored in the B environment that blocks running. Genes associated with locomotor regulation, signaling pathways, reward-processing, goal-focused, and reward-dependent behaviors exhibited significant genotype-by-environment interaction (e.g. Pak6, Adora2a, Drd2, and Arhgap8). Neuropeptide genes including Adcyap1, Cck, Sst, Vgf, Npy, Nts, Penk, and Tac2 and related receptor genes also exhibited significant genotype-by-environment interaction. The majority of the 183 differentially expressed genes between activity genotypes (e.g. Drd1) were under-expressed in C relative to H genotypes and were also under-expressed in B relative to F environments. Our findings indicate that the high voluntary running mouse line studied is a helpful model for understanding the molecular mechanisms in the cerebellum that influence locomotor control and reward-dependent behaviors.

Multiplexed neurochemical signaling by neurons of the ventral tegmental area

The ventral tegmental area (VTA) is an evolutionarily conserved structure that has roles in reward-seeking, safety-seeking, learning, motivation, and neuropsychiatric disorders such as addiction and depression. The involvement of the VTA in these various behaviors and disorders is paralleled by its diverse signaling mechanisms. Here we review recent advances in our understanding of neuronal diversity in the VTA with a focus on cell phenotypes that participate in 'multiplexed' neurotransmission involving distinct signaling mechanisms. First, we describe the cellular diversity within the VTA, including neurons capable of transmitting dopamine, glutamate or GABA as well as neurons capable of multiplexing combinations of these neurotransmitters. Next, we describe the complex synaptic architecture used by VTA neurons in order to accommodate the transmission of multiple transmitters. We specifically cover recent findings showing that VTA multiplexed neurotransmission may be mediated by either the segregation of dopamine and glutamate into distinct microdomains within a single axon or by the integration of glutamate and GABA into a single axon terminal. In addition, we discuss our current understanding of the functional role that these multiplexed signaling pathways have in the lateral habenula and the nucleus accumbens. Finally, we consider the putative roles of VTA multiplexed neurotransmission in synaptic plasticity and discuss how changes in VTA multiplexed neurons may relate to various psychopathologies including drug addiction and depression.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Using c-fos to study neuronal ensembles in corticostriatal circuitry of addiction

Learned associations between drugs and environment play an important role in addiction and are thought to be encoded within specific patterns of sparsely distributed neurons called neuronal ensembles. This hypothesis is supported by correlational data from in vivo electrophysiology and cellular imaging studies in relapse models in rodents. In particular, cellular imaging with the immediate early gene c-fos and its protein product Fos has been used to identify sparsely distributed neurons that were strongly activated during conditioned drug behaviors such as drug self-administration and context- and cue-induced reinstatement of drug seeking. Here we review how Fos and the c-fos promoter have been employed to demonstrate causal roles for Fos-expressing neuronal ensembles in prefrontal cortex and nucleus accumbens in conditioned drug behaviors. This work has allowed identification of unique molecular and electrophysiological alterations within Fos-expressing neuronal ensembles that may contribute to the development and expression of learned associations in addiction.

Sensitivity to self-administered cocaine within the lateral preoptic-rostral lateral hypothalamic continuum

The lateral preoptic-rostral lateral hypothalamic continuum (LPH) receives projections from the nucleus accumbens and is believed to be one route by which nucleus accumbens signaling affects motivated behaviors. While accumbens firing patterns are known to be modulated by fluctuating levels of cocaine, studies of the LPH's drug-related firing are absent from the literature. The present study sought to electrophysiologically test whether drug-related tonic and slow-phasic patterns exist in the firing of LPH neurons during a free-access cocaine self-administration task. Results demonstrated that a majority of neurons in the LPH exhibited changes in both tonic and slow-phasic firing rates during fluctuating drug levels. During the maintenance phase of self-administration, 69.6% of neurons exhibited at least a twofold change in tonic firing rate when compared to their pre-drug firing rates. Moreover, 54.4% of LPH neurons demonstrated slow-phasic patterns, specifically "progressive reversal" patterns, which have been shown to be related to pharmacological changes across the inter-infusion interval. Firing rate was correlated with calculated drug level in 58.7% of recorded cells. Typically, a negative correlation between drug level and firing rate was observed, with a majority of neurons showing decreases in firing during cocaine self-administration. A small percentage of LPH neurons also exhibited correlations between locomotor behavior and firing rate; however, correlations with drug level in these same neurons were always stronger. Thus, the weak relationships between LPH firing and locomotor behaviors during cocaine self-administration do not account for the observed changes in firing. Overall, these findings suggest that a proportion of LPH neurons are sensitive to fluctuations in cocaine concentration and may contribute to neural activity that controls drug taking.

Cocaine self-administration produces pharmacodynamic tolerance: differential effects on the potency of dopamine transporter blockers, releasers, and methylphenidate

The dopamine transporter (DAT) is the primary site of action for psychostimulant drugs such as cocaine, methylphenidate, and amphetamine. Our previous work demonstrated a reduced ability of cocaine to inhibit the DAT following high-dose cocaine self-administration (SA), corresponding to a reduced ability of cocaine to increase extracellular dopamine. However, this effect had only been demonstrated for cocaine. Thus, the current investigations sought to understand the extent to which cocaine SA (1.5 mg/kg/inf × 40 inf/day × 5 days) altered the ability of different dopamine uptake blockers and releasers to inhibit dopamine uptake, measured using fast-scan cyclic voltammetry in rat brain slices. We demonstrated that, similar to cocaine, the DAT blockers nomifensine and bupropion were less effective at inhibiting dopamine uptake following cocaine SA. The potencies of amphetamine-like dopamine releasers such as 3,4-methylenedioxymethamphetamine, methamphetamine, amphetamine, and phentermine, as well as a non-amphetamine releaser, 4-benzylpiperidine, were all unaffected. Finally, methylphenidate, which blocks dopamine uptake like cocaine while being structurally similar to amphetamine, shared characteristics of both, resembling an uptake blocker at low concentrations and a releaser at high concentrations. Combined, these experiments demonstrate that after high-dose cocaine SA, there is cross-tolerance of the DAT to other uptake blockers, but not releasers. The reduced ability of psychostimulants to inhibit dopamine uptake following cocaine SA appears to be contingent upon their functional interaction with the DAT as a pure blocker or releaser rather than their structural similarity to cocaine. Further, methylphenidate's interaction with the DAT is unique and concentration-dependent.

Differential effects of cocaine on dopamine neuron firing in awake and anesthetized rats

Cocaine (benzoylmethylecgonine), a natural alkaloid, is a powerful psychostimulant and a highly addictive drug. Unfortunately, the relationships between its behavioral and electrophysiological effects are not clear. We investigated the effects of cocaine on the firing of midbrain dopaminergic (DA) neurons, both in anesthetized and awake rats, using pre-implanted multielectrode arrays and a recently developed telemetric recording system. In anesthetized animals, cocaine (10 mg/kg, intraperitoneally) produced a general decrease of the firing rate and bursting of DA neurons, sometimes preceded by a transient increase in both parameters, as previously reported by others. In awake rats, however, injection of cocaine led to a very different pattern of changes in firing. A decrease in firing rate and bursting was observed in only 14% of DA neurons. Most of the other DA neurons underwent increases in firing rate and bursting: these changes were correlated with locomotor activity in 52% of the neurons, but were uncorrelated in 29% of them. Drug concentration measurements indicated that the observed differences between the two conditions did not have a pharmacokinetic origin. Taken together, our results demonstrate that cocaine injection differentially affects the electrical activity of DA neurons in awake and anesthetized states. The observed increases in neuronal activity may in part reflect the cocaine-induced synaptic potentiation found ex vivo in these neurons. Our observations also show that electrophysiological recordings in awake animals can uncover drug effects, which are masked by general anesthesia.

Slow phasic and tonic activity of ventral pallidal neurons during cocaine self-administration

Ventral pallidal (VP) neurons exhibit rapid phasic firing patterns within seconds of cocaine-reinforced responses. The present investigation examined whether VP neurons exhibited firing rate changes: (1) over minutes during the inter-infusion interval (slow phasic patterns) and/or (2) over the course of the several-hour self-administration session (tonic firing patterns) relative to pre-session firing. Approximately three-quarters (43/54) of VP neurons exhibited slow phasic firing patterns. The most common pattern was a post-infusion decrease in firing followed by a progressive reversal of firing over minutes (51.16%; 22/43). Early reversals were predominantly observed anteriorly whereas progressive and late reversals were observed more posteriorly. Approximately half (51.85%; 28/54) of the neurons exhibited tonic firing patterns consisting of at least a two-fold change in firing. Most cells decreased firing during drug loading, remained low over self-administration maintenance, and reversed following lever removal. Over a whole experiment (tonic) timescale, the majority of neurons exhibited an inverse relationship between calculated drug level and firing rates during loading and post-self-administration behaviors. Fewer neurons exhibited an inverse relationship of calculated drug level and tonic firing rate during self-administration maintenance but, among those that did, nearly all were progressive reversal neurons. The present results show that, similar to its main afferent the nucleus accumbens, VP exhibits both slow phasic and tonic firing patterns during cocaine self-administration. Given that VP neurons are principally GABAergic, the predominant slow phasic decrease and tonic decrease firing patterns within the VP may indicate a disinhibitory influence upon its thalamocortical, mesolimbic, and nigrostriatal targets during cocaine self-administration.

Quantitative pharmacologic MRI: mapping the cerebral blood volume response to cocaine in dopamine transporter knockout mice

The use of pharmacologic MRI (phMRI) in mouse models of brain disorders allows noninvasive in vivo assessment of drug-modulated local cerebral blood volume changes (ΔCBV) as one correlate of neuronal and neurovascular activities. In this report, we employed CBV-weighted phMRI to compare cocaine-modulated neuronal activity in dopamine transporter (DAT) knockout (KO) and wild-type mice. Cocaine acts to block the dopamine, norepinephrine, and serotonin transporters (DAT, NET, and SERT) that clear their respective neurotransmitters from the synapses, helping to terminate cognate neurotransmission. Cocaine consistently reduced CBV, with a similar pattern of regional ΔCBV in brain structures involved in mediating reward in both DAT genotypes. The largest effects (-20% to -30% ΔCBV) were seen in the nucleus accumbens and several cortical regions. Decreasing response amplitudes to cocaine were noted in more posterior components of the cortico-mesolimbic circuit. DAT KO mice had significantly attenuated ΔCBV amplitudes, shortened times to peak response, and reduced response duration in most regions. This study demonstrates that DAT knockout does not abolish the phMRI responses to cocaine, suggesting that adaptations to loss of DAT and/or retained cocaine activity in other monoamine neurotransmitter systems underlie these responses in DAT KO mice.

Rapid phasic activity of ventral pallidal neurons during cocaine self-administration

Little is known regarding the involvement of the ventral pallidum (VP) in cocaine-seeking behavior, in contrast with considerable documentation of the involvement of its major afferent, the nucleus accumbens, over the past thirty years utilizing electrophysiology, lesion, inactivation, molecular, imaging, and other approaches. The VP is neuroanatomically positioned to integrate signals projected from the nucleus accumbens, basolateral amygdala, and ventral tegmental area. In turn, VP projects to thalamoprefrontal, subthalamic, and mesencephalic dopamine regions having widespread influence across mesolimbic, mesocortical, and nigrostriatal systems. Prior lesion studies have implicated VP in cocaine-seeking behavior, but the electrophysiological mechanisms underlying this behavior in the VP have not been investigated. In the present investigation, following 2 weeks of training over which animals increased drug intake, VP phasic activity comprised rapid-phasic increases or decreases in firing rate during the seconds prior to and/or following cocaine-reinforced responses, similar to those found in accumbens. As a population, the direction (increasing or decreasing) and magnitude of firing rate changes were normally distributed suggesting that ventral striatopallidal processing is heterogeneous. Since changes in firing rate around the cocaine-reinforced lever press occurred in animals that escalated drug intake prior to neuronal recordings, a marker of "addiction-like behavior" in the rat, the present experiment provides novel support for a role of VP in drug-seeking behavior. This is especially important given that pallidothalamic and pallidomesencephalic VP projections are positioned to alter dopaminoceptive targets such as the medial prefrontal cortex, nucleus accumbens, and dorsal striatum, all of which have roles in cocaine self-administration.

Electrophysiological evidence of mediolateral functional dichotomy in the rat nucleus accumbens during cocaine self-administration II: phasic firing patterns

In the cocaine self-administering rat, individual nucleus accumbens (NAcc) neurons exhibit phasic changes in firing rate within minutes and/or seconds of lever presses (i.e. slow phasic and rapid phasic changes, respectively). To determine whether neurons that demonstrate these changes during self-administration sessions are differentially distributed in the NAcc, rats were implanted with jugular catheters and microwire arrays in different NAcc subregions (core, dorsal shell, ventromedial shell, ventrolateral shell, or rostral pole). Neural recording sessions were typically conducted on days 13-17 of cocaine self-administration (0.77 mg/kg per 0.2-mL infusion; fixed-ratio 1 schedule of reinforcement; 6-h daily sessions). Pre-press rapid phasic firing rate changes were greater in lateral accumbal (core and ventrolateral shell) than in medial accumbal (dorsal shell and rostral pole shell) subregions. Slow phasic pattern analysis revealed that reversal latencies of neurons that exhibited change + reversal patterns differed mediolaterally: medial NAcc neurons exhibited more early reversals and fewer progressive/late reversals than lateral NAcc neurons. Comparisons of firing patterns within individual neurons across time bases indicated that lateral NAcc pre-press rapid phasic increases were correlated with tonic increases. Tonic decreases were correlated with slow phasic patterns in individual medial NAcc neurons, indicative of greater pharmacological sensitivity of neurons in this region. On the other hand, the bias of the lateral NAcc towards increased pre-press rapid phasic activity, coupled with a greater prevalence of tonic increase firing, may reflect particular sensitivity of these neurons to excitatory afferent signaling and perhaps differential pharmacological influences on firing rates between regions.

Orbitofrontal and insular cortex: neural responses to cocaine-associated cues and cocaine self-administration

Based on neuro-imaging studies in cocaine-addicted humans, it is hypothesized that increases in neural activity within several regions of the prefrontal cortex contribute to cue-induced cocaine seeking and cocaine-induced compulsive drug self-administration. However, electrophysiological tests of these hypotheses are lacking. In the present study, animals were trained to self-administer cocaine (0.75 mg/kg) for 14 days. On the 14th day, we conducted electrophysiological recordings of lateral orbitofrontal (LO) and ventral anterior insula (AIV) neurons. A subset of the combined population of recorded neurons showed a change in firing rate in association with one or more of the following discrete events: (1) presentation of a discriminative stimulus that signaled the onset of the self-administration session, (2) occurrence of the first cocaine-directed operant response, (3) occurrence of a cocaine-reinforced press, and (4) presentation of cues normally paired with delivery of the cocaine reinforcer. The majority of the stimulus- and response-related changes in firing involved a brief increase in firing during the stimulus and response event, respectively. In addition to these event-specific responses, approximately half of the recorded neurons exhibited a sustained change in average firing (i.e., discharges per 30-s bin) during the cocaine self-administration session, relative to average firing during a presession, drug-free period (referred to as session changes). The prevalence of session-increases and decreases were not significantly different. These and other findings are discussed in relation to hypotheses about cue-evoked and cocaine-maintained cocaine-directed behavior.

The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward

The basal ganglia are often conceptualised as three parallel domains that include all the constituent nuclei. The 'ventral domain' appears to be critical for learning flexible behaviours for exploration and foraging, as it is the recipient of converging inputs from amygdala, hippocampal formation and prefrontal cortex, putatively centres for stimulus evaluation, spatial navigation, and planning/contingency, respectively. However, compared to work on the dorsal domains, the rich potential for quantitative theories and models of the ventral domain remains largely untapped, and the purpose of this review is to provide the stimulus for this work. We systematically review the ventral domain's structures and internal organisation, and propose a functional architecture as the basis for computational models. Using a full schematic of the structure of inputs to the ventral striatum (nucleus accumbens core and shell), we argue for the existence of many identifiable processing channels on the basis of unique combinations of afferent inputs. We then identify the potential information represented in these channels by reconciling a broad range of studies from the hippocampal, amygdala and prefrontal cortex literatures with known properties of the ventral striatum from lesion, pharmacological, and electrophysiological studies. Dopamine's key role in learning is reviewed within the three current major computational frameworks; we also show that the shell-based basal ganglia sub-circuits are well placed to generate the phasic burst and dip responses of dopaminergic neurons. We detail dopamine's modulation of ventral basal ganglia's inputs by its actions on pre-synaptic terminals and post-synaptic membranes in the striatum, arguing that the complexity of these effects hint at computational roles for dopamine beyond current ideas. The ventral basal ganglia are revealed as a constellation of multiple functional systems for the learning and selection of flexible behaviours and of behavioural strategies, sharing the common operations of selection-by-disinhibition and of dopaminergic modulation.

Excitability and gap junction-mediated mechanisms in nucleus accumbens regulate self-stimulation reward in rats

The nucleus accumbens (Acb) is a part of the striatum which integrates information from cortical and limbic brain structures, and mediates behaviors which reinforce reward. Previous work has suggested that neuronal synchrony mediated by gap junctions in Acb-related areas is involved in brain pleasure and reward. In order to gain insight into functional aspects of the neural information processing at the level of the striatum, we explored the possible role of Acb gap junctional communication and chemical synapses on reward self-stimulation in rats using positive reinforcement. Rats were trained to press a lever that caused an electrical current to be delivered into the hypothalamus, which is recognized to cause pleasure/reward. Intracerebral infusion into the Acb of the gap junctional blocker carbenoxolone (CBX) decreased the lever-pressing activity. Considering that the net effect of blocking gap junctions is a reduced synchronized output of the cellular activities, which at some level represents a decrease in excitability, two other inhibitors of neuronal excitability, carbamazepine (CBZ) and tetrodotoxin (TTX), were infused into the Acb and their effects on lever-pressing assessed. All manipulations that diminished excitability in the Acb resulted in reduced lever-pressing activity. CBX and TTX were also infused into motor cortex mediating forelimb lever-pressing with no effect. However, a manipulation that has the net effect of increasing excitation, the infusion of the opiate antagonist naloxone, also decreased significantly brain self-stimulation. We conclude that reward behaviors depend to a great extent on both excitability and gap junction-mediated mechanisms in Acb neuronal networks. Thus, the Acb provides a site for the study of pleasure/reward, addiction and conscious experience.

Behavioral functions of the mesolimbic dopaminergic system: an affective neuroethological perspective

The mesolimbic dopaminergic (ML-DA) system has been recognized for its central role in motivated behaviors, various types of reward, and, more recently, in cognitive processes. Functional theories have emphasized DA's involvement in the orchestration of goal-directed behaviors and in the promotion and reinforcement of learning. The affective neuroethological perspective presented here views the ML-DA system in terms of its ability to activate an instinctual emotional appetitive state (SEEKING) evolved to induce organisms to search for all varieties of life-supporting stimuli and to avoid harms. A description of the anatomical framework in which the ML system is embedded is followed by the argument that the SEEKING disposition emerges through functional integration of ventral basal ganglia (BG) into thalamocortical activities. Filtering cortical and limbic input that spreads into BG, DA transmission promotes the "release" of neural activity patterns that induce active SEEKING behaviors when expressed at the motor level. Reverberation of these patterns constitutes a neurodynamic process for the inclusion of cognitive and perceptual representations within the extended networks of the SEEKING urge. In this way, the SEEKING disposition influences attention, incentive salience, associative learning, and anticipatory predictions. In our view, the rewarding properties of drugs of abuse are, in part, caused by the activation of the SEEKING disposition, ranging from appetitive drive to persistent craving depending on the intensity of the affect. The implications of such a view for understanding addiction are considered, with particular emphasis on factors predisposing individuals to develop compulsive drug seeking behaviors.

The nucleus accumbens and reward: neurophysiological investigations in behaving animals

The nucleus accumbens (Acb) is a crucial component of the brain reward system. This report reviews electrophysiological studies that examined Acb cell firing during goal-directed behaviors for natural reinforcers (food, water, sucrose) and drugs of abuse (cocaine, heroin, ethanol). Studies that examined the role of environmental stimuli and operant contingencies on Acb activity during behavior are also explored. Given the extensive literature that links dopamine in the Acb with drug reinforcement, experiments are considered that examined the influence of dopamine in modulating Acb cell firing during drug-seeking behaviors. Finally, because the Acb is one neural substrate of a larger brain reward circuit, the influence of afferent input (hippocampus and prefrontal cortex) on Acb cell firing during behavior is also discussed. These findings provide a unique insight into the cellular mechanisms underlying reward-related processing and goal-directed behaviors and reveal a level of functional organization in the Acb not identified by other experimental approaches.

Accumbal neurons that are activated during cocaine self-administration are spared from inhibitory effects of repeated cocaine self-administration

Hypoactivity of the accumbens is induced by repeated cocaine exposure and is hypothesized to play a role in cocaine addiction. However, it is difficult to understand how a general hypoactivity of the accumbens, which facilitates multiple types of motivated behaviors, could contribute to the selective increase in drug-directed behavior that defines addiction. Electrophysiological recordings, made during sessions in which rats self-administer cocaine, show that most accumbal neurons that encode events related to drug-directed behavior achieve and maintain higher firing rates during the period of cocaine exposure (Task-Activated neurons) than do other accumbal neurons (Task-Non-Activated neurons). We have hypothesized that this difference in activity makes the neurons that facilitate drug-directed behavior less susceptible than other neurons to the chronic inhibitory effects of cocaine. A sparing of neurons that facilitate drug-directed behavior from chronic hypoactivity might lead to a relative increase in the transmission of neuronal signals that facilitate drug-directed behavior through accumbal circuits and thereby contribute to changes in behavior that characterize addiction (ie differential inhibition hypothesis). A prediction of the hypothesis is that neurons that are activated in relation to task events during cocaine self-administration sessions will show less of a decrease in firing across repeated self-administration sessions than will other neurons. To test this prediction, rats were exposed to 30 daily (6 h/day) cocaine self-administration sessions. Chronic extracellular recordings of single accumbal neurons were made during the second to third session and the 30th session. Between-session comparisons showed that decreases in firing were exhibited by Task-Non-Activated, but not by Task-Activated, neurons. During the day 30 session, the magnitude of the difference in firing rate between the two groups of neurons was positively related to the propensity of animals to seek and take cocaine. The findings of the present study are consistent with a basic prediction of the differential inhibition hypothesis and may be relevant to understanding cocaine addiction.

Rat Nucleus Accumbens Neurons Persistently Encode Locations Associated With Morphine Reward

When rats and mice are free to explore a familiar environment they spend more time in a previously rewarded location. This conditioned place preference (CPP) results from an increased probability of initiating transitions from an unrewarded location to one previously paired with reward. We recorded nucleus accumbens (NAc) neurons while rats explored a three-room in-line apparatus. Before place conditioning, approximately equal proportions of NAc neurons show excitations or inhibitions when the rat is in each of the rooms (morphine paired, center or saline paired). Conditioning increased the proportion of neurons inhibited while the rat was in the morphine room and neurons excited in the saline room. Many of the neurons in these two groups responded during room transitions. Furthermore, the postconditioning increase in the population of neurons with room-selective responding persisted for several weeks after the last morphine treatment. This long-lasting change in population responses of NAc neurons to initially neutral locations is a neural correlate of the change in location preference manifest as CPP.

Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm

Environmental stimuli predictive of appetitive events can elicit Pavlovian approach responses that enhance an organism's ability to track and secure natural rewards, but may also contribute to the compulsive nature of drug addiction. Here, we examined the activity of individual nucleus accumbens (NAc) neurons during an autoshaping paradigm. One conditioned stimulus (CS+, a retractable lever presented for 10 s) was immediately followed by the delivery of a 45-mg sucrose pellet to a food receptacle, while another stimulus (CS-, a separate retractable lever presented for 10 s) was never followed by sucrose. Approach responses directed at the CS+ and CS- were recorded as lever presses and had no experimental consequence. Rats (n = 9) selectively approached the CS+ on more than 80% of trials and were surgically prepared for electrophysiological recording. Of 76 NAc neurons, 57 cells (75%) exhibited increases and/or decreases in firing rate (i.e. termed 'phasically active') during the CS+ presentation and corresponding approach response. Forty-seven percent of phasically active cells (27 out of 57) were characterized by time-locked but transient increases in cell firing, while 53% (30 out of 57) showed a significant reduction in firing for the duration of the CS+. In contrast, the same excitatory subpopulation exhibited smaller increases in activity relative to CS- onset, while the inhibitory subpopulation showed no change in firing during the CS- period. The magnitude and prevalence of cue-related neural responses reported here indicates that the NAc encodes biologically significant, repetitive approach responses that may model the compulsive nature of drug addiction in humans.

Exciting inhibition in psychostimulant addiction

Neuroplasticity induced in the nucleus accumbens by repeated psychostimulant administration is thought to underlie the vulnerability to relapse in addicts. Electrophysiological research presents a contradictory portrait of psychostimulant-induced neuroplasticity, reflecting both increases and decreases in excitatory transmission. Drug-induced adaptations of ionic conductances decrease the intrinsic excitability of individual nucleus accumbens spiny neurons but, in the context of the circuitry in which these neurons are embedded, such reduced intrinsic excitability increases the salience of excitatory drive that is elicited by drug-associated stimuli. Thus, we propose that reduced basal excitability, combined with enhanced excitatory drive by drug-associated stimuli, contributes to the two cardinal features of addiction: reduced responding to natural reward and enduring vulnerability to relapse.

Firing Patterns of Accumbal Neurons During a Pavlovian-Conditioned Approach Task

The nucleus accumbens (NAc) is necessary for the expression of Pavlovian-conditioned approach behavior but not for the expression of instrumental behavior conditioned in sessions that set a low response requirement. Although numerous studies have characterized firing patterns of NAc neurons in relation to instrumental behavior, very little is known about how NAc neurons encode information in Pavlovian tasks. In the present study, recordings of accumbal firing patterns were made during sessions in which rats performed a Pavlovian-conditioned approach task. Most of the recorded neurons (74/83, 89%) exhibited significant responses during the conditioned stimulus (CS) presentation and/or the reward exposure. The reward responses were prevalent, predominantly inhibitory, and comparable to reward responses observed in various types of behavioral paradigms, including instrumental tasks. The CS responses could be segregated into multiple subtypes on the basis of directionality, onset latency, and duration. Several characteristics of the CS firing patterns were unique relative to cue responses observed previously during alternative types of conditioning sessions. It is possible that the novel firing patterns correspond to the differential contributions of the accumbens to Pavlovian-conditioned approach behavior and instrumentally conditioned behavior. Regardless, the novel patterns of firing add to existing evidence that characterization of accumbal firing patterns in Pavlovian tasks may provide additional information about the neurophysiological mechanisms that mediate accumbal contributions to behavior.

Critical assessment of how to study addiction and its treatment: human and non-human animal models

Laboratory models, both animal and human, have made enormous contributions to our understanding of addiction. For addictive disorders, animal models have the great advantage of possessing both face validity and a significant degree of predictive validity, already demonstrated. Another important advantage to this field is the ability of reciprocal interplay between preclinical and clinical experiments. These models have made important contributions to the development of medications to treat addictive disorders and will likely result in even more advances in the future. Human laboratory models have gone beyond data obtained from patient histories and enabled investigators to make direct observations of human drug self-administration and test the effects of putative medications on this behavior. This review examines in detail some animal and human models that have led not only to important theories of addiction mechanisms but also to medications shown to be effective in the clinic.

Abstinence from cocaine self-administration heightens neural encoding of goal-directed behaviors in the accumbens

Cocaine addiction in humans is characterized by cycles of abstinence from drug-taking and relapse. Here, electrophysiological recording procedures were used to determine whether nucleus accumbens (Acb) neuronal firing properties are altered following interruption and resumption of cocaine self-administration. Rats (n = 12) were trained to self-administer cocaine (2 h daily sessions) then divided into two groups. Acb activity was recorded for Group 1 (controls) during two additional self-administration sessions completed over the next 2 days (test sessions 1 and 2). Acb activity was recorded for Group 2 (1-month) during one self-administration session completed the next day (test 1), and during a second self-administration session 1 month later (test 2). As in prior reports, a subset of Acb neurons exhibited patterned discharges (short duration and/or long-term cyclic alterations, termed 'phasically active') relative to cocaine-reinforced responding during test session 1. Remarkably, the percentage of phasically active cells dramatically increased (nearly two-fold) following 1-month abstinence, in the core but not the shell of the Acb. Likewise, the strength of the neural correlates (determined via signal-to-baseline ratios) also increased as a function of abstinence. Extinction experiments in another set of rats (n = 12) revealed an increased motivational state for the drug following abstinence. The results show that abstinence from cocaine self-administration causes a dramatic increase in the number and strength of Acb neurons that encode cocaine-related information, thus representing the first neurophysiological correlate of heightened activation of the 'brain reward system' following abstinence and resumption (relapse) of cocaine consumption.

Transition to drug addiction: a negative reinforcement model based on an allostatic decrease in reward function

RATIONALE

The transition from initial drug use to drug addiction has been proposed to result from an allostatic decrease in reward function driven by an overactivation of brain antireward processes.

OBJECTIVES

How decreased reward function explains compulsive drug use is not entirely clear at present, and is still a subject for debate.

METHODS

We present a quantitative model of cocaine self-administration that integrates pharmacokinetic, pharmacodynamic, and motivational factors to address this question. The model assumes that reward system responsivity is a homeostatically regulated process where the desired level of responsivity (called the reward set point) is initially different from the baseline level. The reduction or correction of this difference or error in reward function would drive cocaine self-administration.

RESULTS

Theoretical data obtained by computer simulation fit the experimental data obtained in animals self-administering cocaine (i.e., the within-session pattern of self-injections, the shape and curvature of the dose-injection function, the nonlinear relationship between drug intake and regulated drug effects). Importantly, simulation of an allostatic decrease in reward system responsivity exacerbates the initial error that drives self-administration, thereby increasing both the intake of, and the motivation for, the drug. This allostatic change manifests as a vertical shift in the dose-injection function similar to that seen in animals with escalating cocaine self-administration.

CONCLUSIONS

The present model provides a satisfactory explanation of escalated drug intake and suggests a novel negative reinforcement view of addiction based on an allostatic decrease in reward function.

Spatially selective reward site responses in tonically active neurons of the nucleus accumbens in behaving rats

To study how hippocampal output signals conveying spatial and other contextual information might be integrated in the nucleus accumbens, tonically active accumbens neurons were recorded in three unrestrained rats as they performed spatial orientation tasks on an elevated round rotatable platform with four identical reward boxes symmetrically placed around the edge. The partially water-deprived rats were required to shuttle either between the pair of reward boxes indicated by beacon cues (lights in the boxes) or between the pair of boxes occupying particular locations in relation to environmental landmark cues. In 43/82 neurons, behaviorally correlated phasic modulations in discharge activity occurred, primarily prior to or after water was provided at the reward boxes. Twenty-two had inhibitory modulation, 12 excitatory, and nine were mixed excitatory and inhibitory. Although tonically active neurons (TANs) have rarely been reported in the rodent, the inhibitory and mixed responses correspond to previously reports in the macaque accumbens of tonically active neurons with activity correlated with reward delivery and, following conditioning, to sensory stimuli associated with rewards. Eighteen of the 43 tonically active accumbens neurons showed spatial selectivity, i.e., behaviorally correlated increases or decreases in firing rate were of different magnitudes at the respective reward boxes. This is the first demonstration that the configuration of environmental sensory cues associated with reward sites are also an effective stimulus for these neurons and that different neurons are selective for different places. These results are consistent with a role for the nucleus accumbens in the initiation of goal-directed displacement behaviors.

Nucleus accumbens cell firing and rapid dopamine signaling during goal-directed behaviors in rats

The nucleus accumbens (Acb) is a key neural substrate underlying goal-directed behaviors for both drugs of abuse as well as 'natural' rewards. Here, I review electrophysiological and electrochemical studies completed in our laboratory that examined Acb cell firing and rapid dopamine signaling during behaviors directed toward reward procurement. Electrophysiological studies are reviewed showing that Acb neurons exhibit patterned discharges relative to operant responding for intravenous self-administration of cocaine versus 'natural' reinforcement in rodents. Importantly, subsequent studies showed that discrete subsets of Acb neurons are selectively activated during multiple schedules for a natural reward (water or food) versus cocaine self-administration. These later findings indicate that separate neural circuits selectively process information about goal-directed behaviors for cocaine versus natural reward. In addition, recent findings are reviewed showing that reinforcer selective firing of Acb neurons is not a direct consequence of chronic drug exposure. Next, electrochemical studies are summarized that used fast scan cyclic voltammetry to measure rapid (subsecond) changes in dopamine in the Acb during cocaine self-administration as well as 'natural' reinforcement in rodents. These findings are considered with respect to the role of dopamine in modulating the activity of Acb neurons that encode goal-directed behaviors, the functional organization of the Acb on a microcircuit level, and proposed directions for future studies.

Nicotine administration significantly alters accumbal dopamine in the adult but not in the adolescent rat

Many drug-dependent adults began using drugs during adolescence. In fact, adolescent drug users are more likely to become drug-dependent adults than those abstaining from drug use until after the age of 18. Because of this, recent research has begun to investigate the consequences of adolescent drug use. Specifically, research has begun to focus on the behavioral effects of drugs on the developing brain and the development of drug addiction. The present study examined the responsiveness of the mesolimbic dopamine (DA) pathway during development through the use of in vivo microdialysis. Specifically, it was determined whether nicotine-induced accumbal DA release differs between adolescent and adult rats. To assess nicotine's effects across age, animals received acute or repeated nicotine at early adolescence (postnatal day (PND) 35), late adolescence (PND 45), or young adulthood (PND 60). Findings suggest that there are significant differences between adolescent and adult animals in their dopaminergic response to nicotine. Adult animals had an enhanced DA response to acute nicotine challenge, an effect absent in adolescence. Additionally, this nicotine-induced increase in adults was not apparent after repeated nicotine treatment. These results provide insight into how the adolescent brain responds to nicotine and may also provide evidence as to how prolonged nicotine use affects normal brain development and responsiveness.

Differences between accumbens core and shell neurons exhibiting phasic firing patterns related to drug-seeking behavior during a discriminative-stimulus task

The habit-forming effects of abused drugs depend on the mesocorticolimbic dopamine system innervating the nucleus accumbens (NAcc). To examine whether different NAcc subterritories (core and medial shell) exhibit a differential distribution of neurons showing phasic firing patterns correlated with drug-seeking behavior, rats were trained to self-administer cocaine, and activity of single NAcc neurons was recorded. In the presence of a discriminative-stimulus (S(D)) tone, a single lever press produced an intravenous infusion of cocaine (0.35 mg/kg), terminated the tone, and started an intertone interval ranging from 3 to 6 min. Lever presses during this intertone interval had no programmed consequences. In addition to evaluating neuronal firing patterns associated with cocaine-reinforced presses, we also evaluated firing patterns associated with unreinforced lever presses to allow interpretation of firing free of factors other than the instrumental response (such as tone-off and onset of the pump signaling drug infusion). Core neurons exhibited a greater change in firing than medial shell neurons both in the seconds preceding the reinforced and unreinforced lever press response and in the seconds following the unreinforced response. Core and medial shell neurons exhibited similar changes in firing during the seconds following the cocaine-reinforced press. The differential distribution of neurons exhibiting phasic changes in firing preceding the lever press suggests that the physiological activity of core neurons may play a greater role than that of medial shell neurons in processes related to the execution of conditioned drug-seeking responses.

Neurons in hippocampal afferent zones of rat striatum parse routes into multi-pace segments during maze navigation

Hippocampal 'place' neurons discharge when rats occupy specific regions within an environment. This finding is a cornerstone of the theory of the hippocampus as a cognitive map of space. But for navigation, representations of current position must be implemented by signals concerning where to go next, and how to get there. In recordings in hippocampal output structures associated with the motor system (nucleus accumbens and ventromedial caudate nucleus) in rats solving a plus-maze, neurons fired continuously from the moment the rat left one location until it arrived at the next goal site, or at an intermediate place, such as the maze centre. While other studies have shown discharges during reward approach behaviours, this is the first demonstration of activity corresponding to the parsing of complex routes into sequences of movements between landmarks, similar to the lists of instructions we often employ to communicate directions to follow between points on a map. As these cells fired during a series of several paces or re-orientation movements, perhaps this is homologous to 'chunking'. The temporal overlaps in the activity profiles of the individual neurons provide a possible substrate to successively trigger movements required to arrive at the goal. These hippocampally informed, and in some cases, spatially selective responses support the view of the ventral striatum as an interface between limbic and motor systems, permitting contextual representations to have an impact on fundamental action sequences for goal-directed behaviour.

Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task

The nucleus accumbens (NAc) has long been thought of as a limbic-motor interface. Despite behavioral and anatomical evidence in favor of this idea, little is known about how NAc neurons encode information about motivationally relevant environmental cues and use this information to affect motor action. We therefore investigated the firing of these neurons during the performance of a discriminative stimulus (DS) task using simultaneous multiple single-unit recordings in rats. In this task, two stimuli are randomly presented to the animal: a DS, which signals the availability of a sucrose reward contingent on an operant response, and a similar but nonrewarded stimulus (NS). Subpopulations of NAc neurons increased or decreased their firing in association with several distinct components of the task. In this paper, we investigate cue- and operant-responsive neurons. Neurons excited and inhibited by cues showed larger firing changes in response to the DS than the NS and larger changes when the animal made an operant response to the cue than when the animal failed to respond. Excitations during operant responding were not modulated by the information contained by the cue, whereas inhibitions during operant responding were somewhat larger if the operant response occurred during the DS and somewhat smaller if they occurred in the absence of a cue. These results are consistent with the hypothesis that the firing of subpopulations of NAc neurons encode both the predictive value of environmental stimuli and the specific motor behaviors required to respond to them.

Accumbal Neural Responses During the Initiation and Maintenance of Intravenous Cocaine Self-Administration

During a chronic extracellular recording session, animals with a history of cocaine self-administration were allowed to initiate drug seeking under drug-free conditions. Later, in the same recording session, animals engaged in intravenous cocaine self-administration. During the drug-free period, 31% of 70 accumbal neurons showed a significant increase in average firing rate in association with either or both the exposure to cues that signaled the onset of cocaine availability and the subsequent onset of drug-seeking behavior. The neurons that showed an average excitatory response during the drug-free period were the only group of neurons that showed an average excitatory phasic response to cocaine-reinforced lever presses during the drug self-administration session. A majority of the neurons that were activated during the drug-free period, like the majority of other neurons, showed decreases in average firing in response to self-administered cocaine. However, the neurons that were activated during the drug-free period maintained a higher rate of firing throughout the self-administration session than did other accumbal neurons. The data of the present study are consistent with the conclusion that accumbal neurons contribute to, or otherwise process, initiation of drug seeking under drug-free conditions and that they do so via primarily excitatory responses. Furthermore, there is continuity between the drug-free and -exposed conditions in neural responses associated with drug seeking. Finally, the data have potential implications for understanding mechanisms that transduce accumbal-mediated drug effects that contribute to drug addiction.

Selective encoding of cocaine versus natural rewards by nucleus accumbens neurons is not related to chronic drug exposure

We reported previously that subsets of nucleus accumbens (Acb) neurons differentially encode information about goal-directed behaviors for "natural" (food and water) versus cocaine reward in animals well trained to self-administer the drug (Carelli et al., 2000). Here, we examined whether repeated exposure to cocaine is the crucial determinate of the selective encoding of cocaine versus water reinforcement by Acb neurons. Acb cells were recorded during a water-cocaine multiple schedule from the first day of cocaine exposure as well as during repeated sessions. Specifically, animals were initially trained to press a lever for water and were then surgically prepared for extracellular recording in the Acb. After 1 week, Acb cells were recorded during acquisition of the water-cocaine multiple schedule. Because behavioral responding for water was already established, training on the multiple schedule was divided into three components corresponding to acquisition of self-administration: (1) "initial" (day 1 of self-administration), (2) "reliable" (self-administration behavior was present but erratic), and (3) "stable" (cocaine responding was stable). During the initial component, the percentage of water-selective neurons was high compared with cocaine neurons. However, this became approximately equal with repeated self-administration experience (i.e., during the stable component). Remarkably, the percentage of neurons showing overlapping (similar) neuronal firing patterns during initial exposure to cocaine was low (<8%) and remained low during reliable and stable components. These findings support the view that separate neural circuits in the Acb differentially encode information about cocaine versus natural reward, and that this functional organization is not a direct consequence of chronic drug exposure.

Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues

The nucleus accumbens (NAc) plays an important role in both appetitive and consummatory behavior. To examine how NAc neurons encode information during reward consumption, we recorded the firing activity of rat NAc neurons during the performance of a discriminative stimulus task. In this task, the animal must make an operant response to an intermittently presented cue to obtain a sucrose reward delivered in a reward receptacle. Uncued entries to the receptacle were not rewarded. Both excitations and inhibitions during reward consumption were observed, but substantially more neurons were inhibited than excited. These excitations and inhibitions began when the animal entered the reward receptacle and ended when the animal exited the receptacle. Both excitations and inhibitions were much smaller or nonexistent when the animal made uncued entries into the reward receptacle. In one set of experiments, we randomly withheld the reward in some cued trials that would otherwise have been rewarded. Excitations and inhibitions were of similar magnitude whether or not the reward was delivered. This indicates that the sensory stimulus of reward does not drive these phasic responses; instead, the reward-associated responses may be driven by the conditioned stimuli associated with reward, or they may encode information about consummatory motor activity. Another population of NAc neurons was excited on exit from the reward receptacle. Many of these excitations persisted for tens of seconds after the receptacle exit and showed a significant inverse correlation with the rate of uncued operant responding. These findings are consistent with a contribution of NAc neurons to both reward consummatory and reward seeking behavior.

Differential changes in signal and background firing of accumbal neurons during cocaine self-administration

Learning theories of drug addiction propose that the disorder is, at least in part, attributable to drug effects on accumbal mechanisms that are normally involved in reward-related learning. The neurophysiological mechanisms that might transduce such a drug effect on accumbal mechanisms have yet to be identified. Previous studies showed that a population of accumbal neurons exhibit phasic excitatory responses time locked to cocaine-reinforced lever presses during intravenous cocaine self-administration sessions (neurons referred to as lever-press neurons). Most of the same neurons, like the majority of accumbal neurons, also show a decrease in average firing rate during the drug self-administration session. Evidence indicates that the phasic firing patterns transmit information related to drug-reward-related events. On the other hand, the decreases in average firing reflect a primary pharmacological effect of self-administered cocaine. In the present study, we tested the hypothesis that the phasic firing associated with drug seeking (i.e., signal) is less sensitive than other accumbal firing (i.e., background) to the inhibitory effect of cocaine. During intravenous cocaine self-administration sessions, 45 of 68 neurons showed a decrease in average firing during the self-administration session relative to a predrug baseline period. Fourteen neurons showed both an inhibition in average firing and an excitatory phasic response. For these 14 neurons, signal either remained equal to the average predrug firing rate or exceeded the predrug firing rate during the self-administration session. For the same neurons, background firing generally fell below average predrug firing. The differential changes in signal and background were associated with an increase in the ratio of signal-to-background for the individual neurons. Moreover, the relatively unique resistance of signal to inhibition was associated with an increase in the ratio of signal firing of all lever-press neurons relative to the background firing of all recorded neurons. This type of differential inhibition in signal and background firing might be expected to increase the relative influence of the drug-reward-related signals on accumbal-related neural circuits and differentially influence susceptibility of drug- and non-drug-reward-related synaptic and neural responses to neuroplasticity. It thus represents a mechanism by which inhibitory effects of self-administered drug might amplify the accumbal contribution to behavior and learning and potentially contribute to drug addiction.

Escalation of cocaine self-administration does not depend on altered cocaine-induced nucleus accumbens dopamine levels

Previous studies showed that prolonged access to cocaine or heroin self-administration (long access, or LgA) produces an escalation in drug intake not observed with limited access to the drug (short access, or ShA). The present experiment employed in vivo microdialysis to test the role of alterations in drug pharmacokinetics and/or efficacy in increasing dopamine (DA) levels in the nucleus accumbens (NAcc) during cocaine intake escalation. In experiment 1, both ShA and LgA rats were challenged with passive intravenous administration of cocaine (0.125-1 mg/injection). Regardless of the doses tested, there was no difference between groups in the ability of cocaine to increase NAcc DA levels and no group differences in the temporal profile of dialysate cocaine levels. In experiment 2, cocaine and DA concentrations were measured during cocaine self-administration. Self-administration produced sustained increases of DA in the NAcc with LgA rats maintaining greater steady levels of DA (750% of baseline) than ShA rats (400% of baseline). The difference in the LgA versus ShA rats was not due to differences in the efficacy of cocaine to elevate DA levels, or in the rate of cocaine metabolism, but was directly related to the amount of self-administered cocaine. These findings show that changes in cocaine efficacy or pharmacokinetics do not play a critical role in cocaine intake escalation.

Tonically active neurons in the primate striatum and their role in the processing of information about motivationally relevant events

Analysis of recordings of single neuronal activity in the striatum of monkeys engaged in behavioural tasks has shown that tonically active neurons (TANs) can be distinguished by their distinct spontaneous firing and functional properties. As TANs are assumed to be cholinergic interneurons, the study of their physiological characteristics allows us to gain an insight into the role of a particular type of local-circuit neuron in the processing of information at the striatal level. In monkeys performing various behavioural tasks, the change in the activity of TANs, unlike the diversity of task-related activations exhibited by the phasically active population of striatal neurons, involves a transient depression of the tonic firing related to environmental events of motivational significance. Such events include primary rewards and stimuli that have acquired a reward value during associative learning. These neurons also respond to an aversive air puff, indicating that their responsiveness is not restricted to appetitive conditions. Another striking feature of the TANs is that their responses can be modulated by predictions about stimulus timing. Temporal variations in event occurrence have been found to favour the responses of TANs, whereas the responses are diminished or abolished in the presence of external cues that predict the time at which events will occur. These data suggest that the TANs respond as do detectors of motivationally relevant events, but they also demonstrate that these neurons are influenced by predictive information based on past experience with a given temporal context. TANs represent a unique subset of striatal neurons that might serve a modulatory function, monitoring for temporal relationships between environmental events.

Getting formal with dopamine and reward

Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards. Dopamine neurons display a short-latency, phasic reward signal indicating the difference between actual and predicted rewards. The signal is useful for enhancing neuronal processing and learning behavioral reactions. It is distinctly different from dopamine's tonic enabling of numerous behavioral processes. Neurons in the striatum, frontal cortex, and amygdala also process reward information but provide more differentiated information for identifying and anticipating rewards and organizing goal-directed behavior. The different reward signals have complementary functions, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals. Addictive psychostimulant drugs may exert their action by amplifying the dopamine reward signal.

Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. 'natural' reinforcement

Numerous investigations indicate that the nucleus accumbens (Acb) is an important neural substrate mediating the reinforcing properties of 'natural' rewards (food or water) as well as abused substances. Here, our electrophysiological studies that examined Acb cell firing within seconds of lever press responding for intravenous cocaine vs. water or food reinforcement in rats are reviewed. Initial investigations revealed that a subset of Acb neurons exhibits four types of firing patterns within seconds of the reinforced response for intravenous cocaine during self-administration sessions. Three of those four cell types were also observed during water reinforcement sessions. In a subsequent study, the activity of the same Acb neurons was examined in rats responding on multiple schedules for either two distinct 'natural' reinforcers (water and food), or one of those 'natural' reinforcers and the intravenous self-administration of cocaine. The results showed that the majority of neurons tested exhibited similar, overlapping neuronal firing patterns across the two 'natural' reinforcer conditions. In contrast, the majority of neurons examined displayed differential, nonoverlapping firing patterns relative to operant responding for water (or food) vs. cocaine reinforcement. Additional studies that examined the role of associative factors on Acb cell firing during cocaine self-administration sessions are reviewed. Collectively, these findings illustrate the dynamic nature of Acb cell firing in behaving animals, and provide insight into how Acb neurons process information about goal-directed behaviors for 'natural' reinforcers vs. abused substances.

An examination of nucleus accumbens cell firing during extinction and reinstatement of water reinforcement behavior in rats

Electrophysiological recording procedures were used to examine nucleus accumbens (Acb) cell firing in rats (n = 13) during water reinforcement sessions consisting of three phases. During phase one (maintenance), a lever press resulted in water reinforcement (fixed ratio 1; 0.05 ml/press) paired with an auditory stimulus (0.5 s). Of 128 Acb neurons recorded during maintenance, 40 cells (31%) exhibited one of three types of neuronal firing patterns described previously [J. Neurosci. 14 (12) (1994) 7735-7746; J. Neurosci. 20 (11) (2000) 4255-4266]. Briefly, Acb neurons exhibited increases in firing rate within seconds preceding the reinforced response (type PR) or increases (type RFe) or decreases (type RFi) in activity seconds following response completion. In phase two (extinction), subsequent lever pressing had no programmed consequences (i.e., water reinforcement and the auditory stimulus were not presented). After 30 min of no responding, animals were given water reinforcement/auditory stimulus 'primes' to reestablish lever pressing behavior during the third phase (reinstatement). Results indicated that all types of phasic neurons (PR, RFe and RFi) exhibited an attenuated firing rate during extinction, and in some cases recovery of patterned discharges were observed during reinstatement. No significant changes in cell firing were observed for any cell type during presentation of the stimulus prime used to reestablish operant responding following extinction. These findings are discussed in terms of how Acb neurons process information related to 'natural' reinforcers versus drugs of abuse.

Position sensitivity in phasically discharging nucleus accumbens neurons of rats alternating between tasks requiring complementary types of spatial cues

To determine how hippocampal location-selective discharges might influence downstream structures for navigation, nucleus accumbens neurons were recorded in rats alternating between two tasks guided respectively by lit cues in the maze or by extramaze room cues. Of 144 phasically active neurons, 80 showed significant behavioral correlates including displacements, immobility prior to, or after reward delivery, as well as turning, similar to previous reports. Nine neurons were position-selective, 22 were sensitive to task and platform changes and 40 others were both. Although the accumbens neurons showed the same behavioral correlate in two or four functionally equivalent locations, these responses were stronger at some of these places, evidence for position sensitivity. To test whether position responses were selective for room versus platform cues, the experimental platform was rotated while the rat performed each of the two tasks. This revealed responses to changes in position relative to both platform and room cues, despite the fact that previous studies had shown that place responses of hippocampal neurons recorded in the same task are anchored to room cues only. After these manipulations and shifts between the two tasks, the responses varied among simultaneously recorded neurons, and even in single neurons in alternating visits to reward sites. Again this contrasts with the uniformity of place responses of hippocampal neurons recorded in this same task. Thus accumbens position responses may derive from hippocampal inputs, while responses to context changes are more likely to derive from other signals or intrinsic processing. Considering the accumbens as a limbic-motor interface, we conclude that position-modulated behavioral responses in the accumbens may be intermediate between the allocentric reference frame of position-selective discharges in the hippocampus and the egocentric coding required to organize movement control. The conflicting responses among simultaneously recorded neurons could reflect competition processes serving as substrates for action selection and learning.

Dopamine D1 and NMDA receptors mediate potentiation of basolateral amygdala-evoked firing of nucleus accumbens neurons

Interactions between the basolateral amygdala (BLA) and the nucleus accumbens (NAc) mediate reward-related processes that are modulated by mesoaccumbens dopamine (DA) transmission. The present in vivo electrophysiological study assessed: (1) changes in the firing probability of submaximal BLA-evoked single neuronal firing activity in the NAc after tetanic stimulation of the BLA, and (2) the functional roles of DA and NMDA receptors in these processes. Tetanic stimulation of the BLA potentiated BLA-evoked firing activity of NAc neurons for a short duration ( approximately 25 min). This short-term potentiation was associated with an increase in DA oxidation currents that was monitored with chronoamperometry. Systemic or iontophoretic application before BLA tetanus of the D(1) receptor antagonist SCH23390, but not the D(2) receptor antagonist sulpiride, abolished the potentiation of BLA-evoked NAc activity, whereas administration of SCH23390 3 min after tetanus had no effect. However, systemic administration of the NMDA antagonist 3-(2-carboxypiperazin-4-yl)-propyl-1-phosphonic acid (CPP), either before or after BLA tetanus, abolished the potentiation of BLA-evoked firing of NAc neurons. These data suggest that higher-frequency activity in BLA efferents can autoregulate their excitatory influence over neural activity of NAc neurons by facilitating the release of DA and activating both DA D(1) and NMDA receptors. This may represent a cellular mechanism that facilitates approach behaviors directed toward reward-related stimuli that are mediated by BLA-NAc circuitries.

Reward signaling by dopamine neurons

Dopamine projections from the midbrain to the striatum and frontal cortex are involved in behavioral reactions controlled by rewards, as inferred from deficits in parkinsonism, schizophrenia, and drug addiction. Recent experiments have shown that dopamine neurons are not directly modulated in relation to movements. Rather, they appear to code the rewarding aspects of environmental stimuli. They show short, phasic increases of activity following primary food and liquid rewards ("unconditioned stimuli") and conditioned, reward-predicting stimuli of visual, auditory, and somatosensory modalities. They also display smaller activation-depression sequences after stimuli resembling rewards and after novel or particularly intense stimuli. Rewards are only reported as far as they occur differently than predicted. According to learning theories, a "prediction error" message may constitute a powerful teaching signal for behavior and learning. The phasic reward message is different from the more tonic enabling function of dopamine that is deficient in Parkinson's disease, indicating that dopamine neurons subserve different functions at different time scales. Neurons in other brain structures, such as the striatum, orbitofrontal cortex, and amygdala, code the quality, quantity, and preference of rewards. The dopamine reward prediction error signal may cooperate with these reward perception signals during the learning and performance of behavioral reactions to motivating environmental stimuli.

Selective activation of accumbens neurons by cocaine-associated stimuli during a water/cocaine multiple schedule

Electrophysiological recording procedures were used to examine the responsiveness of nucleus accumbens (Acb) neurons to stimuli associated with cocaine delivery during a multiple schedule for water reinforcement and cocaine self-administration. Rats (n=9) were trained to press one lever for water reinforcement (0.05 ml/resp.; fixed ratio 1; FR1; 15 min) and a second spatially distinct lever for intravenous cocaine (0.33 mg/infusion; FR1; 2 h). The delivery of each reinforcer was signaled by different auditory stimuli. Of 101 neurons, 52 cells were classified as phasically active, exhibiting one of four well-defined types of patterned discharges relative to the water- or cocaine-reinforced response [J. Neurosci., 14(12) (1994) 7735; J. Neurosci., 20(11) (2000) 4255]. Acb cells were examined in test sessions consisting of 'probe' trials during which the stimulus previously paired with cocaine infusion was randomly presented in a response-independent manner during the self-administration portion of the session. Results showed that only neurons that exhibited changes in firing rate within seconds following the reinforced response for cocaine (but not water) were activated by the stimulus. This finding indicates that the responsiveness of cocaine selective neurons to cocaine-associated stimuli likely represents a conditioned response as opposed to a generalized stimulus-evoked discharge.

Altered sensitivity of CD81-deficient mice to neurobehavioral effects of cocaine

CD81, also known as target of the antiproliferative antibody, is known to be expressed in astrocytes and involved in cell adhesion and, recently, we demonstrated its induction exclusively in the accumbens following cocaine. In the present study, the sensitivity of CD81-deficient mice to behavioral effects of cocaine was evaluated. It was found that CD81-deficient mice exhibited altered sensitivity to cocaine as assessed in the place preference conditioning paradigm and locomotor activity. This deficit in place preference conditioning was not accompanied by a deficit in acquisition or retention of water maze behavior. In addition, CD81 knockout mice exhibited higher levels of nucleus accumbens dopamine as compared to their controls. These observations are discussed in the context of the role of CD81 in cocaine-mediated behaviors.

Position and behavioral modulation of synchronization of hippocampal and accumbens neuronal discharges in freely moving rats

To understand how hippocampal signals are processed by downstream neurons, we analyzed the relative timing between neuronal discharges in simultaneous recordings in the hippocampus and nucleus accumbens of rats performing in a plus maze. In all, 154 pairs of cells (composed of 65 hippocampal and 56 accumbens neurons) were examined during the 1 s period prior to reward delivery. Cross-correlation analyses over a +/- 300-ms window with 10-ms bins revealed that 108 pairs had at least one significant histogram bin (P < 0.01). The most frequently occurring peaks of hippocampal firing prior to accumbens discharges appeared at latencies from -30-0 ms, corresponding to published values of the latency of the hippocampal pathway to the nucleus accumbens. Other peaks appeared most often at latencies multiples of about 110 ms prior to and after this, corresponding to theta rhythmicity. Since firing synchronization can result from several types of connectivity patterns (such as common inputs), a group of 18 hippocampus-accumbens pairs was selected as those most likely to have monosynaptic connections. The criterion was the presence of at least one highly significant peak (P < 0.001) at latencies corresponding to field potentials evoked in the accumbens by hippocampal stimulation. A significant peak occurred on all four maze arms for only one of these cell pairs, indicating positional modulation for the others. In addition, behavior dependence of the synchrony between these nucleus accumbens and hippocampus neurons was examined by studying data in relation to three different synchronization points: reward box arrival, box departure, and arrival at the center of the maze. This indicates that the functional connectivity between hippocampal and accumbens neurons was stronger when the rat was near reward areas. Ten of the hippocampal neurons in these 18 cell pairs showed 9-Hz (theta) rhythmic activity in autocorrelation analyses. Of these 10 cells, cross-correlograms from eight hippocampal-accumbens pairs also showed theta rhythmicity. Overall, these results indicate that the synchrony between hippocampus and nucleus accumbens neurons is modulated by spatial position and behavior, and theta rhythm may play an important role for this synchronization.

Reduction of zif268 messenger RNA expression during prolonged withdrawal following "binge" cocaine self-administration in rats

Cocaine self-administration increases dopamine efflux and neuronal activity in the mesocorticolimbic dopamine system compared with experimenter-administered cocaine. Following a prolonged cocaine self-administration binge, dopamine efflux in the nucleus accumbens is attenuated and behaviors emerge that are indicative of anhedonia and anxiety. The neuronal correlates of these behavioral and neurochemical effects of a cocaine binge were assessed using in situ hybridization histochemistry to detect changes in zif268 messenger RNA expression. Rats were fitted with intravenous catheters; one group was trained to self-administer cocaine (0.5mg/injection), then allowed continuous access to cocaine during a 16h binge, while yoked animals received either saline or cocaine according to the same schedule. Measurement of tactile startle responses and ultrasonic distress calls either immediately after termination of cocaine access or one or 14 days later confirmed peak withdrawal at 24h after the binge. The level of zif268 messenger RNA was lower upon termination of cocaine self-administration than in both yoked treatment groups in the ventral tegmental area and hippocampus. In contrast, zif268 messenger RNA expression increased in the periaqueductal gray matter one day after termination of passive cocaine treatment, coincident with enhanced expression of ultrasonic vocalizations. Zif268 messenger RNA expression decreased over time in the nucleus accumbens core and infralimbic cortex, with reduced expression observed in the nucleus accumbens core, caudatoputamen, hippocampus and amygdala 14 days after termination of cocaine self-administration. The results suggest that withdrawal following a cocaine self-administration binge produces a long-lasting reduction of constitutive zif268 messenger RNA expression in mesocorticolimbic brain regions related to the nucleus accumbens. The relatively greater effect in animals that self-administered cocaine implies a relationship of certain regional responses to behavioral conditioning.