Neuronal and behavioral correlations in the medial prefrontal cortex and nucleus accumbens during cocaine self-administration by rats

Prelimbic and infralimbic medial prefrontal cortex neuron activity signals cocaine seeking variables across multiple timescales

RATIONALE AND OBJECTIVES

The prefrontal cortex is critical for execution and inhibition of reward seeking. Neural manipulation of rodent medial prefrontal cortex (mPFC) subregions differentially impacts execution and inhibition of cocaine seeking. Dorsal, or prelimbic (PL), and ventral, or infralimbic (IL) mPFC are implicated in cocaine seeking or extinction of cocaine seeking, respectively. This differentiation is not seen across all studies, indicating that further research is needed to understand specific mPFC contributions to drug seeking.

METHODS

We recorded neuronal activity in mPFC subregions during cocaine self-administration, extinction, and cue- and cocaine-induced reinstatement of cocaine seeking.

RESULTS

Both PL and IL neurons were phasically responsive around lever presses during cocaine self-administration, and activity in both areas was reduced during extinction. During both cue- and, to a greater extent, cocaine-induced reinstatement, PL neurons exhibited significantly elevated responses, in line with previous studies demonstrating a role for the region in relapse. The enhanced PL signaling in cocaine-induced reinstatement was driven by strong excitation and inhibition in different groups of neurons. Both of these response types were stronger in PL vs. IL neurons. Finally, we observed tonic changes in activity in all tasks phases, reflecting both session-long contextual modulation as well as minute-to-minute activity changes that were highly correlated with brain cocaine levels and motivation associated with cocaine seeking.

CONCLUSIONS

Although some differences were observed between PL and IL neuron activity across sessions, we found no evidence of a go/stop dichotomy in PL/IL function. Instead, our results demonstrate temporally heterogeneous prefrontal signaling during cocaine seeking and extinction in both PL and IL, revealing novel and complex functions for both regions during these behaviors. This combination of findings argues that mPFC neurons, in both PL and IL, provide multifaceted contributions to the regulation of drug seeking and addiction.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Integration of value and action in medial prefrontal neural systems

The rodent medial prefrontal cortex (mPFC) plays a key role in regulating cognition, emotion, and behavior. mPFC neurons are activated in diverse experimental paradigms, raising the questions of whether there are specific task elements or dimensions encoded by mPFC neurons, and whether these encoded parameters are selective to neurons in particular mPFC subregions or networks. Here, we consider the role of mPFC neurons in processing appetitive and aversive cues, outcomes, and related behaviors. mPFC neurons are strongly activated in tasks probing value and outcome-associated actions, but these responses vary across experimental paradigms. Can we identify specific categories of responses (e.g., positive or negative value), or do mPFC neurons exhibit response properties that are too heterogeneous/complex to cluster into distinct conceptual groups? Based on a review of relevant studies, we consider what has been done and what needs to be further explored in order to address these questions.

The Mesolimbic Dopamine Activity Signatures of Relapse to Alcohol-Seeking

The mesolimbic dopamine system comprises distinct compartments supporting different functions in learning and motivation. Less well understood is how complex addiction-related behaviors emerge from activity patterns across these compartments. Here we show how different forms of relapse to alcohol-seeking in male rats are assembled from activity across the VTA and the nucleus accumbens. First, we used chemogenetic approaches to show a causal role for VTA TH neurons in two forms of relapse to alcohol-seeking: renewal (context-induced reinstatement) and reacquisition. Then, using gCaMP fiber photometry of VTA TH neurons, we identified medial and lateral VTA TH neuron activity profiles during self-administration, renewal, and reacquisition. Next, we used optogenetic inhibition of VTA TH neurons to show distinct causal roles for VTA subregions in distinct forms of relapse. We then used dLight fiber photometry to measure dopamine binding across the ventral striatum (medial accumbens shell, accumbens core, lateral accumbens shell) and showed complex and heterogeneous profiles of dopamine binding during self-administration and relapse. Finally, we used representational similarity analysis to identify mesolimbic dopamine signatures of self-administration, extinction, and relapse. Our results show that signatures of relapse can be identified from heterogeneous activity profiles across the mesolimbic dopamine system and that these signatures are unique for different forms of relapse.SIGNIFICANCE STATEMENT It is axiomatic that the actions of dopamine are critical to drug addiction. Yet how relapse to drug-seeking is assembled from activity across the mesolimbic dopamine system is poorly understood. Here we show how relapse to alcohol-seeking relates to activity in specific VTA and accumbens compartments, how these change for different forms of relapse, and how relapse-associated activity relates to activity during self-administration and extinction. We report the mesolimbic dopamine activity signatures for relapse and show that these signatures are unique for different forms of relapse.

Visualizing Infralimbic Control over Incubation of Cocaine Craving

The infralimbic prefrontal cortex serves complex roles in controlling drug-seeking behavior. In this issue of Neuron, Cameron et al. (2019) provide new insights into engagement and function of the infralimbic cortex → nucleus accumbens corticostriatal pathway in the incubation of cocaine craving.

Increased Cocaine Motivation Is Associated with Degraded Spatial and Temporal Representations in IL-NAc Neurons

Craving for cocaine progressively increases in cocaine users during drug-free periods, contributing to relapse. The projection from the infralimbic cortex to the nucleus accumbens shell (IL-NAc) is thought to inhibit cocaine seeking. However, it is not known whether and how IL-NAc neurons contribute to the increased motivation associated with a drug-free period. We first performed cellular resolution imaging of IL-NAc neurons in rats during a drug-seeking test. This revealed neurons with spatial selectivity within the cocaine-associated context, a decrease in activity around the time of cocaine seeking, and an inverse relationship between cocaine-seeking activity and subsequent cocaine motivation. All these properties were reduced by a drug-free period. Next, we transiently activated this projection, which resulted in reduced drug seeking, regardless of the drug-free period. Taken together, this suggests that altered IL-NAc activity after a drug-free period may enhance cocaine motivation without fundamentally altering the projection's ability to inhibit drug seeking.

A Cognition-Related Neural Oscillation Pattern, Generated in the Prelimbic Cortex, Can Control Operant Learning in Rats

The prelimbic (PrL) cortex constitutes one of the highest levels of cortical hierarchy dedicated to the execution of adaptive behaviors. We have identified a specific local field potential (LFP) pattern generated in the PrL cortex and associated with cognition-related behaviors. We used this pattern to trigger the activation of a visual display on a touch screen as part of an operant conditioning task. Rats learned to increase the presentation rate of the selected θ to β-γ (θ/β-γ) transition pattern across training sessions. The selected LFP pattern appeared to coincide with a significant decrease in the firing of PrL pyramidal neurons and did not seem to propagate to other cortical or subcortical areas. An indication of the PrL cortex's cognitive nature is that the experimental disruption of this θ/β-γ transition pattern prevented the proper performance of the acquired task without affecting the generation of other motor responses. The use of this LFP pattern to trigger an operant task evoked only minor changes in its electrophysiological properties. Thus, the PrL cortex has the capability of generating an oscillatory pattern for dealing with environmental constraints. In addition, the selected θ/β-γ transition pattern could be a useful tool to activate the presentation of external cues or to modify the current circumstances.SIGNIFICANCE STATEMENT Brain-machine interfaces represent a solution for physically impaired people to communicate with external devices. We have identified a specific local field potential pattern generated in the prelimbic cortex and associated with goal-directed behaviors. We used the pattern to trigger the activation of a visual display on a touch screen as part of an operant conditioning task. Rats learned to increase the presentation rate of the selected field potential pattern across training. The selected pattern was not modified when used to activate the touch screen. Electrical stimulation of the recording site prevented the proper performance of the task. Our findings show that the prelimbic cortex can generate oscillatory patterns that rats can use to control their environment for achieving specific goals.

Frontostriatal Circuit Dynamics Correlate with Cocaine Cue-Evoked Behavioral Arousal during Early Abstinence

It is thought that frontostriatal circuits play an important role in mediating conditioned behavioral responses to environmental stimuli that were previously encountered during drug administration. However, the neural correlates of conditioned responses to drug-associated cues are not well understood at the level of large populations of simultaneously recorded neurons, or at the level of local field potential (LFP) synchrony in the frontostriatal network.

It is thought that frontostriatal circuits play an important role in mediating conditioned behavioral responses to environmental stimuli that were previously encountered during drug administration. However, the neural correlates of conditioned responses to drug-associated cues are not well understood at the level of large populations of simultaneously recorded neurons, or at the level of local field potential (LFP) synchrony in the frontostriatal network. Here we introduce a behavioral assay of conditioned arousal to cocaine cues involving pupillometry in awake head-restrained mice. After just 24 h of drug abstinence, brief exposures to olfactory stimuli previously paired with cocaine injections led to a transient dilation of the pupil, which was greater than the dilation effect to neutral cues. In contrast, there was no cue-selective change in locomotion, as measured by the rotation of a circular treadmill. The behavioral assay was combined with simultaneous recordings from dozens of electrophysiologically identified units in the medial prefrontal cortex (mPFC) and ventral striatum (VS). We found significant relationships between cocaine cue-evoked pupil dilation and the proportion of inhibited principal cells in the mPFC and VS. Additionally, LFP coherence analysis revealed a significant correlation between pupillary response and synchrony in the 25–45 Hz frequency band. Together, these results show that pupil dilation is sensitive to drug-associated cues during acute stages of abstinence, and that individual animal differences in this behavioral arousal response can be explained by two complementary measures of frontostriatal network activity.

Current Models and Future Directions for Understanding the Neural Circuitries of Maternal Behaviors in Rodents

Maternal behaviors in rodents include a number of subcomponents, such as nursing, nest building, licking and grooming of pups, pup retrieval, and maternal aggression. Because each behavior involves a unique motor pattern, a unique ensemble neural circuitry must underlie each behavior. To what extent there is overlap in terms of brain regions and specific neurons for each circuit is being actively investigated. This review will first examine overlapping and separate components of pup retrieval and maternal aggression circuitries while examining a central role for medial preoptic area (MPA) in both behaviors. With an emphasis on experimental approaches, the review will then highlight recent findings and propose future directions for understanding maternal behavior regulation. Finally, examples for why studying the neural basis of maternal behaviors can bring insights to other areas of neuroscience, such as feeding, addiction, and anxiety and aggression regulation will be provided.

Low- and high-gamma oscillations deviate in opposite directions from zero-phase synchrony in the limbic corticostriatal loop

The loop structure of cortico-striatal anatomy in principle enables both descending (cortico-striatal) and ascending (striato-cortical) influences, but the factors that regulate the flow of information in these loops are not known. We report that low- and high-gamma oscillations (∼50 and ∼80 Hz, respectively) in the local field potential of freely moving rats are highly synchronous between the infralimbic region of the medial prefrontal cortex (mPFC) and the ventral striatum (vStr). Strikingly, high-gamma oscillations in mPFC preceded those in vStr, whereas low-gamma oscillations in mPFC lagged those in vStr, with short (∼1 ms) time lags. These systematic deviations from zero-phase synchrony were consistent across measures based on amplitude cross-correlation and phase slopes and were robustly maintained between behavioral states and different individual subjects. Furthermore, low- and high-gamma oscillations were associated with distinct ensemble spiking patterns in vStr, even when controlling for overt behavioral differences and slow changes in neural activity. These results imply that neural activity in vStr and mPFC is tightly coupled at the gamma timescale and raise the intriguing possibility that frequency-specific deviations from this coupling may signal transient leader-follower switches.

Differential roles of medial prefrontal subregions in the regulation of drug seeking

The prefrontal cortex plays an important role in shaping cognition and behavior. Many studies have shown that medial prefrontal cortex (mPFC) plays a key role in seeking, extinction, and reinstatement of cocaine seeking in rodent models of relapse. Subregions of mPFC appear to play distinct roles in these behaviors, such that the prelimbic cortex (PL) is proposed to drive cocaine seeking and the infralimbic cortex (IL) is proposed to suppress cocaine seeking after extinction. This dichotomy of mPFC function may be a general attribute, as similar dorsal-ventral distinctions exist for expression vs. extinction of fear conditioning. However, other results indicate that the role of mPFC neurons in reward processing is more complex than a simple PL-seek vs. IL-extinguish dichotomy. Both PL and IL have been shown to drive and inhibit drug seeking (and other types of behaviors) depending on a range of factors including the behavioral context, the drug-history of the animal, and the type of drug investigated. This heterogeneity of findings may reflect multiple subcircuits within each of these PFC areas supporting unique functions. It may also reflect the fact that the mPFC plays a multifaceted role in shaping cognition and behavior, including those overlapping with cocaine seeking and extinction. Here we discuss research leading to the hypothesis that dorsal and ventral mPFC differentially control drug seeking and extinction. We also present recent results calling the absolute nature of a PL vs. IL dichotomy into question. Finally, we consider alternate functions for mPFC that correspond less to response execution and inhibition and instead incorporate the complex cognitive behavior for which the mPFC is broadly appreciated.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Role of the thalamic nucleus reuniens in mediating interactions between the hippocampus and medial prefrontal cortex during spatial working memory

Despite decades of research, the neural mechanisms of spatial working memory remain poorly understood. Although the dorsal hippocampus is known to be critical for memory-guided behavior, experimental evidence suggests that spatial working memory depends not only on the hippocampus itself, but also on the circuit comprised of the hippocampus and the medial prefrontal cortex (mPFC). Disruption of hippocampal-mPFC interactions may result in failed transfer of spatial and contextual information processed by the hippocampus to the circuitry in mPFC responsible for decision making and goal-directed behavior. Oscillatory synchrony between the hippocampus and mPFC has been shown to increase in tasks with high spatial working memory demand. However, the mechanisms and circuitry supporting hippocampal-mPFC interactions during these tasks is unknown. The midline thalamic nucleus reuniens (RE) is reciprocally connected to both the hippocampus and the mPFC and has been shown to be critical for a variety of working memory tasks. Therefore, it is likely that hippocampal-mPFC oscillatory synchrony is modulated by RE activity. This article will review the anatomical connections between the hippocampus, mPFC and RE along with the behavioral studies that have investigated the effects of RE disruption on working memory task performance. The article will conclude with suggestions for future directions aimed at identifying the specific role of the RE in regulating functional interactions between the hippocampus and the PFC and investigating the degree to which these interactions contribute to spatial working memory.

Using c-fos to study neuronal ensembles in corticostriatal circuitry of addiction

Learned associations between drugs and environment play an important role in addiction and are thought to be encoded within specific patterns of sparsely distributed neurons called neuronal ensembles. This hypothesis is supported by correlational data from in vivo electrophysiology and cellular imaging studies in relapse models in rodents. In particular, cellular imaging with the immediate early gene c-fos and its protein product Fos has been used to identify sparsely distributed neurons that were strongly activated during conditioned drug behaviors such as drug self-administration and context- and cue-induced reinstatement of drug seeking. Here we review how Fos and the c-fos promoter have been employed to demonstrate causal roles for Fos-expressing neuronal ensembles in prefrontal cortex and nucleus accumbens in conditioned drug behaviors. This work has allowed identification of unique molecular and electrophysiological alterations within Fos-expressing neuronal ensembles that may contribute to the development and expression of learned associations in addiction.

Prelimbic and infralimbic cortical regions differentially encode cocaine-associated stimuli and cocaine-seeking before and following abstinence

Cocaine stimuli often trigger relapse of drug-taking, even following periods of prolonged abstinence. Here, electrophysiological recordings were made in rats (n = 29) to determine how neurons in the prelimbic (PrL) or infralimbic (IL) regions of the medial prefrontal cortex (mPFC) encode cocaine-associated stimuli and cocaine-seeking, and whether this processing is differentially altered after 1 month of cocaine abstinence. After self-administration training, neurons (n = 308) in the mPFC were recorded during a single test session conducted either the next day or 1 month later. Test sessions consisted of three phases during which (i) the tone-houselight stimulus previously paired with cocaine infusion during self-administration was randomly presented by the experimenter, (ii) rats responded on the lever previously associated with cocaine during extinction and (iii) the tone-houselight was presented randomly between cocaine-reinforced responding during resumption of cocaine self-administration. PrL neurons showed enhanced encoding of the cocaine stimulus and drug-seeking behavior (under extinction and self-administration) following 30 days of abstinence. In contrast, although IL neurons encoded cocaine cues and cocaine-seeking, there were no pronounced changes in IL responsiveness following 30 days of abstinence. Importantly, cue-related changes do not represent a generalised stimulus-evoked discharge as PrL and IL neurons in control animals (n = 4) exhibited negligible recruitment by the tone-houselight stimulus. The results support the view that, following abstinence, neural encoding in the PrL but not IL may play a key role in enhanced cocaine-seeking, particularly following re-exposure to cocaine-associated cues.

Differential roles of ventral pallidum subregions during cocaine self-administration behaviors

The ventral pallidum (VP) is necessary for drug-seeking behavior. VP contains ventromedial (VPvm) and dorsolateral (VPdl) subregions, which receive projections from the nucleus accumbens shell and core, respectively. To date no study has investigated the behavioral functions of the VPdl and VPvm subregions. To address this issue, we investigated whether changes in firing rate (FR) differed between VP subregions during four events: approaching toward, responding on, or retreating away from a cocaine-reinforced operandum and a cocaine-associated cue. Baseline FR and waveform characteristics did not differ between subregions. VPdl neurons exhibited a greater change in FR compared with VPvm neurons during approaches toward, as well as responses on, the cocaine-reinforced operandum. VPdl neurons were more likely to exhibit a similar change in FR (direction and magnitude) during approach and response than VPvm neurons. In contrast, VPvm firing patterns were heterogeneous, changing FRs during approach or response alone, or both. VP neurons did not discriminate cued behaviors from uncued behaviors. No differences were found between subregions during the retreat, and no VP neurons exhibited patterned changes in FR in response to the cocaine-associated cue. The stronger, sustained FR changes of VPdl neurons during approach and response may implicate VPdl in the processing of drug-seeking and drug-taking behavior via projections to subthalamic nucleus and substantia nigra pars reticulata. In contrast, the heterogeneous firing patterns of VPvm neurons may implicate VPvm in facilitating mesocortical structures with information related to the sequence of behaviors predicting cocaine self-infusions via projections to mediodorsal thalamus and ventral tegmental area.

Ensemble neural activity of the frontal cortical basal ganglia system predicts reaction time task performance in rats

The question pursued in this study was when neural activity appears in the cortico-basal ganglia system that could predict alternate behavioral responses in a reaction time (RT) task. In this protocol, rats first performed a nose poke to initiate a trial, depressed a lever when presented, and then released the lever after a tone cue. Multiple-channel, single-unit recordings (up to 62 units) were obtained simultaneously from the prefrontal cortex, the dorsal medial striatum, the globus pallidus, and the substantia nigra pars reticulata in a single rat during a session. Results indicated that (1) global alterations of neural activity appeared in clusters, which was associated with different behavioral components and observed in each of the targeted areas; (2) small independent subsets of neurons responded differently between error (lever was released before tone presentation) and correct trials (lever was released within 0.5s after tone onset) during these behavioral episodes; (3) significant correlations between RTs and single units activities were found in the early preparation phases of the task. The results reveal that complex early preparatory activity exists several seconds before the final movements in a RT task, which may determine executive functions leading to rapid decoding of alternate behavioral performances.

Electrophysiological evidence of mediolateral functional dichotomy in the rat accumbens during cocaine self-administration: tonic firing patterns

Given the increasing research emphasis on putative accumbal functional compartmentation, we sought to determine whether neurons that demonstrate changes in tonic firing rate during cocaine self-administration are differentially distributed across subregions of the NAcc. Rats were implanted with jugular catheters and microwire arrays targeting NAcc subregions (core, dorsal shell, ventromedial shell, ventrolateral shell and rostral pole shell). Recordings were obtained after acquisition of stable cocaine self-administration (0.77 mg/kg/0.2mL infusion; fixed-ratio 1 schedule of reinforcement; 6-h daily sessions). During the self-administration phase of the experiment, neurons demonstrated either: (i) tonic suppression (or decrease); (ii) tonic activation (or increase); or (iii) no tonic change in firing rate with respect to rates of firing during pre- and post-drug phases. Consistent with earlier observations, tonic decrease was the predominant firing pattern observed. Differences in the prevalence of tonic increase firing were observed between the core and the dorsal shell and dorsal shell-core border regions, with the latter two areas exhibiting a virtual absence of tonic increases. Tonic suppression was exhibited to a greater extent by the dorsal shell-core border region relative to the core. These differences could reflect distinct subregional afferent processing and/or differential sensitivity of subpopulations of NAcc neurons to cocaine. Ventrolateral shell firing topographies resembled those of core neurons. Taken together, these observations are consistent with an emerging body of literature that differentiates the accumbens mediolaterally and further advances the likelihood that distinct functions are subserved by NAcc subregions in appetitive processing.

The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward

The basal ganglia are often conceptualised as three parallel domains that include all the constituent nuclei. The 'ventral domain' appears to be critical for learning flexible behaviours for exploration and foraging, as it is the recipient of converging inputs from amygdala, hippocampal formation and prefrontal cortex, putatively centres for stimulus evaluation, spatial navigation, and planning/contingency, respectively. However, compared to work on the dorsal domains, the rich potential for quantitative theories and models of the ventral domain remains largely untapped, and the purpose of this review is to provide the stimulus for this work. We systematically review the ventral domain's structures and internal organisation, and propose a functional architecture as the basis for computational models. Using a full schematic of the structure of inputs to the ventral striatum (nucleus accumbens core and shell), we argue for the existence of many identifiable processing channels on the basis of unique combinations of afferent inputs. We then identify the potential information represented in these channels by reconciling a broad range of studies from the hippocampal, amygdala and prefrontal cortex literatures with known properties of the ventral striatum from lesion, pharmacological, and electrophysiological studies. Dopamine's key role in learning is reviewed within the three current major computational frameworks; we also show that the shell-based basal ganglia sub-circuits are well placed to generate the phasic burst and dip responses of dopaminergic neurons. We detail dopamine's modulation of ventral basal ganglia's inputs by its actions on pre-synaptic terminals and post-synaptic membranes in the striatum, arguing that the complexity of these effects hint at computational roles for dopamine beyond current ideas. The ventral basal ganglia are revealed as a constellation of multiple functional systems for the learning and selection of flexible behaviours and of behavioural strategies, sharing the common operations of selection-by-disinhibition and of dopaminergic modulation.

Orbitofrontal and anterior cingulate cortex neurons selectively process cocaine-associated environmental cues in the rhesus monkey

Encounters with stimuli associated with drug use are believed to contribute to relapse. To probe the neurobiology of environmentally triggered drug use, we have conducted single-unit recordings in rhesus monkeys during presentation of two distinct types of drug paired cues that differentially support drug-seeking. The animals were highly conditioned to these cues via exposure during self-administration procedures conducted over a 4 year period. The cues studied were a discriminative cue that signaled response-contingent availability of cocaine, and a discrete cue that was temporally paired with the cocaine infusion (0.1 or 0.5 mg/kg). Two cortical regions consistently activated by cocaine-associated cues in human imaging studies are the orbitofrontal (OFC) and anterior cingulate cortex (ACC), though little is known about cortical neuronal activity responses to drug cues. We simultaneously recorded single-unit activity in OFC and ACC as well as in dorsal striatum in rhesus monkeys during cocaine self-administration. Dorsal striatal neurons were less engaged by drug cues than cortical regions. Between OFC and ACC, distinct functionality was apparent in neuronal responses. OFC neurons preferentially responded to the discriminative cue, consistent with a role in cue-induced drug-seeking. In contrast, the ACC did not respond more to the discriminative cue than to the discrete cue. Also distinct from the OFC, ACC showed sustained firing throughout the 18 s duration of the discrete cue. This pattern of sustained activation in ACC is consistent with a role in reward expectation and/or in mediating behavioral effects of discrete cues paired with drug infusions.

Environmental enrichment alters neuronal processing in the nucleus accumbens core during appetitive conditioning

Although the core region of the nucleus accumbens (NAcc) has been implicated in motor control and the acquisition of appetitive learning, these processes are altered by environmental experience. To assess how environment influences neuronal processing in NAcc core, we recorded single-unit activity during acquisition of an appetitive learning task in which rats reared in an environmentally enriched condition (EC) learned the operant response (nosepoke into a lit hole) for sucrose reinforcement faster than rats reared in an isolated condition (IC). In the first training session, even before the emergence of learning differences, core neurons were more likely to respond (increase or decrease activity) during the operant and consummatory responses in EC than IC rats. By the third training session, when learning differences emerged, EC neurons continued to be more responsive than IC neurons, but in very different ways: the response shifted to the cues that signaled trial onset (1900 Hz tone and green LED) and reward availability (4500 Hz tone and yellow LED). Cue-related responding, moreover, was dominated by neuronal excitations. In contrast, post-acquisition recordings revealed no EC-IC differences. Collectively, these results suggest that core neurons are initially more responsive to discrete, goal-directed movements in EC rats, but as learning materializes, the neuronal response shifts to the cues that predict these movements. Thus, environmental experience alters core neuronal processing of both motor- and sensory-related events but at different stages over the course of learning.

Endocannabinoid signaling mediates cocaine-induced inhibitory synaptic plasticity in midbrain dopamine neurons

Drugs that increase GABA levels in the brain reduce cocaine seeking in rodents and humans, suggesting that GABAergic inhibition regulates cocaine-seeking behavior. We previously reported that repeated cocaine exposure in vivo facilitates long-term potentiation by reducing the strength of GABAergic inhibition in dopamine neurons of the ventral tegmental area (VTA). Selective blockade of cocaine-induced reduction of GABAergic inhibition in the VTA might diminish cocaine-induced aberrant synaptic plasticity and addictive behavior. Here, we investigated the mechanism for cocaine-induced reduction of GABAergic inhibition. We show that a pathophysiologically relevant concentration of cocaine enables a normally ineffective stimulus to induce long-term depression (LTD) of IPSCs (I-LTD) in VTA dopamine neurons of midbrain slices. Activation of D2 dopamine receptors and group I metabotropic glutamate receptors and subsequent recruitment of endocannabinoid signaling are required for I-LTD induction. We further demonstrate that in vivo pretreatment with antagonists to these receptors blocks cocaine-induced reduction of GABAergic inhibition and that repeated cocaine exposure in vivo occludes the subsequent induction of I-LTD ex vivo. Together, these results suggest that repeated cocaine exposure reduces the strength of GABAergic inhibition in dopamine neurons by inducing I-LTD-like modification in vivo.

Dynamics of action potential backpropagation in basal dendrites of prefrontal cortical pyramidal neurons

Basal dendrites of neocortical pyramidal neurons are relatively short and directly attached to the cell body. This allows electrical signals arising in basal dendrites to strongly influence the neuronal output. Likewise, somatic action potentials (APs) should readily propagate back into the basilar dendritic tree to influence synaptic plasticity. Two recent studies, however, determined that sodium APs are severely attenuated in basal dendrites of cortical pyramidal cells, so that they completely fail in distal dendritic segments. Here we used the latest improvements in the voltage-sensitive dye imaging technique (Zhou et al., 2007) to study AP backpropagation in basal dendrites of layer 5 pyramidal neurons of the rat prefrontal cortex. With a signal-to-noise ratio of > 15 and minimal temporal averaging (only four sweeps) we were able to sample AP waveforms from the very last segments of individual dendritic branches (dendritic tips). We found that in short- (< 150 microm) and medium (150-200 microm in length)-range basal dendrites APs backpropagated with modest changes in AP half-width or AP rise-time. The lack of substantial changes in AP shape and dynamics of rise is inconsistent with the AP-failure model. The lack of substantial amplitude boosting of the third AP in the high-frequency burst also suggests that in short- and medium-range basal dendrites backpropagating APs were not severely attenuated. Our results show that the AP-failure concept does not apply in all basal dendrites of the rat prefrontal cortex. The majority of synaptic contacts in the basilar dendritic tree actually received significant AP-associated electrical and calcium transients.

The nucleus accumbens and reward: neurophysiological investigations in behaving animals

The nucleus accumbens (Acb) is a crucial component of the brain reward system. This report reviews electrophysiological studies that examined Acb cell firing during goal-directed behaviors for natural reinforcers (food, water, sucrose) and drugs of abuse (cocaine, heroin, ethanol). Studies that examined the role of environmental stimuli and operant contingencies on Acb activity during behavior are also explored. Given the extensive literature that links dopamine in the Acb with drug reinforcement, experiments are considered that examined the influence of dopamine in modulating Acb cell firing during drug-seeking behaviors. Finally, because the Acb is one neural substrate of a larger brain reward circuit, the influence of afferent input (hippocampus and prefrontal cortex) on Acb cell firing during behavior is also discussed. These findings provide a unique insight into the cellular mechanisms underlying reward-related processing and goal-directed behaviors and reveal a level of functional organization in the Acb not identified by other experimental approaches.

Molecular components and functions of the endocannabinoid system in mouse prefrontal cortex

Background

Cannabinoids have deleterious effects on prefrontal cortex (PFC)-mediated functions and multiple evidences link the endogenous cannabinoid (endocannabinoid) system, cannabis use and schizophrenia, a disease in which PFC functions are altered. Nonetheless, the molecular composition and the physiological functions of the endocannabinoid system in the PFC are unknown.

Methodology/Principal Findings

Here, using electron microscopy we found that key proteins involved in endocannabinoid signaling are expressed in layers V/VI of the mouse prelimbic area of the PFC: presynaptic cannabinoid CB1 receptors (CB1R) faced postsynaptic mGluR5 while diacylglycerol lipase α (DGL-α), the enzyme generating the endocannabinoid 2-arachidonoyl-glycerol (2-AG) was expressed in the same dendritic processes as mGluR5. Activation of presynaptic CB1R strongly inhibited evoked excitatory post-synaptic currents. Prolonged synaptic stimulation at 10Hz induced a profound long-term depression (LTD) of layers V/VI excitatory inputs. The endocannabinoid -LTD was presynaptically expressed and depended on the activation of postsynaptic mGluR5, phospholipase C and a rise in postsynaptic Ca²⁺ as predicted from the localization of the different components of the endocannabinoid system. Blocking the degradation of 2-AG (with URB 602) but not of anandamide (with URB 597) converted subthreshold tetanus to LTD-inducing ones. Moreover, inhibiting the synthesis of 2-AG with Tetrahydrolipstatin, blocked endocannabinoid-mediated LTD. All together, our data show that 2-AG mediates LTD at these synapses.

Conclusions/Significance

Our data show that the endocannabinoid -retrograde signaling plays a prominent role in long-term synaptic plasticity at the excitatory synapses of the PFC. Alterations of endocannabinoid -mediated synaptic plasticity may participate to the etiology of PFC-related pathologies.

Selective delay activity in the medial prefrontal cortex of the rat: contribution of sensorimotor information and contingency

The medial prefrontal cortex (mPFC) plays a critical role in the organization of goal-directed behaviors and in the learning of reinforcement contingencies. Given these observations, it was hypothesized that mPFC neurons may store associations between sequentially paired stimuli when both stimuli contribute to the prediction of reward. To test this hypothesis, neural-ensemble spiking activity was recorded as rats performed a paired-associate discrimination task. Rats were trained to associate sequentially presented stimuli with probabilistic reward. In one condition, both elements of the stimulus sequence provided information about reward delivery. In another condition, only the first stimulus contributed to the prediction. As hypothesized, stimulus-selective, prospective delay activity was observed during sequences in which both elements contributed to the prediction of reward. Unexpectedly, selective delay responses were associated with slight variations in head position and thus not necessarily generated by intrinsic mnemonic processes. Interestingly, the sensitivity of neurons to head position was greatest during intervals when reward delivery was certain. These results suggest that a significant portion of delay activity in the rat mPFC reflects task-relevant sensorimotor activity, possibly related to enhancing stimulus detection, rather than stimulus-stimulus associations. These observations agree with recent evidence that suggests that prefrontal neurons are particularly responsive during the performance of action sequences related to the acquisition of reward. These results also indicate that considerable attention must be given to the monitoring and analysis of sensorimotor variables during delay tasks because slight changes in position can produce activity in the mPFC that erroneously appears to be driven by intrinsic mechanisms.

Temporal sequence of ictal discharges propagation in the corticolimbic basal ganglia system during amygdala kindled seizures in freely moving rats

We used a multiple channel, single unit recording technique to investigate the neural activity in different corticolimbic and basal ganglia regions in freely moving rats before and during generalized amygdala kindled seizures. Neural activity was recorded simultaneously in the sensorimotor cortex (Ctx), hippocampus, amygdala, substantia nigra pars reticulata (SNr) and the subthalamic nucleus (STN). We observed massive synchronized activity among neurons of different brain regions during seizure episodes. Neurons in the kindled amygdala led other regions in synchronized firing, revealed by time lags of neurons in other regions in crosscorrelogram analysis. While there was no obvious time lag between Ctx and SNr, the STN and hippocampus did lag behind the Ctx and SNr in correlated firing. Activity in the amygdala and SNr contralateral to the kindling stimulation site lagged behind their ipsilateral counterparts. However, no time lag was found between the kindling and contralateral sides of Ctx, hippocampus and STN. Our data confirm that the amygdala is an epileptic focus that emits ictal discharges to other brain regions. The observed temporal pattern indicates that ictal discharges from the amygdala arrive first at Ctx and SNr, and then spread to the hippocampus and STN. The simultaneous activation of both sides of the Ctx suggests that the neocortex participates in kindled seizures as a unisonant entity to provoke the clonic motor seizures. Early activation of the SNr (before the STN and hippocampus) points to an important role of the SNr in amygdala kindled seizures and supports the view that different SNr manipulations may be effective ways to control seizures.

Neuronal substrates of relapse to cocaine-seeking behavior: role of prefrontal cortex

The return to drug seeking, even after prolonged periods of abstinence, is a defining feature of cocaine addiction. The neural circuitry underlying relapse has been identified in neuropharmacological studies of experimental animals, typically rats, and supported in brain imaging studies of human addicts. Although the nucleus accumbens (NAcc), which has long been implicated in goal-directed behavior, plays a critical role in this circuit, the prefrontal cortex (PFC) appears to process the events that directly trigger relapse: exposure to acute stress, cues previously associated with the drug, and the drug itself. In this paper, we review animal models of relapse and what they have revealed about the mechanisms underlying the involvement of the NAcc and PFC in cocaine-seeking behavior. We also present electrophysiological data from PFC illustrating how the hedonic, motor, motivational, and reinforcing effects of cocaine can be analyzed at the neuronal level. Our preliminary findings suggest a role for PFC in processing information related to cocaine seeking but not the hedonic effects of the drug. Further use of this recording technology can help dissect the functions of PFC and other components of the neural circuitry underlying relapse.

Exciting inhibition in psychostimulant addiction

Neuroplasticity induced in the nucleus accumbens by repeated psychostimulant administration is thought to underlie the vulnerability to relapse in addicts. Electrophysiological research presents a contradictory portrait of psychostimulant-induced neuroplasticity, reflecting both increases and decreases in excitatory transmission. Drug-induced adaptations of ionic conductances decrease the intrinsic excitability of individual nucleus accumbens spiny neurons but, in the context of the circuitry in which these neurons are embedded, such reduced intrinsic excitability increases the salience of excitatory drive that is elicited by drug-associated stimuli. Thus, we propose that reduced basal excitability, combined with enhanced excitatory drive by drug-associated stimuli, contributes to the two cardinal features of addiction: reduced responding to natural reward and enduring vulnerability to relapse.

Short-term regulation of information processing at the corticoaccumbens synapse

In relation to expectation and delivery of reward, pyramidal neurons of the prefrontal cortex either switch from a single spiking mode to transient phasic bursting, or gradually increase their sustained tonic activity. Here, we examined how switching between firing modes affects information processing at the corticoaccumbens synapse. We report that increasing presynaptic firing frequency in a tonic manner either depresses or facilitates synaptic transmission, depending on initial probability of release. In contrast, repeated bursts of stimulation of cortical afferents trigger a new form of short-term potentiation of synaptic transmission (RB-STP) in the nucleus accumbens (NAc). RB-STP involves the regulation of axonal excitability mediated by 4-AP-sensitive potassium channels in afferent cortical neurons. Thus, in a tonic mode, information flow is tightly controlled by regulatory mechanisms at the level of presynaptic terminals, whereas switching to a bursting mode reliably enhances efficacy of information processing for all cortical afferents to NAc neurons.

Prefrontal cortical cell firing during maintenance, extinction, and reinstatement of goal-directed behavior for natural reward

The prefrontal cortex (PFC) is important for higher cognitive functioning and the processing of reward-related information. Here, electrophysiological recording procedures were used to examine cell firing in the PFC in rats (n = 12) during water reinforcement sessions consisting of three phases. In phase one (maintenance), animals pressed a lever (fixed ratio 1) for water reinforcement (0.05 ml/press) paired with an auditory stimulus. Of 62 neurons recorded during maintenance, 39 (63%) exhibited one of three types of patterned discharges relative to the reinforced response for water. Specifically, PFC neurons exhibited increases in firing rate within seconds preceding the response (type PR; n = 9 cells) or increases (type RFe; n = 16 cells) or decreases (type RFi; n = 14 cells) in firing rate immediately following response completion. The remaining neurons did not alter their firing profiles relative to the reinforced response (type nonphasic cells; n = 23 cells). In phase two (extinction), lever press responses had no programmed consequences (i.e., water reinforcement and the auditory stimulus were not presented). After 30 min of no responding, phase three (reinstatement) began, during which each lever press response was again associated with water reinforcement paired with the stimulus. Results indicate differential effects of extinction/reinstatement on cell firing rates and patterns dependent on cell type. These findings are discussed with respect to the adaptive nature of PFC activity during goal-directed behaviors for "natural" rewards, and are considered relative to prior studies that examined nucleus accumbens cell firing during a similar behavioral task.

Wireless transmission of fast-scan cyclic voltammetry at a carbon-fiber microelectrode: proof of principle

Fast-scan cyclic voltammetry (FSCV) at a carbon-fiber microelectrode (CFM) provides exquisite temporal and spatial resolution for monitoring brain chemistry. The utility of this approach has recently been demonstrated by measuring sub-second dopamine changes associated with behavior. However, one drawback is the cable link between animal and recording equipment that restricts behavior and precludes monitoring in complex environments. As a first step towards developing new instrumentation to overcome this technical limitation, the goal of the present study was to establish proof of principle for the wireless transmission of FSCV at a CFM. Proof of principle was evaluated in terms of measurement stability, fidelity, and susceptibility to ambient electrical noise. Bluetooth digital telemetry provided bi-directional communication between remote and home-base units and stable, high-fidelity data transfer comparable to conventional, wired systems when tested using a dummy cell (i.e., a resistor and capacitor in series simulating electrical properties of a CFM), and dopamine measurements with flow injection analysis and in the anesthetized rat with electrical stimulation. The wireless system was also less susceptible to interference from ambient electrical noise. Taken together, the present findings establish proof of principle for the wireless transmission of FSCV at a CFM.

Cue reactivity in nicotine and tobacco dependence: a “multiple-action” model of nicotine as a primary reinforcement and as an enhancer of the effects of smoking-associated stimuli

The present paper proposes a model for the identification and the validation of brain processes and mechanisms underlying smokers' cue reactivity. Smoking behaviour is maintained by the reinforcing properties of nicotine, but it was also proposed that nicotine enhances the conditioned value of smoking and nicotine-associated stimuli. In fact, it is widely reported that the exposure of smokers to smoking/nicotine-associated stimuli induces cue reactivity, which is a vast array of physiological, psychological and behavioural responses. Imaging studies are revealing neuroanatomical correlates of cue reactivity in brain areas involved in motivational, emotional, cognitive processes and in their integration. Behavioural studies in laboratory animal models have shown analogies between the effects of nicotine-associated stimuli and cue reactivity effects in smokers. Lesion and mapping studies with nicotine reported brain activation patterns in cortico-limbic areas similarly to those obtained with imaging studies in humans. Although only limited studies have been done with nicotine-associated stimuli in animals, the identification of molecular mechanisms underlying other drugs of abuse-associated cue effect may help to propose potential common molecular mechanisms for nicotine cues. These findings suggest that smoking/nicotine-associated stimuli are processed at two levels: (i), bottom-up, automatic processing in a parallel fashion through ascendant pathways, to activate attentional functions; (ii), top-down, in a serial fashion from cortical areas, to modulate sensory inputs and motor control. It appears that nicotine increase information processing at both levels so as to establish and to amplify the conditioned value of smoking cues.

Nucleus accumbens cell firing and rapid dopamine signaling during goal-directed behaviors in rats

The nucleus accumbens (Acb) is a key neural substrate underlying goal-directed behaviors for both drugs of abuse as well as 'natural' rewards. Here, I review electrophysiological and electrochemical studies completed in our laboratory that examined Acb cell firing and rapid dopamine signaling during behaviors directed toward reward procurement. Electrophysiological studies are reviewed showing that Acb neurons exhibit patterned discharges relative to operant responding for intravenous self-administration of cocaine versus 'natural' reinforcement in rodents. Importantly, subsequent studies showed that discrete subsets of Acb neurons are selectively activated during multiple schedules for a natural reward (water or food) versus cocaine self-administration. These later findings indicate that separate neural circuits selectively process information about goal-directed behaviors for cocaine versus natural reward. In addition, recent findings are reviewed showing that reinforcer selective firing of Acb neurons is not a direct consequence of chronic drug exposure. Next, electrochemical studies are summarized that used fast scan cyclic voltammetry to measure rapid (subsecond) changes in dopamine in the Acb during cocaine self-administration as well as 'natural' reinforcement in rodents. These findings are considered with respect to the role of dopamine in modulating the activity of Acb neurons that encode goal-directed behaviors, the functional organization of the Acb on a microcircuit level, and proposed directions for future studies.

Contrast enhancement: a physiological effect of striatal dopamine?

Dopamine functions as an important neuromodulator in the dorsal striatum and ventral striatum/nucleus accumbens. Evidence is accumulating for the idea that striatal neurons compete with each other for control over the animal's motor resources, and that dopamine plays an important modulatory role that allows a particular subset of neurons, encoding a specific behavior, to predominate in this competition. One means by which dopamine could facilitate selection among competing neurons is to enhance the contrast between stronger and weaker excitations (or to increase the "signal to noise ratio" among neurons, where the firing of the most excited neurons is assumed to transmit signal and the firing of the least excited to transmit noise). Here, we review the electrophysiological evidence for this hypothesis and discuss potential cellular mechanisms by which dopamine-mediated contrast enhancement could occur.

Limbic and motor circuitry underlying footshock-induced reinstatement of cocaine-seeking behavior

The role of limbic, cortical, and striatal circuitry in a footshock reinstatement model of relapse to cocaine seeking was evaluated. Transient inhibition of the central extended amygdala [CEA; including the central nucleus of the amygdala (CN), ventral bed nucleus of the stria terminalis (BNSTv), and nucleus accumbens shell (NAshell)], ventral tegmental area (VTA), and motor circuitry [including the dorsal prefrontal cortex (PFCd), nucleus accumbens core (NAcore), and ventral pallidum (VP)] blocked the ability of footshock stress to reinstate lever pressing previously associated with cocaine delivery. However, inhibition of the basolateral amygdala, mediodorsal nucleus of the thalamus, or the ventral prefrontal cortex had no effect on drug-seeking behavior. These data suggest that footshock stress activates limbic circuitry of the CEA that, via the VTA, activates motor output circuitry responsible for producing lever press responding. Consistent with this notion, the D1/D2 dopamine receptor antagonist fluphenazine blocked footshock-induced reinstatement when infused into the PFCd. Further, inhibition of the NAshell blocked a footshock-induced increase in dopamine within the PFC and concomitantly blocked reinstatement responding. Also supporting the idea of a CEA-VTA-motor circuit in stress-induced reinstatement of cocaine seeking, inactivation of the PFCd was shown to block stress-induced glutamate release within the NAcore while concurrently inhibiting reinstatement responding. Taken together, these data suggest that footshock activates limbic circuitry in the CEA, which in turn activates a VTA dopamine projection to the PFCd. The rise in dopamine within the PFCd initiates reinstatement via a glutamatergic projection to the NAcore.

Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task

The nucleus accumbens (NAc) has long been thought of as a limbic-motor interface. Despite behavioral and anatomical evidence in favor of this idea, little is known about how NAc neurons encode information about motivationally relevant environmental cues and use this information to affect motor action. We therefore investigated the firing of these neurons during the performance of a discriminative stimulus (DS) task using simultaneous multiple single-unit recordings in rats. In this task, two stimuli are randomly presented to the animal: a DS, which signals the availability of a sucrose reward contingent on an operant response, and a similar but nonrewarded stimulus (NS). Subpopulations of NAc neurons increased or decreased their firing in association with several distinct components of the task. In this paper, we investigate cue- and operant-responsive neurons. Neurons excited and inhibited by cues showed larger firing changes in response to the DS than the NS and larger changes when the animal made an operant response to the cue than when the animal failed to respond. Excitations during operant responding were not modulated by the information contained by the cue, whereas inhibitions during operant responding were somewhat larger if the operant response occurred during the DS and somewhat smaller if they occurred in the absence of a cue. These results are consistent with the hypothesis that the firing of subpopulations of NAc neurons encode both the predictive value of environmental stimuli and the specific motor behaviors required to respond to them.

Reward, memory and substance abuse: functional neuronal circuits in the nucleus accumbens

The firing patterns of neurons in the nucleus accumbens (NA) are examined and discussed with respect to different types of rewards and reward conditions. Comparisons and contrasts between individually identified NA neuron responses to cocaine self-administration and water reinforcement are presented with an emphasis on the fact that the same neurons do not respond in a phasic manner to both types of rewards. However, the phasic firing patterns, even though segregated for each reinforcer, are quite similar, suggesting that the method of differentiation between rewarding stimuli in the NA is by sorting cell populations into distinct ensembles or networks for each type of reinforcer. These neural networks appear to be 'tuned' to respond to particular associative behavioral contexts that couple response execution to reward delivery, and in the process acquire a reciprocity to firing within reward contexts. This maintains the specificity of each reinforcer for the response and associated stimuli that produce it and, makes it possible to attach different NA networks to different reinforcing circumstances. Comparisons of cocaine and water reinforced NA cell firing patterns during rapid switching between these two reinforcers suggests that the networks are negatively coupled and mutually inhibit each other to maintain accurate encoding of immediately experienced, as well as expected (i.e. future) reward contingencies.

Dynamics of population code for working memory in the prefrontal cortex

Some neurons (delay cells) in the prefrontal cortex elevate their activities throughout the time period during which the animal is required to remember past events and prepare future behavior, suggesting that working memory is mediated by continuous neural activity. It is unknown, however, how working memory is represented within a population of prefrontal cortical neurons. We recorded from neuronal ensembles in the prefrontal cortex as rats learned a new delayed alternation task. Ensemble activities changed in parallel with behavioral learning so that they increasingly allowed correct decoding of previous and future goal choices. In well-trained rats, considerable decoding was possible based on only a few neurons and after removing continuously active delay cells. These results show that neural activity in the prefrontal cortex changes dynamically during new task learning so that working memory is robustly represented and that working memory can be mediated by sequential activation of different neural populations.

Basolateral amygdala neurons encode cocaine self-administration and cocaine-associated cues

Electrophysiological recording procedures were used to examine basolateral amygdala (BLA) cell firing during cocaine self-administration and relative to response-independent presentations of cocaine-associated stimuli. Of 72 neurons (n = 10 rats), 31 cells (43%) were classified as phasically active, exhibiting one of three types of patterned discharges relative to the drug-reinforced response, similar to that previously described for nucleus accumbens (Acb) neurons (Carelli, 2002). Briefly, neurons exhibited increased firing rates within seconds preceding the response [termed preresponse (PR)], increased activity within seconds after the response [termed reinforcement excitation (RFe)] or an inhibition in cell firing before and/or after the response for intravenous cocaine [termed reinforcement inhibition (RFi)]. To examine the responsiveness of these same neurons to cocaine-associated stimuli, the stimulus "probe" procedure was used. Specifically, probe trials (18-20) were presented in which the audiovisual (tone-house light) stimulus associated with intravenous cocaine delivery during self-administration was randomly presented by the computer, interspersed between reinforced lever press responses. Neurons classified as type PR or type RFi were not activated by the stimulus. In contrast, neurons that exhibited increased firing immediately after the response (type RFe neurons) were significantly activated by the audiovisual cue. These findings are discussed with respect to the role of the BLA in cocaine addiction as well as previous studies characterizing Acb cell firing during cocaine self-administration.

Brain circuitry and the reinstatement of cocaine-seeking behavior

RATIONALE

Recent studies have attempted to identify the neuroanatomical substrates underlying primed reinstatement of drug-seeking behavior. Identification of neuronal substrates will provide a logical rationale for designing pharmacological interventions in treating drug relapse.

OBJECTIVE

The objective was to identify brain circuitry that is shared between cue-, drug- and stress-primed reinstatement, as well as identifying aspects of brain circuitry that are distinct for each stimulus modality. The resulting circuit offers theoretical interpretations for consideration in future studies.

RESULTS

Aspects of the circuitry mediating reinstatement can be identified with reasonable confidence. The role of the basolateral amygdala in cue-primed reinstatement, the role of the ventral tegmental area in drug-primed reinstatement and the role of adrenergic innervation of the extended amygdala in stress-primed reinstatement are well characterized. Also, all three modes for priming reinstatement may converge on the anterior cingulate cortex and have a final common output through the core of the nucleus accumbens. Lacunae in our understanding of the circuit were identified, especially with regard to how stress priming is conveyed from the extended amygdala to the shared anterior cingulate accumbens core circuit.

CONCLUSIONS

The proposed convergence of priming stimuli into the glutamatergic projection from anterior cingulate to the accumbens core combined with the changes in glutamate transmission and signaling that accompany repeated psychostimulant administration points to the potential value of pharmacological agents that manipulate glutamate release or postsynaptic glutamate receptor signaling and trafficking in treating primed relapse in addicts.

Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability

OBJECTIVE

Epidemiological studies indicate that experimentation with addictive drugs and onset of addictive disorders is primarily concentrated in adolescence and young adulthood. The authors describe basic and clinical data supporting adolescent neurodevelopment as a biologically critical period of greater vulnerability for experimentation with substances and acquisition of substance use disorders.

METHOD

The authors reviewed recent literature regarding neurocircuitry underlying motivation, impulsivity, and addiction, with a focus on studies investigating adolescent neurodevelopment.

RESULTS

Adolescent neurodevelopment occurs in brain regions associated with motivation, impulsivity, and addiction. Adolescent impulsivity and/or novelty seeking as a transitional trait behavior can be explained in part by maturational changes in frontal cortical and subcortical monoaminergic systems. These developmental processes may advantageously promote learning drives for adaptation to adult roles but may also confer greater vulnerability to the addictive actions of drugs.

CONCLUSIONS

An exploration of developmental changes in neurocircuitry involved in impulse control has significant implications for understanding adolescent behavior, addiction vulnerability, and the prevention of addiction in adolescence and adulthood.

Effects of expectations for different reward magnitudes on neuronal activity in primate striatum

In behavioral science, it is well known that humans and nonhuman animals are highly sensitive to differences in reward magnitude when choosing an outcome from a set of alternatives. We know that a realm of behavioral reactions is altered when animals begin to expect different levels of reward outcome. Our present aim was to investigate how the expectation for different magnitudes of reward influences behavior-related neurophysiology in the anterior striatum. In a spatial delayed response task, different instruction pictures are presented to the monkey. Each image represents a different magnitude of juice. By reaching to the spatial location where an instruction picture was presented, animals could receive the particular liquid amount designated by the stimulus. Reliable preferences in reward choice trials and differences in anticipatory licks, performance errors, and reaction times indicated that animals differentially expected the various reward amounts predicted by the instruction cues. A total of 374 of 2,000 neurons in the anterior parts of the caudate nucleus, putamen, and ventral striatum showed five forms of task-related activation during the preparation or execution of movement and activations preceding or following the liquid drop delivery. Approximately one-half of these striatal neurons showed differing response levels dependent on the magnitude of liquid to be received. Results of a linear regression analysis showed that reward magnitude and single cell discharge rate were related in a subset of neurons by a monotonic positive or negative relationship. Overall, these data support the idea that the striatum utilizes expectancies that contain precise information concerning the predicted, forthcoming level of reward in directing general behavioral reactions.

Induction of the learning and plasticity-associated gene Zif268 following exposure to a discrete cocaine-associated stimulus

We investigated whether the expression of the plasticity-associated gene, zif268, was associated with memories retrieved by exposure to a discrete stimulus that had been associated with cocaine, either self-administered or administered noncontingently. In the absence of drug, passive presentation of a cocaine-associated light stimulus induced changes in the expression of zif268 measured by in situ hybridization within a limbic cortical-ventral striatal circuit that was not only regionally selective but related to whether the rats had originally received response-contingent or noncontingent stimulus-drug pairings. In rats that had self-administered drug, the cocaine-conditioned stimulus (CS) increased zif268 expression in neurons of the ventral tegmental area, nucleus accumbens core and shell, and basal nucleus of the amygdala but not hippocampus, prelimbic area of the medial prefrontal cortex or amygdala central nucleus. The same CS that had been associated with cocaine administered noncontingently additionally increased zif268 mRNA levels in area Cg1 of the anterior cingulate cortex, ventral and lateral regions of the orbitofrontal cortex and lateral nucleus of the amygdala. Zif268 induction was related to the predictive relationship between the stimulus and cocaine as no changes were seen in cocaine-experienced rats that had received unpaired light and drug presentations during training. Thus, zif268 expression is increased by appetitively (drug) conditioned stimuli after Pavlovian learning. Zif268 may participate in the molecular mechanisms underlying the reconsolidation or re-encoding of Pavlovian stimulus-drug associations across a distributed limbic cortical-ventral striatal neural network and that may contribute to the basis of the enduring drug-seeking behaviour produced by environmental cues.

Effects of cue exposure on brain glucose utilization 8 days after repeated cocaine administration

Relapse to cocaine use may involve exposure to cocaine-associated environmental cues. The present experiment tested the hypothesis that basal local cerebral metabolic rate for glucose (LCMR(glu)), as measured by the 2-deoxy-D-[l-(14)C]glucose (2-DG) autoradiography, would change in the presence of cocaine conditioned cues at 8 days after the last of seven daily cocaine injections (30 mg/kg). This dose regimen results in sensitization to the locomotor effects of cocaine. Cocaine was administered to two groups of rats while saline was administered to a third. In the conditioned group, the rats were placed into the 2-DG experimental chamber immediately after cocaine injection. Rats in the non-conditioned group were placed into their home cage after cocaine administration. A control group received only saline. The 2-DG experiment was conducted in non-drugged animals 8 days after treatment completion. The interaction between treatment status and brain region was significant. Mean basal LCMR(glu) was significantly lower in 12 brain regions in the conditioned group as compared to the control group, but was significantly lower in only four areas in the non-conditioned group. Regions in which there were significant changes in the conditioned group included the basolateral amygdala, subiculum, medial thalamus, lateral habenula and the substantia nigra pars compacta. LCMR(glu) was significantly reduced in the ventrolateral orbital cortex and rostral nucleus accumbens in both experimental groups. These findings indicate that repeated cocaine administration can cause protracted decreases in basal LCMR(glu), decreases that are more widespread in the brain during exposure to cocaine-associated cues.

Endogenous cannabinoids mediate long-term synaptic depression in the nucleus accumbens

Do endocannabinoids (eCBs) participate in long-term synaptic plasticity in the brain? Using pharmacological approaches and genetically altered mice, we show that stimulation of prelimbic cortex afferents at naturally occurring frequencies causes a long-term depression of nucleus accumbens glutamatergic synapses mediated by eCB release and presynaptic CB1 receptors. Translation of glutamate synaptic transmission into eCB retrograde signaling involved metabotropic glutamate receptors and postsynaptic intracellular Ca(2+) stores. These findings unveil the role of the eCB system in activity-dependent long-term synaptic plasticity and identify a mechanism by which marijuana can alter synaptic functions in the endogenous brain reward system.

Cue dependency of nicotine self-administration and smoking

A paradox exists regarding the reinforcing properties of nicotine. The abuse liability associated with smoking equals or exceeds that of other addictive drugs, yet the euphoric, reinforcing and other psychological effects of nicotine, compared to these other drugs, are more subtle, are manifest under more restricted conditions, and do not readily predict the difficulty most smokers experience in achieving abstinence. One possible resolution to this apparent inconsistency is that environmental cues associated with drug delivery become conditioned reinforcers and take on powerful incentive properties that are critically important for sustaining smoking in humans and nicotine self-administration in animals. We tested this hypothesis by using a widely employed self-administration paradigm in which rats press a lever at high rates for 1 h/day to obtain intravenous infusions of nicotine that are paired with two types of visual stimuli: a chamber light that when turned on signals drug availability and a 1-s cue light that signals drug delivery. We show that these visual cues are at least as important as nicotine in sustaining a high rate of responding once self-administration has been established, in the degree to which withdrawing nicotine extinguishes the behavior, and in the reinstatement of lever pressing after extinction. Additional studies demonstrated that the importance of these cues was manifest under both fixed ratio and progressive ratio (PR) schedules of reinforcement. The possibility that nicotine-paired cues are as important as nicotine in smoking behavior should refocus our attention on the psychology and neurobiology of conditioned reinforcers in order to stimulate the development of more effective treatment programs for smoking cessation.