Ventral medial prefrontal cortex neuronal ensembles mediate context-induced relapse to heroin

Medial prefrontal cortex inactivation attenuates the diurnal rhythm in amphetamine reward

Psychostimulant reward, as assessed via the conditioned place preference (CPP) paradigm, exhibits a daily rhythm with peaks in the late dark and early light periods, and a nadir near the light-to-dark transition. While this diurnal rhythm is correlated with neural activity in several corticolimbic structures, the brain regions mediating this behavioral rhythm remain unknown. Here, we examine the role of the ventral medial prefrontal cortex (mPFC). The effects of excitotoxic mPFC lesions on daily rhythms in amphetamine CPP were examined at previously observed peak (zeitgeber time [ZT] 23) and nadir times (ZT11). mPFC lesions encompassing the prelimbic and infralimbic subregions increased the CPP for amphetamine at the nadir time, thereby eliminating the daily rhythm in amphetamine reward. To examine the effects of transient mPFC inactivation, rats received intra-mPFC infusions of GABA receptor agonists during the acquisition or expression phases of CPP testing. Inactivation of the ventral mPFC at either of these phases also eliminated the daily rhythm in amphetamine-induced CPP via an increase in drug-paired chamber dwell time at the baseline nadir. Together, these results indicate that the ventral mPFC plays a critical role in mediating the diurnal rhythm in amphetamine CPP during both the acquisition and expression of learned reward-context associations. Moreover, as the loss of rhythmicity occurs via an increase at the nadir point, these results suggest that excitatory output from the ventral mPFC normally inhibits context-elicited reward seeking prior to the light-to-dark transition.

Reward learning requires activity of matrix metalloproteinase-9 in the central amygdala

Learning how to avoid danger and pursue reward depends on negative emotions motivating aversive learning and positive emotions motivating appetitive learning. The amygdala is a key component of the brain emotional system; however, an understanding of how various emotions are differentially processed in the amygdala has yet to be achieved. We report that matrix metalloproteinase-9 (MMP-9, extracellularly operating enzyme) in the central nucleus of the amygdala (CeA) is crucial for appetitive, but not for aversive, learning in mice. The knock-out of MMP-9 impairs appetitively motivated conditioning, but not an aversive one. MMP-9 is present at the excitatory synapses in the CeA with its activity greatly enhanced after the appetitive training. Finally, blocking extracellular MMP-9 activity with its inhibitor TIMP-1 provides evidence that local MMP-9 activity in the CeA is crucial for the appetitive, but not for aversive, learning.

Targeting cocaine versus heroin memories: divergent roles within ventromedial prefrontal cortex

In the search for novel treatments for addiction, most research has been propelled by the hope for a 'magic bullet' that would cure all forms of addiction. More recently, the field has started to appreciate the differences between psychostimulants versus opiates. Recent data suggest that the ventromedial prefrontal cortex (vmPFC) may fundamentally serve different roles in cocaine versus heroin addiction: acting as a neural OFF switch for cocaine seeking, but an ON switch for heroin seeking. We discuss the relevance of this distinction in relationship to three main functions of the vmPFC: (i) extinction memory, (ii) the suppression of impulsive behaviors, and (iii) the transition from goal-directed behaviors to habits. We highlight the importance of dopamine in modulating corticostriatal circuits for each of these functions. Finally, we conclude by discussing the implications for treatment strategies.

Corticotropin-releasing factor receptor type-2 is involved in the cocaine-primed reinstatement of cocaine conditioned place preference in rats

Here we explored the in vivo role of brain corticotropin-releasing factor receptor type-2 (CRFR2) in cocaine-primed reinstatement of drug seeking. Conditioned place preference (CPP) procedure was used to assess the acquisition, extinction and reinstatement of cocaine-seeking behavior in rats. First, expressions of CRFR2 were shown to be affected in a brain region-specific manner within cocaine-induced CPP and cocaine-extinct CPP models. Bilateral blockade of CRFR2 in the dorsal portion of the medial prefrontal cortex (mPFC), or hippocampus (HP) was partially inhibited, but in the dorsal striatum (DS) did not affect, the cocaine-primed reinstatement of cocaine CPP.

Addiction is Not a Natural Kind

I argue that addiction is not an appropriate category to support generalizations for the purposes of scientific prediction. That is, addiction is not a natural kind. I discuss the Homeostatic Property Cluster (HPC) theory of kinds, according to which members of a kind share a cluster of properties generated by a common mechanism or set of mechanisms. Leading accounts of addiction in literature fail to offer a mechanism that explains addiction across substances. I discuss popular variants of the disease conception and demonstrate that at least one class of substances that fails to confirm a major prediction of each account. When no mechanism can be found to explain the occurrence of the relevant properties in members of a category, the HPC view suggests that we revise our categories. I discuss options offered by the HPC view, including category revision and category replacement. I then conclude that talk of addiction as a prediction-supporting category should be replaced with categories such as "S-addiction" and "T-addiction," where S and T are substances or sets of substances of abuse, as these categories are genuine natural kinds.

New technologies for examining the role of neuronal ensembles in drug addiction and fear

Correlational data suggest that learned associations are encoded within neuronal ensembles. However, it has been difficult to prove that neuronal ensembles mediate learned behaviours because traditional pharmacological and lesion methods, and even newer cell type-specific methods, affect both activated and non-activated neurons. In addition, previous studies on synaptic and molecular alterations induced by learning did not distinguish between behaviourally activated and non-activated neurons. Here, we describe three new approaches--Daun02 inactivation, FACS sorting of activated neurons and Fos-GFP transgenic rats--that have been used to selectively target and study activated neuronal ensembles in models of conditioned drug effects and relapse. We also describe two new tools--Fos-tTA transgenic mice and inactivation of CREB-overexpressing neurons--that have been used to study the role of neuronal ensembles in conditioned fear.

The reinstatement model of drug relapse: recent neurobiological findings, emerging research topics, and translational research

BACKGROUND AND RATIONALE

Results from many clinical studies suggest that drug relapse and craving are often provoked by acute exposure to the self-administered drug or related drugs, drug-associated cues or contexts, or certain stressors. During the last two decades, this clinical scenario has been studied in laboratory animals by using the reinstatement model. In this model, reinstatement of drug seeking by drug priming, drug cues or contexts, or certain stressors is assessed following drug self-administration training and subsequent extinction of the drug-reinforced responding.

OBJECTIVE

In this review, we first summarize recent (2009-present) neurobiological findings from studies using the reinstatement model. We then discuss emerging research topics, including the impact of interfering with putative reconsolidation processes on cue- and context-induced reinstatement of drug seeking, and similarities and differences in mechanisms of reinstatement across drug classes. We conclude by discussing results from recent human studies that were inspired by results from rat studies using the reinstatement model.

CONCLUSIONS

Main conclusions from the studies reviewed highlight: (1) the ventral subiculum and lateral hypothalamus as emerging brain areas important for reinstatement of drug seeking, (2) the existence of differences in brain mechanisms controlling reinstatement of drug seeking across drug classes, (3) the utility of the reinstatement model for assessing the effect of reconsolidation-related manipulations on cue-induced drug seeking, and (4) the encouraging pharmacological concordance between results from rat studies using the reinstatement model and human laboratory studies on cue- and stress-induced drug craving.

Possible contributions of a novel form of synaptic plasticity in Aplysia to reward, memory, and their dysfunctions in mammalian brain

Recent studies in Aplysia have identified a new variation of synaptic plasticity in which modulatory transmitters enhance spontaneous release of glutamate, which then acts on postsynaptic receptors to recruit mechanisms of intermediate- and long-term plasticity. In this review I suggest the hypothesis that similar plasticity occurs in mammals, where it may contribute to reward, memory, and their dysfunctions in several psychiatric disorders. In Aplysia, spontaneous release is enhanced by activation of presynaptic serotonin receptors, but presynaptic D1 dopamine receptors or nicotinic acetylcholine receptors could play a similar role in mammals. Those receptors enhance spontaneous release of glutamate in hippocampus, entorhinal cortex, prefrontal cortex, ventral tegmental area, and nucleus accumbens. In all of those brain areas, glutamate can activate postsynaptic receptors to elevate Ca²⁺ and engage mechanisms of early-phase long-term potentiation (LTP), including AMPA receptor insertion, and of late-phase LTP, including protein synthesis and growth. Thus, presynaptic receptors and spontaneous release may contribute to postsynaptic mechanisms of plasticity in brain regions involved in reward and memory, and could play roles in disorders that affect plasticity in those regions, including addiction, Alzheimer’s disease, schizophrenia, and attention deficit hyperactivity disorder (ADHD).

Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning

This article reviews research on the behavioral and neural mechanisms of extinction as it is represented in both Pavlovian and instrumental learning. In Pavlovian extinction, repeated presentation of a signal without its reinforcer weakens behavior evoked by the signal; in instrumental extinction, repeated occurrence of a voluntary action without its reinforcer weakens the strength of the action. In either case, contemporary research at both the behavioral and neural levels of analysis has been guided by a set of extinction principles that were first generated by research conducted at the behavioral level. The review discusses these principles and illustrates how they have informed the study of both Pavlovian and instrumental extinction. It shows that behavioral and neurobiological research efforts have been tightly linked and that their results are readily integrated. Pavlovian and instrumental extinction are also controlled by compatible behavioral and neural processes. Since many behavioral effects observed in extinction can be multiply determined, we suggest that the current close connection between behavioral-level and neural-level analyses will need to continue.

Detection of molecular alterations in methamphetamine-activated Fos-expressing neurons from a single rat dorsal striatum using fluorescence-activated cell sorting (FACS)

Methamphetamine and other drugs activate a small proportion of all neurons in the brain. We previously developed a fluorescence-activated cell sorting (FACS)-based method to characterize molecular alterations induced selectively in activated neurons that express the neural activity marker Fos. However, this method requires pooling samples from many rats. We now describe a modified FACS-based method to characterize molecular alterations in Fos-expressing dorsal striatal neurons from a single rat using a multiplex pre-amplification strategy. Fos and NeuN (a neuronal marker) immunohistochemistry indicate that 5-6% of dorsal striatum neurons were activated 90 min after acute methamphetamine injections (5 mg/kg, i.p.) while less than 0.5% of neurons were activated by saline injections. We used FACS to separate NeuN-labeled neurons into Fos-positive and Fos-negative neurons and assessed mRNA expression using RT-qPCR from as little as five Fos-positive neurons. Methamphetamine induced 3-20-fold increases of immediate early genes arc, homer-2, c-fos, fosB, and its isoforms (ΔfosB and a novel isoform ΔfosB-2) in Fos-positive but not Fos-negative neurons. Immediate early gene mRNA induction was 10-fold lower or absent when assessed in unsorted samples from single dorsal striatum homogenates. Our modified method makes it feasible to study unique molecular alterations in neurons activated by drugs or drug-associated cues in complex addiction models. Methamphetamine and other drugs activate a small proportion of all neurons in the brain. We here report an improved method to characterize molecular alterations induced selectively in activated neurons that express the neural activity marker Fos. We used FACS along with targeted PCR pre-amplification to assess acute methamphetamine-induced gene expression from as few as 5 Fos-expressing neurons from a single rat dorsal striatum. Methamphetamine induced 3-20-fold increases of immediate early genes (IEGs) in Fos-positive but not Fos-negative neurons. Targeted PCR pre-amplification makes it feasible to study unique molecular alterations in neurons activated by drugs or drug-associated cues in complex addiction models.

Extinction of drug seeking: Neural circuits and approaches to augmentation

Extinction training can reduce drug seeking behavior. This article reviews the neural circuits that contribute to extinction and approaches to enhancing the efficacy of extinction. Extinction of drug seeking depends on cortical-striatal-hypothalamic and cortical-hypothalamic-thalamic pathways. These pathways interface, in the hypothalamus and thalamus respectively, with the neural circuits controlling reinstatement of drug seeking. The actions of these pathways at lateral hypothalamic orexin neurons, and of perifornical/dorsomedial hypothalamic derived opioid peptides at kappa opioid receptors in the paraventricular thalamus, are important for inhibiting drug seeking. Despite effectively reducing or inhibiting drug seeking in the short term, extinguished drug seeking is prone to relapse. Three different strategies to augment extinction learning or retrieval are reviewed: pharmacological augmentation, retrieval - extinction training, and provision of extinction memory retrieval cues. These strategies have been used in animal models and with human drug users to enhance extinction or cue exposure treatments. They hold promise as novel strategies to promote abstinence from drug seeking. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Using optogenetics to study habits

It is now well documented that optogenetics brings to neuroscience a long sought-after foothold to study the causal role of millisecond-scale activity of genetically or anatomically defined populations of neurons. Progress is rapid, and, as evidenced by the work collected in this Special Issue, the possibilities of what can now be done are almost dizzying. Even for those concerned with complex phenomena, such as behavioral habits and flexibility, signs are that we could be on the threshold of a leap in scientific understanding. Here. we note this special time in neuroscience by the example of our use of optogenetics to study habitual behavior. We present a basic sketch of the neural circuitry of habitual behavior built mainly on findings from experiments in which lesion and drug microinjection techniques were employed in combination with sophisticated behavioral analysis. We then outline the types of questions that now can be approached through the use of optogenetic approaches, and, as an example, we summarize the results of a recent study of ours in which we took this approach to probe the neural basis of habit formation. With optogenetic methods, we were able to demonstrate that a small site in the medial prefrontal cortex can control habits on-line during their execution, and we were able to control new habits when they competed with prior ones. The nearly immediate effect of disabling this site optogenetically suggests the existence of a mechanism for moment-to-moment monitoring of behaviors that long have been thought to be almost automatic and reflexive. This example highlights the kind of new knowledge that can be gained by the carefully timed use of optogenetic tools. This article is part of a Special Issue entitled Optogenetics (7th BRES).

Differential recruitment of distinct amygdalar nuclei across appetitive associative learning

The amygdala is important for reward-associated learning, but how distinct cell groups within this heterogeneous structure are recruited during appetitive learning is unclear. Here we used Fos induction to map the functional amygdalar circuitry recruited during early and late training sessions of Pavlovian appetitive conditioning. We found that a number of distinct amygdalar nuclei were differentially recruited by tone-food pairings during the early and late stages of training, suggesting evidence of learning-induced plasticity. Notably, these selectively activated nuclei belong to dissociable subsystems that are well placed to simultaneously inform cortical (cognitive) processing and behavioral control during tone-food learning.

Optogenetic inhibition of dorsal medial prefrontal cortex attenuates stress-induced reinstatement of palatable food seeking in female rats

Relapse to maladaptive eating habits during dieting is often provoked by stress. Recently, we identified a role of dorsal medial prefrontal cortex (mPFC) neurons in stress-induced reinstatement of palatable food seeking in male rats. It is unknown whether endogenous neural activity in dorsal mPFC drives stress-induced reinstatement in female rats. Here, we used an optogenetic approach, in which female rats received bilateral dorsal mPFC microinjections of viral constructs coding light-sensitive eNpHR3.0-eYFP or control eYFP protein and intracranial fiber optic implants. Rats were food restricted and trained to lever press for palatable food pellets. Subsequently, pellets were removed, and lever pressing was extinguished; then the effect of bilateral dorsal mPFC light delivery on reinstatement of food seeking was assessed after injections of the pharmacological stressor yohimbine (an α-2 andrenoceptor antagonist) or pellet priming, a manipulation known to provoke food seeking in hungry rats. Dorsal mPFC light delivery attenuated yohimbine-induced reinstatement of food seeking in eNpHR3.0-injected but not eYFP-injected rats. This optical manipulation had no effect on pellet-priming-induced reinstatement or ongoing food-reinforced responding. Dorsal mPFC light delivery attenuated yohimbine-induced Fos immunoreactivity and disrupted neural activity during in vivo electrophysiological recording in awake rats. Optical stimulation caused significant outward currents and blocked electrically evoked action potentials in eNpHR3.0-injected but not eYFP-injected mPFC hemispheres. Light delivery alone caused no significant inflammatory response in mPFC. These findings indicate that intracranial light delivery in eNpHR3.0 rats disrupts endogenous dorsal mPFC neural activity that plays a role in stress-induced relapse to food seeking in female rats.

A role for the prefrontal cortex in heroin-seeking after forced abstinence by adult male rats but not adolescents

Adolescent drug abuse is hypothesized to increase the risk of drug addiction. Yet male rats that self-administer heroin as adolescents show attenuated drug-seeking after abstinence, compared with adults. Here we explore a role for neural activity in the medial prefrontal cortex (mPFC) in age-dependent heroin-seeking. Adolescent (35-day-old at start; adolescent-onset) and adult (86-day-old at start) male rats acquired lever-pressing maintained by heroin using a fixed ratio one reinforcement schedule (0.05 and 0.025 mg/kg per infusion). Following 12 days of forced abstinence, rats were tested for heroin-seeking over 1 h by measuring the number of lever presses on the active lever. Unbiased stereology was then used to estimate the number of Fos-ir(+) and Fos-ir(-) neurons in prelimbic and infralimbic mPFC. As before, adolescents and adults self-administered similar amounts of heroin, but subsequent heroin-seeking was attenuated in the younger rats. Similarly, the adolescent-onset group failed to show significant neural activation in the prelimbic or infralimbic mPFC during the heroin-seeking test, whereas the adult-onset heroin self-administration group showed two to six times more Fos-ir(+) neurons than their saline counterparts in both mPFC subregions. Finally, the overall number of neurons in the infralimbic cortex was greater in rats from the adolescent-onset groups than adults. The mPFC may thus have a key role in some age-dependent effects of heroin self-administration.

Association of time-dependent changes in mu opioid receptor mRNA, but not BDNF, TrkB, or MeCP2 mRNA and protein expression in the rat nucleus accumbens with incubation of heroin craving

RATIONALE AND OBJECTIVES

Responding to heroin cues progressively increases after cessation of heroin self-administration (incubation of heroin craving). We investigated whether this incubation is associated with time-dependent changes in brain-derived neurotrophic factor (BDNF) and methyl-CpG binding protein 2 (MeCP2) signaling and mu opioid receptor (MOR) expression in nucleus accumbens (NAc), dorsal striatum (DS), and medial prefrontal cortex (mPFC). We also investigated the effect of the preferential MOR antagonist naloxone on cue-induced heroin seeking during abstinence.

METHODS

We trained rats to self-administer heroin or saline for 9-10 days and then dissected the NAc, DS, and mPFC at different abstinence days and measured mRNA and protein levels of BDNF, TrkB, and MeCP2, as well as MOR mRNA (Oprm1). In other groups, we assessed cue-induced heroin seeking in extinction tests after 1, 11, and 30 abstinence days, and naloxone's (0-1.0 mg/kg) effect on extinction responding after 1 and 15 days.

RESULTS

Cue-induced heroin seeking progressively increased or incubated during abstinence. This incubation was not associated with changes in BDNF, TrkB, or MeCP2 mRNA or protein levels in NAc, DS, or mPFC; additionally, no molecular changes were observed after extinction tests on day 11. In NAc, but not DS or mPFC, MOR mRNA decreased on abstinence day 1 and returned to basal levels over time. Naloxone significantly decreased cue-induced heroin seeking after 15 abstinence days but not 1 day.

CONCLUSIONS

Results suggest a role of MOR in incubation of heroin craving. As previous studies implicated NAc BDNF in incubation of cocaine craving, our data suggest that different mechanisms contribute to incubation of heroin versus cocaine craving.

Endogenous opiates and behavior: 2011

This paper is the thirty-fourth consecutive installment of the annual review of research concerning the endogenous opioid system. It summarizes papers published during 2011 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides, opioid receptors, opioid agonists and opioid antagonists. The particular topics that continue to be covered include the molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors related to behavior (Section 2), and the roles of these opioid peptides and receptors in pain and analgesia (Section 3); stress and social status (Section 4); tolerance and dependence (Section 5); learning and memory (Section 6); eating and drinking (Section 7); alcohol and drugs of abuse (Section 8); sexual activity and hormones, pregnancy, development and endocrinology (Section 9); mental illness and mood (Section 10); seizures and neurologic disorders (Section 11); electrical-related activity and neurophysiology (Section 12); general activity and locomotion (Section 13); gastrointestinal, renal and hepatic functions (Section 14); cardiovascular responses (Section 15); respiration (Section 16); and immunological responses (Section 17).

Unique gene alterations are induced in FACS-purified Fos-positive neurons activated during cue-induced relapse to heroin seeking

Cue-induced heroin seeking after prolonged withdrawal is associated with neuronal activation and altered gene expression in prefrontal cortex (PFC). However, these previous studies assessed gene expression in all neurons regardless of their activity state during heroin seeking. Using Fos as a marker of neural activity, we describe distinct molecular alterations induced in activated versus non-activated neurons during cue-induced heroin seeking after prolonged withdrawal. We trained rats to self-administer heroin for 10 days (6 h/day) and assessed cue-induced heroin seeking in extinction tests after 14 or 30 days. We used fluorescent-activated cell sorting (FACS) to purify Fos-positive and Fos-negative neurons from PFC 90 min after extinction testing. Flow cytometry showed that Fos-immunoreactivity was increased in less than 10% of sparsely distributed PFC neurons. mRNA levels of the immediate early genes fosB, arc, egr1, and egr2, as well as npy and map2k6, were increased in Fos-positive, but not Fos-negative, neurons. In support of these findings, double-label immunohistochemistry indicated substantial coexpression of neuropeptide Y (NPY)- and Arc-immunoreactivity in Fos-positive neurons. Our data indicate that cue-induced relapse to heroin seeking after prolonged withdrawal induces unique molecular alterations within activated PFC neurons that are distinct from those observed in the surrounding majority of non-activated neurons.

Role of orbitofrontal cortex neuronal ensembles in the expression of incubation of heroin craving

In humans, exposure to cues previously associated with heroin use often provokes relapse after prolonged withdrawal periods. In rats, cue-induced heroin seeking progressively increases after withdrawal (incubation of heroin craving). Here, we examined the role of orbitofrontal cortex (OFC) neuronal ensembles in the enhanced response to heroin cues after prolonged withdrawal or the expression of incubation of heroin craving. We trained rats to self-administer heroin (6 h/d for 10 d) and assessed cue-induced heroin seeking in extinction tests after 1 or 14 withdrawal days. Cue-induced heroin seeking increased from 1 to 14 d and was accompanied by increased Fos expression in ∼12% of OFC neurons. Nonselective inactivation of OFC neurons with the GABA agonists baclofen + muscimol decreased cue-induced heroin seeking on withdrawal day 14 but not day 1. We then used the Daun02 inactivation procedure to assess a causal role of the minority of selectively activated Fos-expressing OFC neurons (that presumably form cue-encoding neuronal ensembles) in cue-induced heroin seeking after 14 withdrawal days. We trained c-fos-lacZ transgenic rats to self-administer heroin and 11 d later reexposed them to heroin-associated cues or novel cues for 15 min (induction day), followed by OFC Daun02 or vehicle injections 90 min later; we then tested the rats in extinction tests 3 d later. Daun02 selectively decreased cue-induced heroin seeking in rats previously reexposed to the heroin-associated cues on induction day but not in rats exposed previously to novel cues. Results suggest that heroin-cue-activated OFC neuronal ensembles contribute to the expression of incubation of heroin craving.

Drug specificity in extended access cocaine and heroin self-administration

Increased drug availability can precipitate a rapid escalation of drug consumption in both vulnerable humans and laboratory animals. Drug intake escalation is observed across a broad spectrum of drugs of abuse, including stimulants, opiates, ethanol and phencyclidine. Whether and to what extent the processes underlying escalated levels of drug intake vary across different substances is poorly understood. The present study sought to address this question in rats self-administering both cocaine and heroin-two addictive drugs with both common and different neurobiological effects. In experiment 1, we determined how cocaine intake is initially related to heroin intake in non-escalated rats with a limited access to both drugs. In experiment 2, two groups of rats were initially allowed to self-administer either cocaine or heroin for 1 hour per day and then after behavioral stabilization, for 6 hours per day to precipitate drug intake escalation. In each group, dose-injection functions for cocaine and heroin self-administration were generated. In experiment 1, regardless of the dose, rats with a high intake of one drug did not necessarily have a high intake of the alternate drug. In experiment 2, escalated levels of heroin or cocaine self-administration did not generalize to the other drug. This outcome was confirmed in a third drug substitution experiment following different access lengths to cocaine self-administration (i.e. 1, 4 and 8 hours). The processes underlying spontaneous and escalated drug overconsumption appear thus to vary across different drugs of abuse. More research should be devoted in the future to these differences.

The role of medial prefrontal cortex in extinction and reinstatement of alcohol-seeking in rats

The prelimbic (PL) and infralimbic (IL) medial prefrontal cortex (mPFC) are thought to play opposing roles in drug-seeking behaviour. Specifically, the PL promotes drug-seeking whereas the IL is necessary for the inhibition of drug-seeking during extinction. We studied the roles of the PL, IL and dorsal peduncular PFC (DP) in the expression of context-induced reinstatement, reacquisition and extinction of alcoholic beer-seeking. In context-induced reinstatement (renewal), animals were trained to nosepoke for alcoholic beer (context A), extinguished (context B) and then tested in context A and B. In reacquisition, animals received the same instrumental training and extinction without any contextual manipulation. On test, alcoholic beer was again available and responding was compared with naive controls. Just prior to the test, rats received bilateral infusion of baclofen/muscimol into the PL, IL or DP. Reversible inactivation of the PL attenuated ABA renewal but augmented reacquisition. Reversible inactivation of IL had no effect on the reinstatement or reacquisition of alcoholic beer-seeking and had no effect on extinction expression (ABB and AAA). IL inactivation did, however, increase the latencies with which animals responded on test but only when animals were tested in the extinction context. DP inactivation had no effect on reinstatement or reacquisition. These studies are inconsistent with the view that PL and IL exert opposing effects on drug-seeking. Rather, they support the view that PL is important for retrieval of drug-seeking contingency information and that the use of contextual information is enhanced with IL manipulation.

Translating upwards: linking the neural and social sciences via neuroeconomics

The social and neural sciences share a common interest in understanding the mechanisms that underlie human behaviour. However, interactions between neuroscience and social science disciplines remain strikingly narrow and tenuous. We illustrate the scope and challenges for such interactions using the paradigmatic example of neuroeconomics. Using quantitative analyses of both its scientific literature and the social networks in its intellectual community, we show that neuroeconomics now reflects a true disciplinary integration, such that research topics and scientific communities with interdisciplinary span exert greater influence on the field. However, our analyses also reveal key structural and intellectual challenges in balancing the goals of neuroscience with those of the social sciences. To address these challenges, we offer a set of prescriptive recommendations for directing future research in neuroeconomics.

Catching the engram: strategies to examine the memory trace

Memories are stored within neuronal ensembles in the brain. Modern genetic techniques can be used to not only visualize specific neuronal ensembles that encode memories (e.g., fear, craving) but also to selectively manipulate those neurons. These techniques are now being expanded for the study of various types of memory. In this review, we will summarize the genetic methods used to visualize and manipulate neurons involved in the representation of memory engrams. The methods will help clarify how memory is encoded, stored and processed in the brain. Furthermore, these approaches may contribute to our understanding of the pathological mechanisms associated with human memory disorders and, ultimately, may aid the development of therapeutic strategies to ameliorate these diseases.

Disturbances in behavior and cortical enkephalin gene expression during the anticipation of ethanol in rats characterized as high drinkers

The process of ethanol anticipation is a particularly important phenomenon that can determine subsequent drug-taking behavior. Recent studies suggest that systems within the medial prefrontal cortex (mPFC), during anticipation, may contribute to the goal-directed seeking of ethanol. The current investigation examined the possibility that the opioid peptide enkephalin (ENK), known to mediate some of the reinforcing properties of ethanol, may function in the mPFC during the anticipation of ethanol access. Using a limited access (3 h/d) paradigm for 10 days with 20% ethanol, Sprague-Dawley rats were first identified either as low drinkers (LD, <1.0 g/kg/3 h) or as high drinkers (HD, >2.0 g/kg/3 h) that exhibited a long-term phenotype of high ethanol consumption and a significant ethanol deprivation effect. During the anticipation period immediately preceding daily ethanol access, the HD rats compared to LD or Control animals with ad libitum ethanol access exhibited increased anticipatory behaviors, including greater exploratory behavior in a novel open field as revealed by significantly more time spent in the rearing position (+53-65%, p < 0.05) and increased number of rears made (+33-44%, p < 0.05) and greater novelty-seeking behavior in a hole-board apparatus revealed by an increase in total (+50-52%, p < 0.05) and novel nose pokes (+45-48%, p < 0.05). In the HD rats, analysis of the mPFC using real-time quantitative PCR showed significantly greater mRNA levels of ENK (p < 0.05) and the mu-opioid receptor (MOR) (p < 0.05), but not delta-opioid receptor (DOR), and this increase in ENK expression was found, using in situ hybridization, to occur specifically in the prelimbic (PrL) subregion of the mPFC. When injected into the PrL during the anticipation period, a MOR agonist but not DOR agonist significantly increased consumption of 20% ethanol (p < 0.05). These findings support the role of ENK, acting through MOR within the PrL to promote the anticipation and excessive consumption of ethanol.

Glutamate mechanisms underlying opiate memories

As the major excitatory neurotransmitter in the brain, glutamate plays an undisputable integral role in opiate addiction. This relates, in part, to the fact that addiction is a disorder of learning and memory, and glutamate is required for most types of memory formation. As opiate addiction develops, the addict becomes conditioned to engage in addictive behaviors, and these behaviors can be triggered by opiate-associated cues during abstinence, resulting in relapse. Some medications for opiate addiction exert their therapeutic effects at glutamate receptors, especially the NMDA receptor. Understanding the neural circuits controlling opiate addiction, and the locus of glutamate's actions within these circuits, will help guide the development of targeted pharmacotherapeutics for relapse.

Medial prefrontal cortex neuronal activation and synaptic alterations after stress-induced reinstatement of palatable food seeking: a study using c-fos-GFP transgenic female rats

Relapse to maladaptive eating habits during dieting is often provoked by stress and there is evidence for a role of ovarian hormones in stress responses and feeding. We studied the role of these hormones in stress-induced reinstatement of food seeking and medial prefrontal cortex (mPFC) neuronal activation in c-fos-GFP transgenic female rats, which express GFP in strongly activated neurons. Food-restricted ovariectomized or sham-operated c-fos-GFP rats were trained to lever-press for palatable food pellets. Subsequently, lever-pressing was extinguished and reinstatement of food seeking and mPFC neuronal activation was assessed after injections of the pharmacological stressor yohimbine (0.5-2 mg/kg) or pellet priming (1-4 noncontingent pellets). Estrous cycle effects on reinstatement were also assessed in wild-type rats. Yohimbine- and pellet-priming-induced reinstatement was associated with Fos and GFP induction in mPFC; both reinstatement and neuronal activation were minimally affected by ovarian hormones in both c-fos-GFP and wild-type rats. c-fos-GFP transgenic rats were then used to assess glutamatergic synaptic alterations within activated GFP-positive and nonactivated GFP-negative mPFC neurons following yohimbine-induced reinstatement of food seeking. This reinstatement was associated with reduced AMPA receptor/NMDA receptor current ratios and increased paired-pulse facilitation in activated GFP-positive but not GFP-negative neurons. While ovarian hormones do not appear to play a role in stress-induced relapse of food seeking in our rat model, this reinstatement was associated with unique synaptic alterations in strongly activated mPFC neurons. Our paper introduces the c-fos-GFP transgenic rat as a new tool to study unique synaptic changes in activated neurons during behavior.

Object/context specific memory deficits following medial frontal cortex damage in mice

Recent evidence suggests that the medial prefrontal cortex (MFC) is important for processing contextual information. Here we evaluate the performance of mice with MFC damage in a discrimination task that requires an association between an object and the context in which it was experienced (the object/context mismatch task), as well as a version of the novel object preference task that does not require knowledge of contextual information to resolve. Adult C57/BL6 mice received aspiration lesions of the MFC or control surgery. Upon recovery, mice were tested in the object/context mismatch and novel object preference tasks. The object/context mismatch task involved exposing mice to two different contexts, each of which housed a unique pair of identical objects. After a brief delay, mice were re-exposed to one of the contexts, this time with one object that was congruent with that context and one that was not. Novel object preference was performed within a single context, housing an identical pair of objects. After the initial exposure and following a brief delay, mice were re-exposed to the context, this time housing a familiar and a novel object. Control mice were able to successfully resolve the object/context mismatch and novel object preference discriminations, investigating the incongruent/novel object within each task significantly greater than chance. Mice with MFC damage experienced deficits in the object/context mismatch task but not the novel object preference task. These findings add to a growing body of evidence that demonstrate a critical role for the MFC in contextual information processing.

Role of projections from ventral medial prefrontal cortex to nucleus accumbens shell in context-induced reinstatement of heroin seeking

In humans, exposure to contexts previously associated with heroin use can provoke relapse. In rats, exposure to heroin-paired contexts after extinction of drug-reinforced responding in different contexts reinstates heroin seeking. This effect is attenuated by inhibition of glutamate or dopamine transmission in nucleus accumbens shell, or inactivation of ventral medial prefrontal cortex (mPFC). Here, we used an anatomical asymmetrical disconnection procedure to demonstrate that an interaction between glutamatergic projections from ventral mPFC to accumbens shell and local dopamine D(1) postsynaptic receptors contributes to context-induced reinstatement of heroin seeking. We also combined the marker of neuronal activity, Fos, with the retrograde tracer Fluoro-Gold to assess activation in this pathway during context-induced reinstatement. Rats were trained to self-administer heroin for 12 d; drug infusions were paired with a discrete tone-light cue. Lever pressing was subsequently extinguished in a nondrug-associated context in the presence of the discrete cue. Rats were then tested in the heroin- or extinction-associated contexts under extinction conditions. Injections of muscimol + baclofen into ventral mPFC in one hemisphere and D(1)-family receptor antagonist SCH 23390 into the contralateral or ipsilateral accumbens shell decreased context-induced reinstatement. Unilateral injections of muscimol + baclofen into ventral mPFC or SCH 23390 into the accumbens shell had no effect. Context-induced reinstatement was associated with increased Fos expression in ventral mPFC neurons, including those projecting to accumbens shell, with higher double-labeling in the ipsilateral projection than in the contralateral projection. Our results demonstrate that activation of glutamatergic projections from ventral mPFC to accumbens shell, previously implicated in inhibition of cocaine relapse, promotes heroin relapse.

Facilitated extinction of morphine conditioned place preference with Tat-GluA2(3Y) interference peptide

Neuroplasticity including long-term depression (LTD) has been implicated in both learning processes and addiction. LTD can be blocked by intravenous administration of the interference peptide Tat-GluA2(3Y) that prevents regulated endocytosis of the alpha-amino-3-hydroxy-5-methyl-isoxazole-4-propionic acid (AMPA) receptor. In this study, Tat-GluA2(3Y) was used to assess the role of LTD in the induction, expression, extinction and reinstatement of morphine-induced conditioned place preference (CPP). CPP was established in rats by pairing morphine (5 mg/kg, i.p.) or saline with a specific environmental context using a balanced protocol. Tat-GluA2(3Y) (0; 1.5; 2.25 nmol/g; i.v.), scrambled peptide (Tat-GluA2(Sc)), or vehicle was administered during the acquisition phase or prior to the test for CPP. Tat-GluA2(3Y) had no effect on the induction or initial expression of morphine-induced CPP. Rats that received Tat-GluA2(3Y) or Tat-GluA2(Sc) during acquisition were subsequently tested for 11 consecutive days in order to extinguish morphine CPP. CPP was then reinstated by an injection of morphine (5 mg/kg, i.p.). Co-administration of morphine and Tat-GluA2(3Y) during acquisition greatly facilitated extinction of CPP without affecting morphine-induced reinstatement of CPP. Using an intermittent retest schedule with bi-weekly tests to measure the maintenance of CPP, Tat-GluA2(3Y) during the acquisition phase had no effect on the maintenance of CPP. We propose that co-administration of Tat-GluA2(3Y) with morphine during acquisition of CPP weakens the association between morphine and contextual cues leading to rapid extinction of morphine CPP with repeated daily testing.

Contextual encoding by ensembles of medial prefrontal cortex neurons

Contextual representations serve to guide many aspects of behavior and influence the way stimuli or actions are encoded and interpreted. The medial prefrontal cortex (mPFC), including the anterior cingulate subregion, has been implicated in contextual encoding, yet the nature of contextual representations formed by the mPFC is unclear. Using multiple single-unit tetrode recordings in rats, we found that different activity patterns emerged in mPFC ensembles when animals moved between different environmental contexts. These differences in activity patterns were significantly larger than those observed for hippocampal ensembles. Whereas ≈11% of mPFC cells consistently preferred one environment over the other across multiple exposures to the same environments, optimal decoding (prediction) of the environmental setting occurred when the activity of up to ≈50% of all mPFC neurons was taken into account. On the other hand, population activity patterns were not identical upon repeated exposures to the very same environment. This was partly because the state of mPFC ensembles seemed to systematically shift with time, such that we could sometimes predict the change in ensemble state upon later reentry into one environment according to linear extrapolation from the time-dependent shifts observed during the first exposure. We also observed that many strongly action-selective mPFC neurons exhibited a significant degree of context-dependent modulation. These results highlight potential differences in contextual encoding schemes by the mPFC and hippocampus and suggest that the mPFC forms rich contextual representations that take into account not only sensory cues but also actions and time.

Investigation of the neuroanatomical substrates of reward seeking following protracted abstinence in mice

Persistent vulnerability to relapse represents a major challenge in the treatment of drug addiction. The brain circuitry that underlies relapse-like behaviour can be investigated using animal models of drug seeking. As yet there have been no comprehensive brain mapping studies that have specifically examined the neuroanatomical substrates of cue-induced opiate seeking following abstinence in a mouse operant paradigm. The aim of this study was to compare the brain regions involved in sucrose vs. morphine seeking following protracted abstinence in mice. Male CD1 mice were trained to respond for either sucrose (10% w/v) or intravenous morphine (0.1 mg kg(-1) per infusion) in an operant paradigm in the presence of a discrete cue. Once stable responding was established, mice were subjected to abstinence in their home cages for 3 weeks and then perfused for tissue collection, or returned to the operant chambers to assess cue-induced reward seeking before being perfused for tissue collection. Brain tissue was processed for Fos immunohistochemistry and Fos expression was quantified in a range of brain nuclei. We identified unique patterns of neuronal activation for sucrose and morphine seeking mice as well as some overlap. Structures activated in both ‘relapse' groups included the anterior cingulate and orbitofrontal cortex, nucleus accumbens shell, bed nucleus of the stria terminalis, substantia nigra pars compacta, ventral tegmental area, hippocampus, periaqueductal grey, locus coeruleus and lateral habenula. Structures that were more activated in morphine seeking mice included the nucleus accumbens core, basolateral amygdala, substantia nigra pars reticulata, and the central nucleus of the amygdala. The dorsal raphe was the only structure examined that was specifically activated in sucrose seeking mice. Overall our findings support a cortico-striatal limbic circuit driving opiate seeking, and we have identified some additional circuitry potentially relevant to reward seeking following abstinence.

Neural circuit competition in cocaine-seeking: roles of the infralimbic cortex and nucleus accumbens shell

Following cocaine self-administration and extinction training, activity in the infralimbic cortex (IL) suppresses cocaine-seeking behavior. IL inactivation induces cocaine-seeking whereas activation suppresses cocaine-reinstated drug-seeking. We asked how the suppression of cocaine-seeking induced by IL activation integrates with the circuitry promoting reinstated cocaine-seeking. Following cocaine self-administration and extinction training, rats underwent cue-induced reinstatement. In order to activate IL projections, microinjections of PEPA, a positive allosteric modulator of AMPA receptors, were made into the IL in combination with microinjections into a variety of nuclei known to regulate cocaine-seeking. Intra-IL PEPA administration suppressed cue-induced reinstatement without affecting locomotor activity. The suppression of cocaine-seeking was reversed by activating dopamine neurons in the ventral tegmental area with microinjections of the μ-opioid receptor agonist DAMGO, and was partially reversed by dopamine microinjections into the prelimbic cortex or basolateral amygdala. Previous evidence suggests that the nucleus accumbens shell both promotes and suppresses cocaine-seeking. The suppression of cue-induced cocaine seeking by PEPA in the IL was reversed by intra-shell microinjections of either dopamine or the AMPA receptor antagonist CNQX, suggesting that the accumbens shell bidirectionally regulates cocaine-seeking depending on whether dopamine input is mimicked or glutamate input is inhibited. Together, these findings indicate that the IL acts 'upstream' from structures promoting cocaine-seeking, including from the mesolimbic dopamine projections to the prelimbic cortex and basolateral amygdala, and that the accumbens shell may be a crucial point of integration between the circuits that promote (ventral tegmental area) and inhibit (IL) reinstated cocaine-seeking.

The hypothalamus and the neurobiology of drug seeking

The hypothalamus is a neural structure critical for expression of motivated behaviours that ensure survival of the individual and the species. It is a heterogeneous structure, generally recognised to have four distinct regions in the rostrocaudal axis (preoptic, supraoptic, tuberal and mammillary). The tuberal hypothalamus in particular has been implicated in the neural control of appetitive motivation, including feeding and drug seeking. Here we review the role of the tuberal hypothalamus in appetitive motivation. First, we review evidence that different regions of the hypothalamus exert opposing control over feeding. We then review evidence that a similar bi-directional regulation characterises hypothalamic contributions to drug seeking and reward seeking. Lateral regions of the dorsal tuberal hypothalamus are important for promoting reinstatement of drug seeking, whereas medial regions of the dorsal tuberal hypothalamus are important for inhibiting this drug seeking after extinction training. Finally, we review evidence that these different roles for medial versus lateral dorsal tuberal hypothalamus in promoting or preventing reinstatement of drug seeking are mediated, at least in part, by different populations of hypothalamic neurons as well as the neural circuits in which they are located.

Hippocampal GluA1-containing AMPA receptors mediate context-dependent sensitization to morphine

Glutamatergic systems, including AMPA receptors (AMPARs), are involved in opiate-induced neuronal and behavioral plasticity, although the mechanisms underlying these effects are not fully understood. In the present study, we investigated the effects of repeated morphine administration on AMPAR expression, synaptic plasticity, and context-dependent behavioral sensitization to morphine. We found that morphine treatment produced changes of synaptic AMPAR expression in the hippocampus, a brain area that is critically involved in learning and memory. These changes could be observed 1 week after the treatment, but only when mice developed context-dependent behavioral sensitization to morphine in which morphine treatment was associated with drug administration environment. Context-dependent behavioral sensitization to morphine was also associated with increased basal synaptic transmission and disrupted hippocampal long-term potentiation (LTP), whereas these effects were less robust when morphine administration was not paired with the drug administration environment. Interestingly, some effects may be related to the prior history of morphine exposure in the drug-associated environment, since alterations of AMPAR expression, basal synaptic transmission, and LTP were observed in mice that received a saline challenge 1 week after discontinuation of morphine treatment. Furthermore, we demonstrated that phosphorylation of GluA1 AMPAR subunit plays a critical role in the acquisition and expression of context-dependent behavioral sensitization, as this behavior is blocked by a viral vector that disrupts GluA1 phosphorylation. These data provide evidence that glutamatergic signaling in the hippocampus plays an important role in context-dependent sensitization to morphine and supports further investigation of glutamate-based strategies for treating opiate addiction.

The synaptic pathology of drug addiction

A hallmark of drug addiction is the uncontrollable desire to consume drugs at the expense of severe negative consequences. Moreover, addicts that successfully refrain from drug use have a high vulnerability to relapse even after months or years of abstinence. In this chapter, we will discuss the current understanding of drug-induced neuroplasticity within the mesocorticolimbic brain system that contributes to the development of addiction and the persistence of relapse to drug seeking. I particular, we will focus at animal models that can be translated to human addiction. Although dopaminergic transmission is important for the acute effects of drug intake, the long-lived behavioral abnormalities associated with addiction are thought to arise from pathological plasticity in glutamatergic neurotransmission. The nature of changes in excitatory synaptic plasticity depends on several factors, including the type of drug, the brain area, and the time-point studied in the transition of drug exposure to withdrawal and relapse to drug seeking. Identification of drug-induced neuroplasticity is crucial to understand how molecular and cellular adaptations contribute to the end stage of addiction, which from a clinical perspective, is a time-point where pharmacotherapy may be most effectively employed.

Chemical genetics: receptor-ligand pairs for rapid manipulation of neuronal activity

Toward the functional dissection of neuronal circuits, a number of new genetic tools have been developed that enable rapid and reversible manipulation of genetically defined neuronal subtypes in intact mammalian brain circuits. Alongside the breakthrough technology of optogenetics, receptor-ligand pairs provide complementary approaches to modulate neuronal activity using chemical genetics.

Visualization and manipulation of neural activity in the developing vertebrate nervous system

Neural activity during vertebrate development has been unambiguously shown to play a critical role in sculpting circuit formation and function. Patterned neural activity in various parts of the developing nervous system is thought to modulate neurite outgrowth, axon targeting, and synapse refinement. The nature and role of patterned neural activity during development has been classically studied with in vitro preparations using pharmacological manipulations. In this review we discuss newly available and developing molecular-genetic tools for the visualization and manipulation of neural activity patterns specifically during development.

Opiate versus psychostimulant addiction: the differences do matter

The publication of the psychomotor stimulant theory of addiction in 1987 and the finding that addictive drugs increase dopamine concentrations in the rat mesolimbic system in 1988 have led to a predominance of psychobiological theories that consider addiction to opiates and addiction to psychostimulants as essentially identical phenomena. Indeed, current theories of addiction - hedonic allostasis, incentive sensitization, aberrant learning and frontostriatal dysfunction - all argue for a unitary account of drug addiction. This view is challenged by behavioural, cognitive and neurobiological findings in laboratory animals and humans. Here, we argue that opiate addiction and psychostimulant addiction are behaviourally and neurobiologically distinct and that the differences have important implications for addiction treatment, addiction theories and future research.

Optogenetics: potentials for addiction research

Research on the biology of addiction has advanced significantly over the last 50 years expanding our understanding of the brain mechanisms underlying reward, reinforcement and craving. Novel experimental approaches and techniques have provided an ever increasing armory of tools to dissect behavioral processes, neural networks and molecular mechanisms. The ultimate goal is to reintegrate this knowledge into a coherent, mechanistic framework of addiction to help identify new treatment. This can be greatly facilitated by using tools that allow, with great spatial and temporal specificity, to link molecular changes with altered activation of neural circuits and behavior. Such specificity can now be achieved by using optogenetic tools. Our review describes the general principles of optogenetics and its use to understand the links between neural activity and behavior. We also provide an overview of recent studies using optogenetic tools in addiction and consider some outstanding questions of addiction research that are particularly amenable for optogenetic approaches.

Neurobiology of the incubation of drug craving

It was suggested in 1986 that cue-induced drug craving in cocaine addicts progressively increases over the first several weeks of abstinence and remains high for extended periods. During the past decade, investigators have identified an analogous incubation phenomenon in rodents, in which time-dependent increases in cue-induced drug seeking are observed after withdrawal from intravenous cocaine self-administration. Such an incubation of drug craving is not specific to cocaine, as similar findings have been observed after self-administration of heroin, nicotine, methamphetamine and alcohol in rats. In this review, we discuss recent results that have identified important brain regions involved in the incubation of drug craving, as well as evidence for the underlying cellular mechanisms. Understanding the neurobiology of the incubation of drug craving in rodents is likely to have significant implications for furthering understanding of brain mechanisms and circuits that underlie craving and relapse in human addicts.