AMPA/kainate, NMDA, and dopamine D1 receptor function in the nucleus accumbens core: a context-limited role in the encoding and consolidation of instrumental memory

Sex-Specific Mechanisms Underlie Long-Term Potentiation at Hippocampus→Medium Spiny Neuron Synapses in the Medial Shell of the Nucleus Accumbens

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp→NAc synapses is rewarding, and mice can establish learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigated sex differences in the mechanisms underlying Hipp→NAc LTP using whole-cell electrophysiology and pharmacology. We observed similarities in basal synaptic strength between males and females and found that LTP occurs postsynaptically with similar magnitudes in both sexes. However, key sex differences emerged as LTP in males required NMDA receptors (NMDAR), whereas LTP in females utilized an NMDAR-independent mechanism involving L-type voltage-gated Ca2+ channels (VGCCs) and estrogen receptor α (ERα). We also uncovered sex-similar features as LTP in both sexes depended on CaMKII activity and occurred independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

Sex-specific mechanisms underlie long-term potentiation at hippocampus-nucleus accumbens synapses

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary in order to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp-NAc synapses is rewarding, and that mice can make learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigate sex differences in the mechanisms underlying Hipp-NAc LTP using whole-cell electrophysiology and pharmacology. We found that males and females display similar magnitudes of Hipp-NAc LTP which occurs postsynaptically. However, LTP in females requires L-type voltage-gated Ca 2+ channels (VGCC) for postsynaptic Ca 2+ influx, while males rely on NMDA receptors (NMDAR). Additionally, females require estrogen receptor α (ERα) activity for LTP while males do not. These differential mechanisms converge as LTP in both sexes depends on CAMKII activity and occurs independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral excitatory pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

SIGNIFICANCE STATEMENT

Strengthening of Hipp-NAc synapses drives reward-related behaviors. Male and female mice have similar magnitudes of long-term potentiation (LTP) and both sexes have a predicted postsynaptic locus of plasticity. Despite these similarities, we illustrate here that sex-specific molecular mechanisms are used to elicit LTP. Given the bidirectional relationship between Hipp-NAc synaptic strength in mediating reward-related behaviors, the use of distinct molecular mechanisms may explain sex differences observed in stress susceptibility or response to rewarding stimuli. Discovery and characterization of convergent sex differences provides mechanistic insight into the sex-specific function of Hipp-NAc circuitry and has widespread implications for circuits mediating learning and reward-related behavior.

Alcohol and cannabinoid binges and daily exposure to nicotine in adolescent/young adult rats induce sex-dependent long-term appetitive instrumental learning impairment

Adolescence is a critical developmental period, concerning anatomical, neurochemical and behavioral changes. Moreover, adolescents are more sensitive to the long-term deleterious effects of drug abuse. Binge-like consumption of alcohol and marijuana, along with tobacco smoking, is a dangerous pattern often observed in adolescents during weekends. Nevertheless, the long-term effect of their adolescent co-exposure has not been yet experimentally investigated. Long-Evans adolescent male (n = 20) and female (n = 20) rats from postnatal day 30 (P30) until P60 were daily treated with nicotine (0.3 mg/kg, i.p.), and, on two consecutive 'binging days' per week (for a total of eight times), received an intragastric ethanol solution (3 g/kg) and an intraperitoneal (i.p.) dose of cannabinoid 1/2 receptor agonist WIN55,212-2 (1.2 mg/kg). These rats were tested after treatment discontinuation at > P90 for associative food-rewarded operant learning in the two-lever conditioning chambers for six consecutive days on a fixed ratio 1 (FR1) schedule followed by another six days of daily FR2 schedule testing, after 42 days rest. We found the main effects of sex x treatment interactions in FR1 but not in FR2 experiments. Treated females show attenuated operant responses for food pellets during all FR1 and the FR2 schedule, whilst the treated males show an impairment in FR2 but not in the FR1 schedule. Moreover, the treated females' percentage of learners was significantly lower than female controls in FR1 while treated males were lower than controls in FR2. Our findings suggest that intermittent adolescent abuse of common drugs, such as alcohol and marijuana, and chronic tobacco exposure can cause significant long-term effects on motivation for natural reinforcers later in adulthood in both sexes. Females appear to be sensitive earlier to the deleterious effects of adolescent polydrug abuse, with both sexes having an increased likelihood of developing lifelong brain alterations.

The effects of ninjin'yoeito on the electrophysiological properties of dopamine neurons in the ventral tegmental area/substantia nigra pars compacta and medium spiny neurons in the nucleus accumbens

The ventral tegmental area (VTA), substantia nigra pars compacta (SNpc) and nucleus accumbens (NAc) are involved in the regulation of appetite and motivational behaviors. A traditional Japanese (Kampo) medicine, ninjin'yoeito (NYT), has been reported to improve decreased motivation and anorexia in patients with Alzheimer's disease and apathy-like model mice. Thus, NYT may affect the activities of neurons in the VTA, SNpc and NAc. However, little is known about the underlying mechanisms of NYT. Here, we investigated the effects of NYT on the electrophysiological properties of dopaminergic neurons in the VTA and SNpc, as well as on those of medium spiny neurons (MSNs) in the NAc (core and shell subregions), by applying the patch-clamp technique in the brain slices. NYT reduced the resting membrane potential of VTA and SNpc dopaminergic neurons. In contrast, NYT increased the firing frequency of NAc MSNs accompanied by shortened first spike latency and interspike interval. Furthermore, NYT attenuated the inward rectification and sustained outward currents. In conclusion, NYT may directly influence the excitability of dopaminergic neurons in the VTA and SNpc, as well as MSNs in the NAc (core and shell). NYT may modulate dopamine signals in appetite and motivational behaviors.

Opposing roles for striatonigral and striatopallidal neurons in dorsolateral striatum in consolidating new instrumental actions

Comparatively little is known about how new instrumental actions are encoded in the brain. Using whole-brain c-Fos mapping, we show that neural activity is increased in the anterior dorsolateral striatum (aDLS) of mice that successfully learn a new lever-press response to earn food rewards. Post-learning chemogenetic inhibition of aDLS disrupts consolidation of the new instrumental response. Similarly, post-learning infusion of the protein synthesis inhibitor anisomycin into the aDLS disrupts consolidation of the new response. Activity of D1 receptor-expressing medium spiny neurons (D1-MSNs) increases and D2-MSNs activity decreases in the aDLS during consolidation. Chemogenetic inhibition of D1-MSNs in aDLS disrupts the consolidation process whereas D2-MSN inhibition strengthens consolidation but blocks the expression of previously learned habit-like responses. These findings suggest that D1-MSNs in the aDLS encode new instrumental actions whereas D2-MSNs oppose this new learning and instead promote expression of habitual actions.

Shifting motivational states: The effects of nucleus accumbens dopamine and opioid receptor activation on a modified effort-based choice task

The nucleus accumbens (NAc) is critical for regulating the appetitive and consummatory phases of motivated behavior. These experiments examined the effects of dopamine and opioid receptor manipulations within the NAc during an effort-based choice task that allowed for simultaneous assessment of both phases of motivation. Male Sprague-Dawley rats received bilateral guide cannulas targeting the NAc core and were tested in 1-hr sessions with free access to rat chow and the choice to work for sugar pellets on a progressive ratio 2 (PR2) reinforcement schedule. Individual groups of rats were tested following stimulation or blockade of NAc D1-like or D2-like receptors, stimulation of μ-, δ-, or κ-opioid receptors, or antagonism of opioid receptors. Behavior was examined under ad libitum conditions and following 23-h food restriction. NAc blockade of the D1-like receptors or stimulation of the D2 receptor reduced break point for earning sugar pellets; D2 receptor stimulation also modestly lowered chow intake. NAc μ-opioid receptor stimulation increased intake of the freely-available chow while simultaneously reducing break point for the sugar pellets. In non-restricted conditions, δ-opioid receptor stimulation increased both food intake and breakpoint. There were no effects of stimulating NAc D1 or κ receptors, nor did blocking D2 or opioid receptors affect task behavior. These data support prior literature linking dopamine to appetitive motivational processes, and suggest that μ- and δ-opioid receptors affect food-directed motivation differentially. Specifically, μ-opioid receptors shifted behavior towards consumption, and δ-opioid receptor enhanced both sugar-seeking and consumption of the pabulum chow when animals were not food restricted.

NMDA receptor-dependent plasticity in the nucleus accumbens connects reward-predictive cues to approach responses

Learning associations between environmental cues and rewards is a fundamental adaptive function. Via such learning, reward-predictive cues come to activate approach to locations where reward is available. The nucleus accumbens (NAc) is essential for cued approach behavior in trained subjects, and cue-evoked excitations in NAc neurons are critical for the expression of this behavior. Excitatory synapses within the NAc undergo synaptic plasticity that presumably contributes to cued approach acquisition, but a direct link between synaptic plasticity within the NAc and the development of cue-evoked neural activity during learning has not been established. Here we show that, with repeated cue-reward pairings, cue-evoked excitations in the NAc emerge and grow in the trials prior to the detectable expression of cued approach behavior. We demonstrate that the growth of these signals requires NMDA receptor-dependent plasticity within the NAc, revealing a neural mechanism by which the NAc participates in learning of conditioned reward-seeking behaviors.

Conditioned stimuli elicit phasic changes in nucleus accumbens (NAc) firing that invigorate approach responses to predicted rewards. Here the authors show that NAc neurons acquire cue-evoked responses during learning as a result of excitatory plasticity within the NAc.

HIV-1 Tat regulation of dopamine transmission and microglial reactivity is brain region specific

The transactivator of transcription protein, HIV-1 Tat, is linked to neuroAIDS, where degeneration of dopamine neurons occurs. Using a mouse model expressing GFAP-driven Tat protein under doxycycline (Dox) regulation, we investigated microglial-neuronal interactions in the rostral substantia nigra pars compacta (SNc). Immunohistochemistry for microglia and tyrosine hydroxylase (TH) showed that the ratio of microglia to dopamine neurons is smaller in the SNc than in the ventral tegmental area (VTA) and that this difference is maintained following 7-day Dox exposure in wild type animals. Administration of Dox to wild types had no effect on microglial densities. In addressing the sensitivity of neurons to potentially adverse effects of HIV-1 Tat, we found that HIV-1 Tat exposure in vivo selectively decreased TH immunoreactivity in the SNc but not in the VTA, while levels of TH mRNA in the SNc remained unchanged. HIV-1 Tat induction in vivo did not alter the total number of neurons in these brain regions. Application of Tat (5 ng) into dopamine neurons with whole-cell patch pipette decreased spontaneous firing activity. Tat induction also produced a decline in microglial cell numbers, but no microglial activation. Thus, disappearance of dopaminergic phenotype is due to a loss of TH immunoreactivity rather than to neuronal death, which would have triggered microglial activation. We conclude that adverse effects of HIV-1 Tat produce a hypodopamine state by decreasing TH immunoreactivity and firing activity of dopamine neurons. Reduced microglial numbers after Tat exposure in vivo suggest impaired microglial functions and altered bidirectional interactions between dopamine neurons and microglia.

Repurposing steroidogenesis inhibitors for the therapy of neuropsychiatric disorders: Promises and caveats

Steroids exert a profound influence on behavioral reactivity, by modulating the functions of most neurotransmitters and shaping the impact of stress and sex-related variables on neural processes. This background - as well as the observation that most neuroactive steroids (including sex hormones, glucocorticoids and neurosteroids) are synthetized and metabolized by overlapping enzymatic machineries - points to steroidogenic pathways as a powerful source of targets for neuropsychiatric disorders. Inhibitors of steroidogenic enzymes have been developed and approved for a broad range of genitourinary and endocrine dysfunctions, opening to new opportunities to repurpose these drugs for the treatment of mental problems. In line with this idea, preliminary clinical and preclinical results from our group have shown that inhibitors of key steroidogenic enzymes, such as 5α-reductase and 17,20 desmolase-lyase, may have therapeutic efficacy in specific behavioral disorders associated with dopaminergic hyperfunction. While the lack of specificity of these effects raises potential concerns about endocrine adverse events, these initial findings suggest that steroidogenesis modulators with greater brain specificity may hold significant potential for the development of alternative therapies for psychiatric problems. This article is part of the Special Issue entitled 'Drug Repurposing: old molecules, new ways to fast track drug discovery and development for CNS disorders'.

The strength of reward-related learning depends on the degree of activation of ventral tegmental area dopamine neurons

We tested whether (1) the capacity of a reward-associated conditioned stimulus (CS) to cause conditioned activation of ventral tegmental area (VTA) dopamine (DA) neurons is associated with its capacity to elicit conditioned approach responses and (2) whether the acquisition of these capacities by a CS requires N-methyl-D-aspartate (NMDA) and muscarinic acetylcholine (mACh) receptor stimulation. Rats were trained to emit a conditioned approach response to a light CS that was previously paired with food and were treated systemically with scopolamine (a mACh receptor antagonist) or MK-801 (an NMDA receptor antagonist) either prior to each conditioning session (during which animals experienced paired CS and food presentations) or prior to the conditioned approach (CS-only) test. Brains were harvested after the CS-only test and processed for tyrosine hydroxylase (TH) (DA cells) and c-fos in the VTA. When animals received scopolamine or MK-801 treatment prior to conditioning sessions we observed significantly fewer TH-labeled (i.e., DA) cells in the VTA that expressed c-fos and significantly less conditioned approach responding during the CS-only test. Further analysis showed a correlation between the number of VTA DA cells activated and the number of conditioned approach responses. Treatments made prior to the CS-only test did not affect responding. Altogether these results suggest that the degree to which a CS elicits conditioned approach depends partially on the degree to which the CS activates VTA DA cells and that the acquisition of both of these capacities by a CS requires mACh and NMDA receptor stimulation.

Involvement of AMPA/Kainate Glutamate Receptor in the Extinction and Reinstatement of Morphine-Induced Conditioned Place Preference: A Behavioral and Molecular Study

Glutamate receptors in mesolimbic areas such as the nucleus accumbens, ventral tegmental area, prefrontal cortex (PFC), and hippocampus (HIP) are a component of the mechanisms of drug-induced reward and can modulate the firing pattern of dopaminergic neurons in the reward system. In addition, several lines of study have indicated that cAMP response element-binding protein (CREB) and c-fos have important role in morphine-induced conditioned place preference (CPP) induced by drugs of abuse, such as morphine, cocaine, nicotine, and alcohol. Therefore, in the present study, we investigated the changes in phosphorylated CREB (p-CREB) and c-fos induction within the nucleus accumbens (NAc), HIP, and PFC after intracerebroventricular (ICV) administration of different doses of CNQX or vehicle during extinction period or reinstatement of morphine-induced CPP. In all groups, the CPP procedure was done; afterward, the conditioning scores were recorded by Ethovision software. After behavioral test recording, we dissected out the NAc, HIP, and PFC regions and measured the p-CREB/CREB ratio and c-fos level by Western blot analysis. Our results showed that administration of CNQX significantly shortened the extinction of morphine CPP. Besides, ICV microinjection of CNQX following extinction period decreased the reinstatement of morphine CPP in extinguished rats. In molecular section, in treatment group, all mentioned factors were dose-dependently decreased in comparison with vehicle group (DMSO) after ICV microinjection of different doses of CNQX but not in pre-extinction microinjection. These findings suggested that antagonism of AMPA receptor decreased p-CREB/CREB ratio and c-fos level in the PFC, NAc, and HIP. Modulation of the drug memory reconsolidation may be useful for faster extinction of drug-induced reward and attenuation of drug-seeking behavior.

Acquisition and expression of fat-conditioned flavor preferences are differentially affected by NMDA receptor antagonism in BALB/c and SWR mice

Conditioned flavor preferences are elicited by fat (Intralipid) in inbred mouse strains with BALB/c and SWR mice displaying among the most robust preferences. Dopamine D₁ and opioid receptor antagonism differentially reduces the acquisition (learning) and expression (maintenance) of fat-conditioned flavor preferences in these two strains. Because noncompetitive NMDA receptor antagonism with MK-801 differentially altered sugar-conditioned flavor preferences in these strains, and because NMDA receptors are involved in fat intake, the present study examined whether MK-801 differentially altered expression and acquisition of fat (Intralipid)-conditioned flavor preferences in BALB/c and SWR mice. In expression studies, food-restricted male mice alternately consumed a flavored (CS+, e.g., cherry, 5 sessions) 5% Intralipid solution and a differently-flavored (CS-, e.g., grape, 5 sessions) 0.5% Intralipid solution. Two-bottle CS choice tests occurred following vehicle or MK-801 (100, 200µg/kg). MK-801 blocked expression of Intralipid-CFP at both doses in BALB/c mice, but only at the 100µg/kg dose in SWR mice. In acquisition studies, groups of BALB/c (0, 100µg/kg) and SWR (0, 100µg/kg) male mice were treated prior to the ten acquisition training sessions followed by six 2-bottle CS choice tests without injections. MK-801 eliminated acquisition of Intralipid-conditioned flavor preferences in BALB/c mice, and actually changed the preference to an avoidance response in SWR mice. Thus, NMDA receptor signaling appears essential especially for the learning of fat-conditioned flavor preferences in both mouse strains.

Relief learning requires a coincident activation of dopamine D1 and NMDA receptors within the nucleus accumbens

Relief learning is the association of a stimulus with the offset of an aversive event. Later, the now conditioned relief stimulus induces appetitive-like behavioral changes. We previously demonstrated that the NMDA receptors within the nucleus accumbens (NAC) are involved in relief learning. The NAC is also important for reward learning and it has been shown that reward learning is mediated by an interaction of accumbal dopamine and NMDA glutamate receptors. Since conditioned relief has reward-like properties, we hypothesized that (a) acquisition of relief learning requires the activation of dopamine D1 receptors in the NAC, and (b) if D1 receptors are involved in this process as expected, a concurrent dopamine D1 and NMDA receptor activation may mediate this learning. The present study tested these hypotheses. Therefore, rats received intra-NAC injections of the dopamine D1 receptor antagonist SCH23390 and the NMDA antagonist AP5, either separately or together, at different time points of a relief conditioning procedure. First, we showed that SCH23390 dose-dependently blocked acquisition and the expression of conditioned relief. Next, we demonstrated that co-injections of SCH23390 and AP5 into the NAC, at doses that were ineffective when applied separately, blocked acquisition but not consolidation or expression of relief learning. Notably, neither of the injections affected the locomotor response of the animals to the aversive stimuli suggesting that their perception is not changed. This data indicates that a co-activation of dopamine D1 and NMDA receptors in the NAC is required for acquisition of relief learning.

Reassessing wanting and liking in the study of mesolimbic influence on food intake

Humans and animals such as rats and mice tend to overconsume calorie-dense foods, a phenomenon that likely contributes to obesity. One often-advanced explanation for why we preferentially consume sweet and fatty foods is that they are more "rewarding" than low-calorie foods. "Reward" has been subdivided into three interdependent psychological processes: hedonia (liking a food), reinforcement (formation of associations among stimuli, actions, and/or the food), and motivation (wanting the food). Research into these processes has focused on the mesolimbic system, which comprises both dopamine neurons in the ventral tegmental area and neurons in their major projection target, the nucleus accumbens. The mesolimbic system and closely connected structures are commonly referred to as the brain's "reward circuit." Implicit in this title is the assumption that "rewarding" experiences are generally the result of activity in this circuit. In this review, I argue that food intake and the preference for calorie-dense foods can be explained without reference to subjective emotions. Furthermore, the contribution of mesolimbic dopamine to food intake and preference may not be a general one of promoting or coordinating behaviors that result in the most reward or caloric intake but may instead be limited to the facilitation of a specific form of neural computation that results in conditioned approach behavior. Studies on the neural mechanisms of caloric intake regulation must address how sensory information about calorie intake affects not just the mesolimbic system but also many other forms of computation that govern other types of food-seeking and food-oriented behaviors.

Differential effects of clozapine, metoclopramide, haloperidol and risperidone on acquisition and performance of operant responding in rats

RATIONALE

Prior research has not systematically investigated the effects of systemic antipsychotic drugs on operant response acquisition, specifically their behavioural microstructure, reinforcement blunting and relative potency in acquisition compared to performance once operant responding has stabilized.

OBJECTIVES

This study aims to systematically investigate the effects of systemically administered clozapine, metoclopramide, haloperidol and risperidone during free operant response acquisition and performance.

METHODS

Following magazine training, food-restricted male Wistar rats lever pressed for food reward in 15 min daily operant conditioning sessions.

RESULTS

All drugs suppressed operant response acquisition and performance. Risperidone and metoclopramide, but not clozapine or haloperidol, suppressed operant responding more potently during acquisition than performance. The dopamine D2-like receptor antagonists haloperidol and metoclopramide that affect the ventral and dorsal striatum blunted reinforcement and decreased inactive lever presses in acquisition. In contrast, the atypical antipsychotics clozapine and risperidone that affect the ventral striatum and prefrontal cortex failed to decrease inactive lever presses during acquisition, suggesting a possible decision-making deficit. Haloperidol decreased active lever pressing over performance days. The drugs did not appear to affect rats' sensitivity to active lever press outcome, even though they suppressed active lever pressing.

CONCLUSIONS

Results suggest that reinforcement impact during operant acquisition is dependent on dopamine D2 receptors while drugs affecting, among other areas, the prefrontal cortex produce a deficit in ability to suppress inactive lever press responses.

Reduction in Responding for Sucrose and Cocaine Reinforcement by Disruption of Memory Reconsolidation

Stored memories are dynamic and, when reactivated, can undergo a process of destabilization and reconsolidation to update them with new information. Reconsolidation has been shown for a variety of experimental settings; most recently for well-learned instrumental memories, a class of memory previously thought not to undergo reconsolidation. Here we tested, in rats, whether a weakly-trained lever-pressing memory destabilized following a shift in reinforcement contingency. We show that lever-pressing memory for both sucrose and cocaine reinforcement destabilized under appropriate conditions, and that the reconsolidation of this memory was impaired by systemic administration of the NMDA receptor (NMDAR) antagonist [5R,10S]-[+]-5-methyl-10,1-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine (MK-801). We went on to investigate the potential role of the nucleus accumbens (NAc) in the reconsolidation of sucrose-reinforced instrumental memories, showing that co-infusion of the NMDAR antagonist 2-amino-5-phosphonopentanoic acid (AP-5) and the dopamine-1 receptor (D1R) antagonist 7-chloro-3-methyl-1-phenyl-1,2,4,5-tetrahydro-3-benzazepin-8-ol (SCH23390) into the NAc prior to memory reactivation impaired reconsolidation; however, there was no effect when these drugs were infused alone. Further investigation of this effect suggests the combined infusion disrupted the reconsolidation of pavlovian components of memory, and we hypothesize that coactivation of accumbal D1Rs and NMDARs may contribute to both the destabilization and reconsolidation of appetitive memory. Our work demonstrates that weakly-trained instrumental memories undergo reconsolidation under similar parameters to well-trained ones, and also suggests that receptor coactivation in the NAc may contribute to memory destabilization. Furthermore, it provides an important demonstration of the therapeutic potential of reconsolidation-based treatments that target the instrumental components of memory in maladaptive drug seeking.

Region-specific role of Rac in nucleus accumbens core and basolateral amygdala in consolidation and reconsolidation of cocaine-associated cue memory in rats

RATIONALE AND OBJECTIVES

Drug reinforcement and the reinstatement of drug seeking are associated with the pathological processing of drug-associated cue memories that can be disrupted by manipulating memory consolidation and reconsolidation. Ras-related C3 botulinum toxin substrate (Rac) is involved in memory processing by regulating actin dynamics and neural structure plasticity. The nucleus accumbens (NAc) and amygdala have been implicated in the consolidation and reconsolidation of emotional memories. Therefore, we hypothesized that Rac in the NAc and amygdala plays a role in the consolidation and reconsolidation of cocaine-associated cue memory.

METHODS

Conditioned place preference (CPP) and microinjection of Rac inhibitor NSC23766 were used to determine the role of Rac in the NAc and amygdala in the consolidation and reconsolidation of cocaine-associated cue memory in rats.

RESULTS

Microinjections of NSC23766 into the NAc core but not shell, basolateral (BLA), or central amygdala (CeA) after each cocaine-conditioning session inhibited the consolidation of cocaine-induced CPP. A microinjection of NSC23766 into the BLA but not CeA, NAc core, or NAc shell immediately after memory reactivation induced by exposure to a previously cocaine-paired context disrupted the reconsolidation of cocaine-induced CPP. The effect of memory disruption on cocaine reconsolidation was specific to reactivated memory, persisted at least 2 weeks, and was not reinstated by a cocaine-priming injection.

CONCLUSIONS

Our findings indicate that Rac in the NAc core and BLA are required for the consolidation and reconsolidation of cocaine-associated cue memory, respectively.

Impairing effect of amphetamine and concomitant ionotropic glutamate receptors blockade in the ventral striatum on spatial learning in mice

RATIONALE

Accumulating evidence supports the involvement of the ventral striatum (VS) in spatial information processing. The multiple cortical glutamatergic and mesolimbic dopaminergic (DAergic) afferences on the same neurons in the ventral striatum provide the neuroanatomical substrate for glutamate and dopamine functional interaction. However, there is little evidence in the literature on how this interaction affects the ability to encode spatial information.

OBJECTIVE

First, we evaluated the effect of intra-VS bilateral infusion of different doses of amphetamine (0.3, 0.75, and 1.5 μg/side) on the ability to detect spatial novelty in mice. Next, we examined the impact produced on the same abilities by intra-VS infusion of ineffective doses of amphetamine (0.3 μg/side) in association with N-methyl-D-aspartate (NMDA) (3.125 ng/side) or α-amino-3-hydroxy-5-methylisoxazole-4-propionic acid (AMPA) (0.25 ng/side) receptor antagonist.

RESULTS

The results show that infusion of amphetamine impairs detection of spatial novelty, affecting also exploratory activity and marginally the detection of nonspatial novelty. In contrast, an association of subthreshold doses of amphetamine with NMDA or AMPA receptor antagonists exerted a selective effect on reactivity to a spatial change.

CONCLUSIONS

These findings demonstrate that enhanced DAergic activity in the VS enhances glutamate receptor antagonist-induced impairment in learning and memory.

Electroacupuncture reduces cocaine-induced seizures and mortality in mice

The aims of this study were to characterize the protective profile of electroacupuncture (EA) on cocaine-induced seizures and mortality in mice. Mice were treated with EA (2 Hz, 50 Hz, and 100 Hz), or they underwent needle insertion without anesthesia at the Dazhui (GV14) and Baihui (GV20) acupoints before cocaine administration. EA at 50 Hz applied to GV14 and GV20 significantly reduced the seizure severity induced by a single dose of cocaine (75 mg/kg; i.p.). Furthermore, needle insertion into GV14 and GV20 and EA at 2 Hz and 50 Hz at both acupoints significantly reduced the mortality rate induced by a single lethal dose of cocaine (125 mg/kg; i.p.). In the sham control group, EA at 50 Hz applied to bilateral Tianzong (SI11) acupoints had no protective effects against cocaine. In addition, EA at 50 Hz applied to GV14 and GV20 failed to reduce the incidence of seizures and mortality induced by the local anesthetic procaine. In an immunohistochemistry study, EA (50 Hz) pretreatment at GV14 and GV20 decreased cocaine (75 mg/kg; i.p.)-induced c-Fos expression in the paraventricular thalamus. While the dopamine D₃ receptor antagonist, SB-277011-A (30 mg/kg; s.c), did not by itself affect cocaine-induced seizure severity, it prevented the effects of EA on cocaine-induced seizures. These results suggest that EA alleviates cocaine-induced seizures and mortality and that the dopamine D₃ receptor is involved, at least in part, in the anticonvulsant effects of EA in mice.

The clinical relevance of neuroplasticity in corticostriatal networks during operant learning

Dopamine and glutamate serve crucial functions in neural plasticity, learning and memory, and addiction. Contemporary theories contend that these two, widely-distributed neurotransmitter systems play an integrative role in motivational and associative information processing. Combined signaling of these systems, particularly through the dopamine (DA) D1 and glutamate (Glu) N-methyl-d-aspartate receptors (NMDAR), triggers critical intracellular signaling cascades that lead to changes in chromatin structure, gene expression, synaptic plasticity, and ultimately behavior. Addictive drugs also induce long-term neuroadaptations at the molecular and genomic levels causing structural changes that alter basic connectivity. Indeed, evidence that drugs of abuse engage D1- and NMDA-mediated neuronal cascades shared with normal reward learning provides one of the most important insights from contemporary studies on the neurobiology of addiction. Such drug-induced neuroadaptations likely contribute to abnormal information processing and behavior, resulting in the poor decision-making, loss of control, and compulsivity that characterize addiction. Such features are also common to many other neuropsychiatric disorders. Behavior problems, construed as difficulties associated with operant learning and behavior, present compelling challenges and unique opportunities for their treatment that require further study. The present review highlights the integrative work of Ann E. Kelley and colleagues, demonstrating a critical role not only for NMDAR, D1 receptors (D1R), and their associated signaling cascades, but also for other Glu receptors and protein synthesis in operant learning throughout a cortico-striatal-limbic network. Recent work has extended the impact of appetitive learning to epigenetic processes. A better understanding of these processes will likely assist in discovering therapeutics to engage neural plasticity-related processes and promote functional behavioral adaptations.

Deletion of the NMDA-NR1 receptor subunit gene in the mouse nucleus accumbens attenuates apomorphine-induced dopamine D1 receptor trafficking and acoustic startle behavior

The nucleus accumbens (Acb) contains subpopulations of neurons defined by their receptor content and potential involvement in sensorimotor gating and other behaviors that are dysfunctional in schizophrenia. In Acb neurons, the NMDA NR1 (NR1) subunit is coexpressed not only with the dopamine D1 receptor (D1R), but also with the µ-opioid receptor (µ-OR), which mediates certain behaviors that are adversely impacted by schizophrenia. The NMDA-NR1 subunit has been suggested to play a role in the D1R trafficking and behavioral dysfunctions resulting from systemic administration of apomorphine, a D1R and dopamine D2 receptor agonist that impacts prepulse inhibition to auditory-evoked startle (AS). Together, this evidence suggests that the NMDA receptor may regulate D1R trafficking in Acb neurons, including those expressing µ-OR, in animals exposed to auditory startle and apomorphine. We tested this hypothesis by combining spatial-temporal gene deletion technology, dual labeling immunocytochemistry, and behavioral analysis. Deleting NR1 in Acb neurons prevented the increase in the dendritic density of plasma membrane D1Rs in single D1R and dual (D1R and µ-OR) labeled dendrites in the Acb in response to apomorphine and AS. Deleting NR1 also attenuated the decrease in AS induced by apomorphine. In the absence of apomorphine and startle, deletion of Acb NR1 diminished social interaction, without affecting novel object recognition, or open field activity. These results suggest that NR1 expression in the Acb is essential for apomorphine-induced D1R surface trafficking, as well as auditory startle and social behaviors that are impaired in multiple psychiatric disorders.

Critical role of NMDA but not opioid receptors in the acquisition of fat-conditioned flavor preferences in rats

Animals learn to prefer flavors associated with the intake of dietary fats such as corn oil (CO) solutions. We previously reported that fat-conditioned flavor preferences in rats were relatively unaffected by systemic treatment with dopamine D1 and D2 antagonsits. The present study examined whether systemic opioid (naltrexone, NTX) or NMDA (MK-801) receptor antagonists altered the acquisition and/or expression of CO-CFP. The CFP was produced by training rats to drink one novel flavor (CS+, e.g., cherry) mixed in a 3.5% CO solution and another flavor (CS-, e.g., grape) in a 0.9% CO solution. In expression studies, food-restricted rats drank these solutions in one-bottle sessions (2 h) over 10 d. Subsequent two-bottle tests with the CS+ and CS- flavors mixed in 0.9% CO solutions occurred 0.5h after systemic administration of vehicle (VEH), NTX (0.1-5 mg/kg) or MK-801 (50-200 μg/kg). Rats displayed a robust CS+ preference following VEH treatment (85-88%) which was significantly though moderately attenuated by NTX (69-70%). The lower doses of MK-801 slightly reduced the CS+ preference; the high dose blocked the CS+ preference (49%) but also markedly reduced overall CS intake. In separate acquisition studies, rats received VEH or NTX (0.1, 0.5, 1mg/kg) or MK-801 (100 μg/kg) 0.5h prior to 1-bottle training trials with CS+/3.5% CO and CS-/0.9% CO training solutions. Additional Limited VEH groups were trained with intakes limited to that of the NTX and MK-801 groups. Subsequent two-bottle CS+ vs. CS- tests were conducted without injections. Significant and persistent CS+ preferences were observed in VEH (77-84%) and Limited VEH (88%) groups. NTX treatment during training failed to block the acquisition of CO-CFP although the magnitude of the CS+ preference was reduced by 0.5 (70%) and 1.0 (72%) mg/kg doses relative to the Limited VEH treatment (88%). In contrast, MK-801 (100 μg/kg) treatment during training blocked the acquisition of the CO-CFP. These data suggest a critical role for NMDA, but not opioid receptor signaling in the acquisition of a fat conditioned flavor preferences, and at best limited involvement of NMDA and opioid receptors in the expression of a previously learned preference.

Dopamine-glutamate interplay in the ventral striatum modulates spatial learning in a receptor subtype-dependent manner

The ventral striatum (VS) is characterized by a distinctive neural architecture in which multiple corticolimbic glutamatergic (GLUergic) and mesolimbic dopaminergic (DAergic) afferents converge on the same output cell type (the medium-sized spiny neuron, MSN). However, despite the gateway function attributed to VS and its involvement in action selection and spatial navigation, as well as the evidence of physical and functional receptor-receptor interaction between different members of ionotropic GLUergic and DAergic receptors, there is no available knowledge that such reciprocal interaction may be critical in shaping the ability to learn novel spatial and non-spatial arrangement of stimuli. In this study, it was evaluated whether intra-VS bilateral infusion of either N-methyl-D-aspartate (NMDA) or α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptor-selective antagonists may suppress the ability to detect spatial or non-spatial novelty in a non-associative behavioral task. In a second set of experiments, we further examined the hypothesis that VS-mediated spatial information processing may be subserved by some preferential receptor-receptor interactions among specific GLUergic and DAergic receptor subtypes. This was assessed by concomitant intra-VS infusion of the combination between subthreshold doses of either NMDA or AMPA receptor antagonists with individual D1 or D2 receptor blockade. The results of this study highlighted the fact that NMDA or AMPA receptors are differentially involved in processing of spatial and non-spatial novelty, and showed for the first time that preferential NMDA/D1 and AMPA/D2 receptor-receptor functional communication, but not NMDA/D2 and AMPA/D1, is required for enabling learning of novel spatial information in the VS.

Melanocortin 4 receptor signaling in dopamine 1 receptor neurons is required for procedural memory learning

It is now widely recognized that exposure to palatable foods engages reward circuits that promote over-eating and facilitate the development of obesity. While the melanocortin 4 receptor (MC4R) has previously been shown to regulate food intake and energy expenditure, little is known about its role in food reward. We demonstrate that MC4R is co-expressed with the dopamine 1 receptor (D1R) in the ventral striatum. While MC4R-null mice are hyperphagic and obese, they exhibit impairments in acquisition of operant responding for a high fat reinforcement. Restoration of MC4R signaling in D1R neurons normalizes procedural learning without affecting motivation to obtain high fat diet. MC4R signaling in D1R neurons is also required for learning in a non-food-reinforced version of the cued water maze. Finally, MC4R signaling in neostriatal slices increases phosphorylation of the Thr34 residue of DARPP-32, a protein phosphatase-1 inhibitor that regulates synaptic plasticity. These data identify a novel requirement for MC4R signaling in procedural memory learning.

An NMDA antagonist in the MPOA impairs copulation and stimulus sensitization in male rats

Systemic injections of an NMDA antagonist have been shown to impair mating in male rats. One site where glutamate and its NMDA receptors may contribute to mating is the medial preoptic area (MPOA), which is vital for male sexual behavior. Glutamate is released in the MPOA during copulation, and especially at the time of ejaculation. We report here that the NMDA antagonist MK-801, microinjected into the MPOA, impaired copulatory behavior in sexually naïve as well as experienced males. In rats tested both as naïve and after sexual experience, drug treatment produced more profound impairment in naïve males. In addition, MK-801, microinjected into the MPOA before each of 7 noncopulatory exposures to receptive female rats, resulted in copulatory impairments on a drug-free test on Day 8, relative to aCSF-treated rats; their behavior was similar to that of males that had not been preexposed to females. Therefore, NMDA receptors in the MPOA contribute to the control of copulation and stimulus sensitization. Glutamate, acting via NMDA receptors, regulates many neural functions, including neuronal plasticity. This is the first demonstration that a similar mechanism in the MPOA sensitizes male rats to the stimuli from a receptive female, and thereby enhances their behavior.

Propensity to 'relapse' following exposure to cocaine cues is associated with the recruitment of specific thalamic and epithalamic nuclei

The thalamus is considered an important interface between the ventral striatopallidum and the dorsal striatum, and may therefore contribute to compulsive drug-seeking behaviour. Recent evidence suggests that the paraventricular thalamus (PVT), a dorsal midline thalamic nucleus, and the mediodorsal thalamus (MD) are involved in drug self-administration and respond to drug-associated cues. At present, however, the role of these thalamic regions in mediating cue-induced reinstatement of cocaine-seeking is unclear. Similarly, the habenula complex, part of the epithalamus, has been implicated in nicotine self-administration and cue-induced reinstatement of heroin seeking, but the role of this region in cocaine reinstatement behaviour has received little attention. Rats (n=20) were trained to self-administer cocaine in the presence of discriminative stimuli associated with drug availability (S⁺) or drug non-availability (S⁻). Once a stable level of responding was reached, lever pressing was extinguished. Animals were then tested for reinstatement and sacrificed immediately following the presentation of either the S⁻ or S⁺ discriminative stimuli, and Fos-protein expression was assessed in thalamic and epithalamic regions. Interestingly, significant variation was observed in reinstatement behaviour, allowing a comparison between high-reinstating (HR), low-reinstating (LR) and control animals. Compared with LR animals, HR animals exhibited increased Fos-protein expression in the PVT, intermediodorsal thalamus and the medial and lateral divisions of the habenula. Our data provide evidence that activation of thalamic and epithalamic nuclei is associated with propensity to reinstate to cocaine-seeking elicited by drug-related cues. We also build upon existing data highlighting the importance of the PVT in reinstatement behaviour.

Computational models of reinforcement learning: the role of dopamine as a reward signal

Reinforcement learning is ubiquitous. Unlike other forms of learning, it involves the processing of fast yet content-poor feedback information to correct assumptions about the nature of a task or of a set of stimuli. This feedback information is often delivered as generic rewards or punishments, and has little to do with the stimulus features to be learned. How can such low-content feedback lead to such an efficient learning paradigm? Through a review of existing neuro-computational models of reinforcement learning, we suggest that the efficiency of this type of learning resides in the dynamic and synergistic cooperation of brain systems that use different levels of computations. The implementation of reward signals at the synaptic, cellular, network and system levels give the organism the necessary robustness, adaptability and processing speed required for evolutionary and behavioral success.

Repeated administrations of dopamine receptor agents affect lithium-induced state-dependent learning in mice

The influence of repeated administration of dopamine receptor agents on the effect of lithium on lithium-induced state-dependent learning was examined in mice. Immediate post-training intraperitoneal (i.p.) administrations of lithium (10 and 20 m/kg) decreased the step-down latency of a single-trial inhibitory avoidance task. This was fully or partly reversed by pre-test administration of the same doses of the drug, with maximum response at the dose of 10 mg/kg, suggesting state-dependent learning was induced by lithium. Here, it has also been shown that repeated intracerebroventricular administrations of a mixed D1/D2 dopamine receptors agonist apomorphine (once daily injections of 0.5 microg/mouse for three consecutive days followed by five days of no drug treatment) increased the effect of lower doses of pre-test lithium (1.25, 2.5 and 5 mg/kg, i.p.) on the reinstatement of the step-down latency decreased by post-training lithium (10 mg/kg). On the contrary, not only repeated administrations of the dopamine D1 receptor antagonist SCH 23390 (0.5 and 1 microg/mouse) but also the dopamine D2 receptor antagonist sulpiride (0.3 and 1 microg/mouse) disrupted the state-dependent learning induced by lithium. These results suggest that state-dependent learning induced by lithium may be altered by repeated pretreatment of dopamine receptor agents.

Hormones that increase maternal responsiveness affect accumbal dopaminergic responses to pup- and food-stimuli in the female rat

The present study investigated hormonal mediation of maternal behavior and accumbal dopamine (DA) responses to pup-stimuli, as measured in microdialysis samples collected from the nucleus accumbens shell of female rats in non-homecage environment. In Experiment 1, samples were collected before and after continuous homecage pup experience from either intact postpartum or cycling females. In Experiment 2, samples were collected before and after responding maternally in homecage from ovariectomized females given either parturient-like hormone or sham treatments. After baseline sample collection in the dialysis chamber, pup and food stimuli were individually presented to females. Upon sampling completion, all animals were placed back into their homecage with donor pups for several days, and then the sample collection procedure was repeated. Prior to stimulus presentation, postpartum and hormone-treated females had decreased basal DA release compared to their controls. In response to pup stimuli, only postpartum and hormone-treated females had increased DA release compared to basal release (both sampling days). In response to food stimuli, all females had increased DA responses from basal; although there were group differences on the initial day of sampling. Findings suggest that hormones associated with inducing maternal behavior in the postpartum rat play a significant role in modifying accumbal dopaminergic responses on first exposure to pup stimuli in the rat. However, the postpartum experience provides further modifications to this brain region to promote DA responses to pup stimuli.

Involvement of amygdala dopamine and nucleus accumbens NMDA receptors in ethanol-seeking behavior in mice

Although progress has been made identifying neural mechanisms underlying ethanol's primary reinforcing effects, few studies have examined the mechanisms mediating ethanol-induced conditioned effects. A recent lesion study suggests that expression of ethanol-conditioned behaviors depends upon an intact amygdala and nucleus accumbens core. However, specific mechanisms within these nuclei are unknown. In the present experiments, we used site-specific microinfusions of dopamine and NMDA receptor antagonists to examine the roles of accumbens and amygdala in the expression of ethanol conditioned place preference (CPP) in mice. In experiments 1 and 2, a D1/D2/D3 receptor antagonist (flupenthixol) was infused into accumbens or amygdala before testing, whereas experiment 3 used pretest infusions of an NMDA antagonist (AP-5) to examine the role of intra-accumbens NMDA receptors. Dopamine antagonism of accumbens was without effect, but intra-amygdala infusions of flupenthixol blocked CPP expression. Moreover, this effect was dependent upon dopamine antagonism within the basolateral nucleus but not the central nucleus of the amygdala. Antagonism of NMDA receptors in accumbens also blocked CPP expression. The present findings suggest that expression of the ethanol-conditioned response depends upon amygdala dopamine and accumbens NMDA receptors. These are the first studies in any species to show a role for amygdala dopamine receptors and the first studies in mice to implicate accumbens NMDA receptors in ethanol-induced conditioned effects.

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Here we challenge the view that reward-guided learning is solely controlled by the mesoaccumbens pathway arising from dopaminergic neurons in the ventral tegmental area and projecting to the nucleus accumbens. This widely accepted view assumes that reward is a monolithic concept, but recent work has suggested otherwise. It now appears that, in reward-guided learning, the functions of ventral and dorsal striata, and the cortico-basal ganglia circuitry associated with them, can be dissociated. Whereas the nucleus accumbens is necessary for the acquisition and expression of certain appetitive Pavlovian responses and contributes to the motivational control of instrumental performance, the dorsal striatum is necessary for the acquisition and expression of instrumental actions. Such findings suggest the existence of multiple independent yet interacting functional systems that are implemented in iterating and hierarchically organized cortico-basal ganglia networks engaged in appetitive behaviors ranging from Pavlovian approach responses to goal-directed instrumental actions controlled by action-outcome contingencies.

Acute and chronic dopamine receptor stimulation modulates AMPA receptor trafficking in nucleus accumbens neurons cocultured with prefrontal cortex neurons

Postsynaptic interactions between dopamine (DA) and glutamate receptors in the nucleus accumbens (NAc) are critical for addiction. To determine the effect of acute and repeated DA receptor stimulation on AMPA receptor (AMPAR) synaptic targeting in medium spiny NAc neurons, we developed a model system consisting of rat NAc neurons cocultured with prefrontal cortex neurons from enhanced green fluorescent protein-expressing mice. Cortical neurons restore excitatory input onto NAc neurons but are distinguishable based on fluorescence. First, we showed that brief D1-like agonist exposure increased AMPAR insertion onto extrasynaptic regions of NAc neuronal processes through a mechanism requiring protein kinase A. This facilitated the Ca2+/calmodulin dependent protein kinase II (CaMKII)-dependent synaptic incorporation of AMPARs in response to subsequent NMDA receptor (NMDAR) stimulation. Through this mechanism, DA may promote reward- and drug-related plasticity in the NAc. Then, to model effects of repeated in vivo cocaine exposure, we treated cocultures with DA (1 microm, 30 min) on days 7, 9, and 11 in culture. On day 15, NAc neurons exhibited increased synaptic AMPAR levels. This was associated with CaMKII activation and was blocked by the CaMKII inhibitor KN-93 (N-[2-[N-(4-chlorocinnamyl)-N-methylaminomethyl]phenyl]-N-(2-hydroxyethyl)-4-methoxybenzenesulfonamide phosphate salt). Furthermore, D1-like agonist exposure on day 15 no longer increased AMPAR surface expression. This refractoriness was associated with decreased D1 receptor surface expression. NMDAR surface expression was not altered by acute or repeated DA receptor stimulation. These results suggest that (1) after repeated DA treatment, NAc neurons are more responsive to glutamate inputs but D(1)-like receptor regulation of plasticity is impaired, and (2) NAc/prefrontal cortex cocultures are useful for studying dopamine-induced neuroadaptations.

The structural basis for mapping behavior onto the ventral striatum and its subdivisions

The striatum can be divided into dorsal (caudate-putamen) and ventral parts. In the ventral division, the nucleus accumbens, which subserves adaptive and goal-directed behaviors, is further subdivided into shell and core. Accumbal neurons show different types of experience-dependent plasticity: those in the core seem to discriminate the motivational value of conditioned stimuli, features that rely on the integration of information and enhanced synaptic plasticity at the many spines on these cells, whereas shell neurons seem to be involved with the release of predetermined behavior patterns in relation to unconditioned stimuli, and the behavioral consequences of repeated administration of addictive drugs. In the core, the principal neurons are medium sized and densely spiny, but in the medial shell, these same neurons are much smaller and their dendrites, significantly less spiny, suggesting that morphological differences could mediate unique neuroadaptations associated with each region. This review is focused on evaluating the structural differences in nucleus accumbens core and shell neurons and discusses how such different morphologies could underlie distinguishable behavioral processes.

Chronic administration of morphine is associated with a decrease in surface AMPA GluR1 receptor subunit in dopamine D1 receptor expressing neurons in the shell and non-D1 receptor expressing neurons in the core of the rat nucleus accumbens

The nucleus accumbens (Acb) is an extensively studied neuroanatomical substrate of opiate reward and the neural plasticity associated with chronic opioid use. The cellular mechanisms mediating opioid-dependent plasticity are uncertain, however AMPA-type glutamate receptor trafficking in dopamine D1 dopamine receptor (D1R) expressing neurons may be a potential cellular pathway for these adaptations, although there is no evidence for this possibility. Immunogold electron microscopy was used to quantify the surface expression of the AMPA GluR1 subunit in dendritic profiles of neurons in the Acb in response to intermittent 14-day non-contingent injections of escalating doses of morphine, a model that parallels opioid self-administration. To determine if changes in GluR1 trafficking occurred in neurons potentially sensitive to dopamine-induced D1R activation, immunoperoxidase labeling of D1R was combined with immunogold labeling of GluR1. Immunogold quantification was performed in two distinct Acb subregions, the shell, an area involved in processing incentive salience related to rewarding stimuli, and the core, an area involved in reward-seeking behaviors. We provide the first report that chronic morphine administration is associated with a receptor-phenotypic decrease in surface trafficking of GluR1 in Acb subregions. When compared to saline injected animals, morphine produced a decrease in plasma membrane GluR1 labeling in medium- and large-sized D1R expressing dendritic profiles in the Acb shell. In contrast, in the Acb core, surface GluR1 was decreased in small-sized dendrites that did not express the dopamine receptor. These results indicate that chronic intermittent injection of escalating doses of morphine is accompanied by ultrastructural plasticity of GluR1 in neurons that are responsive to glutamate and dopamine-induced D1R activation in the Acb shell, and neurons capable of responding to glutamate but not D1R receptor stimulation in the Acb core. Thus, AMPA receptor trafficking associated with chronic opiate exposure in functionally distinct areas of the Acb may be distinguished by D1R receptor activation, suggesting the potential for differing neural substrates of reward and motor aspects of addictive processes involving glutamate and dopamine signaling.

Behavioral functions of the mesolimbic dopaminergic system: an affective neuroethological perspective

The mesolimbic dopaminergic (ML-DA) system has been recognized for its central role in motivated behaviors, various types of reward, and, more recently, in cognitive processes. Functional theories have emphasized DA's involvement in the orchestration of goal-directed behaviors and in the promotion and reinforcement of learning. The affective neuroethological perspective presented here views the ML-DA system in terms of its ability to activate an instinctual emotional appetitive state (SEEKING) evolved to induce organisms to search for all varieties of life-supporting stimuli and to avoid harms. A description of the anatomical framework in which the ML system is embedded is followed by the argument that the SEEKING disposition emerges through functional integration of ventral basal ganglia (BG) into thalamocortical activities. Filtering cortical and limbic input that spreads into BG, DA transmission promotes the "release" of neural activity patterns that induce active SEEKING behaviors when expressed at the motor level. Reverberation of these patterns constitutes a neurodynamic process for the inclusion of cognitive and perceptual representations within the extended networks of the SEEKING urge. In this way, the SEEKING disposition influences attention, incentive salience, associative learning, and anticipatory predictions. In our view, the rewarding properties of drugs of abuse are, in part, caused by the activation of the SEEKING disposition, ranging from appetitive drive to persistent craving depending on the intensity of the affect. The implications of such a view for understanding addiction are considered, with particular emphasis on factors predisposing individuals to develop compulsive drug seeking behaviors.

Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement

Ventral tegmental area (VTA) neuron firing precedes behaviors elicited by reward-predictive sensory cues and scales with the magnitude and unpredictability of received rewards. These patterns are consistent with roles in the performance of learned appetitive behaviors and in positive reinforcement, respectively. The VTA includes subpopulations of neurons with different afferent connections, neurotransmitter content, and projection targets. Because the VTA and substantia nigra pars compacta are the sole sources of striatal and limbic forebrain dopamine, measurements of dopamine release and manipulations of dopamine function have provided critical evidence supporting a VTA contribution to these functions. However, the VTA also sends GABAergic and glutamatergic projections to the nucleus accumbens and prefrontal cortex. Furthermore, VTA-mediated but dopamine-independent positive reinforcement has been demonstrated. Consequently, identifying the neurotransmitter content and projection target of VTA neurons recorded in vivo will be critical for determining their contribution to learned appetitive behaviors.

When administered into the nucleus accumbens core or shell, the NMDA receptor antagonist AP-5 reinstates cocaine-seeking behavior in the rat

Nucleus accumbens glutamate transmission plays a critical role in cocaine priming-induced reinstatement of drug seeking. Previous studies have demonstrated that systemic or intra-accumbens shell administration of an NMDA receptor antagonist reinstates cocaine-seeking behavior. However, it is unclear if antagonizing NMDA receptors in the nucleus accumbens core or shell subregions will differentially affect cocaine reinstatement. To investigate this possibility, we microinjected the competitive NMDA receptor antagonist AP-5 (0, 3 or 30 microg) into either the nucleus accumbens core or shell and assessed the reinstatement of cocaine-seeking behavior. When microinjected into the shell, both doses of AP-5 produced reinstatement of cocaine seeking. In contrast, when administered into the core, only the highest dose of AP-5 reinstated cocaine-seeking behavior; moreover, the magnitude of this effect was substantially less than when AP-5 was administered into the shell. This study provides evidence that pharmacological antagonism of NMDA receptors in the nucleus accumbens core or shell promotes the reinstatement of cocaine seeking.

Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats

RATIONALE

The prediction error hypothesis of dopamine action states that dopamine signals are necessary for the brain to update the predictive significance of cues. Yet, little is known whether D1 or D2 receptor-mediated signals in the nucleus accumbens core (AcbC) are required to learn a reversal of the predictive significance of cues.

OBJECTIVE

Here we examined the effects of a selective D1 or D2 receptor blockade in the AcbC on learning a reversal of previously acquired cue-reward magnitude contingencies.

MATERIALS AND METHODS

Rats were trained on a reaction time (RT) task demanding conditioned lever release with discriminative visual cues signalling in advance the upcoming reward magnitude (one or five food pellets). After acquisition, RTs were guided by cue-associated reward magnitudes, i.e. RTs of responses were significantly shorter for expected high vs low reward. Thereafter, cue-reward magnitude contingencies were reversed. Reversal learning was tested for 12 daily sessions with intra-AcbC micro-infusions being given on sessions 1-6. Subjects received pre-trial infusions of the selective D1 or D2 receptor antagonists, SCH23390 (0.5, 2 microg per side) or raclopride (1, 4 microg per side), or vehicle (0.5 microl).

RESULTS

Intra-AcbC infusion of SCH23390 (0.5, 2 microg) or raclopride (1, 4 microg) did not inhibit discrimination reversal learning, but the higher dose of each drug increased RTs of instrumental responses.

CONCLUSIONS

In a visual discrimination task as used here, D1 and D2 receptor-mediated signals in the AcbC seem to be unnecessary in updating the reward-predictive significance of cues, rather, they serve to activate instrumental behaviour.

The nucleus accumbens as part of a basal ganglia action selection circuit

BACKGROUND

The nucleus accumbens is the ventral extent of the striatum, the main input nucleus of the basal ganglia. Recent hypotheses propose that the accumbens and its dopamine projection from the midbrain contribute to appetitive behaviors required to obtain reward. However, the specific nature of this contribution is unclear. In contrast, significant advances have been made in understanding the role of the dorsal striatum in action selection and decision making.

OBJECTIVE

In order to develop a hypothesis of the role of nucleus accumbens dopamine in action selection, the physiology and behavioral pharmacology of the nucleus accumbens are compared to those of the dorsal striatum.

HYPOTHESES

Three hypotheses concerning the role of dopamine in these structures are proposed: (1) that dopamine release in the dorsal striatum serves to facilitate the ability to respond appropriately to temporally predictable stimuli (that is, stimuli that are so predictable that animals engage in anticipatory behavior just prior to the stimulus); (2) that dopamine in the nucleus accumbens facilitates the ability to respond to temporally unpredictable stimuli (which require interruption of ongoing behavior); and (3) that accumbens neurons participate in action selection in response to such stimuli by virtue of their direct (monosynaptic inhibitory) and indirect (polysynaptic excitatory) projections to basal ganglia output nuclei.

The debate over dopamine's role in reward: the case for incentive salience

INTRODUCTION

Debate continues over the precise causal contribution made by mesolimbic dopamine systems to reward. There are three competing explanatory categories: 'liking', learning, and 'wanting'. Does dopamine mostly mediate the hedonic impact of reward ('liking')? Does it instead mediate learned predictions of future reward, prediction error teaching signals and stamp in associative links (learning)? Or does dopamine motivate the pursuit of rewards by attributing incentive salience to reward-related stimuli ('wanting')? Each hypothesis is evaluated here, and it is suggested that the incentive salience or 'wanting' hypothesis of dopamine function may be consistent with more evidence than either learning or 'liking'. In brief, recent evidence indicates that dopamine is neither necessary nor sufficient to mediate changes in hedonic 'liking' for sensory pleasures. Other recent evidence indicates that dopamine is not needed for new learning, and not sufficient to directly mediate learning by causing teaching or prediction signals. By contrast, growing evidence indicates that dopamine does contribute causally to incentive salience. Dopamine appears necessary for normal 'wanting', and dopamine activation can be sufficient to enhance cue-triggered incentive salience. Drugs of abuse that promote dopamine signals short circuit and sensitize dynamic mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Such drugs interact with incentive salience integrations of Pavlovian associative information with physiological state signals. That interaction sets the stage to cause compulsive 'wanting' in addiction, but also provides opportunities for experiments to disentangle 'wanting', 'liking', and learning hypotheses. Results from studies that exploited those opportunities are described here.

CONCLUSION

In short, dopamine's contribution appears to be chiefly to cause 'wanting' for hedonic rewards, more than 'liking' or learning for those rewards.

Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding

BACKGROUND AND OBJECTIVES

The idea that nucleus accumbens (Acb) dopamine transmission contributes to the neural mediation of reward, at least in a general sense, has achieved wide acceptance. Nevertheless, debate remains over the precise nature of dopamine's role in reward and even over the nature of reward itself. In the present article, evidence is reviewed from studies of food intake, feeding microstructure, instrumental responding for food reinforcement, and dopamine efflux associated with feeding, which suggests that reward processing in the Acb is best understood as an interaction among distinct processes coded by discrete neurotransmitter systems.

RESULTS

In agreement with several theories of Acb dopamine function, it is proposed here that allocation of motor effort in seeking food or food-associated conditioned stimuli can be dissociated from computations relevant to the hedonic evaluation of food during the consummatory act. The former appears to depend upon Acb dopamine transmission and the latter upon striatal opioid peptide release. Moreover, dopamine transmission may play a role in 'stamping in' associations between motor acts and goal attainment and perhaps also neural representations corresponding to rewarding outcomes. Finally, evidence is reviewed that amino acid transmission specifically in the Acb shell acts as a central 'circuit breaker' to flexibly enable or terminate the consummatory act, via descending connections to hypothalamic feeding control systems.

CONCLUSIONS

The heuristic framework outlined above may help explain why dopamine-compromising manipulations that strongly diminish instrumental goal-seeking behaviors leave consummatory activity relatively unaffected.

A "good parent" function of dopamine: transient modulation of learning and performance during early stages of training

While extracellular dopamine (DA) concentrations are increased by a wide category of salient stimuli, there is evidence to suggest that DA responses to primary and conditioned rewards may be distinct from those elicited by other types of salient events. A reward-specific mode of neuronal responding would be necessary if DA acts to strengthen behavioral response tendencies under particular environmental conditions or to set current environmental inputs as goals that direct approach responses. As described in this review, DA critically mediates both the acquisition and expression of learned behaviors during early stages of training, however, during later stages, at least some forms of learned behavior become independent of (or less dependent upon) DA transmission for their expression.

Impairment in consolidation of learned place preference following dopaminergic neurotoxicity in mice is ameliorated by N-acetylcysteine but not D1 and D2 dopamine receptor agonists

Some of the major concerns related to methamphetamine (METH) abuse are the neuronal damage inflicted at dopamine (DA) nerve terminals and the cognitive deficits observed in human METH abusers. We have shown that a high dose of METH selectively depleted dopaminergic markers in striatum, frontal cortex and amygdala of Swiss Webster mice, and impaired learned place preference. In this study, we investigated whether deficits in consolidation of place learning, as a consequence of METH neurotoxicity, underlie the underperformance of cocaine conditioned place preference (CPP). Administration of METH (5 mg/kg x 3) to Swiss Webster mice decreased striatal tyrosine hydroxylase (TH) immunoreactive neurons and significantly increased glial fibrillary acidic protein (GFAP) expression, confirming the neurotoxic potential of METH in mice. This treatment significantly attenuated the establishment of cocaine (15 mg/kg) CPP compared to control. To investigate whether manipulation of the consolidation phase improves learned place preference, mice were trained by cocaine and received daily post-training injections of DA receptor agonists or N-acetylcysteine (NAC). As memory consolidation occurs shortly after training, drugs were administered either immediately or 2 h post-training. Immediate post-training administration of the D1 DA receptor agonist SKF38393 (5, 10, and 20 mg/kg) or the D2 DA receptor agonist quinpirole (0.25, 0.5, and 1.0 mg/kg) did not improve the establishment of CPP following METH neurotoxicity. However, immediate but not delayed NAC administration (50 and 100 mg/kg) enhanced cocaine CPP following METH neurotoxicity and had no effect on control CPP. The levels of the reduced form of glutathione (GSH) in striatum, amygdala, hippocampus and frontal cortex were significantly lower in METH-treated mice compared to control during the period of CPP training. Acute and repeated administration of NAC to METH-treated mice restored the decreased brain GSH but had no effect on controls. Results suggest that METH-induced dopaminergic neurotoxicity is associated with impairment of consolidation of learned place preference, and that this impairment is improved by immediate post-training administration of the glutathione precursor NAC and not by D1 or D2 DA receptor agonists. Restoration of brain glutathione levels immediately post-training may facilitate the consolidation process.