Response-reinforcement learning is dependent on N-methyl-D-aspartate receptor activation in the nucleus accumbens core

The nucleus accumbens in reward and aversion processing: insights and implications

The nucleus accumbens (NAc), a central component of the brain's reward circuitry, has been implicated in a wide range of behaviors and emotional states. Emerging evidence, primarily drawing from recent rodent studies, suggests that the function of the NAc in reward and aversion processing is multifaceted. Prolonged stress or drug use induces maladaptive neuronal function in the NAc circuitry, which results in pathological conditions. This review aims to provide comprehensive and up-to-date insights on the role of the NAc in motivated behavior regulation and highlights areas that demand further in-depth analysis. It synthesizes the latest findings on how distinct NAc neuronal populations and pathways contribute to the processing of opposite valences. The review examines how a range of neuromodulators, especially monoamines, influence the NAc's control over various motivational states. Furthermore, it delves into the complex underlying mechanisms of psychiatric disorders such as addiction and depression and evaluates prospective interventions to restore NAc functionality.

Activation of Metabotropic Glutamate Receptor 3 Modulates Thalamo-accumbal Transmission and Rescues Schizophrenia-Like Physiological and Behavioral Deficits

BACKGROUND

Polymorphisms in the gene encoding for metabotropic glutamate receptor 3 (mGlu3) are associated with an increased likelihood of schizophrenia diagnosis and can predict improvements in negative symptoms following treatment with antipsychotics. However, the mechanisms by which mGlu3 can regulate brain circuits involved in schizophrenia pathophysiology are not clear.

METHODS

We employed selective pharmacological tools and a variety of approaches including whole-cell patch-clamp electrophysiology, slice optogenetics, and fiber photometry to investigate the effects of mGlu3 activation on phencyclidine (PCP)-induced impairments in thalamo-accumbal transmission and sociability deficits. A chemogenetic approach was used to evaluate the role of thalamo-accumbal transmission in PCP-induced sociability deficits.

RESULTS

We first established that PCP treatment augmented excitatory transmission onto dopamine D1 receptor-expressing medium spiny neurons (D1-MSNs) in the nucleus accumbens (NAc) and induced sociability deficits. Our studies revealed a selective increase in glutamatergic synaptic transmission from thalamic afferents to D1-MSNs in the NAc shell. Chemogenetic silencing of thalamo-accumbal inputs rescued PCP-induced sociability deficits. Pharmacological activation of mGlu3 normalized PCP-induced impairments in thalamo-accumbal transmission and sociability deficits. Mechanistic studies revealed that mGlu3 activation induced robust long-term depression at synapses from the thalamic projections onto D1-MSNs in the NAc shell.

CONCLUSIONS

These data demonstrate that activation of mGlu3 decreases thalamo-accumbal transmission and thereby rescues sociability deficits in mouse modeling schizophrenia-like symptoms. These findings provide novel insights into the NAc-specific mechanisms and suggest that agents modulating glutamatergic signaling in the NAc may provide a promising approach for treating negative symptoms in schizophrenia.

DeepBiomarker2: Prediction of alcohol and substance use disorder risk in post-traumatic stress disorder patients using electronic medical records and multiple social determinants of health

Introduction

Prediction of high-risk events amongst patients with mental disorders is critical for personalized interventions. In our previous study, we developed a deep learning-based model, DeepBiomarker by utilizing electronic medical records (EMR) to predict the outcomes of patients with suicide-related events in post-traumatic stress disorder (PTSD) patients.

Methods

We improved our deep learning model to develop DeepBiomarker2 through data integration of multimodal information: lab tests, medication use, diagnosis, and social determinants of health (SDoH) parameters (both individual and neighborhood level) from EMR data for outcome prediction. We further refined our contribution analysis for identifying key factors. We applied DeepBiomarker2 to analyze EMR data of 38,807 patients from University of Pittsburgh Medical Center diagnosed with PTSD to determine their risk of developing alcohol and substance use disorder (ASUD).

Results

DeepBiomarker2 predicted whether a PTSD patient will have a diagnosis of ASUD within the following 3 months with a c-statistic (receiver operating characteristic AUC) of 0·93. We used contribution analysis technology to identify key lab tests, medication use and diagnosis for ASUD prediction. These identified factors imply that the regulation of the energy metabolism, blood circulation, inflammation, and microbiome is involved in shaping the pathophysiological pathways promoting ASUD risks in PTSD patients. Our study found protective medications such as oxybutynin, magnesium oxide, clindamycin, cetirizine, montelukast and venlafaxine all have a potential to reduce risk of ASUDs.

Discussion

DeepBiomarker2 can predict ASUD risk with high accuracy and can further identify potential risk factors along with medications with beneficial effects. We believe that our approach will help in personalized interventions of PTSD for a variety of clinical scenarios.

Alcohol and cannabinoid binges and daily exposure to nicotine in adolescent/young adult rats induce sex-dependent long-term appetitive instrumental learning impairment

Adolescence is a critical developmental period, concerning anatomical, neurochemical and behavioral changes. Moreover, adolescents are more sensitive to the long-term deleterious effects of drug abuse. Binge-like consumption of alcohol and marijuana, along with tobacco smoking, is a dangerous pattern often observed in adolescents during weekends. Nevertheless, the long-term effect of their adolescent co-exposure has not been yet experimentally investigated. Long-Evans adolescent male (n = 20) and female (n = 20) rats from postnatal day 30 (P30) until P60 were daily treated with nicotine (0.3 mg/kg, i.p.), and, on two consecutive 'binging days' per week (for a total of eight times), received an intragastric ethanol solution (3 g/kg) and an intraperitoneal (i.p.) dose of cannabinoid 1/2 receptor agonist WIN55,212-2 (1.2 mg/kg). These rats were tested after treatment discontinuation at > P90 for associative food-rewarded operant learning in the two-lever conditioning chambers for six consecutive days on a fixed ratio 1 (FR1) schedule followed by another six days of daily FR2 schedule testing, after 42 days rest. We found the main effects of sex x treatment interactions in FR1 but not in FR2 experiments. Treated females show attenuated operant responses for food pellets during all FR1 and the FR2 schedule, whilst the treated males show an impairment in FR2 but not in the FR1 schedule. Moreover, the treated females' percentage of learners was significantly lower than female controls in FR1 while treated males were lower than controls in FR2. Our findings suggest that intermittent adolescent abuse of common drugs, such as alcohol and marijuana, and chronic tobacco exposure can cause significant long-term effects on motivation for natural reinforcers later in adulthood in both sexes. Females appear to be sensitive earlier to the deleterious effects of adolescent polydrug abuse, with both sexes having an increased likelihood of developing lifelong brain alterations.

Unraveling the mysteries of dendritic spine dynamics: Five key principles shaping memory and cognition

Recent research extends our understanding of brain processes beyond just action potentials and chemical transmissions within neural circuits, emphasizing the mechanical forces generated by excitatory synapses on dendritic spines to modulate presynaptic function. From in vivo and in vitro studies, we outline five central principles of synaptic mechanics in brain function: P1: Stability - Underpinning the integral relationship between the structure and function of the spine synapses. P2: Extrinsic dynamics - Highlighting synapse-selective structural plasticity which plays a crucial role in Hebbian associative learning, distinct from pathway-selective long-term potentiation (LTP) and depression (LTD). P3: Neuromodulation - Analyzing the role of G-protein-coupled receptors, particularly dopamine receptors, in time-sensitive modulation of associative learning frameworks such as Pavlovian classical conditioning and Thorndike's reinforcement learning (RL). P4: Instability - Addressing the intrinsic dynamics crucial to memory management during continual learning, spotlighting their role in "spine dysgenesis" associated with mental disorders. P5: Mechanics - Exploring how synaptic mechanics influence both sides of synapses to establish structural traces of short- and long-term memory, thereby aiding the integration of mental functions. We also delve into the historical background and foresee impending challenges.

Removal of reinforcement improves instrumental performance in humans by decreasing a general action bias rather than unmasking learnt associations

Performance during instrumental learning is commonly believed to reflect the knowledge that has been acquired up to that point. However, recent work in rodents found that instrumental performance was enhanced during periods when reinforcement was withheld, relative to periods when reinforcement was provided. This suggests that reinforcement may mask acquired knowledge and lead to impaired performance. In the present study, we investigated whether such a beneficial effect of removing reinforcement translates to humans. Specifically, we tested whether performance during learning was improved during non-reinforced relative to reinforced task periods using signal detection theory and a computational modelling approach. To this end, 60 healthy volunteers performed a novel visual go/no-go learning task with deterministic reinforcement. To probe acquired knowledge in the absence of reinforcement, we interspersed blocks without feedback. In these non-reinforced task blocks, we found an increased d', indicative of enhanced instrumental performance. However, computational modelling showed that this improvement in performance was not due to an increased sensitivity of decision making to learnt values, but to a more cautious mode of responding, as evidenced by a reduction of a general response bias. Together with an initial tendency to act, this is sufficient to drive differential changes in hit and false alarm rates that jointly lead to an increased d'. To conclude, the improved instrumental performance in the absence of reinforcement observed in studies using asymmetrically reinforced go/no-go tasks may reflect a change in response bias rather than unmasking latent knowledge.

Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning

How are actions linked with subsequent outcomes to guide choices? The nucleus accumbens, which is implicated in this process, receives glutamatergic inputs from the prelimbic cortex and midline regions of the thalamus. However, little is known about whether and how representations differ across these input pathways. By comparing these inputs during a reinforcement learning task in mice, we discovered that prelimbic cortical inputs preferentially represent actions and choices, whereas midline thalamic inputs preferentially represent cues. Choice-selective activity in the prelimbic cortical inputs is organized in sequences that persist beyond the outcome. Through computational modeling, we demonstrate that these sequences can support the neural implementation of reinforcement-learning algorithms, in both a circuit model based on synaptic plasticity and one based on neural dynamics. Finally, we test and confirm a prediction of our circuit models by direct manipulation of nucleus accumbens input neurons.

Phasic stimulation in the nucleus accumbens enhances learning after traumatic brain injury

Traumatic brain injury (TBI) is a significant cause of morbidity and mortality worldwide. Despite improvements in survival, treatments that improve functional outcome remain lacking. There is, therefore, a pressing need to develop novel treatments to improve functional recovery. Here, we investigated task-matched deep-brain stimulation of the nucleus accumbens (NAc) to augment reinforcement learning in a rodent model of TBI. We demonstrate that task-matched deep brain stimulation (DBS) of the NAc can enhance learning following TBI. We further demonstrate that animals receiving DBS exhibited greater behavioral improvement and enhanced neural proliferation. Treated animals recovered to an uninjured behavioral baseline and showed retention of improved performance even after stimulation was stopped. These results provide encouraging early evidence for the potential of NAc DBS to improve functional outcomes following TBI and that its effects may be broad, with alterations in neurogenesis and synaptogenesis.

A behavioural correlate of the synaptic eligibility trace in the nucleus accumbens

Reward reinforces the association between a preceding sensorimotor event and its outcome. Reinforcement learning (RL) theory and recent brain slice studies explain the delayed reward action such that synaptic activities triggered by sensorimotor events leave a synaptic eligibility trace for 1 s. The trace produces a sensitive period for reward-related dopamine to induce synaptic plasticity in the nucleus accumbens (NAc). However, the contribution of the synaptic eligibility trace to behaviour remains unclear. Here we examined a reward-sensitive period to brief pure tones with an accurate measurement of an effective timing of water reward in head-fixed Pavlovian conditioning, which depended on the plasticity-related signaling in the NAc. We found that the reward-sensitive period was within 1 s after the pure tone presentation and optogenetically-induced presynaptic activities at the NAc, showing that the short reward-sensitive period was in conformity with the synaptic eligibility trace in the NAc. These findings support the application of the synaptic eligibility trace to construct biologically plausible RL models.

Anticipation: An Essential Feature of Anhedonia

The following essay addresses the evolution of the term "anhedonia" as a key construct in biological psychiatry, especially as it pertains to positive emotional and motivational states central to mental health and well-being. In its strictest definition, anhedonia was intended to convey an inability to experience "pleasure" derived from ingestion of sweet tastes or the experience of pleasant odors and tactile sensations, among a host of positive sensations. However, this definition has proved to be too restrictive to capture the complexity of key psychological factors linked to major depression, schizophrenia, and substance use disorders it was originally intended to address. Despite the appeal of the elegant simplicity of the term anhedonia, its limitations soon became apparent when used to explain psychological constructs including aspects of learning, memory, and incentive motivation that are major determinants of success in securing the necessities of life. Accordingly, the definition of anhedonia has morphed into a much broader term that includes key roles in the disturbance of motivation in the form of anergia, impaired incentive motivation, along with deficits in associative learning and key aspects of memory, on which the ability to predict the consequences of one's actions are based. Here we argue that it is this latter capacity, namely predicting the likely consequences of motivated behavior, which can be termed "anticipation," that is especially important in the key deficits implied by the general term anhedonia in the context of neuropsychiatric conditions.

Astrocytes in Addictive Disorders

Astroglia are key regulators of synaptic function, playing central roles in homeostatic ion buffering, energy dynamics, transmitter uptake, maintenance of neurotransmitter pools, and regulation of synaptic plasticity through release of neuroactive chemicals. Given the myriad of crucial homeostatic and signaling functions attributed to astrocytes and the variety of neurotransmitter receptors expressed by astroglia, they serve as prime cellular candidates for establishing maladaptive synaptic plasticity following drug exposure. Initial studies on astroglia and addiction have placed drug-mediated disruptions in the homeostatic regulation of glutamate as a central aspect of relapse vulnerability. However, the generation of sophisticated tools to study and manipulate astroglia have proven that the interaction between addictive substances, astroglia, and relapse-relevant synaptic plasticity extends far beyond the homeostatic regulation of glutamate. Here we present astroglial systems impacted by drug exposure and discuss how changes in astroglial biology contribute to addiction biology.

Neuroplasticity and Multilevel System of Connections Determine the Integrative Role of Nucleus Accumbens in the Brain Reward System

A growing body of evidence suggests that nucleus accumbens (NAc) plays a significant role not only in the physiological processes associated with reward and satisfaction but also in many diseases of the central nervous system. Summary of the current state of knowledge on the morphological and functional basis of such a diverse function of this structure may be a good starting point for further basic and clinical research. The NAc is a part of the brain reward system (BRS) characterized by multilevel organization, extensive connections, and several neurotransmitter systems. The unique role of NAc in the BRS is a result of: (1) hierarchical connections with the other brain areas, (2) a well-developed morphological and functional plasticity regulating short- and long-term synaptic potentiation and signalling pathways, (3) cooperation among several neurotransmitter systems, and (4) a supportive role of neuroglia involved in both physiological and pathological processes. Understanding the complex function of NAc is possible by combining the results of morphological studies with molecular, genetic, and behavioral data. In this review, we present the current views on the NAc function in physiological conditions, emphasizing the role of its connections, neuroplasticity processes, and neurotransmitter systems.

Opposing roles for striatonigral and striatopallidal neurons in dorsolateral striatum in consolidating new instrumental actions

Comparatively little is known about how new instrumental actions are encoded in the brain. Using whole-brain c-Fos mapping, we show that neural activity is increased in the anterior dorsolateral striatum (aDLS) of mice that successfully learn a new lever-press response to earn food rewards. Post-learning chemogenetic inhibition of aDLS disrupts consolidation of the new instrumental response. Similarly, post-learning infusion of the protein synthesis inhibitor anisomycin into the aDLS disrupts consolidation of the new response. Activity of D1 receptor-expressing medium spiny neurons (D1-MSNs) increases and D2-MSNs activity decreases in the aDLS during consolidation. Chemogenetic inhibition of D1-MSNs in aDLS disrupts the consolidation process whereas D2-MSN inhibition strengthens consolidation but blocks the expression of previously learned habit-like responses. These findings suggest that D1-MSNs in the aDLS encode new instrumental actions whereas D2-MSNs oppose this new learning and instead promote expression of habitual actions.

Integrating the Roles of Midbrain Dopamine Circuits in Behavior and Neuropsychiatric Disease

Dopamine (DA) is a behaviorally and clinically diverse neuromodulator that controls CNS function. DA plays major roles in many behaviors including locomotion, learning, habit formation, perception, and memory processing. Reflecting this, DA dysregulation produces a wide variety of cognitive symptoms seen in neuropsychiatric diseases such as Parkinson’s, Schizophrenia, addiction, and Alzheimer’s disease. Here, we review recent advances in the DA systems neuroscience field and explore the advancing hypothesis that DA’s behavioral function is linked to disease deficits in a neural circuit-dependent manner. We survey different brain areas including the basal ganglia’s dorsomedial/dorsolateral striatum, the ventral striatum, the auditory striatum, and the hippocampus in rodent models. Each of these regions have different reported functions and, correspondingly, DA’s reflecting role in each of these regions also has support for being different. We then focus on DA dysregulation states in Parkinson’s disease, addiction, and Alzheimer’s Disease, emphasizing how these afflictions are linked to different DA pathways. We draw upon ideas such as selective vulnerability and region-dependent physiology. These bodies of work suggest that different channels of DA may be dysregulated in different sets of disease. While these are great advances, the fine and definitive segregation of such pathways in behavior and disease remains to be seen. Future studies will be required to define DA’s necessity and contribution to the functional plasticity of different striatal regions.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Shifting motivational states: The effects of nucleus accumbens dopamine and opioid receptor activation on a modified effort-based choice task

The nucleus accumbens (NAc) is critical for regulating the appetitive and consummatory phases of motivated behavior. These experiments examined the effects of dopamine and opioid receptor manipulations within the NAc during an effort-based choice task that allowed for simultaneous assessment of both phases of motivation. Male Sprague-Dawley rats received bilateral guide cannulas targeting the NAc core and were tested in 1-hr sessions with free access to rat chow and the choice to work for sugar pellets on a progressive ratio 2 (PR2) reinforcement schedule. Individual groups of rats were tested following stimulation or blockade of NAc D1-like or D2-like receptors, stimulation of μ-, δ-, or κ-opioid receptors, or antagonism of opioid receptors. Behavior was examined under ad libitum conditions and following 23-h food restriction. NAc blockade of the D1-like receptors or stimulation of the D2 receptor reduced break point for earning sugar pellets; D2 receptor stimulation also modestly lowered chow intake. NAc μ-opioid receptor stimulation increased intake of the freely-available chow while simultaneously reducing break point for the sugar pellets. In non-restricted conditions, δ-opioid receptor stimulation increased both food intake and breakpoint. There were no effects of stimulating NAc D1 or κ receptors, nor did blocking D2 or opioid receptors affect task behavior. These data support prior literature linking dopamine to appetitive motivational processes, and suggest that μ- and δ-opioid receptors affect food-directed motivation differentially. Specifically, μ-opioid receptors shifted behavior towards consumption, and δ-opioid receptor enhanced both sugar-seeking and consumption of the pabulum chow when animals were not food restricted.

Inhibitory effects of Shati/Nat8l overexpression in the medial prefrontal cortex on methamphetamine-induced conditioned place preference in mice

Shati/Nat8l is a novel N-acetyltransferase identified in the brain of mice treated with methamphetamine (METH). Shati/Nat8l mRNA is expressed in various brain areas, including the prefrontal cortex (PFC), where the expression level is higher than that in other brain regions. Shati/Nat8l overexpression in the nucleus accumbens (NAc) attenuates the pharmacological response to METH via mGluR3. Meanwhile, dopamine (DA) and glutamate dysregulations have been reported in the medial prefrontal cortex (mPFC) and NAc after METH self-administration and during reinstatement. However, the mechanism, the reward system, and function of Shati/Nat8l in the mPFC is unclear. Here, we injected an adeno-associated virus (AAV) vector containing Shati/Nat8l into the mPFC of mice, to overexpress Shati/Nat8l in the mPFC (mPFC-Shati/Nat8l). Interestingly, the METH-induced conditioned place preference (CPP) was attenuated in the mPFC-Shati/Nat8l mice, but locomotor activity was not. Additionally, immunohistochemical results from mice that were injected with AAV-GFP showed fluorescence in the mPFC and other brain regions, mainly the NAc, indicating an mPFC-NAc top-down connection. Finally, in vivo microdialysis experiments revealed that Shati/Nat8l overexpression in the mPFC reduced extracellular DA levels and suppressed the METH-induced DA increase in the NAc. Moreover, decreased extracellular glutamate levels were observed in the NAc. These results indicate that Shati/Nat8l overexpression in the mPFC attenuates METH-induced CPP by decreasing extracellular DA in the NAc. In contrast, Shati/Nat8l-mPFC overexpression did not alter METH-induced hyperlocomotion. This study demonstrates that Shati/Nat8l in the mPFC attenuates METH reward-seeking behaviour but not the psychomotor activity of METH.

Distinct Populations of Neurons Activated by Heroin and Cocaine in the Striatum as Assessed by catFISH

Despite the still prevailing notion of a shared substrate of action for all addictive drugs, there is evidence suggesting that opioid and psychostimulant drugs differ substantially in terms of their neurobiological and behavioral effects. These differences may reflect separate neural circuits engaged by the two drugs. Here we used the catFISH (cellular compartment analysis of temporal activity by fluorescence in situ hybridization) technique to investigate the degree of overlap between neurons engaged by heroin versus cocaine in adult male Sprague Dawley rats. The catFISH technique is a within-subject procedure that takes advantage of the different transcriptional time course of the immediate-early genes homer 1a and arc to determine to what extent two stimuli separated by an interval of 25 min engage the same neuronal population. We found that throughout the striatal complex the neuronal populations activated by noncontingent intravenous injections of cocaine (800 μg/kg) and heroin (100 and 200 μg/kg), administered at an interval of 25 min from each other, overlapped to a much lesser extent than in the case of two injections of cocaine (800 μg/kg), also 25 min apart. The greatest reduction in overlap between populations activated by cocaine and heroin was in the dorsomedial and dorsolateral striatum (∼30% and ∼22%, respectively, of the overlap observed for the sequence cocaine-cocaine). Our results point toward a significant separation between neuronal populations activated by heroin and cocaine in the striatal complex. We propose that our findings are a proof of concept that these two drugs are encoded differently in a brain area believed to be a common neurobiological substrate to drug abuse.

Molecular Plasticity of the Nucleus Accumbens Revisited-Astrocytic Waves Shall Rise

Part of the ventral striatal division, the nucleus accumbens (NAc) drives the circuit activity of an entire macrosystem about reward like a "flagship," signaling and leading diverse conducts. Accordingly, NAc neurons feature complex inhibitory phenotypes that assemble to process circuit inputs and generate outputs by exploiting specific arrays of opposite and/or parallel neurotransmitters, neuromodulatory peptides. The resulting complex combinations enable versatile yet specific forms of accumbal circuit plasticity, including maladaptive behaviors. Although reward signaling and behavior are elaborately linked to neuronal circuit activities, it is plausible to propose whether these neuronal ensembles and synaptic islands can be directly controlled by astrocytes, a powerful modulator of neuronal activity. Pioneering studies showed that astrocytes in the NAc sense citrate cycle metabolites and/or ATP and may induce recurrent activation. We argue that the astrocytic calcium, GABA, and Glu signaling and altered sodium and chloride dynamics fundamentally shape metaplasticity by providing active regulatory roles in the synapse- and network-level flexibility of the NAc.

NMDA receptor-dependent plasticity in the nucleus accumbens connects reward-predictive cues to approach responses

Learning associations between environmental cues and rewards is a fundamental adaptive function. Via such learning, reward-predictive cues come to activate approach to locations where reward is available. The nucleus accumbens (NAc) is essential for cued approach behavior in trained subjects, and cue-evoked excitations in NAc neurons are critical for the expression of this behavior. Excitatory synapses within the NAc undergo synaptic plasticity that presumably contributes to cued approach acquisition, but a direct link between synaptic plasticity within the NAc and the development of cue-evoked neural activity during learning has not been established. Here we show that, with repeated cue-reward pairings, cue-evoked excitations in the NAc emerge and grow in the trials prior to the detectable expression of cued approach behavior. We demonstrate that the growth of these signals requires NMDA receptor-dependent plasticity within the NAc, revealing a neural mechanism by which the NAc participates in learning of conditioned reward-seeking behaviors.

Conditioned stimuli elicit phasic changes in nucleus accumbens (NAc) firing that invigorate approach responses to predicted rewards. Here the authors show that NAc neurons acquire cue-evoked responses during learning as a result of excitatory plasticity within the NAc.

Lateral preoptic and ventral pallidal roles in locomotion and other movements

The lateral preoptic area (LPO) and ventral pallidum (VP) are structurally and functionally distinct territories in the subcommissural basal forebrain. It was recently shown that unilateral infusion of the GABAA receptor antagonist, bicuculline, into the LPO strongly invigorates exploratory locomotion, whereas bicuculline infused unilaterally into the VP has a negligible locomotor effect, but when infused bilaterally, produces vigorous, abnormal pivoting and gnawing movements and compulsive ingestion. This study was done to further characterize these responses. We observed that bilateral LPO infusions of bicuculline activate exploratory locomotion only slightly more potently than unilateral infusions and that unilateral and bilateral LPO injections of the GABAA receptor agonist muscimol potently suppress basal locomotion, but only modestly inhibit locomotion invigorated by amphetamine. In contrast, unilateral infusions of muscimol into the VP affect basal and amphetamine-elicited locomotion negligibly, but bilateral VP muscimol infusions profoundly suppress both. Locomotor activation elicited from the LPO by bicuculline was inhibited modestly and profoundly by blockade of dopamine D2 and D1 receptors, respectively, but was not entirely abolished even under combined blockade of dopamine D1 and D2 receptors. That is, infusing the LPO with bic caused instances of near normal, even if sporadic, invigoration of locomotion in the presence of saturating dopamine receptor blockade, indicating that LPO can stimulate locomotion in the absence of dopamine signaling. Pivoting following bilateral VP bicuculline infusions was unaffected by dopamine D2 receptor blockade, but was completely suppressed by D1 receptor blockade. The present results are discussed in a context of neuroanatomical and functional organization underlying exploratory locomotion and adaptive movements.

Neural Dynamics of Autistic Repetitive Behaviors and Fragile X Syndrome: Basal Ganglia Movement Gating and mGluR-Modulated Adaptively Timed Learning

This article develops the iSTART neural model that proposes how specific imbalances in cognitive, emotional, timing, and motor processes that involve brain regions like prefrontal cortex, temporal cortex, amygdala, hypothalamus, hippocampus, and cerebellum may interact together to cause behavioral symptoms of autism. These imbalances include underaroused emotional depression in the amygdala/hypothalamus, learning of hyperspecific recognition categories that help to cause narrowly focused attention in temporal and prefrontal cortices, and breakdowns of adaptively timed motivated attention and motor circuits in the hippocampus and cerebellum. The article expands the model's explanatory range by, first, explaining recent data about Fragile X syndrome (FXS), mGluR, and trace conditioning; and, second, by explaining distinct causes of stereotyped behaviors in individuals with autism. Some of these stereotyped behaviors, such as an insistence on sameness and circumscribed interests, may result from imbalances in the cognitive and emotional circuits that iSTART models. These behaviors may be ameliorated by operant conditioning methods. Other stereotyped behaviors, such as repetitive motor behaviors, may result from imbalances in how the direct and indirect pathways of the basal ganglia open or close movement gates, respectively. These repetitive behaviors may be ameliorated by drugs that augment D2 dopamine receptor responses or reduce D1 dopamine receptor responses. The article also notes the ubiquitous role of gating by basal ganglia loops in regulating all the functions that iSTART models.

Subcortical association with memory performance in schizophrenia: a structural magnetic resonance imaging study

Memory performance is severely impaired in individuals with schizophrenia. Although several studies have reported a relationship between memory performance and hippocampal volume, only a few structural magnetic resonance imaging (MRI) studies have investigated the relationship between memory performance and subcortical structures other than hippocampus in patients with schizophrenia. We investigated the relationship between memory performance and subcortical regional volumes in a large sample of patients with schizophrenia. Participants included 174 patients with schizophrenia and 638 healthy comparison subjects (HCS). The Wechsler Memory Scale-Revised (WMS-R) has three memory indices (verbal immediate recall, visual immediate recall, and delayed recall (verbal plus visual)) and one control neurocognitive index (attention/concentration). We obtained T1-weighted MRI data and measured the bilateral volumes of the hippocampus, amygdala, thalamus, nucleus accumbens (NA), caudate, putamen, and globus pallidus. Patients with schizophrenia had significantly lower scores for all of the indices of the WMS-R than the HCS. They had more severe impairments in verbal immediate recall and delayed recall than in visual immediate recall and attention/concentration. Verbal immediate recall/delayed recall scores in patients with schizophrenia were significantly correlated not only with hippocampal volume (left: r = 0.34; right: r = 0.28/left: r = 0.33; right: r = 0.31), but also with NA volume (left: r = 0.24; right: r = 0.25/left: r = 0.26; right: r = 0.27). The present investigation with a large sample size did not only replicate hippocampal volume and memory association, but also found that NA volume is associated with memory performances in schizophrenia.

Beta-arrestin 1 regulation of reward-motivated behaviors and glutamatergic function

The two highly homologous non-visual arrestins, beta-arrestin 1 and 2, are ubiquitously expressed in the central nervous system, yet knowledge of their disparate roles is limited. While beta-arrestin 2 (βarr2) has been implicated in several aspects of reward-related learning and behavior, very little is known about the behavioral function of beta-arrestin 1 (βarr1). Using mice lacking βarr1, we focused on the role of this scaffolding and signal transduction protein in reward-motivated behaviors and in striatal glutamatergic function. We found that βarr1 KO mice were both slower in acquiring cocaine self-administration and in extinguishing this behavior. They also showed deficits in learning tasks supported by a natural food reward, suggesting a general alteration in reward processing. We then examined glutamatergic synaptic strength in WT and KO medium spiny neurons (MSNs) of the Nucleus Accumbens (NAc) shell in naïve animals, and from those that underwent cocaine self-administration. An increase in the AMPA/NMDA (A/N) ratio and a relative lack of GluN2B-enriched NMDARs was found in naïve KO vs WT MSNs. Applying Lim Domain Kinase (LIMK1), the kinase that phosphorylates and inactivates cofilin, to these cells, showed that both βarr1 and LIMK regulate the A/N ratio and GluN2B-NMDARs. Cocaine self-administration increased the A/N ratio and GluN2B-NMDARs in WT MSNs and, although the A/N ratio also increased in KO MSNs, this was accompanied by fewer GluN2B-NMDARs and an appearance of calcium-permeable AMPARs. Finally, to examine the consequences of reduced basal GluN2B-NMDARs in reward-processing seen in KO mice, we chronically infused ifenprodil, a GluN2B antagonist, into the NAc shell of WT mice. This intervention substantially reduced food-motivated behavior. Together these findings identify a previously unknown role of βarr1 in regulating specific reward-motivated behaviors and glutamatergic function.

Abundant collateralization of temporal lobe projections to the accumbens, bed nucleus of stria terminalis, central amygdala and lateral septum

Behavioral flexibility is subserved in part by outputs from the cerebral cortex to telencephalic subcortical structures. In our earlier evaluation of the organization of the cortical-subcortical output system (Reynolds and Zahm, J Neurosci 25:11757-11767, 2005), retrograde double-labeling was evaluated in the prefrontal cortex following tracer injections into pairs of the following subcortical telencephalic structures: caudate-putamen, core and shell of the accumbens (Acb), bed nucleus of stria terminalis (BST) and central nucleus of the amygdala (CeA). The present study was done to assess patterns of retrograde labeling in the temporal lobe after similar paired tracer injections into most of the same telencephalic structures plus the lateral septum (LS). In contrast to the modest double-labeling observed in the prefrontal cortex in the previous study, up to 60-80 % of neurons in the basal and accessory basal amygdaloid nuclei and amygdalopiriform transition area exhibited double-labeling in the present study. The most abundant double-labeling was generated by paired injections into structures affiliated with the extended amygdala, including the CeA, BST and Acb shell. Injections pairing the Acb core with the BST or CeA produced significantly fewer double-labeled neurons. The ventral subiculum exhibited modest amounts of double-labeling associated with paired injections into the Acb, BST, CeA and LS. The results raise the issue of how an extraordinarily collateralized output from the temporal lobe may contribute to behavioral flexibility.

The Nucleus Accumbens: Mechanisms of Addiction across Drug Classes Reflect the Importance of Glutamate Homeostasis

The nucleus accumbens is a major input structure of the basal ganglia and integrates information from cortical and limbic structures to mediate goal-directed behaviors. Chronic exposure to several classes of drugs of abuse disrupts plasticity in this region, allowing drug-associated cues to engender a pathologic motivation for drug seeking. A number of alterations in glutamatergic transmission occur within the nucleus accumbens after withdrawal from chronic drug exposure. These drug-induced neuroadaptations serve as the molecular basis for relapse vulnerability. In this review, we focus on the role that glutamate signal transduction in the nucleus accumbens plays in addiction-related behaviors. First, we explore the nucleus accumbens, including the cell types and neuronal populations present as well as afferent and efferent connections. Next we discuss rodent models of addiction and assess the viability of these models for testing candidate pharmacotherapies for the prevention of relapse. Then we provide a review of the literature describing how synaptic plasticity in the accumbens is altered after exposure to drugs of abuse and withdrawal and also how pharmacological manipulation of glutamate systems in the accumbens can inhibit drug seeking in the laboratory setting. Finally, we examine results from clinical trials in which pharmacotherapies designed to manipulate glutamate systems have been effective in treating relapse in human patients. Further elucidation of how drugs of abuse alter glutamatergic plasticity within the accumbens will be necessary for the development of new therapeutics for the treatment of addiction across all classes of addictive substances.

Enhanced structural connectivity within a brain sub-network supporting working memory and engagement processes after cognitive training

The structural connectome provides relevant information about experience and training-related changes in the brain. Here, we used network-based statistics (NBS) and graph theoretical analyses to study structural changes in the brain as a function of cognitive training. Fifty-six young women were divided in two groups (experimental and control). We assessed their cognitive function before and after completing a working memory intervention using a comprehensive battery that included fluid and crystallized abilities, working memory and attention control, and we also obtained structural MRI images. We acquired and analyzed diffusion-weighted images to reconstruct the anatomical connectome and we computed standardized changes in connectivity as well as group differences across time using NBS. We also compared group differences relying on a variety of graph-theory indices (clustering, characteristic path length, global and local efficiency and strength) for the whole network as well as for the sub-network derived from NBS analyses. Finally, we calculated correlations between these graph indices and training performance as well as the behavioral changes in cognitive function. Our results revealed enhanced connectivity for the training group within one specific network comprised of nodes/regions supporting cognitive processes required by the training (working memory, interference resolution, inhibition, and task engagement). Significant group differences were also observed for strength and global efficiency indices in the sub-network detected by NBS. Therefore, the connectome approach is a valuable method for tracking the effects of cognitive training interventions across specific sub-networks. Moreover, this approach allowsfor the computation of graph theoretical network metricstoquantifythetopological architecture of the brain networkdetected. The observed structural brain changes support the behavioral results reported earlier (see Colom, Román, et al., 2013).

Acquisition and expression of fat-conditioned flavor preferences are differentially affected by NMDA receptor antagonism in BALB/c and SWR mice

Conditioned flavor preferences are elicited by fat (Intralipid) in inbred mouse strains with BALB/c and SWR mice displaying among the most robust preferences. Dopamine D₁ and opioid receptor antagonism differentially reduces the acquisition (learning) and expression (maintenance) of fat-conditioned flavor preferences in these two strains. Because noncompetitive NMDA receptor antagonism with MK-801 differentially altered sugar-conditioned flavor preferences in these strains, and because NMDA receptors are involved in fat intake, the present study examined whether MK-801 differentially altered expression and acquisition of fat (Intralipid)-conditioned flavor preferences in BALB/c and SWR mice. In expression studies, food-restricted male mice alternately consumed a flavored (CS+, e.g., cherry, 5 sessions) 5% Intralipid solution and a differently-flavored (CS-, e.g., grape, 5 sessions) 0.5% Intralipid solution. Two-bottle CS choice tests occurred following vehicle or MK-801 (100, 200µg/kg). MK-801 blocked expression of Intralipid-CFP at both doses in BALB/c mice, but only at the 100µg/kg dose in SWR mice. In acquisition studies, groups of BALB/c (0, 100µg/kg) and SWR (0, 100µg/kg) male mice were treated prior to the ten acquisition training sessions followed by six 2-bottle CS choice tests without injections. MK-801 eliminated acquisition of Intralipid-conditioned flavor preferences in BALB/c mice, and actually changed the preference to an avoidance response in SWR mice. Thus, NMDA receptor signaling appears essential especially for the learning of fat-conditioned flavor preferences in both mouse strains.

Contrasting effects of 5-HT3 receptor stimulation of the nucleus accumbens or ventral tegmentum on food intake in the rat

Although serotonin (5-HT) signaling is known to regulate food intake and energy homeostasis, the roles of the 5-HT₃ receptor in feeding processes have been elusive. 5-HT₃ receptors are found throughout mesolimbic circuitry that promote feeding not only in response to hunger, but also to the palatable and rewarding properties of food. These experiments examined if stimulation or blockade of the 5-HT₃ receptor of the nucleus accumbens (NAcc) or ventral tegmentum affected food intake in the rat in response to hunger or the presence of a palatable diet. Rats (N=6-9/group) received bilateral injections of the 5-HT₃ agonist m-chlorophenylbiguanide hydrochloride (mCPBG; at 0.0, 10.0, or 20.0μg/0.5μl/side) or the 5-HT₃ antagonist ondansetron hydrochloride (at 0.0, 1.0, 2.0, or 5.0μg/0.5μl/side) into either the NAcc or the ventral tegmentum. NAcc 5-HT₃ receptor stimulation significantly increased 2-h food intake in food-deprived animals offered rat chow and in a separate group of unrestricted rats offered a sweetened fat diet. In contrast to the feeding increase seen with NAcc treatments, stimulation of 5-HT₃ receptors of the ventral tegmentum significantly reduced food and water intake in food-restricted animals; reductions of intake in non-restricted rats offered the palatable diet did not approach significance. Blockade of the 5-HT₃ receptor had no effect on feeding in either brain region. These data support a functional role for serotonergic signaling in the mesolimbic pathway on motivated behavior, and demonstrate that 5-HT₃ receptors differentially modulate food consumption in a region-dependent manner.

The ketamine-like compound methoxetamine substitutes for ketamine in the self-administration paradigm and enhances mesolimbic dopaminergic transmission

RATIONALE

Recently, an increasing number of emergency cases due to a novel ketamine-like drug, methoxetamine (MXE), were reported in several countries. However, very little is known about the neuropsychopharmacological and reinforcing profile of this compound.

OBJECTIVES

Our study aims to investigate the effects of MXE on self-administration (SA) behaviour in comparison to ketamine and on dopaminergic transmission.

METHODS

A SA substitution study was performed in male rats trained to intravenously (IV) self-administer ketamine. At responding stability, rats were exposed to sequential phases of MXE substitution at different dosages (starting from 0.5 and then decreasing to 0.25 and 0.125 mg/kg). Standard electrophysiological techniques were used to record changes in firing activities of ventral tegmental area (VTA) dopamine neurons projecting to the nucleus accumbens (NAc) shell after acute injection of cumulative doses of MXE (0.031-0.5 mg/kg IV). Finally, in vivo microdialysis was performed in freely moving rats to evaluate the effect of acute MXE administration (0.125, 0.25 and 0.5 mg/kg IV) on dopamine release in the NAc shell.

RESULTS

MXE 0.125 and 0.25 mg/kg, but not 0.5 mg/kg, substituted for ketamine SA. MXE also induced a dose-dependent stimulation of firing rate (p < 0.0001) and burst firing (p < 0.05) of NAc-projecting VTA dopamine neurons. Consistently, MXE significantly (p < 0.05) increased dopamine extracellular levels in the NAc shell at 0.5 and 0.25 mg/kg with different time onsets, i.e. at 40 and 100 min, respectively.

CONCLUSIONS

This study, while confirming the reinforcing effects of MXE, highlights an electrophysiological and neurochemical profile predictive of its addictive properties.

Computational neurorehabilitation: modeling plasticity and learning to predict recovery

Despite progress in using computational approaches to inform medicine and neuroscience in the last 30 years, there have been few attempts to model the mechanisms underlying sensorimotor rehabilitation. We argue that a fundamental understanding of neurologic recovery, and as a result accurate predictions at the individual level, will be facilitated by developing computational models of the salient neural processes, including plasticity and learning systems of the brain, and integrating them into a context specific to rehabilitation. Here, we therefore discuss Computational Neurorehabilitation, a newly emerging field aimed at modeling plasticity and motor learning to understand and improve movement recovery of individuals with neurologic impairment. We first explain how the emergence of robotics and wearable sensors for rehabilitation is providing data that make development and testing of such models increasingly feasible. We then review key aspects of plasticity and motor learning that such models will incorporate. We proceed by discussing how computational neurorehabilitation models relate to the current benchmark in rehabilitation modeling - regression-based, prognostic modeling. We then critically discuss the first computational neurorehabilitation models, which have primarily focused on modeling rehabilitation of the upper extremity after stroke, and show how even simple models have produced novel ideas for future investigation. Finally, we conclude with key directions for future research, anticipating that soon we will see the emergence of mechanistic models of motor recovery that are informed by clinical imaging results and driven by the actual movement content of rehabilitation therapy as well as wearable sensor-based records of daily activity.

Topiramate for the management of methamphetamine dependence: a pilot randomized, double-blind, placebo-controlled trial

To date, no medication has been approved as an effective treatment for methamphetamine dependence. Topiramate has attracted considerable attention as a treatment for the dependence on alcohol and stimulants. Therefore, this study aimed to evaluate the effect of topiramate for methamphetamine dependence. This study was a double-blind, randomized, placebo-controlled trial. In the present investigation, 62 methamphetamine-dependent adults were enrolled and randomized into two groups, and received topiramate or a placebo for 10 weeks in escalating doses from 50 mg/day to the target maintenance dose of 200 mg/day. Addiction severity index (ASI) and craving scores were registered every week. The Beck questionnaire was also given to each participant at baseline and every 2 weeks during the treatment. Urine samples were collected at baseline and every 2 weeks during the treatment. Fifty-seven patients completed 10 weeks of the trial. There was no significant difference between both groups in the mean percentage of prescribed capsules taken by the participants. At week six, the topiramate group showed a significantly lower proportion of methamphetamine-positive urine tests in comparison with the placebo group (P = 0.01). In addition, there were significantly lower scores in the topiramate group in comparison with the placebo group in two domains of ASI: drug use severity (P < 0.001) and drug need (P < 0.001). Furthermore, the craving score (duration) significantly declined in the topiramate patients compared to those receiving the placebo. In conclusion, the results of this trial suggest that topiramate may be beneficial for the treatment of methamphetamine dependence.

Relief memory consolidation requires protein synthesis within the nucleus accumbens

Relief learning refers to the association of a stimulus with the relief from an aversive event. The thus-learned relief stimulus then can induce, e.g., an attenuation of the startle response or approach behavior, indicating positive valence. Previous studies revealed that the nucleus accumbens is essential for the acquisition and retrieval of relief memory. Here, we ask whether the nucleus accumbens is also the brain site for consolidation of relief memory into a long-term form. In rats, we blocked local protein synthesis within the nucleus accumbens by local infusions of anisomycin at different time points during a relief conditioning experiment. Accumbal anisomycin injections immediately after the relief conditioning session, but not 4 h later, prevented the consolidation into long-term relief memory. The retention of already consolidated relief memory was not affected by anisomycin injections. This identifies a time window and site for relief memory consolidation. These findings should complement our understanding of the full range of effects of adverse experiences, including cases of their distortion in humans such as post-traumatic stress disorder and/or phobias.

Dopaminergic and cholinergic learning mechanisms in nicotine addiction

Nicotine addiction drives tobacco use by one billion people worldwide, causing nearly six million deaths a year. Nicotine binds to nicotinic acetylcholine receptors that are normally activated by the endogenous neurotransmitter acetylcholine. The widespread expression of nicotinic receptors throughout the nervous system accounts for the diverse physiological effects triggered by nicotine. A crucial influence of nicotine is on the synaptic mechanisms underlying learning that contribute to the addiction process. Here, we focus on the acquisition phase of smoking addiction and review animal model studies on how nicotine modifies dopaminergic and cholinergic signaling in key nodes of the reinforcement circuitry: ventral tegmental area, nucleus accumbens (NAc), amygdala, and hippocampus. Capitalizing on mechanisms that subserve natural rewards, nicotine activates midbrain dopamine neurons directly and indirectly, and nicotine causes dopamine release in very broad target areas throughout the brain, including the NAc, amygdala, and hippocampus. In addition, nicotine orchestrates local changes within those target structures, alters the release of virtually all major neurotransmitters, and primes the nervous system to the influence of other addictive drugs. Hence, understanding how nicotine affects the circuitry for synaptic plasticity and learning may aid in developing reasoned therapies to treat nicotine addiction.

Relief learning is dependent on NMDA receptor activation in the nucleus accumbens

BACKGROUND AND PURPOSE

Recently, we demonstrated that the nucleus accumbens (NAC) is required for the acquisition and expression of relief memory. The purpose of this study was to investigate the role of NMDA receptors within the NAC in relief learning.

EXPERIMENTAL APPROACH

The NMDA receptor antagonist 2-amino-5-phosphonopentanoic acid (AP-5) was injected into the NAC. The effects of these injections on the acquisition and expression of relief memory, as well as on the reactivity to aversive electric stimuli, were tested.

KEY RESULTS

Intra-accumbal AP-5 injections blocked the acquisition but not the expression of relief memory. Furthermore, reactivity to aversive electric stimuli was not affected by the AP-5 injections.

CONCLUSION AND IMPLICATION

The present data indicate that NMDA-dependent plasticity within the NAC is crucial for the acquisition of relief memory.

Differential effects of clozapine, metoclopramide, haloperidol and risperidone on acquisition and performance of operant responding in rats

RATIONALE

Prior research has not systematically investigated the effects of systemic antipsychotic drugs on operant response acquisition, specifically their behavioural microstructure, reinforcement blunting and relative potency in acquisition compared to performance once operant responding has stabilized.

OBJECTIVES

This study aims to systematically investigate the effects of systemically administered clozapine, metoclopramide, haloperidol and risperidone during free operant response acquisition and performance.

METHODS

Following magazine training, food-restricted male Wistar rats lever pressed for food reward in 15 min daily operant conditioning sessions.

RESULTS

All drugs suppressed operant response acquisition and performance. Risperidone and metoclopramide, but not clozapine or haloperidol, suppressed operant responding more potently during acquisition than performance. The dopamine D2-like receptor antagonists haloperidol and metoclopramide that affect the ventral and dorsal striatum blunted reinforcement and decreased inactive lever presses in acquisition. In contrast, the atypical antipsychotics clozapine and risperidone that affect the ventral striatum and prefrontal cortex failed to decrease inactive lever presses during acquisition, suggesting a possible decision-making deficit. Haloperidol decreased active lever pressing over performance days. The drugs did not appear to affect rats' sensitivity to active lever press outcome, even though they suppressed active lever pressing.

CONCLUSIONS

Results suggest that reinforcement impact during operant acquisition is dependent on dopamine D2 receptors while drugs affecting, among other areas, the prefrontal cortex produce a deficit in ability to suppress inactive lever press responses.

Reduction in Responding for Sucrose and Cocaine Reinforcement by Disruption of Memory Reconsolidation

Stored memories are dynamic and, when reactivated, can undergo a process of destabilization and reconsolidation to update them with new information. Reconsolidation has been shown for a variety of experimental settings; most recently for well-learned instrumental memories, a class of memory previously thought not to undergo reconsolidation. Here we tested, in rats, whether a weakly-trained lever-pressing memory destabilized following a shift in reinforcement contingency. We show that lever-pressing memory for both sucrose and cocaine reinforcement destabilized under appropriate conditions, and that the reconsolidation of this memory was impaired by systemic administration of the NMDA receptor (NMDAR) antagonist [5R,10S]-[+]-5-methyl-10,1-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine (MK-801). We went on to investigate the potential role of the nucleus accumbens (NAc) in the reconsolidation of sucrose-reinforced instrumental memories, showing that co-infusion of the NMDAR antagonist 2-amino-5-phosphonopentanoic acid (AP-5) and the dopamine-1 receptor (D1R) antagonist 7-chloro-3-methyl-1-phenyl-1,2,4,5-tetrahydro-3-benzazepin-8-ol (SCH23390) into the NAc prior to memory reactivation impaired reconsolidation; however, there was no effect when these drugs were infused alone. Further investigation of this effect suggests the combined infusion disrupted the reconsolidation of pavlovian components of memory, and we hypothesize that coactivation of accumbal D1Rs and NMDARs may contribute to both the destabilization and reconsolidation of appetitive memory. Our work demonstrates that weakly-trained instrumental memories undergo reconsolidation under similar parameters to well-trained ones, and also suggests that receptor coactivation in the NAc may contribute to memory destabilization. Furthermore, it provides an important demonstration of the therapeutic potential of reconsolidation-based treatments that target the instrumental components of memory in maladaptive drug seeking.

Differential modulation of reinforcement learning by D2 dopamine and NMDA glutamate receptor antagonism

The firing pattern of midbrain dopamine (DA) neurons is well known to reflect reward prediction errors (PEs), the difference between obtained and expected rewards. The PE is thought to be a crucial signal for instrumental learning, and interference with DA transmission impairs learning. Phasic increases of DA neuron firing during positive PEs are driven by activation of NMDA receptors, whereas phasic suppression of firing during negative PEs is likely mediated by inputs from the lateral habenula. We aimed to determine the contribution of DA D2-class and NMDA receptors to appetitively and aversively motivated reinforcement learning. Healthy human volunteers were scanned with functional magnetic resonance imaging while they performed an instrumental learning task under the influence of either the DA D2 receptor antagonist amisulpride (400 mg), the NMDA receptor antagonist memantine (20 mg), or placebo. Participants quickly learned to select ("approach") rewarding and to reject ("avoid") punishing options. Amisulpride impaired both approach and avoidance learning, while memantine mildly attenuated approach learning but had no effect on avoidance learning. These behavioral effects of the antagonists were paralleled by their modulation of striatal PEs. Amisulpride reduced both appetitive and aversive PEs, while memantine diminished appetitive, but not aversive PEs. These data suggest that striatal D2-class receptors contribute to both approach and avoidance learning by detecting both the phasic DA increases and decreases during appetitive and aversive PEs. NMDA receptors on the contrary appear to be required only for approach learning because phasic DA increases during positive PEs are NMDA dependent, whereas phasic decreases during negative PEs are not.

The effects of nucleus accumbens μ-opioid and adenosine 2A receptor stimulation and blockade on instrumental learning

Prior research has shown that glutamate and dopamine receptors in the nucleus accumbens (NAcc) core are critical for the learning of an instrumental response for food reinforcement. It has also been demonstrated that μ-opioid and adenosine A2A receptors within the NAcc impact feeding and motivational processes. In these experiments, we examined the potential roles of NAcc μ-opioid and A2A receptors on instrumental learning and performance. Sprague-Dawley rats were food restricted and trained to lever press following daily intra-accumbens injections of the A2A receptor agonist CGS 21680 (at 0.0, 6.0, or 24.0ng/side), the A2A antagonist pro-drug MSX-3 (at 0.0, 1.0, or 3.0μg/side), the μ-opioid agonist DAMGO (at 0.0, 0.025, or 0.025μg/side), or the opioid receptor antagonist naltrexone (at 0.0, 2.0 or 20.0μg/side). After five days, rats continued training without drug injections until lever pressing rates stabilized, and were then tested with a final drug test to assess potential performance effects. Stimulation, but not inhibition, of NAcc adenosine A2A receptors depressed lever pressing during learning and performance tests, but did not impact lever pressing on non-drug days. Both μ-opioid receptor stimulation and blockade inhibited learning of the lever-press response, though only naltrexone treatment caused impairments in lever-pressing after the task had been learned. The effect of A2A receptor stimulation on learning and performance were consistent with known effects of adenosine on effort-related processes, whereas the pattern of lever presses, magazine approaches, and pellet consumption following opioid receptor manipulations suggested that their effects may have been driven by drug-induced shifts in the incentive value of the sugar reinforcer.

Dopamine preferentially inhibits NMDA receptor-mediated EPSCs by acting on presynaptic D1 receptors in nucleus accumbens during postnatal development

Nucleus accumbens (nAcb), a major site of action of drugs of abuse and dopamine (DA) signalling in MSNs (medium spiny neurons), is critically involved in mediating behavioural responses of drug addiction. Most studies have evaluated the effects of DA on MSN firing properties but thus far, the effects of DA on a cellular circuit involving glutamatergic afferents to the nAcb have remained rather elusive. In this study we attempted to characterize the effects of dopamine (DA) on evoked glutamatergic excitatory postsynaptic currents (EPSCs) in nAcb medium spiny (MS) neurons in 1 to 21 day-old rat pups. The EPSCs evoked by local nAcb stimuli displayed both AMPA/KA and NMDA receptor-mediated components. The addition of DA to the superfusing medium produced a marked decrease of both components of the EPSCs that did not change during the postnatal period studied. Pharmacologically isolated AMPA/KA receptor-mediated response was inhibited on average by 40% whereas the isolated NMDA receptor-mediated EPSC was decreased by 90%. The effect of DA on evoked EPSCs were mimicked by the D₁-like receptor agonist SKF 38393 and antagonized by the D₁-like receptor antagonist SCH 23390 whereas D₂-like receptor agonist or antagonist respectively failed to mimic or to block the action of DA. DA did not change the membrane input conductance of MS neurons or the characteristics of EPSCs produced by the local administration of glutamate in the presence of tetrodotoxin. In contrast, DA altered the paired-pulse ratio of evoked EPSCs. The present results show that the activation D₁-like dopaminergic receptors modulate glutamatergic neurotransmission by preferentially inhibiting NMDA receptor-mediated EPSC through presynaptic mechanisms.

Why fat is so preferable: from oral fat detection to inducing reward in the brain

Potential mechanisms underlying the high palatability of fat can be assessed by reviewing animal studies on fat detection and brain patterns during reward behavior. Fatty acids are likely recognized by receptors on taste buds, with the signals transmitted to the brain through taste nerves. Ingested oil is broken down and absorbed in the gastrointestinal tract, which also sends signals to the brain through unknown mechanisms. Information from both sensory receptors and peripheral tissue is integrated by the brain, resulting in a strong appetite for fatty foods via a reward system. Understanding mechanisms of fat recognition will prove valuable in the development of strategies to manage the high palatability of foods.

Differential effect of beta-adrenergic receptor antagonism in basolateral amygdala on reconsolidation of aversive and appetitive memories associated with morphine in rats

Positive and negative emotional experiences induced by addictive drugs play an important role in the development of dysfunctional drug-related memory, which becomes resistant to extinction and contributes to high rate of relapse. Those memories may undergo a process called reconsolidation that in some cases can be disrupted by pharmacological treatment. The basolateral amygdala (BLA) has been shown to mediate the reconsolidation of drug-related appetitive memory, but its role in withdrawal-related aversive memory remains elusive. The present study used conditioned place preference (CPP) and conditioned place aversion (CPA) paradigms to investigate the role of BLA and its noradrenergic receptors in reconsolidation of morphine-associated emotional memory in rats. We found that inhibition of protein synthesis in BLA disrupted the reconsolidation of morphine CPP (m-CPP) and CPA related to morphine withdrawal (m-CPA). A high dose of the β-noradrenergic receptor antagonist propranolol (3 µg) in BLA-impaired reconsolidation of m-CPA but not m-CPP, whereas a low dose (0.3 µg) was ineffective. In contrast, neither low nor high doses of the α-noradrenergic receptor antagonist phentolamine (1 or 10 µg) blocked the reconsolidation of m-CPP and m-CPA. In addition, infusion of propranolol (3 µg) into nucleus accumbens after retrieval of either m-CPP or m-CPA did not affect its reconsolidation. The findings indicate that appetitive and aversive addictive memories share common neural substrates in BLA, but the specific neurotransmitter mechanism on reconsolidation of morphine-associated negative and positive memories can be dissociable.