Synaptic plasticity in an in vitro slice preparation of the rat nucleus accumbens

Wireless optogenetic stimulation on the prelimbic to the nucleus accumbens core circuit attenuates cocaine-induced behavioral sensitization

Behavioral sensitization is defined as the heightened and persistent behavioral response to repeated drug exposure as a manifestation of drug craving. Psychomotor stimulants such as cocaine can induce strong behavioral sensitization. In this study, we explored the effects of optogenetic stimulation of the prelimbic (PL) to the nucleus accumbnes (NAc) core on the expression of cocaine-induced behavioral sensitization. Using wireless optogenetics, we selectively stimulated the PL-NAc core circuit, and assessed the effects of this treatment on cocaine-induced locomotor activity and accompanying changes in neuronal activation and dendritic spine density. Our findings revealed that optogenetic stimulation of the PL-NAc core circuit effectively suppressed the cocaine-induced locomotor sensitization, accompanied by a reduction in c-Fos expression within the NAc core. Moreover, optogenetic stimulation led to reduction in dendritic spine density, particularly thin and mushroom spine densities, in the NAc core. This study demonstrates that cocaine-induced locomotor sensitization can be regulated by optogenetic stimulation of the PL-NAc core circuit, providing insights into the crucial role of this circuit in psychomotor stimulant addiction.

Sex-Specific Mechanisms Underlie Long-Term Potentiation at Hippocampus→Medium Spiny Neuron Synapses in the Medial Shell of the Nucleus Accumbens

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp→NAc synapses is rewarding, and mice can establish learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigated sex differences in the mechanisms underlying Hipp→NAc LTP using whole-cell electrophysiology and pharmacology. We observed similarities in basal synaptic strength between males and females and found that LTP occurs postsynaptically with similar magnitudes in both sexes. However, key sex differences emerged as LTP in males required NMDA receptors (NMDAR), whereas LTP in females utilized an NMDAR-independent mechanism involving L-type voltage-gated Ca2+ channels (VGCCs) and estrogen receptor α (ERα). We also uncovered sex-similar features as LTP in both sexes depended on CaMKII activity and occurred independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

Sex-specific mechanisms underlie long-term potentiation at hippocampus-nucleus accumbens synapses

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary in order to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp-NAc synapses is rewarding, and that mice can make learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigate sex differences in the mechanisms underlying Hipp-NAc LTP using whole-cell electrophysiology and pharmacology. We found that males and females display similar magnitudes of Hipp-NAc LTP which occurs postsynaptically. However, LTP in females requires L-type voltage-gated Ca 2+ channels (VGCC) for postsynaptic Ca 2+ influx, while males rely on NMDA receptors (NMDAR). Additionally, females require estrogen receptor α (ERα) activity for LTP while males do not. These differential mechanisms converge as LTP in both sexes depends on CAMKII activity and occurs independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral excitatory pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

SIGNIFICANCE STATEMENT

Strengthening of Hipp-NAc synapses drives reward-related behaviors. Male and female mice have similar magnitudes of long-term potentiation (LTP) and both sexes have a predicted postsynaptic locus of plasticity. Despite these similarities, we illustrate here that sex-specific molecular mechanisms are used to elicit LTP. Given the bidirectional relationship between Hipp-NAc synaptic strength in mediating reward-related behaviors, the use of distinct molecular mechanisms may explain sex differences observed in stress susceptibility or response to rewarding stimuli. Discovery and characterization of convergent sex differences provides mechanistic insight into the sex-specific function of Hipp-NAc circuitry and has widespread implications for circuits mediating learning and reward-related behavior.

Framework for internal sensation of pleasure using constraints from disparate findings in nucleus accumbens

It is necessary to find a mechanism that generates first-person inner sensation of pleasure to understand what causes addiction and associated behaviour by drugs of abuse. The actual mechanism is expected to explain several disparate findings in nucleus accumbens (NAc), a brain region associated with pleasure, in an interconnected manner. Previously, it was possible to derive a mechanism for natural learning and explain: (1) Generation of inner sensation of memory using changes generated by learning; and (2) Long-term potentiation as an experimental delayed scaled-up change by the same mechanism that occur during natural learning. By extending these findings and by using disparate third person observations in NAc from several studies, present work provides a framework of a mechanism that generates internal sensation of pleasure that can provide interconnected explanations for: (1) Ability to induce robust long-term depression (LTD) in NAc from naïve animals; (2) Impaired ability to induce LTD in “addicted” state; (3) Attenuation of postsynaptic potentials by cocaine; and (4) Reduced firing of medium spiny neurons in response to cocaine or dopamine. Findings made by this work are testable.

Deep Gated Hebbian Predictive Coding Accounts for Emergence of Complex Neural Response Properties Along the Visual Cortical Hierarchy

Predictive coding provides a computational paradigm for modeling perceptual processing as the construction of representations accounting for causes of sensory inputs. Here, we developed a scalable, deep network architecture for predictive coding that is trained using a gated Hebbian learning rule and mimics the feedforward and feedback connectivity of the cortex. After training on image datasets, the models formed latent representations in higher areas that allowed reconstruction of the original images. We analyzed low- and high-level properties such as orientation selectivity, object selectivity and sparseness of neuronal populations in the model. As reported experimentally, image selectivity increased systematically across ascending areas in the model hierarchy. Depending on the strength of regularization factors, sparseness also increased from lower to higher areas. The results suggest a rationale as to why experimental results on sparseness across the cortical hierarchy have been inconsistent. Finally, representations for different object classes became more distinguishable from lower to higher areas. Thus, deep neural networks trained using a gated Hebbian formulation of predictive coding can reproduce several properties associated with neuronal responses along the visual cortical hierarchy.

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the “landscape” (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.

NMDA receptor-dependent plasticity in the nucleus accumbens connects reward-predictive cues to approach responses

Learning associations between environmental cues and rewards is a fundamental adaptive function. Via such learning, reward-predictive cues come to activate approach to locations where reward is available. The nucleus accumbens (NAc) is essential for cued approach behavior in trained subjects, and cue-evoked excitations in NAc neurons are critical for the expression of this behavior. Excitatory synapses within the NAc undergo synaptic plasticity that presumably contributes to cued approach acquisition, but a direct link between synaptic plasticity within the NAc and the development of cue-evoked neural activity during learning has not been established. Here we show that, with repeated cue-reward pairings, cue-evoked excitations in the NAc emerge and grow in the trials prior to the detectable expression of cued approach behavior. We demonstrate that the growth of these signals requires NMDA receptor-dependent plasticity within the NAc, revealing a neural mechanism by which the NAc participates in learning of conditioned reward-seeking behaviors.

Conditioned stimuli elicit phasic changes in nucleus accumbens (NAc) firing that invigorate approach responses to predicted rewards. Here the authors show that NAc neurons acquire cue-evoked responses during learning as a result of excitatory plasticity within the NAc.

The Nucleus Accumbens: Mechanisms of Addiction across Drug Classes Reflect the Importance of Glutamate Homeostasis

The nucleus accumbens is a major input structure of the basal ganglia and integrates information from cortical and limbic structures to mediate goal-directed behaviors. Chronic exposure to several classes of drugs of abuse disrupts plasticity in this region, allowing drug-associated cues to engender a pathologic motivation for drug seeking. A number of alterations in glutamatergic transmission occur within the nucleus accumbens after withdrawal from chronic drug exposure. These drug-induced neuroadaptations serve as the molecular basis for relapse vulnerability. In this review, we focus on the role that glutamate signal transduction in the nucleus accumbens plays in addiction-related behaviors. First, we explore the nucleus accumbens, including the cell types and neuronal populations present as well as afferent and efferent connections. Next we discuss rodent models of addiction and assess the viability of these models for testing candidate pharmacotherapies for the prevention of relapse. Then we provide a review of the literature describing how synaptic plasticity in the accumbens is altered after exposure to drugs of abuse and withdrawal and also how pharmacological manipulation of glutamate systems in the accumbens can inhibit drug seeking in the laboratory setting. Finally, we examine results from clinical trials in which pharmacotherapies designed to manipulate glutamate systems have been effective in treating relapse in human patients. Further elucidation of how drugs of abuse alter glutamatergic plasticity within the accumbens will be necessary for the development of new therapeutics for the treatment of addiction across all classes of addictive substances.

Using In Vitro Electrophysiology to Screen Medications: Accumbal Plasticity as an Engram of Alcohol Dependence

The nucleus accumbens (NAc) is a central component of the mesocorticolimbic reward system. Increasing evidence strongly implicates long-term synaptic neuroadaptations in glutamatergic excitatory activity of the NAc shell and/or core medium spiny neurons in response to chronic drug and alcohol exposure. Such neuroadaptations likely play a critical role in the development and expression of drug-seeking behaviors. We have observed unique cell-type-specific bidirectional changes in NAc synaptic plasticity (metaplasticity) following acute and chronic intermittent ethanol exposure. Other investigators have also previously observed similar metaplasticity in the NAc following exposure to psychostimulants, opiates, and amazingly, even following an anhedonia-inducing experience. Considering that the proteome of the postsynaptic density likely contains hundreds of biochemicals, proteins and other components and regulators, we believe that there is a large number of potential molecular sites through which accumbal metaplasticity may be involved in chronic alcohol abuse. Many of our companion laboratories are now engaged in identifying and screening medications targeting candidate genes and its products previously linked to maladaptive alcohol phenotypes. We hypothesize that if manipulation of such target genes and their products change NAc plasticity, then that observation constitutes an important validation step for the development of novel therapeutics to treat alcohol dependence.

Cocaine and Amphetamine Induce Overlapping but Distinct Patterns of AMPAR Plasticity in Nucleus Accumbens Medium Spiny Neurons

Repeated exposure to psychostimulant drugs such as cocaine or amphetamine can promote drug-seeking and -taking behavior. In rodent addiction models, persistent changes in excitatory glutamatergic neurotransmission in the nucleus accumbens (NAc) appear to drive this drug-induced behavioral plasticity. To study whether changes in glutamatergic signaling are shared between or exclusive to specific psychostimulant drugs, we examined synaptic transmission from mice following repeated amphetamine or cocaine administration. Synaptic transmission mediated by AMPA-type glutamate receptors was potentiated in the NAc shell 10-14 days following repeated amphetamine or cocaine treatment. This synaptic enhancement was depotentiated by re-exposure to amphetamine or cocaine. By contrast, in the NAc core only repeated cocaine exposure enhanced synaptic transmission, which was subsequently depotentiated by an additional cocaine but not amphetamine injection during drug abstinence. To better understand the drug-induced depotentiation, we replicated these in vivo findings using an ex vivo model termed 'challenge in the bath,' and showed that drug-induced decreases in synaptic strength occur rapidly (within 30 min) and require activation of metabotropic glutamate receptor 5 (mGluR5) and protein synthesis in the NAc shell, but not NAc core. Overall, these data demonstrate the specificity of neuronal circuit changes induced by amphetamine, introduce a novel method for studying drug challenge-induced plasticity, and define NAc shell medium spiny neurons as a primary site of persistent AMPA-type glutamate receptor plasticity by two widely used psychostimulant drugs.

The origin of glutamatergic synaptic inputs controls synaptic plasticity and its modulation by alcohol in mice nucleus accumbens

It is widely accepted that long-lasting changes of synaptic strength in the nucleus accumbens (NAc), a brain region involved in drug reward, mediate acute and chronic effects of alcohol. However, our understanding of the mechanisms underlying the effects of alcohol on synaptic plasticity is limited by the fact that the NAc receives glutamatergic inputs from distinct brain regions (e.g., the prefrontal cortex (PFCx), the amygdala and the hippocampus), each region providing different information (e.g., spatial, emotional and cognitive). Combining whole-cell patch-clamp recordings and the optogenetic technique, we examined synaptic plasticity, and its regulation by alcohol, at cortical, hippocampal and amygdala inputs in fresh slices of mouse tissue. We showed that the origin of synaptic inputs determines the basic properties of glutamatergic synaptic transmission, the expression of spike-timing dependent long-term depression (tLTD) and long-term potentiation (LTP) and long-term potentiation (tLTP) and their regulation by alcohol. While we observed both tLTP and tLTD at amygadala and hippocampal synapses, we showed that cortical inputs only undergo tLTD. Functionally, we provide evidence that acute Ethyl Alcohol (EtOH) has little effects on higher order information coming from the PFCx, while severely impacting the ability of emotional and contextual information to induce long-lasting changes of synaptic strength.

Functional and structural deficits at accumbens synapses in a mouse model of Fragile X

Fragile X is the most common cause of inherited intellectual disability and a leading cause of autism. The disease is caused by mutation of a single X-linked gene called fmr1 that codes for the Fragile X mental retardation protein (FMRP), a 71 kDa protein, which acts mainly as a translation inhibitor. Fragile X patients suffer from cognitive and emotional deficits that coincide with abnormalities in dendritic spines. Changes in spine morphology are often associated with altered excitatory transmission and long-term plasticity, the most prominent deficit in fmr1-/y mice. The nucleus accumbens, a central part of the mesocortico-limbic reward pathway, is now considered as a core structure in the control of social behaviors. Although the socio-affective impairments observed in Fragile X suggest dysfunctions in the accumbens, the impact of the lack of FMRP on accumbal synapses has scarcely been studied. Here we report for the first time a new spike timing-dependent plasticity paradigm that reliably triggers NMDAR-dependent long-term potentiation (LTP) of excitatory afferent inputs of medium spiny neurons (MSN) in the nucleus accumbens core region. Notably, we discovered that this LTP was completely absent in fmr1-/y mice. In the fmr1-/y accumbens intrinsic membrane properties of MSNs and basal excitatory neurotransmission remained intact in the fmr1-/y accumbens but the deficit in LTP was accompanied by an increase in evoked AMPA/NMDA ratio and a concomitant reduction of spontaneous NMDAR-mediated currents. In agreement with these physiological findings, we found significantly more filopodial spines in fmr1-/y mice by using an ultrastructural electron microscopic analysis of accumbens core medium spiny neuron spines. Surprisingly, spine elongation was specifically due to the longer longitudinal axis and larger area of spine necks, whereas spine head morphology and postsynaptic density size on spine heads remained unaffected in the fmr1-/y accumbens. These findings together reveal new structural and functional synaptic deficits in Fragile X.

Functional deficiency of MHC class I enhances LTP and abolishes LTD in the nucleus accumbens of mice

Major histocompatibility complex class I (MHCI) molecules were recently identified as novel regulators of synaptic plasticity. These molecules are expressed in various brain areas, especially in regions undergoing activity-dependent synaptic plasticity, but their role in the nucleus accumbens (NAc) is unknown. In this study, we investigated the effects of genetic disruption of MHCI function, through deletion of β2-microblobulin, which causes lack of cell surface expression of MHCI. First, we confirmed that MHCI molecules are expressed in the NAc core in wild-type mice. Second, we performed electrophysiological recordings with NAc core slices from wild-type and β2-microglobulin knock-out mice lacking cell surface expression of MHCI. We found that low frequency stimulation induced long-term depression in wild-type but not knock-out mice, whereas high frequency stimulation induced long-term potentiation in both genotypes, with a larger magnitude in knock-out mice. Furthermore, we demonstrated that knock-out mice showed more persistent behavioral sensitization to cocaine, which is a NAc-related behavior. Using this model, we analyzed the density of total AMPA receptors and their subunits GluR1 and GluR2 in the NAc core, by SDS-digested freeze-fracture replica labeling. After repeated cocaine exposure, the density of GluR1 was increased, but there was no change in total AMPA receptors and GluR2 levels in wild-type mice. In contrast, following repeated cocaine exposure, increased densities of total AMPA receptors, GluR1 and GluR2 were observed in knock-out mice. These results indicate that functional deficiency of MHCI enhances synaptic potentiation, induced by electrical and pharmacological stimulation.

Dopamine preferentially inhibits NMDA receptor-mediated EPSCs by acting on presynaptic D1 receptors in nucleus accumbens during postnatal development

Nucleus accumbens (nAcb), a major site of action of drugs of abuse and dopamine (DA) signalling in MSNs (medium spiny neurons), is critically involved in mediating behavioural responses of drug addiction. Most studies have evaluated the effects of DA on MSN firing properties but thus far, the effects of DA on a cellular circuit involving glutamatergic afferents to the nAcb have remained rather elusive. In this study we attempted to characterize the effects of dopamine (DA) on evoked glutamatergic excitatory postsynaptic currents (EPSCs) in nAcb medium spiny (MS) neurons in 1 to 21 day-old rat pups. The EPSCs evoked by local nAcb stimuli displayed both AMPA/KA and NMDA receptor-mediated components. The addition of DA to the superfusing medium produced a marked decrease of both components of the EPSCs that did not change during the postnatal period studied. Pharmacologically isolated AMPA/KA receptor-mediated response was inhibited on average by 40% whereas the isolated NMDA receptor-mediated EPSC was decreased by 90%. The effect of DA on evoked EPSCs were mimicked by the D₁-like receptor agonist SKF 38393 and antagonized by the D₁-like receptor antagonist SCH 23390 whereas D₂-like receptor agonist or antagonist respectively failed to mimic or to block the action of DA. DA did not change the membrane input conductance of MS neurons or the characteristics of EPSCs produced by the local administration of glutamate in the presence of tetrodotoxin. In contrast, DA altered the paired-pulse ratio of evoked EPSCs. The present results show that the activation D₁-like dopaminergic receptors modulate glutamatergic neurotransmission by preferentially inhibiting NMDA receptor-mediated EPSC through presynaptic mechanisms.

Low-frequency stimulation evokes serotonin release in the nucleus accumbens and induces long-term depression via production of endocannabinoid

The nucleus accumbens (NAc), a major component of the mesolimbic system, is involved in the mediation of reinforcing and addictive properties of many dependence-producing drugs. Glutamatergic synapses within the NAc can express plasticity, including a form of endocannabinoid (eCB)-long-term depression (LTD). Recent evidences demonstrate cross talk between eCB signaling pathways and those of other receptor systems, including serotonin (5-HT); the extensive colocalization of CB1 and 5-HT receptors within the NAc suggests the potential for interplay between them. In the present study, we found that 20-min low-frequency (4 Hz) stimulation (LFS-4Hz) of glutamatergic afferences in rat brain slices induces a novel form of eCB-LTD in the NAc core, which requires 5-HT2 and CB1 receptor activation and L-type voltage-gated Ca2+ channel opening. Moreover, we found that exogenous 5-HT application (5 μM, 20 min) induces an analogous LTD (5-HT-LTD) at the same synapses, requiring the activation of the same receptors and the opening of the same Ca2+ channels; LFS-4Hz-LTD and 5-HT-LTD were mutually occlusive. Present results suggest that LFS-4Hz induces the release of 5-HT, which acts at 5-HT2 postsynaptic receptors, increasing Ca2+ influx through L-type voltage-gated channels and 2-arachidonoylglycerol production and release; the eCB travels retrogradely and binds to presynaptic CB1 receptors, causing a long-lasting decrease of glutamate release, resulting in LTD. These observations might be helpful to understand the neurophysiological mechanisms underlying drug addiction, major depression, and other psychiatric disorders characterized by dysfunction of 5-HT neurotransmission in the NAc.

Dopaminergic control of motivation and reinforcement learning: a closed-circuit account for reward-oriented behavior

Humans and animals take actions quickly when they expect that the actions lead to reward, reflecting their motivation. Injection of dopamine receptor antagonists into the striatum has been shown to slow such reward-seeking behavior, suggesting that dopamine is involved in the control of motivational processes. Meanwhile, neurophysiological studies have revealed that phasic response of dopamine neurons appears to represent reward prediction error, indicating that dopamine plays central roles in reinforcement learning. However, previous attempts to elucidate the mechanisms of these dopaminergic controls have not fully explained how the motivational and learning aspects are related and whether they can be understood by the way the activity of dopamine neurons itself is controlled by their upstream circuitries. To address this issue, we constructed a closed-circuit model of the corticobasal ganglia system based on recent findings regarding intracortical and corticostriatal circuit architectures. Simulations show that the model could reproduce the observed distinct motivational effects of D1- and D2-type dopamine receptor antagonists. Simultaneously, our model successfully explains the dopaminergic representation of reward prediction error as observed in behaving animals during learning tasks and could also explain distinct choice biases induced by optogenetic stimulation of the D1 and D2 receptor-expressing striatal neurons. These results indicate that the suggested roles of dopamine in motivational control and reinforcement learning can be understood in a unified manner through a notion that the indirect pathway of the basal ganglia represents the value of states/actions at a previous time point, an empirically driven key assumption of our model.

Molecular and cellular mechanisms of dopamine-mediated behavioral plasticity in the striatum

The striatum is the input structure of the basal ganglia system. By integrating glutamatergic signals from cortical and subcortical regions and dopaminergic signals from mesolimbic nuclei the striatum functions as an important neural substrate for procedural and motor learning as well as for reward-guided behaviors. In addition, striatal activity is significantly altered in pathological conditions in which either a loss of dopamine innervation (Parkinson's disease) or aberrant dopamine-mediated signaling (drug addiction and L-DOPA induced dyskinesia) occurs. Here we discuss cellular mechanisms of striatal synaptic plasticity and aspects of cell signaling underlying striatum-dependent behavior, with a major focus on the neuromodulatory action of the endocannabinoid system and on the role of the Ras-ERK cascade.

A role for Sv2c in basal ganglia functions

SV2C is an isoform of the synaptic vesicle 2 protein family that exhibits a particular pattern of brain expression with enriched expression in several basal ganglia nuclei. In the present study, we have investigated SV2C implication in both normal and pathological basal ganglia functioning with a peculiar attention to dopamine neuron containing regions. In SV2C-/- mice, the expression of tyrosine hydroxylase mRNA in midbrain dopaminergic neurons was largely and significantly increased and enkephalin mRNA expression was significantly decreased in the caudate-putamen and accumbens nucleus. The expression of SV2C was studied in two models of dopaminergic denervation (6-OHDA- and MPTP-induced lesions). In dopamine-depleted animals, SV2C mRNA expression was significant increased in the striatum. In order to further understand the role of SV2C, we performed behavioral experiments on SV2C-/- mice and on knock-down mice receiving an injection of adeno-associated virus expressing SV2C miRNA specifically in the ventral midbrain. These modifications of SV2C expression had little or no impact on behavior in open field and elevated plus maze. However, even if complete loss of SV2C had no impact on conditioned place preference induced by cocaine, the specific knock-down of SV2C expression in the dopaminergic neurons completely abolished the development of a CPP while the reaction to an acute drug injection remains similar in these mice compared to control mice. These results showed that SV2C, a poorly functionally characterized protein is strongly involved in normal operation of the basal ganglia network and could be also involved in system adaptation in basal ganglia pathological conditions.

Updating dopamine reward signals

Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily driven by reward, and to some extent risk, whereas punishment and salience have only limited activating effects when appropriate controls are respected. The signal is homogeneous in terms of time course but heterogeneous in many other aspects. It is essential for synaptic plasticity and a range of behavioural learning situations.

New rules governing synaptic plasticity in core nucleus accumbens medium spiny neurons

The nucleus accumbens is a forebrain region responsible for drug reward and goal-directed behaviors. It has long been believed that drugs of abuse exert their addictive properties on behavior by altering the strength of synaptic communication over long periods of time. To date, attempts at understanding the relationship between drugs of abuse and synaptic plasticity have relied on the high-frequency long-term potentiation model of T.V. Bliss & T. Lømo [(1973) Journal of Physiology, 232, 331-356]. We examined synaptic plasticity using spike-timing-dependent plasticity, a stimulation paradigm that reflects more closely the in vivo firing patterns of mouse core nucleus accumbens medium spiny neurons and their afferents. In contrast to other brain regions, the same stimulation paradigm evoked bidirectional long-term plasticity. The magnitude of spike-timing-dependent long-term potentiation (tLTP) changed with the delay between action potentials and excitatory post-synaptic potentials, and frequency, whereas that of spike-timing-dependent long-term depression (tLTD) remained unchanged. We showed that tLTP depended on N-methyl-d-aspartate receptors, whereas tLTD relied on action potentials. Importantly, the intracellular calcium signaling pathways mobilised during tLTP and tLTD were different. Thus, calcium-induced calcium release underlies tLTD but not tLTP. Finally, we found that the firing pattern of a subset of medium spiny neurons was strongly inhibited by dopamine receptor agonists. Surprisingly, these neurons were exclusively associated with tLTP but not with tLTD. Taken together, these data point to the existence of two subgroups of medium spiny neurons with distinct properties, each displaying unique abilities to undergo synaptic plasticity.

Fast-spiking interneurons of the rat ventral striatum: temporal coordination of activity with principal cells and responsiveness to reward

Although previous in vitro studies revealed inhibitory synaptic connections of fast-spiking interneurons to principal cells in the striatum, uncertainty remains about the nature of the behavioural events that correlate with changes in interneuron activity and about the temporal coordination of interneuron firing with spiking of principal cells under natural conditions. Using in vivo tetrode recordings from the ventral striatum in freely moving rats, fast-spiking neurons were distinguished from putative medium-sized spiny neurons on the basis of their spike waveforms and rates. Cross-correlograms of fast-spiking and putative medium-sized spiny neuron firing patterns revealed a variety of temporal relationships, including peaks of concurrent firing and transient decrements in medium-sized spiny neuron spiking around fast-spiking unit activity. Notably, the onset of these decrements was mostly in advance of the fast-spiking unit firing. Many of these temporal relationships were dependent on the sleep-wake state. Coordinated activity was also found amongst pairs of the same phenotype, both fast-spiking units and putative medium-sized spiny neurons, which was often marked by a broad peak of concurrent firing. When studying fast-spiking neurons in a reward-searching task, they generally showed a pre-reward ramping increment in firing rate but a decrement specifically when the rat received reward. In conclusion, our data indicate that various forms of temporally coordinated activity exist amongst ventral striatal interneurons and principal cells, which cannot be explained by feed-forward inhibitory circuits alone. Furthermore, firing patterns of ventral striatal fast-spiking interneurons do not merely correlate with the general arousal state of the animal but display distinct reward-related changes in firing rate.

Electrical and pharmacological manipulations of the nucleus accumbens core impair synaptic plasticity in the dentate gyrus of the rat

The interest on the physiology of the nucleus accumbens (NAcc) has grown in recent years given its relationship to addictive behaviours, and the possibility to treat them by interacting with NAcc function. We have shown that the prior stimulation of the core region blocks induction of long-term potentiation (LTP) at the dentate gyrus in anaesthetized rats, while the shell facilitated it. In the present study we have confirmed and expanded those results testing the effects of core and shell stimulation in freely moving rats, as well as the effect of blocking D1 receptors in the NAcc. Our results show that shell stimulation had no effect on baseline recordings of the field excitatory postsynaptic potential (fEPSP) or the population spike amplitude (PSA) for 24 h. Core stimulation did not modify baseline-fEPSP, but significantly depressed PSA up to 8 h. LTP maintenance was not modified; neither by core nor shell stimulation after its induction, but LTP induction was impaired (both in the fEPSP and PSA) by core stimulation 15 min before induction. Shell stimulation showed a slight facilitating effect. Previous, topical application of a dopaminergic-receptor antagonist (SCH23390) into the NAcc produced a significantly depressed baseline fEPSP and PSA, as well as LTP measured in both components of the evoked potentials. Our results confirm a dual role of stimulation of NAcc sub-regions on hippocampal baseline synaptic transmission, and LTP induction when activated before induction. In contrast, stimulation of the NAcc had no influence on an already ongoing dentate gyrus LTP. A role for dopaminergic innervation to the NAcc, modifying susceptibility for synaptic plasticity outside the NAcc is also suggested by our results.

Synaptic plasticity in the mesolimbic system: therapeutic implications for substance abuse

In an ever-changing environment, animals must learn new behavioral strategies for the successful procurement of food, sex, and other needs. Synaptic plasticity within the mesolimbic system, a key reward circuit, affords an animal the ability to adapt and perform essential goal-directed behaviors. Ironically, drugs of abuse can also induce synaptic changes within the mesolimbic system, and such changes are hypothesized to promote deleterious drug-seeking behaviors in lieu of healthy, adaptive behaviors. In this review, we will discuss drug-induced neuroadaptations in excitatory transmission in the ventral tegmental area and the nucleus accumbens, two critical regions of the mesolimbic system, and the possible role of dopamine receptors in the development of these neuroadaptations. In particular, we will focus our discussion on recent studies showing changes in AMPA receptor function as a common molecular target of addictive drugs, and the possible behavioral consequences of such neuroadaptations.

Computational models of reinforcement learning: the role of dopamine as a reward signal

Reinforcement learning is ubiquitous. Unlike other forms of learning, it involves the processing of fast yet content-poor feedback information to correct assumptions about the nature of a task or of a set of stimuli. This feedback information is often delivered as generic rewards or punishments, and has little to do with the stimulus features to be learned. How can such low-content feedback lead to such an efficient learning paradigm? Through a review of existing neuro-computational models of reinforcement learning, we suggest that the efficiency of this type of learning resides in the dynamic and synergistic cooperation of brain systems that use different levels of computations. The implementation of reward signals at the synaptic, cellular, network and system levels give the organism the necessary robustness, adaptability and processing speed required for evolutionary and behavioral success.

Functional and dysfunctional synaptic plasticity in prefrontal cortex: roles in psychiatric disorders

Prefrontal cortex (PFC) mediates an assortment of cognitive functions including working memory, behavioral flexibility, attention, and future planning. Unlike the hippocampus, where induction of synaptic plasticity in the network is well-documented in relation to long-term memory, cognitive functions mediated by the PFC have been thought to be independent of long-lasting neuronal adaptation of the network. Nonetheless, accumulating evidence suggests that prefrontal cortical neurons possess the cellular machinery of synaptic plasticity and exhibit lasting changes of neural activity associated with various cognitive processes. Moreover, deficits in the mechanisms of synaptic plasticity induction in the PFC might be involved in the pathophysiology of psychiatric and neurological disorders such as schizophrenia, drug addiction, mood disorders, and Alzheimer's disease.

Roles for nigrostriatal--not just mesocorticolimbic--dopamine in reward and addiction

Forebrain dopamine circuitry has traditionally been studied by two largely independent specialist groups: students of Parkinson's disease who study the nigrostriatal dopamine system that originates in the substantia nigra (SN), and students of motivation and addiction who study the role of the mesolimbic and mesocortical dopamine systems that originate in the ventral tegmental area (VTA). The anatomical evidence for independent nigrostriatal and mesolimbic dopamine systems has, however, long been obsolete. There is now compelling evidence that both nominal "systems" participate in reward function and addiction. Electrical stimulation of both SN and VTA is rewarding, blockade of glutamatergic or cholinergic input to either SN or VTA attenuates the habit-forming effects of intravenous cocaine, and dopamine in both nigrostriatal and mesocorticolimbic terminal fields participates in the defining property of rewarding events: the reinforcement of memory consolidation. Thus, the similarities between nigrostriatal and mesolimbic dopamine systems can be as important as their differences.

Maturation of Excitatory Synaptic Transmission of the Rat Nucleus Accumbens From Juvenile to Adult

Precise control of synaptic strength is critical for maintaining accurate network activity and normal brain functions. Several major brain diseases are related to synaptic alterations in the adult brain. Detailed descriptions of the normal physiological properties of adult synapses are scarce, mainly because of the difficulties in performing whole cell patch-clamp recording in brain slices from adult animals. Here we present the portrait of excitatory synapses and intrinsic properties of medium spiny neurons (MSNs) of the nucleus accumbens (NAc), a central structure of the mesocorticolimbic system, from youth (P14) to adulthood (P120). We found that intrinsic neuronal excitability decreased over development, mainly due to an enhancement of potassium conductance and the consequent reduction in membrane resistance. The ratio between paired-pulse synaptic responses was similar in juvenile, adolescent, and adult MSNs, suggesting that the probability of neurotransmitter release was unaltered. α-Amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR)–mediated excitatory postsynaptic currents (EPSCs) decayed more slowly in adult MSN. In contrast, the kinetic properties and the subunit composition of N-methyl-d-aspartate receptor (NMDAR)–mediated EPSC in the NAc were conserved from youth to adulthood. Changes in synaptic strength were estimated from the ratio of AMPAR to NMDAR evoked and spontaneous EPSCs (AMPAR/NMDAR ratio). Although both AMPAR and NMDAR EPSCs decreased over development, there was an increase of the AMPAR/NMDAR ratio that was linked to changes in NMDAR EPSC. Furthermore, distribution of the AMPAR/NMDAR ratio was more heterogeneous in MSNs from adults, suggesting that synaptic strength is continuously refined during life.

N-Acetylcysteine reverses cocaine-induced metaplasticity

Cocaine addiction is characterized by an impaired ability to develop adaptive behaviors that can compete with cocaine seeking, implying a deficit in the ability to induce plasticity in cortico-accumbens circuitry critical for regulating motivated behavior. RWe found that rats withdrawn from cocaine self-administration had a marked in vivo deficit in the ability to develop long-term potentation (LTP) and depression (LTD) in the nucleus accumbens core subregion following stimulation of prefrontal cortex. N-acetylcysteine treatment prevents relapse in animal models and craving in humans by activating cystine-glutamate exchange and thereby stimulating extrasynaptic metabotropic glutamate receptors (mGluR). N-acetylcysteine treatment restored the ability to induce LTP and LTD by indirectly stimulating mGluR2/3 and mGluR5, respectively. Cocaine self-administration induces metaplasticity that inhibits the further induction of synaptic plasticity, and this impairment can be reversed by N-acetylcysteine, a drug that also prevents relapse.

Limbic and cortical information processing in the nucleus accumbens

The nucleus accumbens regulates goal-directed behaviors by integrating information from limbic structures and the prefrontal cortex. Here, we review recent studies in an attempt to provide an integrated view of the control of information processing in the nucleus accumbens in terms of the regulation of goal-directed behaviors and how disruption of these functions might underlie the pathological states in drug addiction and other psychiatric disorders. We propose a model that could account for the results of several studies investigating limbic-system interactions in the nucleus accumbens and their modulation by dopamine and provide testable hypotheses for how these might relate to the pathophysiology of major psychiatric disorders.

Preferential reactivation of motivationally relevant information in the ventral striatum

Spontaneous "off-line" reactivation of neuronal activity patterns may contribute to the consolidation of memory traces. The ventral striatum exhibits reactivation and has been implicated in the processing of motivational information. It is unknown, however, whether reactivating neuronal ensembles specifically recapitulate information relating to rewards that were encountered during wakefulness. We demonstrate a prolonged reactivation in rat ventral striatum during quiet wakefulness and slow-wave but not rapid eye movement sleep. Reactivation of reward-related information processed in this structure was particularly prominent, and this was primarily attributable to spike trains temporally linked to reward sites. It was accounted for by small, strongly correlated subgroups in recorded cell assemblies and can thus be characterized as a sparse phenomenon. Our results indicate that reactivated memory traces may not only comprise feature- and context-specific information but also contain a value component.

Acute and chronic dopamine receptor stimulation modulates AMPA receptor trafficking in nucleus accumbens neurons cocultured with prefrontal cortex neurons

Postsynaptic interactions between dopamine (DA) and glutamate receptors in the nucleus accumbens (NAc) are critical for addiction. To determine the effect of acute and repeated DA receptor stimulation on AMPA receptor (AMPAR) synaptic targeting in medium spiny NAc neurons, we developed a model system consisting of rat NAc neurons cocultured with prefrontal cortex neurons from enhanced green fluorescent protein-expressing mice. Cortical neurons restore excitatory input onto NAc neurons but are distinguishable based on fluorescence. First, we showed that brief D1-like agonist exposure increased AMPAR insertion onto extrasynaptic regions of NAc neuronal processes through a mechanism requiring protein kinase A. This facilitated the Ca2+/calmodulin dependent protein kinase II (CaMKII)-dependent synaptic incorporation of AMPARs in response to subsequent NMDA receptor (NMDAR) stimulation. Through this mechanism, DA may promote reward- and drug-related plasticity in the NAc. Then, to model effects of repeated in vivo cocaine exposure, we treated cocultures with DA (1 microm, 30 min) on days 7, 9, and 11 in culture. On day 15, NAc neurons exhibited increased synaptic AMPAR levels. This was associated with CaMKII activation and was blocked by the CaMKII inhibitor KN-93 (N-[2-[N-(4-chlorocinnamyl)-N-methylaminomethyl]phenyl]-N-(2-hydroxyethyl)-4-methoxybenzenesulfonamide phosphate salt). Furthermore, D1-like agonist exposure on day 15 no longer increased AMPAR surface expression. This refractoriness was associated with decreased D1 receptor surface expression. NMDAR surface expression was not altered by acute or repeated DA receptor stimulation. These results suggest that (1) after repeated DA treatment, NAc neurons are more responsive to glutamate inputs but D(1)-like receptor regulation of plasticity is impaired, and (2) NAc/prefrontal cortex cocultures are useful for studying dopamine-induced neuroadaptations.

Dopamine D1 receptors and group I metabotropic glutamate receptors contribute to the induction of long-term potentiation in the nucleus accumbens

Long-term changes in the efficacy of glutamatergic synaptic transmission in the striatal complex are proposed to underlie motor learning and neuroadaptations leading to addiction. Dopamine and glutamate play key roles in the induction of long-term potentiation (LTP) and long-term depression (LTD) in the dorsal striatum, but their contribution to synaptic plasticity in the ventral striatum (nucleus accumbens, NAc) has been less extensively studied. We have examined the role of dopamine, glutamate and GABA in the induction of LTP in mouse brain slices containing the NAc. High-frequency stimulation of glutamatergic inputs elicited LTP of field excitatory postsynaptic potentials/population spikes (fEPSP/PSs) in the core region of the NAc. GABA did not seem to participate in LTP induction because LTP was not altered in the presence of either a GABA(A)- (bicuculline) or a GABA(B)- (CGP 55845) receptor antagonist. However, the dopamine D1 receptor antagonist SCH 23390, but not the dopamine D2 receptor antagonist sulpiride, impaired LTP. The dopamine reuptake blocker nomifensine also inhibited LTP induction. We found that group I metabotropic glutamate receptors (mGluRs) contribute to LTP induction because the mGluR1 antagonist LY 367385, or the mGluR5 antagonist MPEP, blocked LTP induction. Furthermore, the glutamate reuptake blocker DL-TBOA also impaired LTP. The present results demonstrate that dopamine and glutamate play critical roles in the mechanisms of induction of LTP in the NAc through the activation of dopamine D1 receptors and group I mGluRs. However, LTP is negatively regulated when endogenous levels of dopamine or glutamate are elevated.

Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement

Ventral tegmental area (VTA) neuron firing precedes behaviors elicited by reward-predictive sensory cues and scales with the magnitude and unpredictability of received rewards. These patterns are consistent with roles in the performance of learned appetitive behaviors and in positive reinforcement, respectively. The VTA includes subpopulations of neurons with different afferent connections, neurotransmitter content, and projection targets. Because the VTA and substantia nigra pars compacta are the sole sources of striatal and limbic forebrain dopamine, measurements of dopamine release and manipulations of dopamine function have provided critical evidence supporting a VTA contribution to these functions. However, the VTA also sends GABAergic and glutamatergic projections to the nucleus accumbens and prefrontal cortex. Furthermore, VTA-mediated but dopamine-independent positive reinforcement has been demonstrated. Consequently, identifying the neurotransmitter content and projection target of VTA neurons recorded in vivo will be critical for determining their contribution to learned appetitive behaviors.

MPTP-induced deficits in striatal synaptic plasticity are prevented by glial cell line-derived neurotrophic factor expressed via an adeno-associated viral vector

This study determined the consequences of dopamine denervation of the striatum on synaptic plasticity and prevention of these changes with gene therapy using an adeno-associated viral vector (AAV) expressing glial cell line-derived neurotrophic factor (GDNF). C57BL6/J mice were injected with the neurotoxin 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine(MPTP); long-term depression (LTD) or potentiation (LTP) were measured in vitro. Fast-scan cyclic voltammetry measured electrically released dopamine from a functionally relevant pool in these same striatal slices. After MPTP, dopamine release and uptake were greatly diminished, and LTP and LTD were blocked in the striatal slices. The loss of plasticity resulted directly from the loss of dopamine since its application rescued synaptic plasticity. Striatal GDNF expression via AAV, before MPTP, significantly protected against the loss of dopamine and prevented the blockade of corticostriatal LTP. These data demonstrate that dopamine plays a role in supporting several forms of striatal plasticity and that GDNF expression via AAV prevents the loss of dopamine and striatal plasticity caused by MPTP. We propose that impairment of striatal plasticity after dopamine denervation plays a role in the symptomology of Parkinson's disease and that AAV expression of neurotrophic factors represents a tenable approach to protecting against or slowing these neurobiological deficits.

Role of the cyclic-AMP/PKA cascade and of P/Q-type Ca++ channels in endocannabinoid-mediated long-term depression in the nucleus accumbens

Glutamate transmission between prefrontal cortex (PFC) and accumbens (NAc) plays a crucial role in the establishment and expression of addictive behaviors. At these synapses exogenous cannabinoid receptor 1 (CB1R) agonists reversibly inhibit excitatory transmission, and the sustained release of endogenous cannabinoids (eCB) following prolonged cortical stimulation leads to long-term depression (LTD). Activation of presynaptic K(+) channels mediates the effects of exocannabinoids, but the transduction pathway underlying the protracted phase of eCB-LTD is unknown. Here we report that the maintenance of eCB-LTD does not involve presynaptic K(+) channels: eCB-LTD was not affected by blockade of K(+) channels with 4-AP (100 microM) and BaCl(2) (300 microM) (fEPSP=78.9+/-5.4% of baseline 58-60 min after tetanus, compared to 78.9+/-5.9% in control slices). In contrast, eCB-LTD was blocked by treatment of the slices with the adenylyl cyclase (AC) activator forskolin (10 microM), and with the protein kinase A (PKA) inhibitor KT5720 (1 microM) (fEPSP=108.9+/-5.7% in forskolin and 110.5+/-7.7% in KT5720, compared to 80.6+/-3.9% in control conditions). Additionally, selective blockade of P/Q-type Ca(2+) channels with omega-agatoxin-IVA (200 nM) occluded the expression of eCB-LTD (fEPSP=113.4+/-15.9% compared to 78.6+/-4.4% in control slices), while blockade of N- with omega-conotoxin-GVIA (1 microM) or L-type Ca(2+) channels with nimodipine (1 microM), was without effect (fEPSP was 83.7+/-5.3% and 87+/-8.9% respectively). These data show that protracted inhibition of AC/PKA activity and P/Q-type Ca(2+) channels are necessary for expression of eCB-LTD at NAc synapses.

Accumbal neurons that are activated during cocaine self-administration are spared from inhibitory effects of repeated cocaine self-administration

Hypoactivity of the accumbens is induced by repeated cocaine exposure and is hypothesized to play a role in cocaine addiction. However, it is difficult to understand how a general hypoactivity of the accumbens, which facilitates multiple types of motivated behaviors, could contribute to the selective increase in drug-directed behavior that defines addiction. Electrophysiological recordings, made during sessions in which rats self-administer cocaine, show that most accumbal neurons that encode events related to drug-directed behavior achieve and maintain higher firing rates during the period of cocaine exposure (Task-Activated neurons) than do other accumbal neurons (Task-Non-Activated neurons). We have hypothesized that this difference in activity makes the neurons that facilitate drug-directed behavior less susceptible than other neurons to the chronic inhibitory effects of cocaine. A sparing of neurons that facilitate drug-directed behavior from chronic hypoactivity might lead to a relative increase in the transmission of neuronal signals that facilitate drug-directed behavior through accumbal circuits and thereby contribute to changes in behavior that characterize addiction (ie differential inhibition hypothesis). A prediction of the hypothesis is that neurons that are activated in relation to task events during cocaine self-administration sessions will show less of a decrease in firing across repeated self-administration sessions than will other neurons. To test this prediction, rats were exposed to 30 daily (6 h/day) cocaine self-administration sessions. Chronic extracellular recordings of single accumbal neurons were made during the second to third session and the 30th session. Between-session comparisons showed that decreases in firing were exhibited by Task-Non-Activated, but not by Task-Activated, neurons. During the day 30 session, the magnitude of the difference in firing rate between the two groups of neurons was positively related to the propensity of animals to seek and take cocaine. The findings of the present study are consistent with a basic prediction of the differential inhibition hypothesis and may be relevant to understanding cocaine addiction.

Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix

The striatum is the major input nucleus of the basal ganglia. It is thought to play a key role in learning on the basis of positive reinforcement and in action selection. One view of the striatum conceives it as comprising a reiterated matrix of processing units that perform common operations in different striatal regions, namely synaptic plasticity according to a three-factor rule, and lateral inhibition. These operations are required for reinforcement learning and selection of previously reinforced actions. Analysis of the behavioral effects of circumscribed lesions of the striatum, however, suggests regional specialization of learning and decision-making operations. We consider how a basic processing unit may be modified by regional variations in neurochemical parameters, for example, by the gradient in density of dopamine terminals from dorsal to ventral striatum. These variations suggest subtle differences between dorsolateral and ventromedial striatal regions in the temporal properties of dopamine signaling, which are superimposed on regional differences in connectivity. We propose that these variations make sense in relation to the temporal structure of activity in striatal inputs from different regions, and the requirements of different learning operations. Dorsolateral striatal (DLS) regions may be subject to brief, precisely timed pulses of dopamine, whereas ventromedial striatal regions integrate dopamine signals over a longer time course. These differences may be important for understanding regional variations in the contribution to reinforcement of habits, versus incentive processes that are sensitive to the value of expected rewards.

Membrane properties and synaptic connectivity of fast-spiking interneurons in rat ventral striatum

In vitro patch-clamp recordings were made to study the membrane properties and synaptic connectivity of fast-spiking interneurons in rat ventral striatum. Using a whole-cell configuration in acutely prepared slices, fast-spiking interneurons were recognized based on their firing properties and their morphological phenotype was confirmed by immunocytochemistry. Membrane properties of fast-spiking interneurons were distinguished from those of medium-sized spiny neurons by their more depolarized resting membrane potential, lower action potential amplitude and shorter half-width, short spike repolarization time and deep spike afterhyperpolarization. Firing patterns of interneurons could be subdivided in a bursting and non-bursting mode. Simultaneous dual whole-cell recordings revealed a high degree of connectivity of fast-spiking interneurons to medium-sized spiny neurons via unidirectional synapses. Burst firing in fast-spiking interneurons that were presynaptic to medium-sized spiny neurons resulted in barrages of postsynaptic potentials showing an initial amplitude increment, rapidly followed by a decrement. In conclusion, ventral striatal fast-spiking interneurons can be clearly distinguished from medium-sized spiny neurons by their membrane properties and their firing patterns can be subdivided in bursting and non-bursting modes. Their synaptic connectivity to medium-sized spiny neurons is unidirectional and characterized by frequency-dependent, dynamic changes in postsynaptic amplitude.

The Dopamine System and the Pathophysiology of Schizophrenia: A Basic Science Perspective

The dopamine system has been a subject of intense investigation due to its role in a number of normal functions and its disruption in pathological conditions. Thus, the dopamine system has been shown to play a major role in cognitive, affective, and motor functions, and its disruption has been proposed to underlie the pathophysiology of several major psychiatric and neurological disorders, including schizophrenia, Parkinson's disease, drug abuse, and attention deficit/hyperactivity disorder. Although these studies have continued to define the basic functional principles of the dopamine system in the mammalian brain, we are still at the initial stages in unraveling the complex role of this transmitter system in regulating behavioral processes. Accumulating evidence suggests that dopamine modulates excitatory and inhibitory neurotransmission, and moreover affects synaptic plasticity induced within the circuits of its target brain regions. It is this role in synaptic plasticity that has associated the dopamine system with aspects of cognitive function involving learning and memory. In this chapter, we summarize recent findings relevant to the role of the dopamine system in psychiatric disorders at cellular, anatomical, and functional levels. In particular, we will focus on the regulation of dopamine neuron activity states and how this impacts dopamine release in cortical and subcortical systems, and the physiological and behavioral impact of dopamine receptor stimulation in the postsynaptic targets of these neurons. A brief summary of recent findings regarding the development and maturation of DA system and how this relates to the pathophysiology of psychiatric disorders are given, and finally models of dopamine system disruption in schizophrenia and how therapeutic approaches impact on dopamine system dynamics is presented.

Nicotine improves morphine-induced impairment of memory: Possible involvement ofN-methyl-D-aspartate receptors in the nucleus accumbens

The possible involvement of N-methyl-D-aspartate (NMDA) receptors in the nucleus accumbens (NAc) in nicotine's effect on impairment of memory by morphine was investigated. A passive avoidance task was used for memory assessment in male Wistar rats. Subcutaneous (s.c.) administration of morphine (5 and 10 mg/kg) after training impaired memory performance in the animals when tested 24 h later. Pretest administration of the same doses of morphine reversed impairment of memory because of post-training administration of the opioid. Moreover, administration of nicotine (0.2 and 0.4 mg/kg, s.c.) before the test prevented impairment of memory by morphine (5 mg/kg) given after training. Impairment of memory performance in the animals because of post-training administration of morphine (5 mg/kg) was also prevented by pretest administration of a noncompetitive NMDA receptor antagonist, MK-801 (0.75 and 1 microg/rat). Interestingly, an ineffective dose of MK-801 (0.5 microg/rat) in combination with low doses (0.075 and 0.1 mg/kg) of nicotine, which had no effects alone, synergistically improved memory performance impaired by morphine given after training. On the other hand, pretest administration of NMDA (0.1 and 0.5 microg/rat), which had no effect alone, in combination with an effective dose (0.4 mg/kg, s.c.) of nicotine prevented the improving effect of nicotine on memory impaired by pretreatment morphine. The results suggest a possible role for NMDA receptors of the NAc in the improving effect of nicotine on the morphine-induced amnesia.

Transient calcium and dopamine increase PKA activity and DARPP-32 phosphorylation

Reinforcement learning theorizes that strengthening of synaptic connections in medium spiny neurons of the striatum occurs when glutamatergic input (from cortex) and dopaminergic input (from substantia nigra) are received simultaneously. Subsequent to learning, medium spiny neurons with strengthened synapses are more likely to fire in response to cortical input alone. This synaptic plasticity is produced by phosphorylation of AMPA receptors, caused by phosphorylation of various signalling molecules. A key signalling molecule is the phosphoprotein DARPP-32, highly expressed in striatal medium spiny neurons. DARPP-32 is regulated by several neurotransmitters through a complex network of intracellular signalling pathways involving cAMP (increased through dopamine stimulation) and calcium (increased through glutamate stimulation). Since DARPP-32 controls several kinases and phosphatases involved in striatal synaptic plasticity, understanding the interactions between cAMP and calcium, in particular the effect of transient stimuli on DARPP-32 phosphorylation, has major implications for understanding reinforcement learning. We developed a computer model of the biochemical reaction pathways involved in the phosphorylation of DARPP-32 on Thr34 and Thr75. Ordinary differential equations describing the biochemical reactions were implemented in a single compartment model using the software XPPAUT. Reaction rate constants were obtained from the biochemical literature. The first set of simulations using sustained elevations of dopamine and calcium produced phosphorylation levels of DARPP-32 similar to that measured experimentally, thereby validating the model. The second set of simulations, using the validated model, showed that transient dopamine elevations increased the phosphorylation of Thr34 as expected, but transient calcium elevations also increased the phosphorylation of Thr34, contrary to what is believed. When transient calcium and dopamine stimuli were paired, PKA activation and Thr34 phosphorylation increased compared with dopamine alone. This result, which is robust to variation in model parameters, supports reinforcement learning theories in which activity-dependent long-term synaptic plasticity requires paired glutamate and dopamine inputs.

Reinforcement learning, based on the association of a stimulus-triggered movement with a reward, involves changes in connection strength between neurons. Memory storage occurs in the striatum, the input stage of the basal ganglia, when a stimulus or movement signal originating from the cortex and a reward signal originating from the midbrain reach the target striatal cells together. Repetitive pairing of these two signals strengthens the connection between cortical and striatal cells. The strengthening of the connections is caused by activation of biochemical signalling pathways inside the striatal cells. These intracellular signalling pathways are explored in a quantitative computational model describing the biochemical pathways important for reinforcement learning. Lindskog et al.'s study shows that when brief reward and stimuli signals are paired, a stronger response in the intracellular signalling occurs compared with the situation when each signal is given alone. This result illustrates mechanisms whereby paired stimuli, but not unpaired stimuli, can cause learning. Furthermore, the model predicts that the biochemical responses are different after brief stimulation as compared with prolonged stimulation. This result highlights the difficulties in predicting the nonlinear interactions within signalling cascades based on prolonged stimulations, which often are used in biochemical experiments.

Session-long modulations of accumbal firing during sucrose-reinforced operant behavior

The nucleus accumbens is involved in the selection and expression of motivated behaviors. Attempts to understand how activity of single neurons in the accumbens relates to behavior have largely concentrated on brief modulations in accumbal firing that occur in the seconds around events during operant sessions. However, a small number of studies have reported modulations that last the entire duration of a behavioral session. In all of these reports, the operant session was a drug self-administration session. The present study tested the hypothesis that session-long modulations, like phasic firing patterns, are components of normal accumbal activity during periods of instrumental behavior. Eight rats were chronically implanted (unilaterally) with microwire arrays in the nucleus accumbens, and trained to lever press on a Fixed-Ratio 1 schedule of sucrose reinforcement. Activity of 51 single units was recorded, and both session-long increases (n = 14) and session-long decreases (n = 13) were observed. These findings show that session-long modulations are a normal component of the response of accumbal neurons during periods of operant behavior. Moreover, although session-long modulations during cocaine self-administration sessions might reflect pharmacological actions, aspects of the modulations might additionally or alternatively correspond to afferent-driven responses. Further characterization of the firing patterns may elucidate novel mechanisms that mediate accumbal contributions to behavior.