51
|
Buschman TJ, Miller EK. Goal-direction and top-down control. Philos Trans R Soc Lond B Biol Sci 2015; 369:rstb.2013.0471. [PMID: 25267814 DOI: 10.1098/rstb.2013.0471] [Citation(s) in RCA: 69] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
We review the neural mechanisms that support top-down control of behaviour and suggest that goal-directed behaviour uses two systems that work in concert. A basal ganglia-centred system quickly learns simple, fixed goal-directed behaviours while a prefrontal cortex-centred system gradually learns more complex (abstract or long-term) goal-directed behaviours. Interactions between these two systems allow top-down control mechanisms to learn how to direct behaviour towards a goal but also how to guide behaviour when faced with a novel situation.
Collapse
Affiliation(s)
- Timothy J Buschman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| | - Earl K Miller
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| |
Collapse
|
52
|
Tozzi A, de Iure A, Tantucci M, Durante V, Quiroga-Varela A, Giampà C, Di Mauro M, Mazzocchetti P, Costa C, Di Filippo M, Grassi S, Pettorossi VE, Calabresi P. Endogenous 17β-estradiol is required for activity-dependent long-term potentiation in the striatum: interaction with the dopaminergic system. Front Cell Neurosci 2015; 9:192. [PMID: 26074768 PMCID: PMC4445326 DOI: 10.3389/fncel.2015.00192] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2015] [Accepted: 04/30/2015] [Indexed: 11/13/2022] Open
Abstract
17β-estradiol (E2), a neurosteroid synthesized by P450-aromatase (ARO), modulates various brain functions. We characterized the role of the locally synthesized E2 on striatal long-term synaptic plasticity and explored possible interactions between E2 receptors (ERs) and dopamine (DA) receptors in the dorsal striatum of adult male rats. Inhibition of E2 synthesis or antagonism of ERs prevented the induction of long-term potentiation (LTP) in both medium spiny neurons (MSNs) and cholinergic interneurons (ChIs). Activation of a D1-like DA receptor/cAMP/PKA-dependent pathway restored LTP. In MSNs exogenous E2 reversed the effect of ARO inhibition. Also antagonism of M1 muscarinic receptors prevented the D1-like receptor-mediated restoration of LTP confirming a role for ChIs in controlling the E2-mediated LTP of MSNs. A novel striatal interaction, occurring between ERs and D1-like receptors in both MSNs and ChIs, might be critical to regulate basal ganglia physiology and to compensate synaptic alterations in Parkinson’s disease.
Collapse
Affiliation(s)
- Alessandro Tozzi
- Department of Experimental Medicine, Section of Physiology and Biochemistry, University of Perugia Perugia, Italy ; Fondazione Santa Lucia, IRCCS Rome, Italy
| | - Antonio de Iure
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | - Michela Tantucci
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | - Valentina Durante
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | - Ana Quiroga-Varela
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | | | - Michela Di Mauro
- Department of Experimental Medicine, Section of Physiology and Biochemistry, University of Perugia Perugia, Italy
| | - Petra Mazzocchetti
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | - Cinzia Costa
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | - Massimiliano Di Filippo
- Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| | - Silvarosa Grassi
- Department of Experimental Medicine, Section of Physiology and Biochemistry, University of Perugia Perugia, Italy
| | - Vito Enrico Pettorossi
- Department of Experimental Medicine, Section of Physiology and Biochemistry, University of Perugia Perugia, Italy
| | - Paolo Calabresi
- Fondazione Santa Lucia, IRCCS Rome, Italy ; Clinica Neurologica, Dipartimento di Medicina, Università degli Studi di Perugia, Ospedale Santa Maria della Misericordia Perugia, Italy
| |
Collapse
|
53
|
Oswald MJ, Schulz JM, Kelsch W, Oorschot DE, Reynolds JNJ. Potentiation of NMDA receptor-mediated transmission in striatal cholinergic interneurons. Front Cell Neurosci 2015; 9:116. [PMID: 25914618 PMCID: PMC4391264 DOI: 10.3389/fncel.2015.00116] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2014] [Accepted: 03/13/2015] [Indexed: 12/30/2022] Open
Abstract
Pauses in the tonic firing of striatal cholinergic interneurons (CINs) emerge during reward-related learning in response to conditioning of a neutral cue. We have previously reported that augmenting the postsynaptic response to cortical afferents in CINs is coupled to the emergence of a cell-intrinsic afterhyperpolarization (AHP) underlying pauses in tonic activity. Here we investigated in a bihemispheric rat-brain slice preparation the mechanisms of synaptic plasticity of excitatory afferents to CINs and the association with changes in the AHP. We found that high frequency stimulation (HFS) of commissural corticostriatal afferents from the contralateral hemisphere induced a robust long-term depression (LTD) of postsynaptic potentials (PSP) in CINs. Depression of the PSP of smaller magnitude and duration was observed in response to HFS of the ipsilateral white matter or cerebral cortex. In Mg2+-free solution HFS induced NMDA receptor-dependent potentiation of the PSP, evident in both the maximal slope and amplitude of the PSP. The increase in maximal slope corroborates previous findings, and was blocked by antagonism of either D1-like dopamine receptors with SCH23390 or D2-like dopamine receptors with sulpiride during HFS in Mg2+-free solution. Potentiation of the slower PSP amplitude component was due to augmentation of the NMDA receptor-mediated potential as this was completely reversed on subsequent application of the NMDA receptor antagonist AP5. HFS similarly potentiated NMDA receptor currents isolated by blockade of AMPA/kainate receptors with CNQX. The plasticity-induced increase in the slow PSP component was directly associated with an increase in the subsequent AHP. Thus plasticity of cortical afferent synapses is ideally suited to influence the cue-induced firing dynamics of CINs, particularly through potentiation of NMDA receptor-mediated synaptic transmission.
Collapse
Affiliation(s)
- Manfred J Oswald
- Department of Anatomy and the Brain Health Research Centre, University of Otago Dunedin, New Zealand
| | - Jan M Schulz
- Department of Anatomy and the Brain Health Research Centre, University of Otago Dunedin, New Zealand
| | - Wolfgang Kelsch
- Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University Mannheim, Germany
| | - Dorothy E Oorschot
- Department of Anatomy and the Brain Health Research Centre, University of Otago Dunedin, New Zealand
| | - John N J Reynolds
- Department of Anatomy and the Brain Health Research Centre, University of Otago Dunedin, New Zealand
| |
Collapse
|
54
|
Moustafa AA, Krishna R, Frank MJ, Eissa AM, Hewedi DH. Cognitive correlates of psychosis in patients with Parkinson's disease. Cogn Neuropsychiatry 2015; 19:381-98. [PMID: 24446773 DOI: 10.1080/13546805.2013.877385] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
INTRODUCTION Psychosis and hallucinations occur in 20-30% of patients with Parkinson's disease (PD). In the current study, we investigate cognitive functions in relation to the occurrence of psychosis in PD patients. METHODS We tested three groups of subjects - PD with psychosis, PD without psychosis and healthy controls - on working memory, learning and transitive inference tasks, which are known to assess prefrontal, basal ganglia and hippocampal functions. RESULTS In the working memory task, results show that patients with and without psychosis were more impaired than the healthy control group. In the transitive inference task, we did not find any difference among the groups in the learning phase performance. Importantly, PD patients with psychosis were more impaired than both PD patients without psychosis and controls at transitive inference. We also found that the severity of psychotic symptoms in PD patients [as measured by the Unified Parkinson Disease Rating Scale Thought Disorder (UPDRS TD) item] is directly associated with the severity of cognitive impairment [as measured by the mini-mental status exam (MMSE)], sleep disturbance [as measured by the Scales for Outcome in Parkinson Disease (SCOPA) sleep scale] and transitive inference (although the latter did not reach significance). CONCLUSIONS Although hypothetical, our data may suggest that the hippocampus is a neural substrate underlying the occurrence of psychosis, sleep disturbance and cognitive impairment in PD patients.
Collapse
Affiliation(s)
- Ahmed A Moustafa
- a Department of Veterans Affairs , New Jersey Health Care System , East Orange , NJ , USA
| | | | | | | | | |
Collapse
|
55
|
Gardoni F, Bellone C. Modulation of the glutamatergic transmission by Dopamine: a focus on Parkinson, Huntington and Addiction diseases. Front Cell Neurosci 2015; 9:25. [PMID: 25784855 PMCID: PMC4345909 DOI: 10.3389/fncel.2015.00025] [Citation(s) in RCA: 73] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2014] [Accepted: 01/14/2015] [Indexed: 01/11/2023] Open
Abstract
Dopamine (DA) plays a major role in motor and cognitive functions as well as in reward processing by regulating glutamatergic inputs. In particular in the striatum the release of DA rapidly influences synaptic transmission modulating both AMPA and NMDA receptors. Several neurodegenerative and neuropsychiatric disorders, including Parkinson, Huntington and addiction-related diseases, manifest a dysregulation of glutamate and DA signaling. Here, we will focus our attention on the mechanisms underlying the modulation of the glutamatergic transmission by DA in striatal circuits.
Collapse
Affiliation(s)
- Fabrizio Gardoni
- Department of Pharmacological and Biomolecular Sciences, University of Milano Milano, Italy
| | - Camilla Bellone
- Department of Fundamental Neuroscience, University of Lausanne Lausanne, Switzerland
| |
Collapse
|
56
|
Igarashi M, Habata T, Akita H, Noda K, Ogata M, Saji M. The NR2B antagonist, ifenprodil, corrects the l-DOPA-induced deficit of bilateral movement and reduces c-Fos expression in the subthalamic nucleus of hemiparkinsonian rats. Neurosci Res 2015; 96:45-53. [PMID: 25697393 DOI: 10.1016/j.neures.2015.02.003] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2014] [Revised: 01/26/2015] [Accepted: 02/06/2015] [Indexed: 12/20/2022]
Abstract
The use of NR2B antagonists in Parkinsonism is still controversial. To examine their anti-parkinsonian effects, the NR2B antagonist, ifenprodil, and L-DOPA were administered together and separately in hemiparkinsonian rats (hemi-PD) that were subjected to a cylinder test. Recovery from hypoactivity was achieved by single administration of 3-7 mg/kg of L-DOPA; however, improvement in the deficit of bilateral forelimb use was not observed. When administered alone, ifenprodil had no anti-parkinsonian effects; however, combined administration of ifenprodil and 7 mg/kg of L-DOPA significantly reversed the deficit of bilateral forelimb use without adversely affecting the L-DOPA-induced improvement in motor activity. Next, in order to identify the brain area influenced by L-DOPA and ifenprodil, quantitative analysis of L-DOPA-induced c-Fos immunoreactivity was performed in various brain areas of hemi-PD following administration of L-dopa with and without ifenprodil. Among brain areas with robust c-Fos expression within the motor loop circuit in dopamine-depleted hemispheres, co-administered ifenprodil markedly attenuated L-DOPA-induced c-Fos expression in only the subthalamic nucleus (STN), suggesting that the STN is the primary target for the anti-parkinsonian action of NR2B antagonists.
Collapse
Affiliation(s)
- Masakazu Igarashi
- Division of Brain Science, Graduate School of Medical Sciences, Kitasato University, Sagamihara, Japan.
| | - Toshiya Habata
- Division of Brain Science, Graduate School of Medical Sciences, Kitasato University, Sagamihara, Japan; Department of Occupational Therapy, School of Allied Health Sciences, Kitasato University, Sagamihara, Japan.
| | - Hisanao Akita
- Division of Brain Science, Graduate School of Medical Sciences, Kitasato University, Sagamihara, Japan; Department of Physiology, School of Allied Health Sciences, Kitasato University, Sagamihara, Japan.
| | - Kazuko Noda
- Department of Physiology, School of Allied Health Sciences, Kitasato University, Sagamihara, Japan.
| | - Masanori Ogata
- Department of Physiology, School of Allied Health Sciences, Kitasato University, Sagamihara, Japan.
| | - Makoto Saji
- Division of Brain Science, Graduate School of Medical Sciences, Kitasato University, Sagamihara, Japan; Department of Physiology, School of Allied Health Sciences, Kitasato University, Sagamihara, Japan.
| |
Collapse
|
57
|
Abstract
In this review, we explore the similarities and differences in the behavioural neurobiology found in the mouse models of Huntington's disease (HD) and the human disease state. The review is organised with a comparative focus on the functional domains of motor control, cognition and behavioural disturbance (akin to psychiatric disturbance in people) and how our knowledge of the underlying physiological changes that are manifest in the HD mouse lines correspond to those seen in the HD clinical population. The review is framed in terms of functional circuitry and neurotransmitter systems and how abnormalities in these systems impact on the behavioural readouts across the mouse lines and how these may correspond to the deficits observed in people. In addition, interpretational issues associated with the data from animal studies are discussed.
Collapse
Affiliation(s)
- Simon P Brooks
- Brain Repair Group, Division of Neuroscience, Cardiff University School of Bioscience, Museum Avenue, Cardiff, Wales, UK,
| | | |
Collapse
|
58
|
Fonck C, Easter A, Pietras MR, Bialecki RA. CNS Adverse Effects: From Functional Observation Battery/Irwin Tests to Electrophysiology. Handb Exp Pharmacol 2015; 229:83-113. [PMID: 26091637 DOI: 10.1007/978-3-662-46943-9_4] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
This chapter describes various approaches for the preclinical assessment of drug-induced central nervous system (CNS) adverse effects. Traditionally, methods to evaluate CNS effects have consisted of observing and scoring behavioral responses of animals after drug is administered. Among several behavioral testing paradigms, the Irwin and the functional observational battery (FOB) are the most commonly used assays for the assessment of CNS effects. The Irwin and FOB are considered good first-tier assays to satisfy the ICH S7A guidance for the preclinical evaluation of new chemical entities (NCE) intended for humans. However, experts have expressed concern about the subjectivity and lack of quantitation that is derived from behavioral testing. More importantly, it is difficult to gain insight into potential mechanisms of toxicity by assessing behavioral outcomes. As a complement to behavioral testing, we propose using electrophysiology-based assays, both in vivo and in vitro, such as electroencephalograms and brain slice field-potential recordings. To better illustrate these approaches, we discuss the implementation of electrophysiology-based techniques in drug-induced assessment of seizure risk, sleep disruption, and cognitive impairment.
Collapse
Affiliation(s)
- Carlos Fonck
- Global Safety Pharmacology, AstraZeneca Pharmaceuticals LP, 35 Gatehouse Drive, Waltham, MA, 02451, USA
| | | | | | | |
Collapse
|
59
|
Wu YW, Kim JI, Tawfik VL, Lalchandani RR, Scherrer G, Ding JB. Input- and cell-type-specific endocannabinoid-dependent LTD in the striatum. Cell Rep 2014; 10:75-87. [PMID: 25543142 DOI: 10.1016/j.celrep.2014.12.005] [Citation(s) in RCA: 80] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2014] [Revised: 11/11/2014] [Accepted: 12/02/2014] [Indexed: 11/26/2022] Open
Abstract
Changes in basal ganglia plasticity at the corticostriatal and thalamostriatal levels are required for motor learning. Endocannabinoid-dependent long-term depression (eCB-LTD) is known to be a dominant form of synaptic plasticity expressed at these glutamatergic inputs; however, whether eCB-LTD can be induced at all inputs on all striatal neurons is still debatable. Using region-specific Cre mouse lines combined with optogenetic techniques, we directly investigated and distinguished between corticostriatal and thalamostriatal projections. We found that eCB-LTD was successfully induced at corticostriatal synapses, independent of postsynaptic striatal spiny projection neuron (SPN) subtype. Conversely, eCB-LTD was only nominally present at thalamostriatal synapses. This dichotomy was attributable to the minimal expression of cannabinoid type 1 (CB1) receptors on thalamostriatal terminals. Furthermore, coactivation of dopamine receptors on SPNs during LTD induction re-established SPN-subtype-dependent eCB-LTD. Altogether, our findings lay the groundwork for understanding corticostriatal and thalamostriatal synaptic plasticity and for striatal eCB-LTD in motor learning.
Collapse
Affiliation(s)
- Yu-Wei Wu
- Department of Neurosurgery, Stanford University School of Medicine, Palo Alto, CA 94304, USA
| | - Jae-Ick Kim
- Department of Neurosurgery, Stanford University School of Medicine, Palo Alto, CA 94304, USA
| | - Vivianne L Tawfik
- Department of Anesthesiology, Perioperative and Pain Medicine, Stanford University School of Medicine, Palo Alto, CA 94304, USA
| | - Rupa R Lalchandani
- Department of Neurosurgery, Stanford University School of Medicine, Palo Alto, CA 94304, USA
| | - Grégory Scherrer
- Department of Neurosurgery, Stanford University School of Medicine, Palo Alto, CA 94304, USA; Department of Anesthesiology, Perioperative and Pain Medicine, Stanford University School of Medicine, Palo Alto, CA 94304, USA; Department of Molecular and Cellular Physiology, Stanford University School of Medicine, Palo Alto, CA 94304, USA
| | - Jun B Ding
- Department of Neurosurgery, Stanford University School of Medicine, Palo Alto, CA 94304, USA; Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Palo Alto, CA 94304, USA.
| |
Collapse
|
60
|
Lim SJ, Fiez JA, Holt LL. How may the basal ganglia contribute to auditory categorization and speech perception? Front Neurosci 2014; 8:230. [PMID: 25136291 PMCID: PMC4117994 DOI: 10.3389/fnins.2014.00230] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2014] [Accepted: 07/13/2014] [Indexed: 02/01/2023] Open
Abstract
Listeners must accomplish two complementary perceptual feats in extracting a message from speech. They must discriminate linguistically-relevant acoustic variability and generalize across irrelevant variability. Said another way, they must categorize speech. Since the mapping of acoustic variability is language-specific, these categories must be learned from experience. Thus, understanding how, in general, the auditory system acquires and represents categories can inform us about the toolbox of mechanisms available to speech perception. This perspective invites consideration of findings from cognitive neuroscience literatures outside of the speech domain as a means of constraining models of speech perception. Although neurobiological models of speech perception have mainly focused on cerebral cortex, research outside the speech domain is consistent with the possibility of significant subcortical contributions in category learning. Here, we review the functional role of one such structure, the basal ganglia. We examine research from animal electrophysiology, human neuroimaging, and behavior to consider characteristics of basal ganglia processing that may be advantageous for speech category learning. We also present emerging evidence for a direct role for basal ganglia in learning auditory categories in a complex, naturalistic task intended to model the incidental manner in which speech categories are acquired. To conclude, we highlight new research questions that arise in incorporating the broader neuroscience research literature in modeling speech perception, and suggest how understanding contributions of the basal ganglia can inform attempts to optimize training protocols for learning non-native speech categories in adulthood.
Collapse
Affiliation(s)
- Sung-Joo Lim
- Department of Psychology, Carnegie Mellon University Pittsburgh, PA, USA ; Department of Neuroscience, Center for the Neural Basis of Cognition, University of Pittsburgh Pittsburgh, PA, USA
| | - Julie A Fiez
- Department of Neuroscience, Center for the Neural Basis of Cognition, University of Pittsburgh Pittsburgh, PA, USA ; Department of Neuroscience, Center for Neuroscience, University of Pittsburgh Pittsburgh, PA, USA ; Department of Psychology, University of Pittsburgh Pittsburgh, PA, USA
| | - Lori L Holt
- Department of Psychology, Carnegie Mellon University Pittsburgh, PA, USA ; Department of Neuroscience, Center for the Neural Basis of Cognition, University of Pittsburgh Pittsburgh, PA, USA ; Department of Neuroscience, Center for Neuroscience, University of Pittsburgh Pittsburgh, PA, USA
| |
Collapse
|
61
|
Keeler JF, Pretsell DO, Robbins TW. Functional implications of dopamine D1 vs. D2 receptors: A 'prepare and select' model of the striatal direct vs. indirect pathways. Neuroscience 2014; 282:156-75. [PMID: 25062777 DOI: 10.1016/j.neuroscience.2014.07.021] [Citation(s) in RCA: 85] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2013] [Revised: 07/14/2014] [Accepted: 07/14/2014] [Indexed: 12/18/2022]
Abstract
The functions of the D1- and D2-dopamine receptors in the basal ganglia have remained somewhat enigmatic, with a number of competing theories relating to the interactions of the 'direct' and 'indirect pathways'. Computational models have been good at simulating properties of the system, but are typically divorced from the underlying neural architecture. In this article we propose a new model which re-addresses response selection at the level of the basal ganglia. At the core of this response selection system the D1 DA receptor-expressing striatal pathways 'prepare' the set of possible appropriate responses. The D2DR-expressing striatal pathways then shape and 'select' from this initial response set framework. This article is part of a Special Issue entitled: Ventral Tegmentum & Dopamine.
Collapse
Affiliation(s)
- J F Keeler
- Department of Psychology and Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge CB2 3EB, UK
| | - D O Pretsell
- Department of Psychology and Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge CB2 3EB, UK
| | - T W Robbins
- Department of Psychology and Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge CB2 3EB, UK.
| |
Collapse
|
62
|
Interference and shaping in sensorimotor adaptations with rewards. PLoS Comput Biol 2014; 10:e1003377. [PMID: 24415925 PMCID: PMC3886885 DOI: 10.1371/journal.pcbi.1003377] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2013] [Accepted: 10/14/2013] [Indexed: 11/19/2022] Open
Abstract
When a perturbation is applied in a sensorimotor transformation task, subjects can adapt and maintain performance by either relying on sensory feedback, or, in the absence of such feedback, on information provided by rewards. For example, in a classical rotation task where movement endpoints must be rotated to reach a fixed target, human subjects can successfully adapt their reaching movements solely on the basis of binary rewards, although this proves much more difficult than with visual feedback. Here, we investigate such a reward-driven sensorimotor adaptation process in a minimal computational model of the task. The key assumption of the model is that synaptic plasticity is gated by the reward. We study how the learning dynamics depend on the target size, the movement variability, the rotation angle and the number of targets. We show that when the movement is perturbed for multiple targets, the adaptation process for the different targets can interfere destructively or constructively depending on the similarities between the sensory stimuli (the targets) and the overlap in their neuronal representations. Destructive interferences can result in a drastic slowdown of the adaptation. As a result of interference, the time to adapt varies non-linearly with the number of targets. Our analysis shows that these interferences are weaker if the reward varies smoothly with the subject's performance instead of being binary. We demonstrate how shaping the reward or shaping the task can accelerate the adaptation dramatically by reducing the destructive interferences. We argue that experimentally investigating the dynamics of reward-driven sensorimotor adaptation for more than one sensory stimulus can shed light on the underlying learning rules. The brain has a robust ability to adapt to external perturbations imposed on acquired sensorimotor transformations. Here, we used a mathematical model to investigate the reward-based component in sensorimotor adaptations. We show that the shape of the delivered reward signal, which in experiments is usually binary to indicate success or failure, affects the adaptation dynamics. We demonstrate how the ability to adapt to perturbations by relying solely on binary rewards depends on motor variability, size of perturbation and the threshold for delivering the reward. When adapting motor responses to multiple sensory stimuli simultaneously, on-line interferences between the motor performance in response to the different stimuli occur as a result of the overlap in the neural representation of the sensory stimuli, as well as the physical distance between them. Adaptation may be extremely slow when perturbations are induced to a few stimuli that are physically different from each other because of destructive interferences. When intermediate stimuli are introduced, the physical distance between neighbor stimuli is reduced, and constructive interferences can emerge, resulting in faster adaptation. Remarkably, adaptation to a widespread sensorimotor perturbation is accelerated by increasing the number of sensory stimuli during training, i.e. learning is faster if one learns more.
Collapse
|
63
|
Morgan CJA, Dodds CM, Furby H, Pepper F, Fam J, Freeman TP, Hughes E, Doeller C, King J, Howes O, Stone JM. Long-Term Heavy Ketamine Use is Associated with Spatial Memory Impairment and Altered Hippocampal Activation. Front Psychiatry 2014; 5:149. [PMID: 25538631 PMCID: PMC4255515 DOI: 10.3389/fpsyt.2014.00149] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2014] [Accepted: 10/12/2014] [Indexed: 11/13/2022] Open
Abstract
Ketamine, a non-competitive N-methyl-d-aspartate receptor antagonist, is rising in popularity as a drug of abuse. Preliminary evidence suggests that chronic, heavy ketamine use may have profound effects on spatial memory but the mechanism of these deficits is as yet unclear. This study aimed to examine the neural mechanism by which heavy ketamine use impairs spatial memory processing. In a sample of 11 frequent ketamine users and 15 poly-drug controls, matched for IQ, age, years in education. We used fMRI utilizing an ROI approach to examine the neural activity of three regions known to support successful navigation; the hippocampus, parahippocampal gyrus, and the caudate nucleus during a virtual reality task of spatial memory. Frequent ketamine users displayed spatial memory deficits, accompanied by and related to, reduced activation in both the right hippocampus and left parahippocampal gyrus during navigation from memory, and in the left caudate during memory updating, compared to controls. Ketamine users also exhibited schizotypal and dissociative symptoms that were related to hippocampal activation. Impairments in spatial memory observed in ketamine users are related to changes in medial temporal lobe activation. Disrupted medial temporal lobe function may be a consequence of chronic ketamine abuse and may relate to schizophrenia-like symptomatology observed in ketamine users.
Collapse
Affiliation(s)
- Celia J A Morgan
- Centre for Clinical Psychopharmacology, University of Exeter , Exeter , UK ; Clinical Psychopharmacology Unit UCL, University College London , London , UK
| | - Chris M Dodds
- Centre for Clinical Psychopharmacology, University of Exeter , Exeter , UK
| | - Hannah Furby
- Neuroimaging Sciences, Cardiff University , Cardiff , UK
| | - Fiona Pepper
- Institute of Psychiatry, Kings College London , London , UK
| | - Johnson Fam
- Department of Experimental Medicine, Imperial College London , London , UK
| | - Tom P Freeman
- Clinical Psychopharmacology Unit UCL, University College London , London , UK
| | - Emer Hughes
- Department of Experimental Medicine, Imperial College London , London , UK
| | - Christian Doeller
- Donders Institute for Brain, Cognition and Behaviour , Nijmegen , Netherlands
| | - John King
- Clinical Psychopharmacology Unit UCL, University College London , London , UK
| | - Oliver Howes
- Department of Experimental Medicine, Imperial College London , London , UK
| | - James M Stone
- Institute of Psychiatry, Kings College London , London , UK ; Department of Experimental Medicine, Imperial College London , London , UK
| |
Collapse
|
64
|
Silkis IG. Mechanisms of the influence of dopamine on the functioning of basal ganglia and movement choice (a comparison of models). NEUROCHEM J+ 2013. [DOI: 10.1134/s1819712413030136] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
65
|
Madeo G, Schirinzi T, Martella G, Latagliata EC, Puglisi F, Shen J, Valente EM, Federici M, Mercuri NB, Puglisi-Allegra S, Bonsi P, Pisani A. PINK1 heterozygous mutations induce subtle alterations in dopamine-dependent synaptic plasticity. Mov Disord 2013; 29:41-53. [PMID: 24167038 DOI: 10.1002/mds.25724] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2013] [Revised: 09/10/2013] [Accepted: 09/16/2013] [Indexed: 11/07/2022] Open
Abstract
Homozygous or compound heterozygous mutations in the phosphatase and tensin homolog-induced putative kinase 1 (PINK1) gene are causative of autosomal recessive, early onset Parkinson's disease. Single heterozygous mutations have been detected repeatedly both in a subset of patients and in unaffected individuals, and the significance of these mutations has long been debated. Several neurophysiological studies from non-manifesting PINK1 heterozygotes have demonstrated the existence of neural plasticity abnormalities, indicating the presence of specific endophenotypic traits in the heterozygous state. We performed a functional analysis of corticostriatal synaptic plasticity in heterozygous PINK1 knockout (PINK1(+/-) ) mice using a multidisciplinary approach and observed that, despite normal motor behavior, repetitive activation of cortical inputs to striatal neurons failed to induce long-term potentiation (LTP), whereas long-term depression was normal. Although nigral dopaminergic neurons exhibited normal morphological and electrophysiological properties with normal responses to dopamine receptor activation, a significantly lower dopamine release was measured in the striatum of PINK1(+/-) mice compared with control mice, suggesting that a decrease in stimulus-evoked dopamine overflow acts as a major determinant for the LTP deficit. Accordingly, pharmacological agents capable of increasing the availability of dopamine in the synaptic cleft restored normal LTP in heterozygous mice. Moreover, monoamine oxidase B inhibitors rescued physiological LTP and normal dopamine release. Our results provide novel evidence for striatal plasticity abnormalities, even in the heterozygous disease state. These alterations might be considered an endophenotype to this monogenic form of Parkinson's disease and a valid tool with which to characterize early disease stage and design possible disease-modifying therapies.
Collapse
Affiliation(s)
- Graziella Madeo
- Department of System Medicine, University of Rome "Tor Vergata", Rome, Italy
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
66
|
Baudonnat M, Huber A, David V, Walton ME. Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales. Front Neurosci 2013; 7:175. [PMID: 24130514 PMCID: PMC3795326 DOI: 10.3389/fnins.2013.00175] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2013] [Accepted: 09/09/2013] [Indexed: 11/13/2022] Open
Abstract
Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty.
Collapse
Affiliation(s)
- Mathieu Baudonnat
- Department of Experimental Psychology, University of Oxford Oxford, UK
| | | | | | | |
Collapse
|
67
|
Hawes SL, Gillani F, Evans RC, Benkert EA, Blackwell KT. Sensitivity to theta-burst timing permits LTP in dorsal striatal adult brain slice. J Neurophysiol 2013; 110:2027-36. [PMID: 23926032 DOI: 10.1152/jn.00115.2013] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Long-term potentiation (LTP) of excitatory afferents to the dorsal striatum likely occurs with learning to encode new skills and habits, yet corticostriatal LTP is challenging to evoke reliably in brain slice under physiological conditions. Here we test the hypothesis that stimulating striatal afferents with theta-burst timing, similar to recently reported in vivo temporal patterns corresponding to learning, evokes LTP. Recording from adult mouse brain slice extracellularly in 1 mM Mg(2+), we find LTP in dorsomedial and dorsolateral striatum is preferentially evoked by certain theta-burst patterns. In particular, we demonstrate that greater LTP is produced using moderate intraburst and high theta-range frequencies, and that pauses separating bursts of stimuli are critical for LTP induction. By altering temporal pattern alone, we illustrate the importance of burst-patterning for LTP induction and demonstrate that corticostriatal long-term depression is evoked in the same preparation. In accord with prior studies, LTP is greatest in dorsomedial striatum and relies on N-methyl-d-aspartate receptors. We also demonstrate a requirement for both Gq- and Gs/olf-coupled pathways, as well as several kinases associated with memory storage: PKC, PKA, and ERK. Our data build on previous reports of activity-directed plasticity by identifying effective values for distinct temporal parameters in variants of theta-burst LTP induction paradigms. We conclude that those variants which best match reports of striatal activity during learning behavior are most successful in evoking dorsal striatal LTP in adult brain slice without altering artificial cerebrospinal fluid. Future application of this approach will enable diverse investigations of plasticity serving striatal-based learning.
Collapse
Affiliation(s)
- Sarah L Hawes
- Molecular Neuroscience Department, The Krasnow Institute for Advanced Study, George Mason University, Fairfax, Virginia
| | | | | | | | | |
Collapse
|
68
|
Perrotti LI, Dennis TS, Jiao X, Servatius RJ, Pang KCH, Beck KD. Activation of extracellular signal-regulated kinase (ERK) and ΔFosB in emotion-associated neural circuitry after asymptotic levels of active avoidance behavior are attained. Brain Res Bull 2013; 98:102-10. [PMID: 23932962 DOI: 10.1016/j.brainresbull.2013.07.004] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2013] [Revised: 06/20/2013] [Accepted: 07/09/2013] [Indexed: 12/30/2022]
Abstract
Avoidance susceptibility may constitute a vulnerability to develop anxiety disorders, and Wistar-Kyoto (WKY) rats exhibit unique features in their acquisition of avoidance behavior that appear to promote susceptibility to this form of learning, namely the absence of the commonly observed "warm-up" effect. The present study sought to determine if strain differences in acquired avoidance behavior, between WKY and Sprague Dawley rats, could be attributed to differences in dopamine-related plasticity, represented by extracellular signal-regulated kinase (ERK) activity, and prolonged neuronal activation, represented by ΔFosB accumulation, in three key areas of the brain: the medial prefrontal cortex (mPFC), dorsal striatum (DS), and basolateral amygdala (BLA). Consistent with earlier work, WKY rats exhibited a higher level of asymptotic performance of avoidance behavior, which included an absence of warm-up in the first few trials of later training sessions, and they exhibited more non-reinforced anticipatory responses in the single minute prior to the initiation of the first warning signal presentation of each training session. In the brain, phosyphorylated ERK2 (pERK2) activation was higher in avoidance trained rats in both the mPFC and DS, although the difference in DS was mostly observed in WKY rats. Avoidance-training was associated with higher levels of ΔFosB expression in the mPFC of SD rats, but not WKY rats. The strain differences in pERK2 activation in the DS and ΔFosB levels in the mPFC may underlie the strain-specific differences observed in warm-up, the emission of non-reinforced anticipatory responses, and general differences in asymptotic performance of active avoidance behavior. The mPFC and DS require further study as potential neural targets for understanding avoidance susceptibility and, as a result, anxiety vulnerability.
Collapse
Affiliation(s)
- Linda I Perrotti
- Department of Psychology, The University of Texas at Arlington, Arlington, TX 76019, USA.
| | | | | | | | | | | |
Collapse
|
69
|
Reber PJ. The neural basis of implicit learning and memory: A review of neuropsychological and neuroimaging research. Neuropsychologia 2013; 51:2026-42. [DOI: 10.1016/j.neuropsychologia.2013.06.019] [Citation(s) in RCA: 126] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2012] [Revised: 06/14/2013] [Accepted: 06/15/2013] [Indexed: 10/26/2022]
|
70
|
Chen JY, Wang EA, Cepeda C, Levine MS. Dopamine imbalance in Huntington's disease: a mechanism for the lack of behavioral flexibility. Front Neurosci 2013; 7:114. [PMID: 23847463 PMCID: PMC3701870 DOI: 10.3389/fnins.2013.00114] [Citation(s) in RCA: 99] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2013] [Accepted: 06/13/2013] [Indexed: 01/10/2023] Open
Abstract
Dopamine (DA) plays an essential role in the control of coordinated movements. Alterations in DA balance in the striatum lead to pathological conditions such as Parkinson's and Huntington's diseases (HD). HD is a progressive, invariably fatal neurodegenerative disease caused by a genetic mutation producing an expansion of glutamine repeats and is characterized by abnormal dance-like movements (chorea). The principal pathology is the loss of striatal and cortical projection neurons. Changes in brain DA content and receptor number contribute to abnormal movements and cognitive deficits in HD. In particular, during the early hyperkinetic stage of HD, DA levels are increased whereas expression of DA receptors is reduced. In contrast, in the late akinetic stage, DA levels are significantly decreased and resemble those of a Parkinsonian state. Time-dependent changes in DA transmission parallel biphasic changes in glutamate synaptic transmission and may enhance alterations in glutamate receptor-mediated synaptic activity. In this review, we focus on neuronal electrophysiological mechanisms that may lead to some of the motor and cognitive symptoms of HD and how they relate to dysfunction in DA neurotransmission. Based on clinical and experimental findings, we propose that some of the behavioral alterations in HD, including reduced behavioral flexibility, may be caused by altered DA modulatory function. Thus, restoring DA balance alone or in conjunction with glutamate receptor antagonists could be a viable therapeutic approach.
Collapse
Affiliation(s)
- Jane Y Chen
- Intellectual and Developmental Disabilities Research Center, Semel Institute for Neuroscience and Human Behavior and the Brain Research Institute, David Geffen School of Medicine, University of California Los Angeles Los Angeles, CA, USA
| | | | | | | |
Collapse
|
71
|
Cerovic M, d'Isa R, Tonini R, Brambilla R. Molecular and cellular mechanisms of dopamine-mediated behavioral plasticity in the striatum. Neurobiol Learn Mem 2013; 105:63-80. [PMID: 23827407 DOI: 10.1016/j.nlm.2013.06.013] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2013] [Revised: 06/20/2013] [Accepted: 06/23/2013] [Indexed: 12/25/2022]
Abstract
The striatum is the input structure of the basal ganglia system. By integrating glutamatergic signals from cortical and subcortical regions and dopaminergic signals from mesolimbic nuclei the striatum functions as an important neural substrate for procedural and motor learning as well as for reward-guided behaviors. In addition, striatal activity is significantly altered in pathological conditions in which either a loss of dopamine innervation (Parkinson's disease) or aberrant dopamine-mediated signaling (drug addiction and L-DOPA induced dyskinesia) occurs. Here we discuss cellular mechanisms of striatal synaptic plasticity and aspects of cell signaling underlying striatum-dependent behavior, with a major focus on the neuromodulatory action of the endocannabinoid system and on the role of the Ras-ERK cascade.
Collapse
Affiliation(s)
- Milica Cerovic
- School of Biosciences, Cardiff University, CF10 3AX Cardiff, UK
| | | | | | | |
Collapse
|
72
|
Guthrie M, Leblois A, Garenne A, Boraud T. Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study. J Neurophysiol 2013; 109:3025-40. [PMID: 23536713 DOI: 10.1152/jn.00026.2013] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
In a previous modeling study, Leblois et al. (2006) demonstrated an action selection mechanism in cortico-basal ganglia loops based on competition between the positive feedback, direct pathway through the striatum and the negative feedback, hyperdirect pathway through the subthalamic nucleus. The present study investigates how multiple level action selection could be performed by the basal ganglia. To do this, the model is extended in a manner consistent with known anatomy and electrophysiology in three main areas. First, two-level decision making has been incorporated, with a cognitive level selecting based on cue shape and a motor level selecting based on cue position. We show that the decision made at the cognitive level can be used to bias the decision at the motor level. We then demonstrate that, for accurate transmission of information between decision-making levels, low excitability of striatal projection neurons is necessary, a generally observed electrophysiological finding. Second, instead of providing a biasing signal between cue choices as an external input to the network, we show that the action selection process can be driven by reasonable levels of noise. Finally, we incorporate dopamine modulated learning at corticostriatal synapses. As learning progresses, the action selection becomes based on learned visual cue values and is not interfered with by the noise that was necessary before learning.
Collapse
Affiliation(s)
- M. Guthrie
- Institut des Maladies Neurodegeneratives, Université Bordeaux-Segalen, UMR 5293, Bordeaux, France
- Institut des Maladies Neurodegeneratives, Centre National de la Recherche Scientifique, UMR 5293, Bordeaux, France
| | - A. Leblois
- Laboratoire de Neurophysique et Physiologie, Université Paris Descartes, UMR 8119, Paris, France
- Laboratoire de Neurophysique et Physiologie, Centre National de la Recherche Scientifique, UMR 8119, Paris, France
| | - A. Garenne
- Institut des Maladies Neurodegeneratives, Université Bordeaux-Segalen, UMR 5293, Bordeaux, France
- Institut des Maladies Neurodegeneratives, Centre National de la Recherche Scientifique, UMR 5293, Bordeaux, France
| | - T. Boraud
- Institut des Maladies Neurodegeneratives, Université Bordeaux-Segalen, UMR 5293, Bordeaux, France
- Institut des Maladies Neurodegeneratives, Centre National de la Recherche Scientifique, UMR 5293, Bordeaux, France
| |
Collapse
|
73
|
Nelson AJD, Killcross S. Accelerated habit formation following amphetamine exposure is reversed by D1, but enhanced by D2, receptor antagonists. Front Neurosci 2013; 7:76. [PMID: 23720609 PMCID: PMC3654215 DOI: 10.3389/fnins.2013.00076] [Citation(s) in RCA: 61] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2013] [Accepted: 04/26/2013] [Indexed: 11/23/2022] Open
Abstract
Repeated exposure to the psychostimulant amphetamine has been shown to disrupt goal-directed instrumental actions and promote the early and abnormal development of goal-insensitive habitual responding (Nelson and Killcross, 2006). To investigate the neuropharmacological specificity of this effect as well as restore goal-directed responding in animals with pre-training amphetamine exposure, animals were treated with the non-selective dopamine antagonist α-flupenthixol, the selective D1 antagonist SCH 23390 or the selective D2 antagonist eticlopride, prior to instrumental training (three sessions). Subsequently, the reinforcer was paired with LiCL-induced gastric-malaise and animals were given a test of goal-sensitivity both in extinction and reacquisition. The effect of these dopaminergic antagonists on the sensitivity of lever press performance to outcome devaluation was assessed in animals with pre-training exposure to amphetamine (Experiments 1A–C) or in non-sensitized animals (Experiment 2). Both α-flupenthixol and SCH23390 reversed accelerated habit formation following amphetamine sensitization. However, eticlopride appeared to enhance this effect and render instrumental performance compulsive as these animals were unable to inhibit responding both in extinction and reacquisition, even though a consumption test confirmed they had acquired an aversion to the reinforcer. These findings demonstrate that amphetamine induced-disruption of goal-directed behavior is mediated by activity at distinct dopamine receptor subtypes and may represent a putative model of the neurochemical processes involved in the loss of voluntary control over behavior.
Collapse
|
74
|
Jennings KA. A comparison of the subsecond dynamics of neurotransmission of dopamine and serotonin. ACS Chem Neurosci 2013; 4:704-14. [PMID: 23627553 DOI: 10.1021/cn4000605] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
The neuromodulators dopamine (DA) and serotonin (5-hydroxytryptamine; 5-HT) are similar in a number of ways. Both monoamines can act by volume transmission at metabotropic receptors to modulate synaptic transmission in brain circuits. Presynaptic regulation of 5-HT and DA is governed by parallel processes, and behaviorally, both exert control over emotional processing. However, differences are also apparent: more than twice as many 5-HT receptor subtypes mediate postsynaptic effects than DA receptors and different presynaptic regulation is also emerging. Monoamines are amenable to real-time electrochemical detection using fast scan cyclic voltammetry (FSCV), which allows resolution of the subsecond dynamics of release and reuptake in response to a single action potential. This approach has greatly enriched understanding of DA transmission and has facilitated an integrated view of how DA mediates behavioral control. However, technical challenges are associated with FSCV measurement of 5-HT and understanding of 5-HT transmission at subsecond resolution has not advanced at the same rate. As a result, how the actions of 5-HT at the level of the synapse translate into behavior is poorly understood. Recent technical advances may aid the study of 5-HT in real-time. It is timely, therefore, to compare and contrast what is currently understood of the subsecond characteristics of transmission for DA and 5-HT. In doing so, a number of areas are highlighted as being worthy of exploration for 5-HT.
Collapse
Affiliation(s)
- Katie A. Jennings
- Department of Physiology, Anatomy and Genetics, Oxford University, South Parks Road, Oxford, U.K. OX1
3PT
| |
Collapse
|
75
|
Rose J, Schiffer AM, Güntürkün O. Striatal dopamine D1 receptors are involved in the dissociation of learning based on reward-magnitude. Neuroscience 2013; 230:132-8. [DOI: 10.1016/j.neuroscience.2012.10.064] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2012] [Revised: 10/22/2012] [Accepted: 10/25/2012] [Indexed: 11/28/2022]
|
76
|
Abstract
Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily driven by reward, and to some extent risk, whereas punishment and salience have only limited activating effects when appropriate controls are respected. The signal is homogeneous in terms of time course but heterogeneous in many other aspects. It is essential for synaptic plasticity and a range of behavioural learning situations.
Collapse
Affiliation(s)
- Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, UK.
| |
Collapse
|
77
|
Fasano C, Bourque MJ, Lapointe G, Leo D, Thibault D, Haber M, Kortleven C, Desgroseillers L, Murai KK, Trudeau LÉ. Dopamine facilitates dendritic spine formation by cultured striatal medium spiny neurons through both D1 and D2 dopamine receptors. Neuropharmacology 2012; 67:432-43. [PMID: 23231809 DOI: 10.1016/j.neuropharm.2012.11.030] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2011] [Revised: 11/23/2012] [Accepted: 11/26/2012] [Indexed: 01/01/2023]
Abstract
Variations of dopamine (DA) levels induced by drugs of abuse or in the context of Parkinson's disease modulate the number of dendritic spines in medium spiny neurons (MSNs) of the striatum, showing that DA plays a major role in the structural plasticity of MSNs. However, little is presently known regarding early spine development in MSNs occurring before the arrival of cortical inputs and in particular about the role of DA and D1 (D1R) and D2 (D2R) DA receptors. A cell culture model reconstituting early cellular interactions between MSNs, intrinsic cholinergic interneurons and DA neurons was used to study the role of DA in spine formation. After 5 or 10 days in vitro, the presence of DA neurons increased the number of immature spine-like protrusions. In MSN monocultures, chronic activation of D1R or D2R also increased the number of spines and spinophilin expression in MSNs, suggesting a direct role for these receptors. In DA-MSN cocultures, chronic blockade of D1R or D2R reduced the number of dendritic spines. Interestingly, the combined activation or blockade of both D1R and D2R failed to elicit more extensive spine formation, suggesting that both receptors act through a mechanism that is not additive. Finally, we found increased ionotropic glutamate receptor responsiveness and miniature excitatory postsynaptic current (EPSC) frequency in DA-MSN co-cultures, in parallel with a higher number of spines containing PSD-95, suggesting that the newly formed spines present functional post-synaptic machinery preparing the MSNs to receive additional glutamatergic contacts. These results represent a first step in the understanding of how dopamine neurons promote the structural plasticity of MSNs during the development of basal ganglia circuits.
Collapse
Affiliation(s)
- Caroline Fasano
- Department of Pharmacology, Faculty of Medicine, Université de Montréal, Montréal, Québec, Canada
| | | | | | | | | | | | | | | | | | | |
Collapse
|
78
|
Abstract
Parkinson disease (PD) is the second most common neurodegenerative disorder after Alzheimer's disease, affecting 1-2% of the population over the age of 65. Both genetic and environmental factors trigger risks of and protection from PD. However, the molecular mechanism of PD is far from being clear. In this study, we downloaded the gene expression profile of PD from Gene Expression Omnibus and identified differentially expressed genes (DEGs) and dysfunctional pathways in PD patients compared with controls. To further understand how these pathways act together to account for the initiation of PD, we constructed a pathway crosstalk network by calculating the Jaccard index among pathways. A total of 873 DEGs and 16 dysfunctional pathways between PD patients and controls were identified. Through constructing a network of pathways, the relationships among PD pathways were visually presented by their interactions. Our results demonstrate the existence of crosstalk between different pathways in PD pathogenesis. These results not only may explain the causes of PD, but could also open the door to new therapeutic approaches for this disease.
Collapse
Affiliation(s)
- Hongyu Diao
- Department of Neurosurgery, Shengjing Hospital of China Medical University, Shenyang, 110004, China.
| | | | | |
Collapse
|
79
|
Berthet P, Hellgren-Kotaleski J, Lansner A. Action selection performance of a reconfigurable basal ganglia inspired model with Hebbian-Bayesian Go-NoGo connectivity. Front Behav Neurosci 2012; 6:65. [PMID: 23060764 PMCID: PMC3462417 DOI: 10.3389/fnbeh.2012.00065] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2012] [Accepted: 09/11/2012] [Indexed: 12/22/2022] Open
Abstract
Several studies have shown a strong involvement of the basal ganglia (BG) in action selection and dopamine dependent learning. The dopaminergic signal to striatum, the input stage of the BG, has been commonly described as coding a reward prediction error (RPE), i.e., the difference between the predicted and actual reward. The RPE has been hypothesized to be critical in the modulation of the synaptic plasticity in cortico-striatal synapses in the direct and indirect pathway. We developed an abstract computational model of the BG, with a dual pathway structure functionally corresponding to the direct and indirect pathways, and compared its behavior to biological data as well as other reinforcement learning models. The computations in our model are inspired by Bayesian inference, and the synaptic plasticity changes depend on a three factor Hebbian–Bayesian learning rule based on co-activation of pre- and post-synaptic units and on the value of the RPE. The model builds on a modified Actor-Critic architecture and implements the direct (Go) and the indirect (NoGo) pathway, as well as the reward prediction (RP) system, acting in a complementary fashion. We investigated the performance of the model system when different configurations of the Go, NoGo, and RP system were utilized, e.g., using only the Go, NoGo, or RP system, or combinations of those. Learning performance was investigated in several types of learning paradigms, such as learning-relearning, successive learning, stochastic learning, reversal learning and a two-choice task. The RPE and the activity of the model during learning were similar to monkey electrophysiological and behavioral data. Our results, however, show that there is not a unique best way to configure this BG model to handle well all the learning paradigms tested. We thus suggest that an agent might dynamically configure its action selection mode, possibly depending on task characteristics and also on how much time is available.
Collapse
Affiliation(s)
- Pierre Berthet
- Computational Biology, School of Computer Science and Communication, KTH Royal Institute of Technology Stockholm, Sweden ; Numerical Analysis and Computer Science, Stockholm University Stockholm, Sweden ; Stockholm Brain Institute Stockholm, Sweden
| | | | | |
Collapse
|
80
|
Wang M, Wong AH, Liu F. Interactions between NMDA and dopamine receptors: A potential therapeutic target. Brain Res 2012; 1476:154-63. [DOI: 10.1016/j.brainres.2012.03.029] [Citation(s) in RCA: 79] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2012] [Revised: 03/08/2012] [Accepted: 03/10/2012] [Indexed: 11/26/2022]
|
81
|
Zhou R, Wang S, Zhu X. Prenatal ethanol exposure alters synaptic plasticity in the dorsolateral striatum of rat offspring via changing the reactivity of dopamine receptor. PLoS One 2012; 7:e42443. [PMID: 22916128 PMCID: PMC3420902 DOI: 10.1371/journal.pone.0042443] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2012] [Accepted: 07/09/2012] [Indexed: 11/17/2022] Open
Abstract
Prenatal exposure to high-level ethanol (EtOH) has been reported to produce hyperlocomotion in offspring. Previous studies have demonstrated synaptic plasticity in cortical afferent to the dorsolateral (DL) striatum is involved in the pathogensis of hyperlocomotion. Here, prenatal EtOH-exposed rat offspring were used to investigate whether maternal EtOH exposure affected synaptic plasticity in the DL striatum. We found high-frequency stimulation (HFS) induced a weaker long-term potentiation (LTP) in EtOH rats than that in control rats at postnatal day (PD) 15. The same protocol of HFS induced long-term depression (LTD) in control group but still LTP in EtOH group at PD 30 or PD 40. Furthermore, enhancement of basal synaptic transmission accompanied by the decrease of pair-pulse facilitation (PPF) was observed in PD 30 EtOH offspring. The perfusion with D1-type receptors (D1R) antagonist SCH23390 recovered synaptic transmission and blocked the induction of abnormal LTP in PD 30 EtOH offspring. The perfusion with D2-type receptors (D2R) agonist quinpirole reversed EtOH-induced LTP into D1R- and metabotropic glutamate receptor-dependent LTD. The data provide the functional evidence that prenatal ethanol exposure led to the persistent abnormal synaptic plasticity in the DL striatum via disturbing the balance between D1R and D2R.
Collapse
Affiliation(s)
- Rong Zhou
- Department of Physiology, Nanjing Medical University, Nanjing, Jiangsu, China.
| | | | | |
Collapse
|
82
|
Akopian G, Crawford C, Petzinger G, Jakowec MW, Walsh JP. Brief mitochondrial inhibition causes lasting changes in motor behavior and corticostriatal synaptic physiology in the Fischer 344 rat. Neuroscience 2012; 215:149-59. [PMID: 22554779 PMCID: PMC3371111 DOI: 10.1016/j.neuroscience.2012.04.060] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2012] [Revised: 04/19/2012] [Accepted: 04/25/2012] [Indexed: 11/26/2022]
Abstract
The striatum is particularly vulnerable to mitochondrial dysfunction and this problem is linked to pathology created by environmental neurotoxins, stimulants like amphetamine, and metabolic disease and ischemia. We studied the course of recovery following a single systemic injection of the mitochondrial complex II inhibitor 3-nitropropionic acid (3-NP) and found 3-NP caused lasting changes in motor behavior that were associated with altered activity-dependent plasticity at corticostriatal synapses in Fischer 344 rats. The changes in synapse behavior varied with the time after exposure to the 3-NP injection. The earliest time point studied, 24h after 3-NP, revealed 3-NP-induced an exaggeration of D1 Dopamine (DA) receptor dependent long-term potentiation (LTP) that reversed to normal by 48 h post-3-NP exposure. Thereafter, the likelihood and degree of inducing D2 DA receptor dependent long-term depression (LTD) gradually increased, relative to saline controls, peaking at 1 month after the 3-NP exposure. NMDA receptor binding did not change over the same post 3-NP time points. These data indicate even brief exposure to 3-NP can have lasting behavioral effects mediated by changes in the way DA and glutamate synapses interact.
Collapse
Affiliation(s)
- G Akopian
- Davis School of Gerontology, University of Southern California, Los Angeles, CA 90089-0191, USA
| | | | | | | | | |
Collapse
|
83
|
de Bartolomeis A, Tomasetti C. Calcium-Dependent Networks in Dopamine–Glutamate Interaction: The Role of Postsynaptic Scaffolding Proteins. Mol Neurobiol 2012; 46:275-96. [DOI: 10.1007/s12035-012-8293-6] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2012] [Accepted: 06/21/2012] [Indexed: 01/11/2023]
|
84
|
Abstract
Attention deficit hyperactivity disorder (ADHD) presents special challenges for drug development. Current treatment with psychostimulants and nonstimulants is effective, but their mechanism of action beyond the cellular level is incompletely understood. We review evidence suggesting that altered reinforcement mechanisms are a fundamental characteristic of ADHD. We show that a deficit in the transfer of dopamine signals from established positive reinforcers to cues that predict such reinforcers may underlie these altered reinforcement mechanisms, and in turn explain key symptoms of ADHD. We argue that the neural substrates controlling the excitation and inhibition of dopamine neurons during the transfer process are a promising target for future drug development. There is a need to develop animal models and behavioral paradigms that can be used to experimentally investigate these mechanisms and their effects on sensitivity to reinforcement. More specific and selective targeting of drug development may be possible through this approach.
Collapse
Affiliation(s)
- Gail Tripp
- Human Developmental Neurobiology Unit, Okinawa Institute of Science and Technology Graduate University, Kunigami, Okinawa 904-0412, Japan.
| | | |
Collapse
|
85
|
Summerfield C, Tsetsos K. Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms. Front Neurosci 2012; 6:70. [PMID: 22654730 PMCID: PMC3359443 DOI: 10.3389/fnins.2012.00070] [Citation(s) in RCA: 102] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2012] [Accepted: 04/26/2012] [Indexed: 11/13/2022] Open
Abstract
Investigation into the neural and computational bases of decision-making has proceeded in two parallel but distinct streams. Perceptual decision-making (PDM) is concerned with how observers detect, discriminate, and categorize noisy sensory information. Economic decision-making (EDM) explores how options are selected on the basis of their reinforcement history. Traditionally, the sub-fields of PDM and EDM have employed different paradigms, proposed different mechanistic models, explored different brain regions, disagreed about whether decisions approach optimality. Nevertheless, we argue that there is a common framework for understanding decisions made in both tasks, under which an agent has to combine sensory information (what is the stimulus) with value information (what is it worth). We review computational models of the decision process typically used in PDM, based around the idea that decisions involve a serial integration of evidence, and assess their applicability to decisions between good and gambles. Subsequently, we consider the contribution of three key brain regions – the parietal cortex, the basal ganglia, and the orbitofrontal cortex (OFC) – to perceptual and EDM, with a focus on the mechanisms by which sensory and reward information are integrated during choice. We find that although the parietal cortex is often implicated in the integration of sensory evidence, there is evidence for its role in encoding the expected value of a decision. Similarly, although much research has emphasized the role of the striatum and OFC in value-guided choices, they may play an important role in categorization of perceptual information. In conclusion, we consider how findings from the two fields might be brought together, in order to move toward a general framework for understanding decision-making in humans and other primates.
Collapse
|
86
|
Muresanu DF, Stan A, Buzoianu A. Neuroplasticity and impulse control disorders. J Neurol Sci 2012; 316:15-20. [PMID: 22336702 DOI: 10.1016/j.jns.2012.01.016] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2011] [Revised: 01/11/2012] [Accepted: 01/20/2012] [Indexed: 11/25/2022]
Abstract
Impulse control disorders (ICDs) represent an important medical challenge. The authors of the present paper restricted themselves to present an overview of the neurocircuitry that is involved in ICDs and to present information about the mechanisms of neuroplasticity that are the substrate of the ICDs. Understanding the networks involved in ICDs at the level of the cellular and molecular mechanisms of neural and synaptic plasticity may facilitate the understanding of the ways in which various conditions favour the habit formation and compulsivity that are associated with neurological disorders. The psychological, sociological and forensic dimensions of ICDs are beyond the scope of this paper.
Collapse
Affiliation(s)
- Dafin F Muresanu
- University of Medicine and Pharmacy Iuliu Hatieganu, Cluj-Napoca, Romania.
| | | | | |
Collapse
|
87
|
Mullah SHER, Inaji M, Nariai T, Momose-Sato Y, Sato K, Ohno K. Optical analysis of developmental changes in synaptic potentiation in the neonatal rat corticostriatal projection. Neuroscience 2012; 201:338-48. [PMID: 22119638 DOI: 10.1016/j.neuroscience.2011.11.023] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2011] [Revised: 11/09/2011] [Accepted: 11/10/2011] [Indexed: 10/15/2022]
Abstract
We applied voltage-sensitive dye imaging to neonatal rat cortical slice preparations and analyzed developmental changes in synaptic plasticity, long-term potentiation (LTP), in the corticostriatal projection. Coronal slice preparations were dissected from postnatal 1- to 21-day (P1-P21) rats, and the transmembrane voltage-related optical signals evoked by cortical stimulation were recorded using a 464ch optical recording system with the voltage-sensitive absorption dye. In the striatum, the optical signal was composed of a fast spike-like signal followed by a slow signal, which corresponded to an action potential and an excitatory postsynaptic potential (EPSP), respectively. The slow signal could be detected at the P1 stage, suggesting that the EPSP is already expressed in the corticostriatal projection at least at early stages after birth. On the other hand, the slow signal was potentiated with a single shot of tetanic stimulation and the potentiation lasted at least 1 h, which is considered to correspond to long-term potentiation. With ontogenetic examinations, we found that (1) the EPSP could be potentiated with tetanic stimulation from the P9 stage and that (2) after the LTP induction, the potentiation was maintained for a longer time in the postnatal 3W stage than in the 2W stage. These results suggest that characteristics of LTP change dynamically during postnatal development.
Collapse
Affiliation(s)
- S H-E-R Mullah
- Department of Neurosurgery, Tokyo Medical and Dental University Graduate School and Faculty of Medicine, Tokyo 113-8519, Japan
| | | | | | | | | | | |
Collapse
|
88
|
Abstract
Striatal cholinergic interneurons are pivotal modulators of the striatal circuitry involved in action selection and decision making. Although nicotinic receptors are important transducers of acetylcholine release in the striatum, muscarinic receptors are more pervasive and have been more thoroughly studied. In this review, the effects of muscarinic receptor signaling on the principal cell types in the striatum and its canonical circuits will be discussed, highlighting new insights into their role in synaptic integration and plasticity. These studies, and those that have identified new circuit elements driven by activation of nicotinic receptors, make it clear that temporally patterned activity in cholinergic interneurons must play an important role in determining the effects on striatal circuitry. These effects could be critical to the response to salient environmental stimuli that serve to direct behavior.
Collapse
Affiliation(s)
- Joshua A Goldberg
- Department of Physiology, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | | | | |
Collapse
|
89
|
Klug J, Deutch A, Colbran R, Winder D. Synaptic Triad in the Neostriatum. DOPAMINE – GLUTAMATE INTERACTIONS IN THE BASAL GANGLIA 2011. [DOI: 10.1201/b11284-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
90
|
A Ca(2+) threshold for induction of spike-timing-dependent depression in the mouse striatum. J Neurosci 2011; 31:13015-22. [PMID: 21900580 DOI: 10.1523/jneurosci.3206-11.2011] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The striatum is the principal input nucleus of the basal ganglia, receiving glutamatergic afferents from the cerebral cortex. There is much interest in mechanisms of synaptic plasticity in the corticostriatal synapses. We used two-photon microscopy and whole-cell recording to measure changes in intracellular calcium concentration ([Ca(2+)](i)) associated with spike-time-dependent plasticity in mouse striatum. Uncaging glutamate adjacent to a dendritic spine caused a postsynaptic potential at the soma and a rise in spine [Ca(2+)](i). Action potentials elicited at the soma raised both dendrite and spine [Ca(2+)](i). Pairing protocols in which glutamate uncaging preceded action potentials by 10 ms (pre-post protocol) produced supralinear increases in spine [Ca(2+)](i) compared with the sum of increases seen with uncaging and action potentials alone, or timing protocols in which the uncaging followed the action potentials (post-pre protocols). The supralinear component of the increases in [Ca(2+)](i) were eliminated by the voltage-sensitive calcium channel blocker nimodipine. In the adjacent parent dendrites, the increases in [Ca(2+)](i) were neither supralinear nor sensitive to the relative pre-post timing. In parallel experiments, we investigated the effects of these pairing protocols on spike-timing-dependent synaptic plasticity. Long-term depression (t-LTD) of corticostriatal inputs was induced by pre-post but not post-pre protocols. Intracellular calcium chelators and calcium antagonists blocked pre-post t-LTD, confirming that elevated calcium entering via voltage-sensitive calcium channels is necessary for t-LTD. These findings confirm a spine [Ca(2+)](i) threshold for induction of t-LTD in the corticostriatal pathway, mediated by the supralinear increase in [Ca(2+)](i) associated with pre-post induction protocols.
Collapse
|
91
|
Abstract
The basal ganglia are a chain of subcortical nuclei that facilitate action selection. Two striatal projection systems--so-called direct and indirect pathways--form the functional backbone of the basal ganglia circuit. Twenty years ago, investigators proposed that the striatum's ability to use dopamine (DA) rise and fall to control action selection was due to the segregation of D(1) and D(2) DA receptors in direct- and indirect-pathway spiny projection neurons. Although this hypothesis sparked a debate, the evidence that has accumulated since then clearly supports this model. Recent advances in the means of marking neural circuits with optical or molecular reporters have revealed a clear-cut dichotomy between these two cell types at the molecular, anatomical, and physiological levels. The contrast provided by these studies has provided new insights into how the striatum responds to fluctuations in DA signaling and how diseases that alter this signaling change striatal function.
Collapse
Affiliation(s)
- Charles R Gerfen
- Laboratory of Systems Neuroscience, National Institute of Mental Health, Bethesda, Maryland 20892, USA.
| | | |
Collapse
|
92
|
The contribution of NMDA receptor signaling in the corticobasal ganglia reward network to appetitive Pavlovian learning. J Neurosci 2011; 31:11362-9. [PMID: 21813695 DOI: 10.1523/jneurosci.2411-11.2011] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
NMDA receptors (NMDARs) contribute to phasic transmission and synaptic plasticity and are thought to be important for learning. To better understand where NMDAR signaling is necessary for learning, we combined viral genetic strategies with genetic mouse models to investigate the contribution of NMDARs in the dopamine system to appetitive Pavlovian conditioning. NMDAR signaling in dopamine neurons was not required for Pavlovian conditioning; however, NMDARs in D(1) dopamine receptor (D(1)R)-expressing medium spiny neurons (MSNs), which receive input from dopamine neurons, were critical for this type of learning. NMDAR signaling was also required in brain regions that project to dopamine neurons, because removing NMDARs from afferent neurons to the ventral tegmental area (VTA) also prevented learning. This effect was likely attributable to loss of NMDAR signaling in the neurons of the prefrontal cortex (PFC), because learning could be restored in these animals by rescuing NMDAR expression in the PFC. Moreover, removing NMDARs exclusively from the PFC also prevented learning. Our findings suggest that NMDARs in neurons that project to and receive projections from the VTA are necessary for Pavlovian conditioning and specifically implicate the PFC and D(1)R-expressing MSNs in associative learning.
Collapse
|
93
|
Beeler JA. Preservation of function in Parkinson's disease: what's learning got to do with it? Brain Res 2011; 1423:96-113. [PMID: 22000081 DOI: 10.1016/j.brainres.2011.09.040] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2011] [Revised: 08/06/2011] [Accepted: 09/20/2011] [Indexed: 01/16/2023]
Abstract
Dopamine denervation gives rise to abnormal corticostriatal plasticity; however, its role in the symptoms and progression of Parkinson's disease (PD) has not been articulated or incorporated into current clinical models. The 'integrative selective gain' framework proposed here integrates dopaminergic mechanisms known to modulate basal ganglia throughput into a single conceptual framework: (1) synaptic weights, the neural instantiation of accumulated experience and skill modulated by dopamine-dependent plasticity and (2) system gain, the operating parameters of the basal ganglia, modulated by dopamine's on-line effects on cell excitability, glutamatergic transmission and the balance between facilitatory and inhibitory pathways. Within this framework and based on recent work, a hypothesis is presented that prior synaptic weights and established skills can facilitate motor performance and preserve function despite diminished dopamine; however, dopamine denervation induces aberrant corticostriatal plasticity that degrades established synaptic weights and replaces them with inappropriate, inhibitory learning that inverts the function of the basal ganglia resulting in 'anti-optimization' of motor performance. Consequently, mitigating aberrant corticostriatal plasticity represents an important therapeutic objective, as reflected in the long-duration response to levodopa, reinterpreted here as the correction of aberrant learning. It is proposed that viewing aberrant corticostriatal plasticity and learning as a provisional endophenotype of PD would facilitate investigation of this hypothesis.
Collapse
Affiliation(s)
- Jeff A Beeler
- Department of Neurobiology, The University of Chicago, Chicago, IL, USA.
| |
Collapse
|
94
|
Shiflett MW, Balleine BW. Molecular substrates of action control in cortico-striatal circuits. Prog Neurobiol 2011; 95:1-13. [PMID: 21704115 PMCID: PMC3175490 DOI: 10.1016/j.pneurobio.2011.05.007] [Citation(s) in RCA: 89] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2010] [Revised: 05/24/2011] [Accepted: 05/27/2011] [Indexed: 11/24/2022]
Abstract
The purpose of this review is to describe the molecular mechanisms in the striatum that mediate reward-based learning and action control during instrumental conditioning. Experiments assessing the neural bases of instrumental conditioning have uncovered functional circuits in the striatum, including dorsal and ventral striatal sub-regions, involved in action-outcome learning, stimulus-response learning, and the motivational control of action by reward-associated cues. Integration of dopamine (DA) and glutamate neurotransmission within these striatal sub-regions is hypothesized to enable learning and action control through its role in shaping synaptic plasticity and cellular excitability. The extracellular signal regulated kinase (ERK) appears to be particularly important for reward-based learning and action control due to its sensitivity to combined DA and glutamate receptor activation and its involvement in a range of cellular functions. ERK activation in striatal neurons is proposed to have a dual role in both the learning and performance factors that contribute to instrumental conditioning through its regulation of plasticity-related transcription factors and its modulation of intrinsic cellular excitability. Furthermore, perturbation of ERK activation by drugs of abuse may give rise to behavioral disorders such as addiction.
Collapse
|
95
|
Abstract
Amphetamines are psychostimulant drugs with high abuse potential. Acute and chronic doses of amphetamines affect dopamine (DA) neurotransmission in the basal ganglia. The basal ganglia are a group of subcortical nuclei that are anatomically positioned to integrate cognitive, motor and sensorimotor inputs from the cortex. Amphetamines can differentially alter the functioning of specific BG circuits to produce neurochemical changes that affect cognition, movement, and drug seeking behavior through their effects on DA neurotransmission. This review focuses on how alterations in dopaminergic neurotransmission within distinct basal ganglia pathways can modify their functional output to predict and explain the acute and long term behavioral consequences of amphetamine exposure.
Collapse
|
96
|
Bronfeld M, Bar-Gad I. Loss of specificity in Basal Ganglia related movement disorders. Front Syst Neurosci 2011; 5:38. [PMID: 21687797 PMCID: PMC3108383 DOI: 10.3389/fnsys.2011.00038] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2011] [Accepted: 05/20/2011] [Indexed: 01/08/2023] Open
Abstract
The basal ganglia (BG) are a group of interconnected nuclei which play a pivotal part in limbic, associative, and motor functions. This role is mirrored by the wide range of motor and behavioral abnormalities directly resulting from dysfunction of the BG. Studies of normal behavior have found that BG neurons tend to phasically modulate their activity in relation to different behavioral events. In the normal BG, this modulation is highly specific, with each neuron related only to a small subset of behavioral events depending on specific combinations of movement parameters and context. In many pathological conditions involving BG dysfunction and motor abnormalities, this neuronal specificity is lost. Loss of specificity (LOS) manifests in neuronal activity related to a larger spectrum of events and consequently a large overlap of movement-related activation patterns between different neurons. We review the existing evidence for LOS in BG-related movement disorders, the possible neural mechanisms underlying LOS, its effects on frequently used measures of neuronal activity and its relation to theoretical models of the BG. The prevalence of LOS in a many BG-related disorders suggests that neuronal specificity may represent a key feature of normal information processing in the BG system. Thus, the concept of neuronal specificity may underlie a unifying conceptual framework for the BG role in normal and abnormal motor control.
Collapse
Affiliation(s)
- Maya Bronfeld
- The Leslie and Susan Gonda (Goldschmied) Multidisciplinary Brain Research Center, Bar-Ilan UniversityRamat-Gan, Israel
| | - Izhar Bar-Gad
- The Leslie and Susan Gonda (Goldschmied) Multidisciplinary Brain Research Center, Bar-Ilan UniversityRamat-Gan, Israel
- The Mina and Everard Goodman Faculty of Life Sciences, Bar-Ilan UniversityRamat-Gan, Israel
| |
Collapse
|
97
|
Miller R. Mechanisms of action of antipsychotic drugs of different classes, refractoriness to therapeutic effects of classical neuroleptics, and individual variation in sensitivity to their actions: Part I. Curr Neuropharmacol 2011; 7:302-14. [PMID: 20514210 PMCID: PMC2811864 DOI: 10.2174/157015909790031229] [Citation(s) in RCA: 44] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2009] [Revised: 07/15/2009] [Accepted: 07/28/2009] [Indexed: 12/25/2022] Open
Abstract
Many issues remain unresolved about antipsychotic drugs. Their therapeutic potency scales with affinity for dopamine D2 receptors, but there are indications that they act indirectly, with dopamine D1 receptors (and others) as possible ultimate targets. Classical neuroleptic drugs disinhibit striatal cholinergic interneurones and increase acetyl choline release. Their effects may then depend on stimulation of muscarinic receptors on principle striatal neurones (M4 receptors, with reduction of cAMP formation, for therapeutic effects; M1 receptors for motor side effects). Many psychotic patients do not benefit from neuroleptic drugs, or develop resistance to them during prolonged treatment, but respond well to clozapine. For patients who do respond, there is a wide (>ten-fold) range in optimal doses. Refractoriness or low sensitivity to antipsychotic effects (and other pathologies) could then arise from low density of cholinergic interneurones. Clozapine probably owes its special actions to direct stimulation of M4 receptors, a mechanism available when indirect action is lost.
Collapse
Affiliation(s)
- R Miller
- Otago Centre for Theoretical Studies in Psychiatry and Neuroscience (OCTSPAN), Department of Anatomy and Structural Biology, School of Medical Sciences, University of Otago, P.O.Box 913, Dunedin, New Zealand.
| |
Collapse
|
98
|
Parush N, Tishby N, Bergman H. Dopaminergic Balance between Reward Maximization and Policy Complexity. Front Syst Neurosci 2011; 5:22. [PMID: 21603228 PMCID: PMC3093748 DOI: 10.3389/fnsys.2011.00022] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2010] [Accepted: 04/20/2011] [Indexed: 11/17/2022] Open
Abstract
Previous reinforcement-learning models of the basal ganglia network have highlighted the role of dopamine in encoding the mismatch between prediction and reality. Far less attention has been paid to the computational goals and algorithms of the main-axis (actor). Here, we construct a top-down model of the basal ganglia with emphasis on the role of dopamine as both a reinforcement learning signal and as a pseudo-temperature signal controlling the general level of basal ganglia excitability and motor vigilance of the acting agent. We argue that the basal ganglia endow the thalamic-cortical networks with the optimal dynamic tradeoff between two constraints: minimizing the policy complexity (cost) and maximizing the expected future reward (gain). We show that this multi-dimensional optimization processes results in an experience-modulated version of the softmax behavioral policy. Thus, as in classical softmax behavioral policies, probability of actions are selected according to their estimated values and the pseudo-temperature, but in addition also vary according to the frequency of previous choices of these actions. We conclude that the computational goal of the basal ganglia is not to maximize cumulative (positive and negative) reward. Rather, the basal ganglia aim at optimization of independent gain and cost functions. Unlike previously suggested single-variable maximization processes, this multi-dimensional optimization process leads naturally to a softmax-like behavioral policy. We suggest that beyond its role in the modulation of the efficacy of the cortico-striatal synapses, dopamine directly affects striatal excitability and thus provides a pseudo-temperature signal that modulates the tradeoff between gain and cost. The resulting experience and dopamine modulated softmax policy can then serve as a theoretical framework to account for the broad range of behaviors and clinical states governed by the basal ganglia and dopamine systems.
Collapse
Affiliation(s)
- Naama Parush
- The Interdisciplinary Center for Neural Computation, The Hebrew University Jerusalem, Israel
| | | | | |
Collapse
|
99
|
Siviy SM, Crawford CA, Akopian G, Walsh JP. Dysfunctional play and dopamine physiology in the Fischer 344 rat. Behav Brain Res 2011; 220:294-304. [PMID: 21335036 DOI: 10.1016/j.bbr.2011.02.009] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2010] [Revised: 02/03/2011] [Accepted: 02/06/2011] [Indexed: 02/01/2023]
Abstract
Juvenile Fischer 344 rats are known to be less playful than other inbred strains, although the neurobiological substrate(s) responsible for this phenotype is uncertain. In the present study, Fischer 344 rats were compared to the commonly used outbred Sprague-Dawley strain on several behavioral and physiological parameters in order to ascertain whether the lack of play may be related to compromised activity of brain dopamine (DA) systems. As expected, Fischer 344 rats were far less playful than Sprague-Dawley rats, with Fischer 344 rats less likely to initiate playful contacts with a playful partner and less likely to respond playfully to these contacts. We also found that Fischer 344 rats showed less of a startle response and greater pre-pulse inhibition (PPI), especially at higher pre-pulse intensities. The increase in PPI seen in the Fischer 344 rat could be due to reduced DA modulation of sensorimotor gating and neurochemical measures were consistent with Fischer 344 rats releasing less DA than Sprague-Dawley rats. Fast scan cyclic voltammetry (FSCV) revealed Fischer 344 rats had less evoked DA release in dorsal and ventral striatal brain slices and high-performance liquid chromatography revealed Fischer 344 rats to have less DA turnover in the striatum and prefrontal cortex. We also found DA-dependent forms of cortical plasticity were deficient in the striatum and prefrontal cortex of the Fischer 344 rat. Taken together, these data indicate that deficits in play and enhanced PPI of Fischer 344 rats may be due to reduced DA modulation of corticostriatal and mesolimbic/mesocortical circuits critical to the execution of these behaviors.
Collapse
Affiliation(s)
- Stephen M Siviy
- Department of Psychology, Gettysburg College, Gettysburg, PA 17325, USA.
| | | | | | | |
Collapse
|
100
|
Lerner TN, Kreitzer AC. Neuromodulatory control of striatal plasticity and behavior. Curr Opin Neurobiol 2011; 21:322-7. [PMID: 21333525 DOI: 10.1016/j.conb.2011.01.005] [Citation(s) in RCA: 49] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2010] [Accepted: 01/25/2011] [Indexed: 11/19/2022]
Abstract
Excitatory synapses onto projection neurons in the striatum, the input nucleus of the basal ganglia, play a key role in regulating basal ganglia circuit function and are a major site of long-term synaptic plasticity. Here, we review the mechanisms and regulation of both long-term potentiation and long-term depression at these synapses. In particular, we highlight the role that neuromodulators play in determining the strength and direction of plasticity, which ultimately shapes the balance of activity in basal ganglia circuits and regulates motor behavior.
Collapse
Affiliation(s)
- Talia N Lerner
- Gladstone Institute of Neurological Disease, San Francisco, CA, USA
| | | |
Collapse
|