1
|
Bech P, Crochet S, Dard R, Ghaderi P, Liu Y, Malekzadeh M, Petersen CCH, Pulin M, Renard A, Sourmpis C. Striatal Dopamine Signals and Reward Learning. FUNCTION 2023; 4:zqad056. [PMID: 37841525 PMCID: PMC10572094 DOI: 10.1093/function/zqad056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 09/28/2023] [Accepted: 09/29/2023] [Indexed: 10/17/2023] Open
Abstract
We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.
Collapse
Affiliation(s)
- Pol Bech
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Sylvain Crochet
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Robin Dard
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Parviz Ghaderi
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Yanqi Liu
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Meriam Malekzadeh
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Carl C H Petersen
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Mauro Pulin
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Anthony Renard
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| | - Christos Sourmpis
- Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne CH-1015, Switzerland
| |
Collapse
|
2
|
Zeng J, Li X, Zhang R, Lv M, Wang Y, Tan K, Xia X, Wan J, Jing M, Zhang X, Li Y, Yang Y, Wang L, Chu J, Li Y, Li Y. Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning. Neuron 2023; 111:1118-1135.e5. [PMID: 36706757 PMCID: PMC11152601 DOI: 10.1016/j.neuron.2022.12.034] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 10/03/2022] [Accepted: 12/30/2022] [Indexed: 01/27/2023]
Abstract
The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.
Collapse
Affiliation(s)
- Jianzhi Zeng
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; Institute of Molecular Physiology, Shenzhen Bay Laboratory, Shenzhen 518132, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; Peking-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China; Hefei National Laboratory for Physical Sciences at the Microscale, CAS Key Laboratory of Brain Function and Disease, School of Life Sciences, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, Anhui, China.
| | - Xuelin Li
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China
| | - Renzimo Zhang
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; Peking-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China; Yuanpei College, Peking University, Beijing 100871, China
| | - Mingyue Lv
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China
| | - Yipan Wang
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China
| | - Ke Tan
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China
| | - Xiju Xia
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China; PKU-THU-NIBS Joint Graduate Program, Beijing 100871, China
| | - Jinxia Wan
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China
| | - Miao Jing
- Chinese Institute for Brain Research, Beijing 102206, China
| | - Xiuning Zhang
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China
| | - Yu Li
- School of Medicine, The Chinese University of Hong Kong, Shenzhen 518172, China
| | - Yang Yang
- Institute of Biophysics, State Key Laboratory of Brain and Cognitive Science, Center for Excellence in Biomacromolecules, Chinese Academy of Sciences, Beijing 100101, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Liang Wang
- Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology & Center for Biomedical Optics and Molecular Imaging & CAS Key Laboratory of Health Informatics, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Jun Chu
- Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology & Center for Biomedical Optics and Molecular Imaging & CAS Key Laboratory of Health Informatics, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Yan Li
- Institute of Biophysics, State Key Laboratory of Brain and Cognitive Science, Center for Excellence in Biomacromolecules, Chinese Academy of Sciences, Beijing 100101, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yulong Li
- State Key Laboratory of Membrane Biology, School of Life Sciences, Peking University, Beijing 100871, China; Institute of Molecular Physiology, Shenzhen Bay Laboratory, Shenzhen 518132, China; PKU-IDG/McGovern Institute for Brain Research, Beijing 100871, China; Peking-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing 100871, China; National Biomedical Imaging Center, Peking University, Beijing 100871, China; Yuanpei College, Peking University, Beijing 100871, China; PKU-THU-NIBS Joint Graduate Program, Beijing 100871, China; Chinese Institute for Brain Research, Beijing 102206, China.
| |
Collapse
|
3
|
Yagishita S. Cellular bases for reward-related dopamine actions. Neurosci Res 2023; 188:1-9. [PMID: 36496085 DOI: 10.1016/j.neures.2022.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Revised: 11/09/2022] [Accepted: 12/06/2022] [Indexed: 12/12/2022]
Abstract
Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.
Collapse
Affiliation(s)
- Sho Yagishita
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, The University of Tokyo, Bunkyo-ku, Tokyo, Japan; International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan.
| |
Collapse
|
4
|
KASAI H. Unraveling the mysteries of dendritic spine dynamics: Five key principles shaping memory and cognition. PROCEEDINGS OF THE JAPAN ACADEMY. SERIES B, PHYSICAL AND BIOLOGICAL SCIENCES 2023; 99:254-305. [PMID: 37821392 PMCID: PMC10749395 DOI: 10.2183/pjab.99.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/13/2023] [Accepted: 07/11/2023] [Indexed: 10/13/2023]
Abstract
Recent research extends our understanding of brain processes beyond just action potentials and chemical transmissions within neural circuits, emphasizing the mechanical forces generated by excitatory synapses on dendritic spines to modulate presynaptic function. From in vivo and in vitro studies, we outline five central principles of synaptic mechanics in brain function: P1: Stability - Underpinning the integral relationship between the structure and function of the spine synapses. P2: Extrinsic dynamics - Highlighting synapse-selective structural plasticity which plays a crucial role in Hebbian associative learning, distinct from pathway-selective long-term potentiation (LTP) and depression (LTD). P3: Neuromodulation - Analyzing the role of G-protein-coupled receptors, particularly dopamine receptors, in time-sensitive modulation of associative learning frameworks such as Pavlovian classical conditioning and Thorndike's reinforcement learning (RL). P4: Instability - Addressing the intrinsic dynamics crucial to memory management during continual learning, spotlighting their role in "spine dysgenesis" associated with mental disorders. P5: Mechanics - Exploring how synaptic mechanics influence both sides of synapses to establish structural traces of short- and long-term memory, thereby aiding the integration of mental functions. We also delve into the historical background and foresee impending challenges.
Collapse
Affiliation(s)
- Haruo KASAI
- International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| |
Collapse
|
5
|
Scott DN, Frank MJ. Adaptive control of synaptic plasticity integrates micro- and macroscopic network function. Neuropsychopharmacology 2023; 48:121-144. [PMID: 36038780 PMCID: PMC9700774 DOI: 10.1038/s41386-022-01374-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 06/23/2022] [Accepted: 06/24/2022] [Indexed: 11/09/2022]
Abstract
Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.
Collapse
Affiliation(s)
- Daniel N Scott
- Cognitive Linguistic, and Psychological Sciences, Brown University, Providence, RI, USA.
- Carney Institute for Brain Science, Brown University, Providence, RI, USA.
| | - Michael J Frank
- Cognitive Linguistic, and Psychological Sciences, Brown University, Providence, RI, USA.
- Carney Institute for Brain Science, Brown University, Providence, RI, USA.
| |
Collapse
|
6
|
Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues. Nat Commun 2022; 13:7924. [PMID: 36564387 PMCID: PMC9789106 DOI: 10.1038/s41467-022-35601-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Accepted: 12/13/2022] [Indexed: 12/25/2022] Open
Abstract
The ability to learn Pavlovian associations from environmental cues predicting positive outcomes is critical for survival, motivating adaptive behaviours. This cued-motivated behaviour depends on the nucleus accumbens (NAc). NAc output activity mediated by spiny projecting neurons (SPNs) is regulated by dopamine, but also by cholinergic interneurons (CINs), which can release acetylcholine and glutamate via the activity of the vesicular acetylcholine transporter (VAChT) or the vesicular glutamate transporter (VGLUT3), respectively. Here we investigated behavioural and neurochemical changes in mice performing a touchscreen Pavlovian approach task by recording dopamine, acetylcholine, and calcium dynamics from D1- and D2-SPNs using fibre photometry in control, VAChT or VGLUT3 mutant mice to understand how these signals cooperate in the service of approach behaviours toward reward-predicting cues. We reveal that NAc acetylcholine-dopaminergic signalling is continuously updated to regulate striatal output underlying the acquisition of Pavlovian approach learning toward reward-predicting cues.
Collapse
|
7
|
Jeong H, Taylor A, Floeder JR, Lohmann M, Mihalas S, Wu B, Zhou M, Burke DA, Namboodiri VMK. Mesolimbic dopamine release conveys causal associations. Science 2022; 378:eabq6740. [PMID: 36480599 PMCID: PMC9910357 DOI: 10.1126/science.abq6740] [Citation(s) in RCA: 44] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Learning to predict rewards based on environmental cues is essential for survival. It is believed that animals learn to predict rewards by updating predictions whenever the outcome deviates from expectations, and that such reward prediction errors (RPEs) are signaled by the mesolimbic dopamine system-a key controller of learning. However, instead of learning prospective predictions from RPEs, animals can infer predictions by learning the retrospective cause of rewards. Hence, whether mesolimbic dopamine instead conveys a causal associative signal that sometimes resembles RPE remains unknown. We developed an algorithm for retrospective causal learning and found that mesolimbic dopamine release conveys causal associations but not RPE, thereby challenging the dominant theory of reward learning. Our results reshape the conceptual and biological framework for associative learning.
Collapse
Affiliation(s)
- Huijeong Jeong
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Annie Taylor
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Joseph R Floeder
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | | | - Stefan Mihalas
- Allen Institute for Brain Science, Seattle, WA, USA
- Department of Applied Mathematics, University of Washington, Seattle, WA, USA
| | - Brenda Wu
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Mingkang Zhou
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Dennis A Burke
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Vijay Mohan K Namboodiri
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
- Weill Institute for Neuroscience, Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| |
Collapse
|
8
|
Legaria AA, Matikainen-Ankney BA, Yang B, Ahanonu B, Licholai JA, Parker JG, Kravitz AV. Fiber photometry in striatum reflects primarily nonsomatic changes in calcium. Nat Neurosci 2022; 25:1124-1128. [PMID: 36042311 PMCID: PMC10152879 DOI: 10.1038/s41593-022-01152-z] [Citation(s) in RCA: 27] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 07/21/2022] [Indexed: 11/09/2022]
Abstract
Fiber photometry enables recording of population neuronal calcium dynamics in awake mice. While the popularity of fiber photometry has grown in recent years, it remains unclear whether photometry reflects changes in action potential firing (that is, 'spiking') or other changes in neuronal calcium. In microscope-based calcium imaging, optical and analytical approaches can help differentiate somatic from neuropil calcium. However, these approaches cannot be readily applied to fiber photometry. As such, it remains unclear whether the fiber photometry signal reflects changes in somatic calcium, changes in nonsomatic calcium or a combination of the two. Here, using simultaneous in vivo extracellular electrophysiology and fiber photometry, along with in vivo endoscopic one-photon and two-photon calcium imaging, we determined that the striatal fiber photometry does not reflect spiking-related changes in calcium and instead primarily reflects nonsomatic changes in calcium.
Collapse
Affiliation(s)
- Alex A Legaria
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA
| | | | - Ben Yang
- Department of Neuroscience, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Biafra Ahanonu
- Department of Anatomy, University of California, San Francisco, San Francisco, CA, USA
| | - Julia A Licholai
- Department of Neuroscience, Brown University, Providence, RI, USA
| | - Jones G Parker
- Department of Neuroscience, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
| | - Alexxai V Kravitz
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA. .,Department of Psychiatry, Washington University School of Medicine, St Louis, MO, USA. .,Department of Anesthesiology, Washington University School of Medicine, St Louis, MO, USA.
| |
Collapse
|
9
|
Hong SZ, Mesik L, Grossman CD, Cohen JY, Lee B, Severin D, Lee HK, Hell JW, Kirkwood A. Norepinephrine potentiates and serotonin depresses visual cortical responses by transforming eligibility traces. Nat Commun 2022; 13:3202. [PMID: 35680879 PMCID: PMC9184610 DOI: 10.1038/s41467-022-30827-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Accepted: 05/19/2022] [Indexed: 11/18/2022] Open
Abstract
Reinforcement allows organisms to learn which stimuli predict subsequent biological relevance. Hebbian mechanisms of synaptic plasticity are insufficient to account for reinforced learning because neuromodulators signaling biological relevance are delayed with respect to the neural activity associated with the stimulus. A theoretical solution is the concept of eligibility traces (eTraces), silent synaptic processes elicited by activity which upon arrival of a neuromodulator are converted into a lasting change in synaptic strength. Previously we demonstrated in visual cortical slices the Hebbian induction of eTraces and their conversion into LTP and LTD by the retroactive action of norepinephrine and serotonin Here we show in vivo in mouse V1 that the induction of eTraces and their conversion to LTP/D by norepinephrine and serotonin respectively potentiates and depresses visual responses. We also show that the integrity of this process is crucial for ocular dominance plasticity, a canonical model of experience-dependent plasticity.
Collapse
Affiliation(s)
- Su Z Hong
- Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Lukas Mesik
- Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Cooper D Grossman
- Department of Neuroscience, Johns Hopkins University, Baltimore, MD, 21205, USA
| | - Jeremiah Y Cohen
- Department of Neuroscience, Johns Hopkins University, Baltimore, MD, 21205, USA
| | - Boram Lee
- Department of Pharmacology, University of California at Davis, Davis, CA, 95616, USA
| | - Daniel Severin
- Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Hey-Kyoung Lee
- Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, 21218, USA
- Department of Neuroscience, Johns Hopkins University, Baltimore, MD, 21205, USA
| | - Johannes W Hell
- Department of Pharmacology, University of California at Davis, Davis, CA, 95616, USA
| | - Alfredo Kirkwood
- Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, 21218, USA.
- Department of Neuroscience, Johns Hopkins University, Baltimore, MD, 21205, USA.
| |
Collapse
|