1
|
Brain-inspired meta-reinforcement learning cognitive control in conflictual inhibition decision-making task for artificial agents. Neural Netw 2022; 154:283-302. [DOI: 10.1016/j.neunet.2022.06.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Revised: 06/09/2022] [Accepted: 06/16/2022] [Indexed: 11/21/2022]
|
2
|
Yee DM, Leng X, Shenhav A, Braver TS. Aversive motivation and cognitive control. Neurosci Biobehav Rev 2022; 133:104493. [PMID: 34910931 PMCID: PMC8792354 DOI: 10.1016/j.neubiorev.2021.12.016] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Revised: 11/12/2021] [Accepted: 12/09/2021] [Indexed: 02/03/2023]
Abstract
Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.
Collapse
Affiliation(s)
- Debbie M Yee
- Cognitive, Linguistic, and Psychological Sciences, Brown University, USA; Carney Institute for Brain Science, Brown University, USA; Department of Psychological and Brain Sciences, Washington University in Saint Louis, USA.
| | - Xiamin Leng
- Cognitive, Linguistic, and Psychological Sciences, Brown University, USA; Carney Institute for Brain Science, Brown University, USA
| | - Amitai Shenhav
- Cognitive, Linguistic, and Psychological Sciences, Brown University, USA; Carney Institute for Brain Science, Brown University, USA
| | - Todd S Braver
- Department of Psychological and Brain Sciences, Washington University in Saint Louis, USA
| |
Collapse
|
3
|
Courtiol E, Menezes EC, Teixeira CM. Serotonergic regulation of the dopaminergic system: Implications for reward-related functions. Neurosci Biobehav Rev 2021; 128:282-293. [PMID: 34139249 PMCID: PMC8335358 DOI: 10.1016/j.neubiorev.2021.06.022] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 05/11/2021] [Accepted: 06/10/2021] [Indexed: 12/17/2022]
Abstract
Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.
Collapse
Affiliation(s)
- Emmanuelle Courtiol
- Lyon Neuroscience Research Center, UMR 5292- INSERM U1028- Université Lyon 1, 69675 Bron Cedex, France
| | - Edenia C Menezes
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, Orangeburg, NY 10962, United States
| | - Catia M Teixeira
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, Orangeburg, NY 10962, United States; Department of Child and Adolescent Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, United States.
| |
Collapse
|
4
|
Abstract
This paper introduces a new construct, the 'pivotal mental state', which is defined as a hyper-plastic state aiding rapid and deep learning that can mediate psychological transformation. We believe this new construct bears relevance to a broad range of psychological and psychiatric phenomena. We argue that pivotal mental states serve an important evolutionary function, that is, to aid psychological transformation when actual or perceived environmental pressures demand this. We cite evidence that chronic stress and neurotic traits are primers for a pivotal mental state, whereas acute stress can be a trigger. Inspired by research with serotonin 2A receptor agonist psychedelics, we highlight how activity at this particular receptor can robustly and reliably induce pivotal mental states, but we argue that the capacity for pivotal mental states is an inherent property of the human brain itself. Moreover, we hypothesize that serotonergic psychedelics hijack a system that has evolved to mediate rapid and deep learning when its need is sensed. We cite a breadth of evidences linking stress via a variety of inducers, with an upregulated serotonin 2A receptor system (e.g. upregulated availability of and/or binding to the receptor) and acute stress with 5-HT release, which we argue can activate this primed system to induce a pivotal mental state. The pivotal mental state model is multi-level, linking a specific molecular gateway (increased serotonin 2A receptor signaling) with the inception of a hyper-plastic brain and mind state, enhanced rate of associative learning and the potential mediation of a psychological transformation.
Collapse
Affiliation(s)
- Ari Brouwer
- Centre for Psychedelic Research, Imperial College London, London, United Kingdom
| | | |
Collapse
|
5
|
Conio B, Martino M, Magioncalda P, Escelsior A, Inglese M, Amore M, Northoff G. Opposite effects of dopamine and serotonin on resting-state networks: review and implications for psychiatric disorders. Mol Psychiatry 2020; 25:82-93. [PMID: 30953003 DOI: 10.1038/s41380-019-0406-4] [Citation(s) in RCA: 136] [Impact Index Per Article: 34.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2018] [Revised: 01/18/2019] [Accepted: 03/05/2019] [Indexed: 12/21/2022]
Abstract
Alterations in brain intrinsic activity-as organized in resting-state networks (RSNs) such as sensorimotor network (SMN), salience network (SN), and default-mode network (DMN)-and in neurotransmitters signaling-such as dopamine (DA) and serotonin (5-HT)-have been independently detected in psychiatric disorders like bipolar disorder and schizophrenia. Thus, the aim of this work was to investigate the relationship between such neurotransmitters and RSNs in healthy, by reviewing the relevant work on this topic and performing complementary analyses, in order to better understand their physiological link, as well as their alterations in psychiatric disorders. According to the reviewed data, neurotransmitters nuclei diffusively project to subcortical and cortical regions of RSNs. In particular, the dopaminergic substantia nigra (SNc)-related nigrostriatal pathway is structurally and functionally connected with core regions of the SMN, whereas the ventral tegmental area (VTA)-related mesocorticolimbic pathway with core regions of the SN. The serotonergic raphe nuclei (RNi) connections involve regions of the SMN and DMN. Coherently, changes in neurotransmitters activity impact the functional configuration and level of activity of RSNs, as measured by functional connectivity (FC) and amplitude of low-frequency fluctuations/temporal variability of BOLD signal. Specifically, DA signaling is associated with increase in FC and activity in the SMN (hypothetically via the SNc-related nigrostriatal pathway) and SN (hypothetically via the VTA-related mesocorticolimbic pathway), as well as concurrent decrease in FC and activity in the DMN. By contrast, 5-HT signaling (via the RNi-related pathways) is associated with decrease in SMN activity along with increase in DMN activity. Complementally, our empirical data showed a positive correlation between SNc-related FC and SMN activity, whereas a negative correlation between RNi-related FC and SMN activity (along with tilting of networks balance toward the DMN). According to these data, we hypothesize that the activity of neurotransmitter-related neurons synchronize the low-frequency oscillations within different RSNs regions, thus affecting the baseline level of RSNs activity and their balancing. In our model, DA signaling favors the predominance of SMN-SN activity, whereas 5-HT signaling favors the predominance of DMN activity, manifesting in distinct behavioral patterns. In turn, alterations in neurotransmitters signaling (or its disconnection) may favor a correspondent functional reorganization of RSNs, manifesting in distinct psychopathological states. The here suggested model carries important implications for psychiatric disorders, providing novel and well testable hypotheses especially on bipolar disorder and schizophrenia.
Collapse
Affiliation(s)
- Benedetta Conio
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy.,IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Matteo Martino
- Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
| | - Paola Magioncalda
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy. .,IRCCS Ospedale Policlinico San Martino, Genoa, Italy. .,Brain and Consciousness Research Center, Taipei Medical University - Shuang Ho Hospital, New Taipei City, Taiwan. .,Graduate Institute of Mind Brain and Consciousness, Taipei Medical University, Taipei, Taiwan.
| | - Andrea Escelsior
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy.,IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Matilde Inglese
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy.,Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Neurology, University of Genoa, Genoa, Italy.,Department of Neurology, Radiology and Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Mario Amore
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy.,IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Georg Northoff
- University of Ottawa Brain and Mind Research Institute, and Mind Brain Imaging and Neuroethics Royal's Institute of Mental Health Research, University of Ottawa, Ottawa, ON, Canada. .,Centre for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou, China. .,Mental Health Centre, Zhejiang University School of Medicine, Hangzhou, Zhejiang Province, China.
| |
Collapse
|
6
|
Martino M, Magioncalda P, Conio B, Capobianco L, Russo D, Adavastro G, Tumati S, Tan Z, Lee HC, Lane TJ, Amore M, Inglese M, Northoff G. Abnormal Functional Relationship of Sensorimotor Network With Neurotransmitter-Related Nuclei via Subcortical-Cortical Loops in Manic and Depressive Phases of Bipolar Disorder. Schizophr Bull 2020; 46:163-174. [PMID: 31150559 PMCID: PMC6942162 DOI: 10.1093/schbul/sbz035] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
OBJECTIVE Manic and depressive phases of bipolar disorder (BD) show opposite psychomotor symptoms. Neuronally, these may depend on altered relationships between sensorimotor network (SMN) and subcortical structures. The study aimed to investigate the functional relationships of SMN with substantia nigra (SN) and raphe nuclei (RN) via subcortical-cortical loops, and their alteration in bipolar mania and depression, as characterized by psychomotor excitation and inhibition. METHOD In this resting-state functional magnetic resonance imaging (fMRI) study on healthy (n = 67) and BD patients (n = 100), (1) functional connectivity (FC) between thalamus and SMN was calculated and correlated with FC from SN or RN to basal ganglia (BG)/thalamus in healthy; (2) using an a-priori-driven approach, thalamus-SMN FC, SN-BG/thalamus FC, and RN-BG/thalamus FC were compared between healthy and BD, focusing on manic (n = 34) and inhibited depressed (n = 21) patients. RESULTS (1) In healthy, the thalamus-SMN FC showed a quadratic correlation with SN-BG/thalamus FC and a linear negative correlation with RN-BG/thalamus FC. Accordingly, the SN-related FC appears to enable the thalamus-SMN coupling, while the RN-related FC affects it favoring anti-correlation. (2) In BD, mania showed an increase in thalamus-SMN FC toward positive values (ie, thalamus-SMN abnormal coupling) paralleled by reduction of RN-BG/thalamus FC. By contrast, inhibited depression showed a decrease in thalamus-SMN FC toward around-zero values (ie, thalamus-SMN disconnection) paralleled by reduction of SN-BG/thalamus FC (and RN-BG/thalamus FC). The results were replicated in independent HC and BD datasets. CONCLUSIONS These findings suggest an abnormal relationship of SMN with neurotransmitters-related areas via subcortical-cortical loops in mania and inhibited depression, finally resulting in psychomotor alterations.
Collapse
Affiliation(s)
- Matteo Martino
- Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Paola Magioncalda
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
- Brain and Consciousness Research Center, Taipei Medical University - Shuang Ho Hospital, New Taipei City, Taiwan
- Graduate Institute of Mind Brain and Consciousness, Taipei Medical University, Taipei, Taiwan
- To whom correspondence should be addressed; Clinica Psichiatrica, Ospedale Policlinico San Martino, Largo R. Benzi 10, 16132 Genoa, Italy; tel: +390103537668, fax: +390103537669, e-mail:
| | - Benedetta Conio
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Laura Capobianco
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Daniel Russo
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Giulia Adavastro
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Shankar Tumati
- University of Ottawa Brain and Mind Research Institute, and Mind Brain Imaging and Neuroethics Royal’s Institute of Mental Health Research, University of Ottawa, Ottawa, Canada
| | - Zhonglin Tan
- Mental Health Centre, Zhejiang University School of Medicine, Hangzhou, Zhejiang Province, China
| | - Hsin-Chien Lee
- Department of Psychiatry, College of Medicine and Shuang Ho Hospital, Taipei Medical University, Taipei, Taiwan
| | - Timothy J Lane
- Brain and Consciousness Research Center, Taipei Medical University - Shuang Ho Hospital, New Taipei City, Taiwan
- Graduate Institute of Mind Brain and Consciousness, Taipei Medical University, Taipei, Taiwan
- Graduate Institute of Humanities in Medicine, Taipei Medical University, Taipei, Taiwan
| | - Mario Amore
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Matilde Inglese
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Neurology, University of Genoa, Genoa, Italy
- Department of Neurology, Radiology and Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Georg Northoff
- University of Ottawa Brain and Mind Research Institute, and Mind Brain Imaging and Neuroethics Royal’s Institute of Mental Health Research, University of Ottawa, Ottawa, Canada
- Mental Health Centre, Zhejiang University School of Medicine, Hangzhou, Zhejiang Province, China
- Centre for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou, China
| |
Collapse
|
7
|
Jacob SN, Nienborg H. Monoaminergic Neuromodulation of Sensory Processing. Front Neural Circuits 2018; 12:51. [PMID: 30042662 PMCID: PMC6048220 DOI: 10.3389/fncir.2018.00051] [Citation(s) in RCA: 83] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2017] [Accepted: 06/11/2018] [Indexed: 12/17/2022] Open
Abstract
All neuronal circuits are subject to neuromodulation. Modulatory effects on neuronal processing and resulting behavioral changes are most commonly reported for higher order cognitive brain functions. Comparatively little is known about how neuromodulators shape processing in sensory brain areas that provide the signals for downstream regions to operate on. In this article, we review the current knowledge about how the monoamine neuromodulators serotonin, dopamine and noradrenaline influence the representation of sensory stimuli in the mammalian sensory system. We review the functional organization of the monoaminergic brainstem neuromodulatory systems in relation to their role for sensory processing and summarize recent neurophysiological evidence showing that monoamines have diverse effects on early sensory processing, including changes in gain and in the precision of neuronal responses to sensory inputs. We also highlight the substantial evidence for complementarity between these neuromodulatory systems with different patterns of innervation across brain areas and cortical layers as well as distinct neuromodulatory actions. Studying the effects of neuromodulators at various target sites is a crucial step in the development of a mechanistic understanding of neuronal information processing in the healthy brain and in the generation and maintenance of mental diseases.
Collapse
Affiliation(s)
- Simon N Jacob
- Department of Neurosurgery, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Hendrikje Nienborg
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
| |
Collapse
|
8
|
Serotonin Decreases the Gain of Visual Responses in Awake Macaque V1. J Neurosci 2017; 37:11390-11405. [PMID: 29042433 PMCID: PMC5700422 DOI: 10.1523/jneurosci.1339-17.2017] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2017] [Revised: 09/09/2017] [Accepted: 09/12/2017] [Indexed: 11/21/2022] Open
Abstract
Serotonin, an important neuromodulator in the brain, is implicated in affective and cognitive functions. However, its role even for basic cortical processes is controversial. For example, in the mammalian primary visual cortex (V1), heterogenous serotonergic modulation has been observed in anesthetized animals. Here, we combined extracellular single-unit recordings with iontophoresis in awake animals. We examined the role of serotonin on well-defined tuning properties (orientation, spatial frequency, contrast, and size) in V1 of two male macaque monkeys. We find that in the awake macaque the modulatory effect of serotonin is surprisingly uniform: it causes a mainly multiplicative decrease of the visual responses and a slight increase in the stimulus-selective response latency. Moreover, serotonin neither systematically changes the selectivity or variability of the response, nor the interneuronal correlation unexplained by the stimulus ("noise-correlation"). The modulation by serotonin has qualitative similarities with that for a decrease in stimulus contrast, but differs quantitatively from decreasing contrast. It can be captured by a simple additive change to a threshold-linear spiking nonlinearity. Together, our results show that serotonin is well suited to control the response gain of neurons in V1 depending on the animal's behavioral or motivational context, complementing other known state-dependent gain-control mechanisms.SIGNIFICANCE STATEMENT Serotonin is an important neuromodulator in the brain and a major target for drugs used to treat psychiatric disorders. Nonetheless, surprisingly little is known about how it shapes information processing in sensory areas. Here we examined the serotonergic modulation of visual processing in the primary visual cortex of awake behaving macaque monkeys. We found that serotonin mainly decreased the gain of the visual responses, without systematically changing their selectivity, variability, or covariability. This identifies a simple computational function of serotonin for state-dependent sensory processing, depending on the animal's affective or motivational state.
Collapse
|
9
|
Abstract
Previous attempts to identify a unified theory of brain serotonin function have largely failed to achieve consensus. In this present synthesis, we integrate previous perspectives with new and older data to create a novel bipartite model centred on the view that serotonin neurotransmission enhances two distinct adaptive responses to adversity, mediated in large part by its two most prevalent and researched brain receptors: the 5-HT1A and 5-HT2A receptors. We propose that passive coping (i.e. tolerating a source of stress) is mediated by postsynaptic 5-HT1AR signalling and characterised by stress moderation. Conversely, we argue that active coping (i.e. actively addressing a source of stress) is mediated by 5-HT2AR signalling and characterised by enhanced plasticity (defined as capacity for change). We propose that 5-HT1AR-mediated stress moderation may be the brain's default response to adversity but that an improved ability to change one's situation and/or relationship to it via 5-HT2AR-mediated plasticity may also be important - and increasingly so as the level of adversity reaches a critical point. We propose that the 5-HT1AR pathway is enhanced by conventional 5-HT reuptake blocking antidepressants such as the selective serotonin reuptake inhibitors (SSRIs), whereas the 5-HT2AR pathway is enhanced by 5-HT2AR-agonist psychedelics. This bipartite model purports to explain how different drugs (SSRIs and psychedelics) that modulate the serotonergic system in different ways, can achieve complementary adaptive and potentially therapeutic outcomes.
Collapse
Affiliation(s)
- RL Carhart-Harris
- Psychedelic Research Group, Neuropsychopharmacology Unit, Centre for Psychiatry, Division of Brain Sciences, Department of Medicine, Imperial College London, London, UK
| | - DJ Nutt
- Psychedelic Research Group, Neuropsychopharmacology Unit, Centre for Psychiatry, Division of Brain Sciences, Department of Medicine, Imperial College London, London, UK
| |
Collapse
|
10
|
Korte SM, Prins J, Van den Bergh FS, Oosting RS, Dupree R, Korte-Bouws GA, Westphal KG, Olivier B, Denys DA, Garland A, Güntürkün O. The 5-HT1A/1B-receptor agonist eltoprazine increases both catecholamine release in the prefrontal cortex and dopamine release in the nucleus accumbens and decreases motivation for reward and “waiting” impulsivity, but increases “stopping” impulsivity. Eur J Pharmacol 2017; 794:257-269. [DOI: 10.1016/j.ejphar.2016.11.024] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2016] [Revised: 11/03/2016] [Accepted: 11/16/2016] [Indexed: 10/20/2022]
|
11
|
Li Y, Zhong W, Wang D, Feng Q, Liu Z, Zhou J, Jia C, Hu F, Zeng J, Guo Q, Fu L, Luo M. Serotonin neurons in the dorsal raphe nucleus encode reward signals. Nat Commun 2016; 7:10503. [PMID: 26818705 PMCID: PMC4738365 DOI: 10.1038/ncomms10503] [Citation(s) in RCA: 248] [Impact Index Per Article: 31.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2015] [Accepted: 12/17/2015] [Indexed: 02/06/2023] Open
Abstract
The dorsal raphe nucleus (DRN) is involved in organizing reward-related behaviours; however, it remains unclear how genetically defined neurons in the DRN of a freely behaving animal respond to various natural rewards. Here we addressed this question using fibre photometry and single-unit recording from serotonin (5-HT) neurons and GABA neurons in the DRN of behaving mice. Rewards including sucrose, food, sex and social interaction rapidly activate 5-HT neurons, but aversive stimuli including quinine and footshock do not. Both expected and unexpected rewards activate 5-HT neurons. After mice learn to wait for sucrose delivery, most 5-HT neurons fire tonically during waiting and then phasically on reward acquisition. Finally, GABA neurons are activated by aversive stimuli but inhibited when mice seek rewards. Thus, DRN 5-HT neurons positively encode a wide range of reward signals during anticipatory and consummatory phases of reward responses. Moreover, GABA neurons play a complementary role in reward processing.
Collapse
Affiliation(s)
- Yi Li
- Graduate School of Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing 100730, China
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Weixin Zhong
- Graduate School of Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing 100730, China
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Daqing Wang
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
- School of Life Sciences, Tsinghua University, Beijing 100084, China
| | - Qiru Feng
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Zhixiang Liu
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Jingfeng Zhou
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
- PTN Graduate Program, School of Life Sciences, Peking University, Beijing 100081, China
| | - Chunying Jia
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Fei Hu
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Jiawei Zeng
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
| | - Qingchun Guo
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
- Wuhan National Laboratory for Optoelectronics-Huazhong, Britton Chance Center for Biomedical Photonics, University of Science and Technology, Wuhan 430074, China
| | - Ling Fu
- Wuhan National Laboratory for Optoelectronics-Huazhong, Britton Chance Center for Biomedical Photonics, University of Science and Technology, Wuhan 430074, China
| | - Minmin Luo
- Graduate School of Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing 100730, China
- National Institute of Biological Sciences, Zhongguancun Life Science Park 7 Science Park Road, Beijing 102206, China
- School of Life Sciences, Tsinghua University, Beijing 100084, China
| |
Collapse
|
12
|
Pickard GE, So KF, Pu M. Dorsal raphe nucleus projecting retinal ganglion cells: Why Y cells? Neurosci Biobehav Rev 2015; 57:118-31. [PMID: 26363667 PMCID: PMC4646079 DOI: 10.1016/j.neubiorev.2015.08.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2014] [Revised: 06/30/2015] [Accepted: 08/01/2015] [Indexed: 10/23/2022]
Abstract
Retinal ganglion Y (alpha) cells are found in retinas ranging from frogs to mice to primates. The highly conserved nature of the large, fast conducting retinal Y cell is a testament to its fundamental task, although precisely what this task is remained ill-defined. The recent discovery that Y-alpha retinal ganglion cells send axon collaterals to the serotonergic dorsal raphe nucleus (DRN) in addition to the lateral geniculate nucleus (LGN), medial interlaminar nucleus (MIN), pretectum and the superior colliculus (SC) has offered new insights into the important survival tasks performed by these cells with highly branched axons. We propose that in addition to its role in visual perception, the Y-alpha retinal ganglion cell provides concurrent signals via axon collaterals to the DRN, the major source of serotonergic afferents to the forebrain, to dramatically inhibit 5-HT activity during orientation or alerting/escape responses, which dis-facilitates ongoing tonic motor activity while dis-inhibiting sensory information processing throughout the visual system. The new data provide a fresh view of these evolutionarily old retinal ganglion cells.
Collapse
Affiliation(s)
- Gary E Pickard
- School of Veterinary Medicine and Biomedical Sciences, University of Nebraska, Lincoln, NE, 68583, United States; Department of Ophthalmology and Visual Sciences, University of Nebraska Medical Center, Omaha, NE, 68198, United States; GHM Institute of CNS Regeneration, Jinan University, Guangzhou, China
| | - Kwok-Fai So
- Department of Biomedical Sciences, The University of Hong Kong, Pokfulam, Hong Kong, China; Department of Ophthalmology, The University of Hong Kong, Hong Kong, China; GHM Institute of CNS Regeneration, Jinan University, Guangzhou, China; State Key Laboratory for Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong, China.
| | - Mingliang Pu
- Department of Anatomy and Embryology, School of Basic Medical Sciences, Peking University, Beijing, China; Key Laboratory on Machine Perception (Ministry of Education), Peking University, Beijing, China; Key Laboratory for Visual Impairment and Restoration (Ministry of Education), Peking University, Beijing, China.
| |
Collapse
|
13
|
Luo M, Zhou J, Liu Z. Reward processing by the dorsal raphe nucleus: 5-HT and beyond. ACTA ACUST UNITED AC 2015; 22:452-60. [PMID: 26286655 PMCID: PMC4561406 DOI: 10.1101/lm.037317.114] [Citation(s) in RCA: 76] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2015] [Accepted: 07/06/2015] [Indexed: 12/20/2022]
Abstract
The dorsal raphe nucleus (DRN) represents one of the most sensitive reward sites in the brain. However, the exact relationship between DRN neuronal activity and reward signaling has been elusive. In this review, we will summarize anatomical, pharmacological, optogenetics, and electrophysiological studies on the functions and circuit mechanisms of DRN neurons in reward processing. The DRN is commonly associated with serotonin (5-hydroxytryptamine; 5-HT), but this nucleus also contains neurons of the neurotransmitter phenotypes of glutamate, GABA and dopamine. Pharmacological studies indicate that 5-HT might be involved in modulating reward- or punishment-related behaviors. Recent optogenetic stimulations demonstrate that transient activation of DRN neurons produces strong reinforcement signals that are carried out primarily by glutamate. Moreover, activation of DRN 5-HT neurons enhances reward waiting. Electrophysiological recordings reveal that the activity of DRN neurons exhibits diverse behavioral correlates in reward-related tasks. Studies so far thus demonstrate the strong power of DRN neurons in reward signaling and at the same time invite additional efforts to dissect the roles and mechanisms of different DRN neuron types in various processes of reward-related behaviors.
Collapse
Affiliation(s)
- Minmin Luo
- National Institute of Biological Sciences, Beijing 102206, China School of Life Sciences, Tsinghua University, Beijing 100084, China
| | - Jingfeng Zhou
- National Institute of Biological Sciences, Beijing 102206, China
| | - Zhixiang Liu
- National Institute of Biological Sciences, Beijing 102206, China
| |
Collapse
|
14
|
Fonseca M, Murakami M, Mainen Z. Activation of Dorsal Raphe Serotonergic Neurons Promotes Waiting but Is Not Reinforcing. Curr Biol 2015; 25:306-315. [DOI: 10.1016/j.cub.2014.12.002] [Citation(s) in RCA: 138] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2014] [Revised: 11/20/2014] [Accepted: 12/01/2014] [Indexed: 11/29/2022]
|