1
|
Feng YY, Bromberg-Martin ES, Monosov IE. Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making. Cell Rep 2024; 43:114341. [PMID: 38878290 DOI: 10.1016/j.celrep.2024.114341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Revised: 03/27/2024] [Accepted: 05/23/2024] [Indexed: 06/25/2024] Open
Abstract
The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.
Collapse
Affiliation(s)
- Yang-Yang Feng
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO, USA; Department of Biomedical Engineering, Washington University, St. Louis, MO, USA
| | | | - Ilya E Monosov
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO, USA; Department of Biomedical Engineering, Washington University, St. Louis, MO, USA; Washington University Pain Center, Washington University, St. Louis, MO, USA; Department of Neurosurgery, Washington University, St. Louis, MO, USA; Department of Electrical Engineering, Washington University, St. Louis, MO, USA.
| |
Collapse
|
2
|
Monosov IE, Zimmermann J, Frank MJ, Mathis MW, Baker JT. Ethological computational psychiatry: Challenges and opportunities. Curr Opin Neurobiol 2024; 86:102881. [PMID: 38696972 PMCID: PMC11162904 DOI: 10.1016/j.conb.2024.102881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Revised: 04/02/2024] [Accepted: 04/03/2024] [Indexed: 05/04/2024]
Abstract
Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions and well-constrained behaviors over short timescales (e.g., trials, hours), many mental health conditions involve complex interactions of mood and cognition that are non-stationary across behavioral contexts and evolve over extended timescales. Here, we discuss opportunities, challenges, and possible future directions in computational psychiatry to quantify non-stationary continuously monitored behaviors. We suggest that this exploratory effort may contribute to a more precision-based approach to treating mental disorders and facilitate a more robust reverse translation across animal species. We conclude with ethical considerations for any field that aims to bridge artificial intelligence and patient monitoring.
Collapse
Affiliation(s)
- Ilya E. Monosov
- Departments of Neuroscience, Biomedical Engineering, Electrical Engineering, and Neurosurgery, Washington University School of Medicine, St. Louis, MO, USA
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - Michael J. Frank
- Carney Center for Computational Brain Science, Brown University, Providence, RI, USA
| | | | | |
Collapse
|
3
|
Feng YY, Bromberg-Martin ES, Monosov IE. Dorsal raphe neurons signal integrated value during multi-attribute decision-making. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.17.553745. [PMID: 37662243 PMCID: PMC10473596 DOI: 10.1101/2023.08.17.553745] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.
Collapse
Affiliation(s)
- Yang-Yang Feng
- Department of Neuroscience, Washington University School of Medicine, St. Louis, Missouri, USA
- Department of Biomedical Engineering, Washington University, St. Louis, Missouri, USA
| | | | - Ilya E. Monosov
- Department of Neuroscience, Washington University School of Medicine, St. Louis, Missouri, USA
- Department of Biomedical Engineering, Washington University, St. Louis, Missouri, USA
- Washington University Pain Center, Washington University, St. Louis, Missouri, USA
- Department of Neurosurgery, Washington University, St. Louis, Missouri, USA
- Department of Electrical Engineering, Washington University, St. Louis, Missouri, USA
| |
Collapse
|
4
|
Behera CK, Joshi A, Wang DH, Sharp T, Wong-Lin K. Degeneracy and stability in neural circuits of dopamine and serotonin neuromodulators: A theoretical consideration. Front Comput Neurosci 2023; 16:950489. [PMID: 36761394 PMCID: PMC9905743 DOI: 10.3389/fncom.2022.950489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Accepted: 12/30/2022] [Indexed: 01/26/2023] Open
Abstract
Degenerate neural circuits perform the same function despite being structurally different. However, it is unclear whether neural circuits with interacting neuromodulator sources can themselves degenerate while maintaining the same neuromodulatory function. Here, we address this by computationally modeling the neural circuits of neuromodulators serotonin and dopamine, local glutamatergic and GABAergic interneurons, and their possible interactions, under reward/punishment-based conditioning tasks. The neural modeling is constrained by relevant experimental studies of the VTA or DRN system using, e.g., electrophysiology, optogenetics, and voltammetry. We first show that a single parsimonious, sparsely connected neural circuit model can recapitulate several separate experimental findings that indicated diverse, heterogeneous, distributed, and mixed DRNVTA neuronal signaling in reward and punishment tasks. The inability of this model to recapitulate all observed neuronal signaling suggests potentially multiple circuits acting in parallel. Then using computational simulations and dynamical systems analysis, we demonstrate that several different stable circuit architectures can produce the same observed network activity profile, hence demonstrating degeneracy. Due to the extensive D2-mediated connections in the investigated circuits, we simulate the D2 receptor agonist by increasing the connection strengths emanating from the VTA DA neurons. We found that the simulated D2 agonist can distinguish among sub-groups of the degenerate neural circuits based on substantial deviations in specific neural populations' activities in reward and punishment conditions. This forms a testable model prediction using pharmacological means. Overall, this theoretical work suggests the plausibility of degeneracy within neuromodulator circuitry and has important implications for the stable and robust maintenance of neuromodulatory functions.
Collapse
Affiliation(s)
- Chandan K. Behera
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Derry∼Londonderry, United Kingdom,*Correspondence: Chandan K. Behera,
| | - Alok Joshi
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Derry∼Londonderry, United Kingdom
| | - Da-Hui Wang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China,School of Systems Science, Beijing Normal University, Beijing, China
| | - Trevor Sharp
- Department of Pharmacology, University of Oxford, Oxford, United Kingdom
| | - KongFatt Wong-Lin
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Derry∼Londonderry, United Kingdom,KongFatt Wong-Lin,
| |
Collapse
|
5
|
Wong-Lin K, Wang DH, Joshi A. Multiscale modeling and analytical methods in neuroscience: Molecules, neural circuits, cognition and brain disorders. J Neurosci Methods 2021; 359:109225. [PMID: 34023364 DOI: 10.1016/j.jneumeth.2021.109225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- KongFatt Wong-Lin
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Magee Campus, Derry∼Londonderry, Northern Ireland, UK.
| | - Da-Hui Wang
- School of Systems Science and National Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Alok Joshi
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Magee Campus, Derry∼Londonderry, Northern Ireland, UK
| |
Collapse
|
6
|
Siemann JK, Grueter BA, McMahon DG. Rhythms, Reward, and Blues: Consequences of Circadian Photoperiod on Affective and Reward Circuit Function. Neuroscience 2020; 457:220-234. [PMID: 33385488 DOI: 10.1016/j.neuroscience.2020.12.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Revised: 12/07/2020] [Accepted: 12/08/2020] [Indexed: 02/01/2023]
Abstract
Circadian disruptions, along with altered affective and reward states, are commonly associated with psychiatric disorders. In addition to genetics, the enduring influence of environmental factors in programming neural networks is of increased interest in assessing the underpinnings of mental health. The duration of daylight or photoperiod is known to impact both the serotonin and dopamine systems, which are implicated in mood and reward-based disorders. This review first examines the effects of circadian disruption and photoperiod in the serotonin system in both human and preclinical studies. We next highlight how brain regions crucial for the serotoninergic system (i.e., dorsal raphe nucleus; DRN), and dopaminergic (i.e., nucleus accumbens; NAc and ventral tegmental area; VTA) system are intertwined in overlapping circuitry, and play influential roles in the pathology of mood and reward-based disorders. We then focus on human and animal studies that demonstrate the impact of circadian factors on the dopaminergic system. Lastly, we discuss how environmental factors such as circadian photoperiod can impact the neural circuits that are responsible for regulating affective and reward states, offering novel insights into the biological mechanisms underlying the pathophysiology, systems, and therapeutic treatments necessary for mood and reward-based disorders.
Collapse
Affiliation(s)
- Justin K Siemann
- Department of Biological Sciences, Vanderbilt University, Nashville, TN 37235, USA; Kennedy Center for Research on Human Development, Vanderbilt University, Nashville, TN 37235, USA
| | - Brad A Grueter
- Department of Pharmacology, Vanderbilt University, Nashville, TN 37235, USA; Department of Anesthesiology, Vanderbilt University, Nashville, TN 37235, USA; Vanderbilt Center for Addiction Research, Vanderbilt University, Nashville, TN 37235, USA; Kennedy Center for Research on Human Development, Vanderbilt University, Nashville, TN 37235, USA
| | - Douglas G McMahon
- Department of Biological Sciences, Vanderbilt University, Nashville, TN 37235, USA; Department of Pharmacology, Vanderbilt University, Nashville, TN 37235, USA; Kennedy Center for Research on Human Development, Vanderbilt University, Nashville, TN 37235, USA.
| |
Collapse
|
7
|
Joshi A, Wang DH, Watterson S, McClean PL, Behera CK, Sharp T, Wong-Lin K. Opportunities for multiscale computational modelling of serotonergic drug effects in Alzheimer's disease. Neuropharmacology 2020; 174:108118. [PMID: 32380022 PMCID: PMC7322519 DOI: 10.1016/j.neuropharm.2020.108118] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Revised: 04/13/2020] [Accepted: 04/27/2020] [Indexed: 12/17/2022]
Abstract
Alzheimer's disease (AD) is an age-specific neurodegenerative disease that compromises cognitive functioning and impacts the quality of life of an individual. Pathologically, AD is characterised by abnormal accumulation of beta-amyloid (Aβ) and hyperphosphorylated tau protein. Despite research advances over the last few decades, there is currently still no cure for AD. Although, medications are available to control some behavioural symptoms and slow the disease's progression, most prescribed medications are based on cholinesterase inhibitors. Over the last decade, there has been increased attention towards novel drugs, targeting alternative neurotransmitter pathways, particularly those targeting serotonergic (5-HT) system. In this review, we focused on 5-HT receptor (5-HTR) mediated signalling and drugs that target these receptors. These pathways regulate key proteins and kinases such as GSK-3 that are associated with abnormal levels of Aβ and tau in AD. We then review computational studies related to 5-HT signalling pathways with the potential for providing deeper understanding of AD pathologies. In particular, we suggest that multiscale and multilevel modelling approaches could potentially provide new insights into AD mechanisms, and towards discovering novel 5-HTR based therapeutic targets.
Collapse
Affiliation(s)
- Alok Joshi
- Intelligent Systems Research Centre, Ulster University, Derry~Londonderry, Northern Ireland, UK.
| | - Da-Hui Wang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China; School of System Science, Beijing Normal University, Beijing, China
| | - Steven Watterson
- Northern Ireland Centre for Stratified Medicine, Biomedical Sciences Research Institute, Ulster University, Derry~Londonderry, Northern Ireland, UK
| | - Paula L McClean
- Northern Ireland Centre for Stratified Medicine, Biomedical Sciences Research Institute, Ulster University, Derry~Londonderry, Northern Ireland, UK
| | - Chandan K Behera
- Intelligent Systems Research Centre, Ulster University, Derry~Londonderry, Northern Ireland, UK
| | - Trevor Sharp
- Department of Pharmacology, University of Oxford, Oxford, UK
| | - KongFatt Wong-Lin
- Intelligent Systems Research Centre, Ulster University, Derry~Londonderry, Northern Ireland, UK.
| |
Collapse
|
8
|
Badman RP, Hills TT, Akaishi R. Multiscale Computation and Dynamic Attention in Biological and Artificial Intelligence. Brain Sci 2020; 10:E396. [PMID: 32575758 PMCID: PMC7348831 DOI: 10.3390/brainsci10060396] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 05/23/2020] [Accepted: 06/17/2020] [Indexed: 11/16/2022] Open
Abstract
Biological and artificial intelligence (AI) are often defined by their capacity to achieve a hierarchy of short-term and long-term goals that require incorporating information over time and space at both local and global scales. More advanced forms of this capacity involve the adaptive modulation of integration across scales, which resolve computational inefficiency and explore-exploit dilemmas at the same time. Research in neuroscience and AI have both made progress towards understanding architectures that achieve this. Insight into biological computations come from phenomena such as decision inertia, habit formation, information search, risky choices and foraging. Across these domains, the brain is equipped with mechanisms (such as the dorsal anterior cingulate and dorsolateral prefrontal cortex) that can represent and modulate across scales, both with top-down control processes and by local to global consolidation as information progresses from sensory to prefrontal areas. Paralleling these biological architectures, progress in AI is marked by innovations in dynamic multiscale modulation, moving from recurrent and convolutional neural networks-with fixed scalings-to attention, transformers, dynamic convolutions, and consciousness priors-which modulate scale to input and increase scale breadth. The use and development of these multiscale innovations in robotic agents, game AI, and natural language processing (NLP) are pushing the boundaries of AI achievements. By juxtaposing biological and artificial intelligence, the present work underscores the critical importance of multiscale processing to general intelligence, as well as highlighting innovations and differences between the future of biological and artificial intelligence.
Collapse
Affiliation(s)
| | | | - Rei Akaishi
- Center for Brain Science, RIKEN, Saitama 351-0198, Japan
| |
Collapse
|
9
|
Abstract
Neurons that synthesize and release 5-hydroxytryptamine (5-HT; serotonin) express a core set of genes that establish and maintain this neurotransmitter phenotype and distinguish these neurons from other brain cells. Beyond a shared 5-HTergic phenotype, these neurons display divergent cellular properties in relation to anatomy, morphology, hodology, electrophysiology and gene expression, including differential expression of molecules supporting co-transmission of additional neurotransmitters. This diversity suggests that functionally heterogeneous subtypes of 5-HT neurons exist, but linking subsets of these neurons to particular functions has been technically challenging. We discuss recent data from molecular genetic, genomic and functional methods that, when coupled with classical findings, yield a reframing of the 5-HT neuronal system as a conglomeration of diverse subsystems with potential to inspire novel, more targeted therapies for clinically distinct 5-HT-related disorders.
Collapse
|
10
|
Trumble BC, Finch CE. THE EXPOSOME IN HUMAN EVOLUTION: FROM DUST TO DIESEL. THE QUARTERLY REVIEW OF BIOLOGY 2019; 94:333-394. [PMID: 32269391 PMCID: PMC7141577 DOI: 10.1086/706768] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Global exposures to air pollution and cigarette smoke are novel in human evolutionary history and are associated with about 16 million premature deaths per year. We investigate the history of the human exposome for relationships between novel environmental toxins and genetic changes during human evolution in six phases. Phase I: With increased walking on savannas, early human ancestors inhaled crustal dust, fecal aerosols, and spores; carrion scavenging introduced new infectious pathogens. Phase II: Domestic fire exposed early Homo to novel toxins from smoke and cooking. Phases III and IV: Neolithic to preindustrial Homo sapiens incurred infectious pathogens from domestic animals and dense communities with limited sanitation. Phase V: Industrialization introduced novel toxins from fossil fuels, industrial chemicals, and tobacco at the same time infectious pathogens were diminishing. Thereby, pathogen-driven causes of mortality were replaced by chronic diseases driven by sterile inflammogens, exogenous and endogenous. Phase VI: Considers future health during global warming with increased air pollution and infections. We hypothesize that adaptation to some ancient toxins persists in genetic variations associated with inflammation and longevity.
Collapse
Affiliation(s)
- Benjamin C Trumble
- School of Human Evolution & Social Change and Center for Evolution and Medicine, Arizona State University Tempe, Arizona 85287 USA
| | - Caleb E Finch
- Leonard Davis School of Gerontology and Dornsife College, University of Southern California Los Angeles, California 90089-0191 USA
| |
Collapse
|
11
|
Drozd US, Shaburova EV, Dygalo NN. Genetic approaches to the investigation of serotonergic neuron functions in animals. Vavilovskii Zhurnal Genet Selektsii 2019. [DOI: 10.18699/vj19.513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
The serotonergic system is one of the most important neurotransmitter systems that take part in the regulation of vital CNS functions. The understanding of its mechanisms will help scientists create new therapeutic approaches to the treatment of mental and neurodegenerative diseases and find out how this neurotransmitter system interacts with other parts of the brain and regulates their activity. Since the serotonergic system anatomy and functionality are heterogeneous and complex, the best tools for studying them are based on manipulation of individual types of neurons without affecting neurons of other neurotransmitter systems. The selective cell control is possible due to the genetic determinism of their functions. Proteins that determine the uniqueness of the cell type are expressed under the regulation of cell-specific promoters. By using promoters that are specific for genes of the serotonin system, one can control the expression of a gene of interest in serotonergic neurons. Here we review approaches based on such promoters. The genetic models to be discussed in the article have already shed the light on the role of the serotonergic system in modulating behavior and processing sensory information. In particular, genetic knockouts of serotonin genes sert, pet1, and tph2 promoted the determination of their contribution to the development and functioning of the brain. In addition, the review describes inducible models that allow gene expression to be controlled at various developmental stages. Finally, the application of these genetic approaches in optogenetics and chemogenetics provided a new resource for studying the functions, discharge activity, and signal transduction of serotonergic neurons. Nevertheless, the advantages and limitations of the discussed genetic approaches should be taken into consideration in the course of creating models of pathological conditions and developing pharmacological treatments for their correction.
Collapse
Affiliation(s)
- U. S. Drozd
- Novosibirsk State University; Institute of Cytology and Genetics, SB RAS
| | - E. V. Shaburova
- Novosibirsk State University; Institute of Cytology and Genetics, SB RAS
| | - N. N. Dygalo
- Novosibirsk State University; Institute of Cytology and Genetics, SB RAS
| |
Collapse
|