51
|
Ye W, Liu S, Liu X, Yu Y. A neural model of the frontal eye fields with reward-based learning. Neural Netw 2016; 81:39-51. [PMID: 27284696 DOI: 10.1016/j.neunet.2016.05.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2015] [Revised: 05/03/2016] [Accepted: 05/06/2016] [Indexed: 11/24/2022]
Abstract
Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue-saccade association.
Collapse
Affiliation(s)
- Weijie Ye
- School of Mathematics, South China University of Technology, Guangzhou, 510640, China
| | - Shenquan Liu
- School of Mathematics, South China University of Technology, Guangzhou, 510640, China.
| | - Xuanliang Liu
- School of Mathematics, South China University of Technology, Guangzhou, 510640, China
| | - Yuguo Yu
- Center for Computational Systems Biology, The State Key Laboratory of Medical Neurobiology and Institutes of Brain Science, Fudan University, School of Life Sciences, Shanghai, 200433, China
| |
Collapse
|
52
|
Exposure to acute stress enhances decision-making competence: Evidence for the role of DHEA. Psychoneuroendocrinology 2016; 67:51-60. [PMID: 26874561 PMCID: PMC4808381 DOI: 10.1016/j.psyneuen.2016.01.031] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/21/2015] [Revised: 01/30/2016] [Accepted: 01/31/2016] [Indexed: 02/03/2023]
Abstract
Exposure to acute stress can impact performance on numerous cognitive abilities, but little is known about how acute stress affects real-world decision-making ability. In the present study, we induced acute stress with a standard laboratory task involving uncontrollable socio-evaluative stress and subsequently assessed decision-making ability using the Adult Decision Making Competence index. In addition, we took baseline and post-test saliva samples from participants to examine associations between decision-making competence and adrenal hormones. Participants in the stress induction group showed enhanced decision-making competence, relative to controls. Further, although both cortisol and dehydroepiandrosterone (DHEA) reactivity predicted decision-making competence when considered in isolation, DHEA was a significantly better predictor than cortisol when both hormones were considered simultaneously. Thus, our results show that exposure to acute stress can have beneficial effects on the cognitive ability underpinning real-world decision-making and that this effect relates to DHEA reactivity more than cortisol.
Collapse
|
53
|
Catecholaminergic neuronal network dysfunction in the frontal lobe of a genetic mouse model of schizophrenia. Acta Neuropsychiatr 2016; 28:117-23. [PMID: 26333915 DOI: 10.1017/neu.2015.51] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
BACKGROUND The precise aetiology of schizophrenia remains unclear. The neurodevelopmental hypothesis of schizophrenia has been proposed based on the accumulation of genomic or neuroimaging studies. OBJECTIVE In this study, we examined the catecholaminergic neuronal networks in the frontal cortices of disrupted-in-schizophrenia 1 (DISC1) knockout (KO) mice, which are considered to be a useful model of schizophrenia. METHODS Six DISC1 homozygous KO mice and six age-matched littermates were used. The animals' brains were cut into 20-μm-thick slices, which were then immunohistochemically stained using an anti-tyrosine hydroxylase (TH) monoclonal antibody. RESULTS The TH-immunopositive fibres detected in the orbitofrontal cortices of the DISC1 KO mice were significantly shorter than those seen in the wild-type mice. CONCLUSION These neuropathological findings indicate that the hypofrontal symptoms of schizophrenia are associated with higher mental function deficiencies or cognitive dysfunction such as a loss of working memory.
Collapse
|
54
|
Arnsten AFT, Wang M, Paspalas CD. Dopamine's Actions in Primate Prefrontal Cortex: Challenges for Treating Cognitive Disorders. Pharmacol Rev 2016; 67:681-96. [PMID: 26106146 DOI: 10.1124/pr.115.010512] [Citation(s) in RCA: 106] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
The prefrontal cortex (PFC) elaborates and differentiates in primates, and there is a corresponding elaboration in cortical dopamine (DA). DA cells that fire to both aversive and rewarding stimuli likely project to the dorsolateral PFC (dlPFC), signaling a salient event. Since 1979, we have known that DA has an essential influence on dlPFC working memory functions. DA has differing effects via D1 (D1R) versus D2 receptor (D2R) families. D1R are concentrated on dendritic spines, and D1/5R stimulation produces an inverted U-shaped dose response on visuospatial working memory performance and Delay cell firing, the neurons that generate representations of visual space. Optimal levels of D1R stimulation gate out "noise," whereas higher levels, e.g., during stress, suppress Delay cell firing. These effects likely involve hyperpolarization-activated cyclic nucleotide-gated channel opening, activation of GABA interneurons, and reduced glutamate release. Dysregulation of D1R has been related to cognitive deficits in schizophrenia, and there is a need for new, lower-affinity D1R agonists that may better mimic endogenous DA to enhance mental representations and improve cognition. In contrast to D1R, D2R are primarily localized on layer V pyramidal cell dendrites, and D2/3R stimulation speeds and magnifies the firing of Response cells, including Response Feedback cells. Altered firing of Feedback neurons may relate to positive symptoms in schizophrenia. Emerging research suggests that DA may have similar effects in the ventrolateral PFC and frontal eye fields. Research on the orbital PFC in monkeys is just beginning and could be a key area for future discoveries.
Collapse
Affiliation(s)
- Amy F T Arnsten
- Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut
| | - Min Wang
- Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut
| | | |
Collapse
|
55
|
Lissek S, Glaubitz B, Wolf OT, Tegenthoff M. The DA antagonist tiapride impairs context-related extinction learning in a novel context without affecting renewal. Front Behav Neurosci 2015; 9:238. [PMID: 26388752 PMCID: PMC4558976 DOI: 10.3389/fnbeh.2015.00238] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2015] [Accepted: 08/20/2015] [Indexed: 11/13/2022] Open
Abstract
Renewal describes the recovery of an extinguished response if recall is tested in a context different from the extinction context. Behavioral studies demonstrated that attention to relevant context strengthens renewal. Neurotransmitters mediating attention and learning such as the dopaminergic (DA) system presumably modulate extinction learning and renewal. However, the role of DA for non-fear-based extinction learning and renewal in humans has not yet been investigated. This fMRI study investigated effects of DA-antagonism upon context-related extinction in a predictive learning task in which extinction occurred either in a novel (ABA) or an unchanged (AAA) context. The tiapride-treated group (TIA) showed significantly impaired ABA extinction learning and a significant within-group difference between ABA and AAA extinction, compared to placebo (PLAC). Groups did not differ in their level of ABA renewal. In ABA extinction, TIA showed reduced activation in dlPFC and OFC, hippocampus, and temporal regions. Across groups, activation in PFC and hippocampus correlated negatively with ABA extinction errors. Results suggest that in context-related extinction learning DA in PFC and hippocampus is involved in readjusting the cue-outcome relationship in the presence of a novel context. However, relating context to the appropriate association during recall does not appear to rely exclusively on DA signaling.
Collapse
Affiliation(s)
- Silke Lissek
- Department of Neurology, BG University Hospital Bergmannsheil, Ruhr-University Bochum Bochum, Germany
| | - Benjamin Glaubitz
- Department of Neurology, BG University Hospital Bergmannsheil, Ruhr-University Bochum Bochum, Germany
| | - Oliver T Wolf
- Department of Cognitive Psychology, Faculty of Psychology, Institute for Cognitive Neuroscience, Ruhr-University Bochum Bochum, Germany
| | - Martin Tegenthoff
- Department of Neurology, BG University Hospital Bergmannsheil, Ruhr-University Bochum Bochum, Germany
| |
Collapse
|
56
|
Ranganath A, Jacob SN. Doping the Mind: Dopaminergic Modulation of Prefrontal Cortical Cognition. Neuroscientist 2015; 22:593-603. [PMID: 26338491 DOI: 10.1177/1073858415602850] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
The prefrontal cortex is the center of cognitive control. Processing in prefrontal cortical circuits enables us to direct attention to behaviorally relevant events; to memorize, structure, and categorize information; and to learn new concepts. The prefrontal cortex receives strong projections from midbrain neurons that use dopamine as a transmitter. In this article, we review the crucial role dopamine plays as a modulator of prefrontal cognitive functions, in the primate brain in particular. Following a summary of the anatomy and physiology of the midbrain dopamine system, we focus on recent studies that investigated dopaminergic effects in prefrontal cortex at the cellular level. We then discuss how unregulated prefrontal dopamine signaling could contribute to major disorders of cognition. The studies highlighted in this review demonstrate the powerful influence dopamine exerts on the mind.
Collapse
Affiliation(s)
- Ajit Ranganath
- Institute of Neuroscience, Technische Universität München, Germany
| | - Simon N Jacob
- Institute of Neuroscience, Technische Universität München, Germany
| |
Collapse
|
57
|
Werlen E, Jones MW. Modulating the map: dopaminergic tuning of hippocampal spatial coding and interactions. PROGRESS IN BRAIN RESEARCH 2015; 219:187-216. [PMID: 26072240 DOI: 10.1016/bs.pbr.2015.03.002] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Salient events activate the midbrain dopaminergic system and have important impacts on various aspects of mnemonic function, including the stability of hippocampus-dependent memories. Dopamine is also central to modulation of neocortical memory processing, particularly during prefrontal cortex-dependent working memory. Here, we review the current state of the circuitry and physiology underlying dopamine's actions, suggesting that--alongside local effects within hippocampus and prefrontal cortex--dopamine released from the midbrain ventral tegmental area is well positioned to dynamically tune interactions between limbic-cortical circuits through modulation of rhythmic network activity.
Collapse
Affiliation(s)
- Emilie Werlen
- School of Physiology and Pharmacology, University of Bristol, University Walk, Bristol, UK.
| | - Matthew W Jones
- School of Physiology and Pharmacology, University of Bristol, University Walk, Bristol, UK
| |
Collapse
|
58
|
Abstract
The prefrontal cortex houses representations critical for ongoing and future behavior expressed in the form of patterns of neural activity. Dopamine has long been suggested to play a key role in the integrity of such representations, with D2-receptor activation rendering them flexible but weak. However, it is currently unknown whether and how D2-receptor activation affects prefrontal representations in humans. In the current study, we use dopamine receptor-specific pharmacology and multivoxel pattern-based functional magnetic resonance imaging to test the hypothesis that blocking D2-receptor activation enhances prefrontal representations. Human subjects performed a simple reward prediction task after double-blind and placebo controlled administration of the D2-receptor antagonist amisulpride. Using a whole-brain searchlight decoding approach we show that D2-receptor blockade enhances decoding of reward signals in the medial orbitofrontal cortex. Examination of activity patterns suggests that amisulpride increases the separation of activity patterns related to reward versus no reward. Moreover, consistent with the cortical distribution of D2 receptors, post hoc analyses showed enhanced decoding of motor signals in motor cortex, but not of visual signals in visual cortex. These results suggest that D2-receptor blockade enhances content-specific representations in frontal cortex, presumably by a dopamine-mediated increase in pattern separation. These findings are in line with a dual-state model of prefrontal dopamine, and provide new insights into the potential mechanism of action of dopaminergic drugs.
Collapse
|
59
|
Avery MC, Krichmar JL. Improper activation of D1 and D2 receptors leads to excess noise in prefrontal cortex. Front Comput Neurosci 2015; 9:31. [PMID: 25814948 PMCID: PMC4356073 DOI: 10.3389/fncom.2015.00031] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2014] [Accepted: 02/25/2015] [Indexed: 02/03/2023] Open
Abstract
The dopaminergic system has been shown to control the amount of noise in the prefrontal cortex (PFC) and likely plays an important role in working memory and the pathophysiology of schizophrenia. We developed a model that takes into account the known receptor distributions of D1 and D2 receptors, the changes these receptors have on neuron response properties, as well as identified circuitry involved in working memory. Our model suggests that D1 receptor under-stimulation in supragranular layers gates internal noise into the PFC leading to cognitive symptoms as has been proposed in attention disorders, while D2 over-stimulation gates noise into the PFC by over-activation of cortico-striatal projecting neurons in infragranular layers. We apply this model in the context of a memory-guided saccade paradigm and show deficits similar to those observed in schizophrenic patients. We also show set-shifting impairments similar to those observed in rodents with D1 and D2 receptor manipulations. We discuss how the introduction of noise through changes in D1 and D2 receptor activation may account for many of the symptoms of schizophrenia depending on where this dysfunction occurs in the PFC.
Collapse
Affiliation(s)
- Michael C Avery
- Systems Neurobiology Laboratory, Salk Institute for Biological Studies San Diego, CA, USA
| | - Jeffrey L Krichmar
- Department of Cognitive Sciences, University of California Irvine, CA, USA ; Department of Computer Sciences, University of California Irvine, CA, USA
| |
Collapse
|
60
|
Puig MV, Antzoulatos EG, Miller EK. Prefrontal dopamine in associative learning and memory. Neuroscience 2014; 282:217-29. [PMID: 25241063 DOI: 10.1016/j.neuroscience.2014.09.026] [Citation(s) in RCA: 89] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2014] [Revised: 09/06/2014] [Accepted: 09/10/2014] [Indexed: 01/14/2023]
Abstract
Learning to associate specific objects or actions with rewards and remembering the associations are everyday tasks crucial for our flexible adaptation to the environment. These higher-order cognitive processes depend on the prefrontal cortex (PFC) and frontostriatal circuits that connect areas in the frontal lobe with the striatum in the basal ganglia. Both structures are densely innervated by dopamine (DA) afferents that originate in the midbrain. Although the activity of DA neurons is thought to be important for learning, the exact role of DA transmission in frontostriatal circuits during learning-related tasks is still unresolved. Moreover, the neural substrates of this modulation are poorly understood. Here, we review our recent work in monkeys utilizing local pharmacology of DA agents in the PFC to investigate the cellular mechanisms of DA modulation of associative learning and memory. We show that blocking both D1 and D2 receptors in the lateral PFC impairs learning of new stimulus-response associations and cognitive flexibility, but not the memory of highly familiar associations. In addition, D2 receptors may also contribute to motivation. The learning deficits correlated with reductions of neural information about the associations in PFC neurons, alterations in global excitability and spike synchronization, and exaggerated alpha and beta neural oscillations. Our findings provide new insights into how DA transmission modulates associative learning and memory processes in frontostriatal systems.
Collapse
Affiliation(s)
- M V Puig
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - E G Antzoulatos
- Center for Neuroscience, Department of Neurobiology, Physiology and Behavior, University of California, Davis, CA 95618, USA
| | - E K Miller
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| |
Collapse
|
61
|
Puig MV, Rose J, Schmidt R, Freund N. Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds. Front Neural Circuits 2014; 8:93. [PMID: 25140130 PMCID: PMC4122189 DOI: 10.3389/fncir.2014.00093] [Citation(s) in RCA: 99] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2014] [Accepted: 07/18/2014] [Indexed: 02/02/2023] Open
Abstract
In this review, we provide a brief overview over the current knowledge about the role of dopamine transmission in the prefrontal cortex during learning and memory. We discuss work in humans, monkeys, rats, and birds in order to provide a basis for comparison across species that might help identify crucial features and constraints of the dopaminergic system in executive function. Computational models of dopamine function are introduced to provide a framework for such a comparison. We also provide a brief evolutionary perspective showing that the dopaminergic system is highly preserved across mammals. Even birds, following a largely independent evolution of higher cognitive abilities, have evolved a comparable dopaminergic system. Finally, we discuss the unique advantages and challenges of using different animal models for advancing our understanding of dopamine function in the healthy and diseased brain.
Collapse
Affiliation(s)
- M. Victoria Puig
- The Picower Institute for Learning and Memory, Department of Brain and Cognitive Sciences, Massachusetts Institute of TechnologyCambridge, MA, USA
| | - Jonas Rose
- The Picower Institute for Learning and Memory, Department of Brain and Cognitive Sciences, Massachusetts Institute of TechnologyCambridge, MA, USA
- Animal Physiology, Institute of Neurobiology, University of TübingenTübingen, Germany
| | - Robert Schmidt
- BrainLinks-BrainTools, Department of Biology, Bernstein Center Freiburg, University of FreiburgFreiburg, Germany
| | - Nadja Freund
- Department of Psychiatry and Psychotherapy, University of TübingenTübingen, Germany
| |
Collapse
|