1
|
Rojas AKP, Linley SB, Vertes RP. Chemogenetic inactivation of the nucleus reuniens and its projections to the orbital cortex produce deficits on discrete measures of behavioral flexibility in the attentional set-shifting task. Behav Brain Res 2024; 470:115066. [PMID: 38801950 DOI: 10.1016/j.bbr.2024.115066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Revised: 05/09/2024] [Accepted: 05/21/2024] [Indexed: 05/29/2024]
Abstract
The nucleus reuniens (RE) of the ventral midline thalamus is a critical node in the communication between the orbitomedial prefrontal cortex (OFC) and the hippocampus (HF). While RE has been shown to directly participate in memory-associated functions through its connections with the medial prefrontal cortex and HF, less is known regarding the role of RE in executive functioning. Here, we examined the involvement of RE and its projections to the orbital cortex (ORB) in attention and behavioral flexibility in male rats using the attentional set shifting task (AST). Rats expressing the hM4Di DREADD receptor in RE were implanted with indwelling cannulas in either RE or the ventromedial ORB to pharmacologically inhibit RE or its projections to the ORB with intracranial infusions of clozapine-N-oxide hydrochloride (CNO). Chemogenetic-induced suppression of RE resulted in impairments in reversal learning and set-shifting. This supports a vital role for RE in behavioral flexibility - or the ability to adapt behavior to changing reward or rule contingencies. Interestingly, CNO suppression of RE projections to the ventromedial ORB produced impairments in rule abstraction - or dissociable effects elicited with direct RE suppression. In summary, the present findings indicate that RE, mediated in part by actions on the ORB, serves a critical role in the flexible use of rules to drive goal directed behavior. The cognitive deficits of various neurological disorders with impaired communication between the HF and OFC, may be partly attributed to alterations of RE -- as an established intermediary between these cortical structures.
Collapse
Affiliation(s)
- Amanda K P Rojas
- Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Stephanie B Linley
- Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL 33431, USA; Department of Psychology, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Robert P Vertes
- Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL 33431, USA; Department of Psychology, Florida Atlantic University, Boca Raton, FL 33431, USA.
| |
Collapse
|
2
|
Alizadeh Mansouri F, Buckley MJ, Tanaka K. Mapping causal links between prefrontal cortical regions and intra-individual behavioral variability. Nat Commun 2024; 15:140. [PMID: 38168052 PMCID: PMC10762061 DOI: 10.1038/s41467-023-44341-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 12/08/2023] [Indexed: 01/05/2024] Open
Abstract
Intra-individual behavioral variability is significantly heightened by aging or neuropsychological disorders, however it is unknown which brain regions are causally linked to such variabilities. We examine response time (RT) variability in 21 macaque monkeys performing a rule-guided decision-making task. In monkeys with selective-bilateral lesions in the anterior cingulate cortex (ACC) or in the dorsolateral prefrontal cortex, cognitive flexibility is impaired, but the RT variability is significantly diminished. Bilateral lesions within the frontopolar cortex or within the mid-dorsolateral prefrontal cortex, has no significant effect on cognitive flexibility or RT variability. In monkeys with lesions in the posterior cingulate cortex, the RT variability significantly increases without any deficit in cognitive flexibility. The effect of lesions in the orbitofrontal cortex (OFC) is unique in that it leads to deficits in cognitive flexibility and a significant increase in RT variability. Our findings indicate remarkable dissociations in contribution of frontal cortical regions to behavioral variability. They suggest that the altered variability in OFC-lesioned monkeys is related to deficits in assessing and accumulating evidence to inform a rule-guided decision, whereas in ACC-lesioned monkeys it results from a non-adaptive decrease in decision threshold and consequently immature impulsive responses.
Collapse
Affiliation(s)
- Farshad Alizadeh Mansouri
- Cognitive Neuroscience Laboratory, Department of Physiology and Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, VIC, 3800, Australia.
- RIKEN Center for Brain Science, Wako, Saitama, 351-0198, Japan.
| | - Mark J Buckley
- Department of Experimental Psychology, Oxford University, Oxford, OX1 3UD, UK
| | - Keiji Tanaka
- RIKEN Center for Brain Science, Wako, Saitama, 351-0198, Japan
| |
Collapse
|
3
|
Abstract
People with damage to the orbitofrontal cortex (OFC) have specific problems making decisions, whereas their other cognitive functions are spared. Neurophysiological studies have shown that OFC neurons fire in proportion to the value of anticipated outcomes. Thus, a central role of the OFC is to guide optimal decision-making by signalling values associated with different choices. Until recently, this view of OFC function dominated the field. New data, however, suggest that the OFC may have a much broader role in cognition by representing cognitive maps that can be used to guide behaviour and that value is just one of many variables that are important for behavioural control. In this Review, we critically evaluate these two alternative accounts of OFC function and examine how they might be reconciled.
Collapse
Affiliation(s)
- Eric B Knudsen
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, USA
| | - Joni D Wallis
- Department of Psychology and Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, USA.
| |
Collapse
|
4
|
Stiers P, Goulas A. Task-specific subnetworks extend from prefrontal cortex to striatum. Cortex 2022; 156:106-125. [DOI: 10.1016/j.cortex.2022.06.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 02/23/2022] [Accepted: 06/07/2022] [Indexed: 11/29/2022]
|
5
|
Wang MZ, Hayden BY, Heilbronner SR. A structural and functional subdivision in central orbitofrontal cortex. Nat Commun 2022; 13:3623. [PMID: 35750659 PMCID: PMC9232485 DOI: 10.1038/s41467-022-31273-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 06/07/2022] [Indexed: 11/09/2022] Open
Abstract
Economic choice requires many cognitive subprocesses, including stimulus detection, valuation, motor output, and outcome monitoring; many of these subprocesses are associated with the central orbitofrontal cortex (cOFC). Prior work has largely assumed that the cOFC is a single region with a single function. Here, we challenge that unified view with convergent anatomical and physiological results from rhesus macaques. Anatomically, we show that the cOFC can be subdivided according to its much stronger (medial) or weaker (lateral) bidirectional anatomical connectivity with the posterior cingulate cortex (PCC). We call these subregions cOFCm and cOFCl, respectively. These two subregions have notable functional differences. Specifically, cOFCm shows enhanced functional connectivity with PCC, as indicated by both spike-field coherence and mutual information. The cOFCm-PCC circuit, but not the cOFCl-PCC circuit, shows signatures of relaying choice signals from a non-spatial comparison framework to a spatially framed organization and shows a putative bidirectional mutually excitatory pattern.
Collapse
Affiliation(s)
- Maya Zhe Wang
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA.
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA
| | - Sarah R Heilbronner
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA
| |
Collapse
|
6
|
Ramírez-Ruiz J, Moreno-Bote R. Optimal Allocation of Finite Sampling Capacity in Accumulator Models of Multialternative Decision Making. Cogn Sci 2022; 46:e13143. [PMID: 35523123 PMCID: PMC9285422 DOI: 10.1111/cogs.13143] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 02/07/2022] [Accepted: 04/16/2022] [Indexed: 11/28/2022]
Abstract
When facing many options, we narrow down our focus to very few of them. Although behaviors like this can be a sign of heuristics, they can actually be optimal under limited cognitive resources. Here, we study the problem of how to optimally allocate limited sampling time to multiple options, modeled as accumulators of noisy evidence, to determine the most profitable one. We show that the effective sampling capacity of an agent increases with both available time and the discriminability of the options, and optimal policies undergo a sharp transition as a function of it. For small capacity, it is best to allocate time evenly to exactly five options and to ignore all the others, regardless of the prior distribution of rewards. For large capacities, the optimal number of sampled accumulators grows sublinearly, closely following a power law as a function of capacity for a wide variety of priors. We find that allocating equal times to the sampled accumulators is better than using uneven time allocations. Our work highlights that multialternative decisions are endowed with breadth–depth tradeoffs, demonstrates how their optimal solutions depend on the amount of limited resources and the variability of the environment, and shows that narrowing down to a handful of options is always optimal for small capacities.
Collapse
Affiliation(s)
- Jorge Ramírez-Ruiz
- Center for Brain and Cognition, Department of Information and Communication Technologies, Universitat Pompeu Fabra
| | - Rubén Moreno-Bote
- Center for Brain and Cognition, Department of Information and Communication Technologies, Universitat Pompeu Fabra.,Serra Húnter Fellow Programme, Universitat Pompeu Fabra
| |
Collapse
|
7
|
Gmaz JM, van der Meer MAA. Context coding in the mouse nucleus accumbens modulates motivationally relevant information. PLoS Biol 2022; 20:e3001338. [PMID: 35486662 PMCID: PMC9094556 DOI: 10.1371/journal.pbio.3001338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 05/11/2022] [Accepted: 04/04/2022] [Indexed: 11/18/2022] Open
Abstract
Neural activity in the nucleus accumbens (NAc) is thought to track fundamentally value-centric quantities linked to reward and effort. However, the NAc also contributes to flexible behavior in ways that are difficult to explain based on value signals alone, raising the question of if and how nonvalue signals are encoded in NAc. We recorded NAc neural ensembles while head-fixed mice performed an odor-based biconditional discrimination task where an initial discrete cue modulated the behavioral significance of a subsequently presented reward-predictive cue. We extracted single-unit and population-level correlates related to the cues and found value-independent coding for the initial, context-setting cue. This context signal occupied a population-level coding space orthogonal to outcome-related representations and was predictive of subsequent behaviorally relevant responses to the reward-predictive cues. Together, these findings support a gating model for how the NAc contributes to behavioral flexibility and provide a novel population-level perspective from which to view NAc computations.
Collapse
Affiliation(s)
- Jimmie M. Gmaz
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, United States of America
| | - Matthijs A. A. van der Meer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, United States of America
- * E-mail:
| |
Collapse
|
8
|
Fine JM, Hayden BY. The whole prefrontal cortex is premotor cortex. Philos Trans R Soc Lond B Biol Sci 2022; 377:20200524. [PMID: 34957853 PMCID: PMC8710885 DOI: 10.1098/rstb.2020.0524] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 10/01/2021] [Indexed: 11/12/2022] Open
Abstract
We propose that the entirety of the prefrontal cortex (PFC) can be seen as fundamentally premotor in nature. By this, we mean that the PFC consists of an action abstraction hierarchy whose core function is the potentiation and depotentiation of possible action plans at different levels of granularity. We argue that the apex of the hierarchy should revolve around the process of goal-selection, which we posit is inherently a form of optimization over action abstraction. Anatomical and functional evidence supports the idea that this hierarchy originates on the orbital surface of the brain and extends dorsally to motor cortex. Accordingly, our viewpoint positions the orbitofrontal cortex in a key role in the optimization of goal-selection policies, and suggests that its other proposed roles are aspects of this more general function. Our proposed perspective will reframe outstanding questions, open up new areas of inquiry and align theories of prefrontal function with evolutionary principles. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.
Collapse
Affiliation(s)
- Justin M. Fine
- Department of Neuroscience, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Benjamin Y. Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| |
Collapse
|
9
|
Zhou J, Gardner MPH, Schoenbaum G. Is the core function of orbitofrontal cortex to signal values or make predictions? Curr Opin Behav Sci 2021; 41:1-9. [PMID: 33869678 PMCID: PMC8052096 DOI: 10.1016/j.cobeha.2021.02.011] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
One dominant hypothesis about the function of the orbitofrontal cortex (OFC) is that the OFC signals the subjective values of possible outcomes to other brain areas for learning and decision making. This popular view generally neglects the fact that OFC is not necessary for simple value-based behavior (i.e., when values have been directly experienced). An alternative, emerging view suggests that OFC plays a more general role in representing structural information about the task or environment, derived from prior experience, and relevant to predicting behavioral outcomes, such as value. From this perspective, value signaling is simply one derivative of the core underlying function of OFC. New data in favor of both views have been accumulating rapidly. Here we review these new data in discussing the relative merits of these two ideas.
Collapse
Affiliation(s)
- Jingfeng Zhou
- Intramural Research Program of the National Institute on Drug Abuse, Baltimore MD, USA
| | - Matthew P H Gardner
- Intramural Research Program of the National Institute on Drug Abuse, Baltimore MD, USA
| | - Geoffrey Schoenbaum
- Intramural Research Program of the National Institute on Drug Abuse, Baltimore MD, USA
| |
Collapse
|
10
|
Maisson DJN, Cash-Padgett TV, Wang MZ, Hayden BY, Heilbronner SR, Zimmermann J. Choice-relevant information transformation along a ventrodorsal axis in the medial prefrontal cortex. Nat Commun 2021; 12:4830. [PMID: 34376663 PMCID: PMC8355277 DOI: 10.1038/s41467-021-25219-w] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 07/27/2021] [Indexed: 11/17/2022] Open
Abstract
Choice-relevant brain regions in prefrontal cortex may progressively transform information about options into choices. Here, we examine responses of neurons in four regions of the medial prefrontal cortex as macaques performed two-option risky choices. All four regions encode economic variables in similar proportions and show similar putative signatures of key choice-related computations. We provide evidence to support a gradient of function that proceeds from areas 14 to 25 to 32 to 24. Specifically, we show that decodability of twelve distinct task variables increases along that path, consistent with the idea that regions that are higher in the anatomical hierarchy make choice-relevant variables more separable. We also show progressively longer intrinsic timescales in the same series. Together these results highlight the importance of the medial wall in choice, endorse a specific gradient-based organization, and argue against a modular functional neuroanatomy of choice.
Collapse
Affiliation(s)
- David J-N Maisson
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA.
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA.
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA.
| | - Tyler V Cash-Padgett
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Maya Z Wang
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Sarah R Heilbronner
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
11
|
Action Costs Rapidly and Automatically Interfere with Reward-Based Decision-Making in a Reaching Task. eNeuro 2021; 8:ENEURO.0247-21.2021. [PMID: 34281978 PMCID: PMC8354712 DOI: 10.1523/eneuro.0247-21.2021] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 06/22/2021] [Indexed: 11/21/2022] Open
Abstract
It is widely assumed that we select actions we value the most. While the influence of rewards on decision-making has been extensively studied, evidence regarding the influence of motor costs is scarce. Specifically, how and when motor costs are integrated in the decision process is unclear. Twenty-two right-handed human participants performed a reward-based target selection task by reaching with their right arm toward one of two visual targets. Targets were positioned in different directions according to biomechanical preference, such that one target was systematically associated with a lower motor cost than the other. Only one of the two targets was rewarded, either in a congruent or incongruent manner with respect to the associated motor cost. A timed-response paradigm was used to manipulate participants' reaction times (RT). Results showed that when the rewarded target carried the highest motor cost, movements produced at short RT (<350 ms) were deviated toward the other (i.e., non-rewarded, low-cost (LC) target). In this context participants needed an additional 150-ms delay to reach the same percentage of rewarded trials as when the LC target was rewarded. Crucially, motor costs affected the total earnings of participants. These results demonstrate a robust interference of motor costs in a simple reward-based decision-making task. They point to the rapid and automatic integration of motor costs at an early stage of processing, potentially through the direct modulation of competing action representations in parieto-frontal regions. The progressive overcoming of this bias with increasing RT is likely achieved through top-down signaling pertaining to expected rewards.
Collapse
|
12
|
Azab H, Hayden BY. Partial integration of the components of value in anterior cingulate cortex. Behav Neurosci 2021; 134:296-308. [PMID: 32658523 DOI: 10.1037/bne0000382] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Evaluation often involves integrating multiple determinants of value, such as the different possible outcomes in risky choice. A brain region can be placed either before or after a presumed evaluation stage by measuring how responses of its neurons depend on multiple determinants of value. A brain region could also, in principle, show partial integration, which would indicate that it occupies a middle position between (preevaluative) nonintegration and (postevaluative) full integration. Existing mathematical techniques cannot distinguish full from partial integration and therefore risk misidentifying regional function. Here we use a new Bayesian regression-based approach to analyze responses of neurons in dorsal anterior cingulate cortex (dACC) to risky offers. We find that dACC neurons only partially integrate across outcome dimensions, indicating that dACC cannot be assigned to either a pre- or postevaluative position. Neurons in dACC also show putative signatures of value comparison, thereby demonstrating that comparison does not require complete evaluation before proceeding. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
Affiliation(s)
- Habiba Azab
- Department of Neuroscience, Center for Magnetic Resonance Research (CMRR), University of Minnesota, Twin Cities
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research (CMRR), University of Minnesota, Twin Cities
| |
Collapse
|
13
|
Abstract
Curiosity is a desire for information that is not motivated by strategic concerns. Latent learning is not driven by standard reinforcement processes. We propose that curiosity serves the purpose of motivating latent learning. While latent learning is often treated as a passive or incidental process, it normally reflects a strong evolved pressure to actively seek large amounts of information. That information in turn allows curious decision makers to represent the structure of their environment, that is, to form cognitive maps. These cognitive maps then drive adaptive flexible behavior. Based on recent data, we propose that orbitofrontal cortex (OFC) and dorsal anterior cingulate cortex (dACC) play complementary roles in curiosity-driven learning. Specifically, we propose that (1) OFC tracks intrinsic value of information and incorporates new information into a cognitive map; and (2) dACC tracks the environmental demands and information availability to then use the cognitive map from OFC to guide behavior.
Collapse
Affiliation(s)
- Maya Zhe Wang
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis MN 55455
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis MN 55455
| |
Collapse
|
14
|
Yoo SBM, Tu JC, Hayden BY. Multicentric tracking of multiple agents by anterior cingulate cortex during pursuit and evasion. Nat Commun 2021; 12:1985. [PMID: 33790275 PMCID: PMC8012621 DOI: 10.1038/s41467-021-22195-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2020] [Accepted: 03/01/2021] [Indexed: 12/16/2022] Open
Abstract
Successful pursuit and evasion require rapid and precise coordination of navigation with adaptive motor control. We hypothesize that the dorsal anterior cingulate cortex (dACC), which communicates bidirectionally with both the hippocampal complex and premotor/motor areas, would serve a mapping role in this process. We recorded responses of dACC ensembles in two macaques performing a joystick-controlled continuous pursuit/evasion task. We find that dACC carries two sets of signals, (1) world-centric variables that together form a representation of the position and velocity of all relevant agents (self, prey, and predator) in the virtual world, and (2) avatar-centric variables, i.e. self-prey distance and angle. Both sets of variables are multiplexed within an overlapping set of neurons. Our results suggest that dACC may contribute to pursuit and evasion by computing and continuously updating a multicentric representation of the unfolding task state, and support the hypothesis that it plays a high-level abstract role in the control of behavior.
Collapse
Affiliation(s)
- Seng Bum Michael Yoo
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA. .,Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, Republic of Korea. .,Department of Biomedical Engineering, Sungkyunkwan University, Suwon, Republic of Korea. .,Department of Brain and Cognitive Sciences, Massachusetts Institution of Technology, Cambridge, MA, USA.
| | - Jiaxin Cindy Tu
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA.,Department of Neuroscience, Washington University at St.Louis, St.Louis, MO, USA
| | - Benjamin Yost Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
15
|
Monko MM, Heilbronner SR. Retrosplenial Cortical Connectivity with Frontal Basal Ganglia Networks. J Cogn Neurosci 2021; 33:1096-1105. [PMID: 33656393 DOI: 10.1162/jocn_a_01699] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Previous studies of the retrosplenial cortex (RSC) have focused on its role in navigation and memory, consistent with its well-established medial temporal connections, but recent evidence also suggests a role for this region in reward and decision making. Because function is determined largely by anatomical connections, and to better understand the anatomy of RSC, we used tract-tracing methods to examine the anatomical connectivity between the rat RSC and frontostriatal networks (canonical reward and decision-making circuits). We find that, among frontal cortical regions, RSC bidirectionally connects most strongly with the ACC, but also with an area of the central-medial orbito-frontal cortex. RSC projects to the dorsomedial striatum, and its terminal fields are virtually encompassed by the frontal-striatal projection zone, suggestive of functional convergence through the basal ganglia. This overlap is driven by ACC, prelimbic cortex, and orbito-frontal cortex, all of which contribute to goal-directed decision making, suggesting that the RSC is involved in similar processes.
Collapse
|
16
|
Ebitz RB, Tu JC, Hayden BY. Rules warp feature encoding in decision-making circuits. PLoS Biol 2020; 18:e3000951. [PMID: 33253163 PMCID: PMC7728226 DOI: 10.1371/journal.pbio.3000951] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Revised: 12/10/2020] [Accepted: 11/02/2020] [Indexed: 01/22/2023] Open
Abstract
We have the capacity to follow arbitrary stimulus-response rules, meaning simple policies that guide our behavior. Rule identity is broadly encoded across decision-making circuits, but there are less data on how rules shape the computations that lead to choices. One idea is that rules could simplify these computations. When we follow a rule, there is no need to encode or compute information that is irrelevant to the current rule, which could reduce the metabolic or energetic demands of decision-making. However, it is not clear if the brain can actually take advantage of this computational simplicity. To test this idea, we recorded from neurons in 3 regions linked to decision-making, the orbitofrontal cortex (OFC), ventral striatum (VS), and dorsal striatum (DS), while macaques performed a rule-based decision-making task. Rule-based decisions were identified via modeling rules as the latent causes of decisions. This left us with a set of physically identical choices that maximized reward and information, but could not be explained by simple stimulus-response rules. Contrasting rule-based choices with these residual choices revealed that following rules (1) decreased the energetic cost of decision-making; and (2) expanded rule-relevant coding dimensions and compressed rule-irrelevant ones. Together, these results suggest that we use rules, in part, because they reduce the costs of decision-making through a distributed representational warping in decision-making circuits.
Collapse
Affiliation(s)
- R. Becket Ebitz
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis, Minnesota, United States of America
- * E-mail:
| | - Jiaxin Cindy Tu
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis, Minnesota, United States of America
| | - Benjamin Y. Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis, Minnesota, United States of America
| |
Collapse
|
17
|
|
18
|
|
19
|
Bala PC, Eisenreich BR, Yoo SBM, Hayden BY, Park HS, Zimmermann J. Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio. Nat Commun 2020; 11:4560. [PMID: 32917899 PMCID: PMC7486906 DOI: 10.1038/s41467-020-18441-5] [Citation(s) in RCA: 80] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2020] [Accepted: 08/10/2020] [Indexed: 11/26/2022] Open
Abstract
The rhesus macaque is an important model species in several branches of science, including neuroscience, psychology, ethology, and medicine. The utility of the macaque model would be greatly enhanced by the ability to precisely measure behavior in freely moving conditions. Existing approaches do not provide sufficient tracking. Here, we describe OpenMonkeyStudio, a deep learning-based markerless motion capture system for estimating 3D pose in freely moving macaques in large unconstrained environments. Our system makes use of 62 machine vision cameras that encircle an open 2.45 m × 2.45 m × 2.75 m enclosure. The resulting multiview image streams allow for data augmentation via 3D-reconstruction of annotated images to train a robust view-invariant deep neural network. This view invariance represents an important advance over previous markerless 2D tracking approaches, and allows fully automatic pose inference on unconstrained natural motion. We show that OpenMonkeyStudio can be used to accurately recognize actions and track social interactions.
Collapse
Affiliation(s)
- Praneet C Bala
- Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, 55455, USA
| | | | - Seng Bum Michael Yoo
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA.
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, 55455, USA.
| | - Hyun Soo Park
- Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, 55455, USA
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, 55455, USA
| |
Collapse
|
20
|
Moreno-Bote R, Ramírez-Ruiz J, Drugowitsch J, Hayden BY. Heuristics and optimal solutions to the breadth-depth dilemma. Proc Natl Acad Sci U S A 2020; 117:19799-19808. [PMID: 32759219 PMCID: PMC7443877 DOI: 10.1073/pnas.2004929117] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
In multialternative risky choice, we are often faced with the opportunity to allocate our limited information-gathering capacity between several options before receiving feedback. In such cases, we face a natural trade-off between breadth-spreading our capacity across many options-and depth-gaining more information about a smaller number of options. Despite its broad relevance to daily life, including in many naturalistic foraging situations, the optimal strategy in the breadth-depth trade-off has not been delineated. Here, we formalize the breadth-depth dilemma through a finite-sample capacity model. We find that, if capacity is small (∼10 samples), it is optimal to draw one sample per alternative, favoring breadth. However, for larger capacities, a sharp transition is observed, and it becomes best to deeply sample a very small fraction of alternatives, which roughly decreases with the square root of capacity. Thus, ignoring most options, even when capacity is large enough to shallowly sample all of them, is a signature of optimal behavior. Our results also provide a rich casuistic for metareasoning in multialternative decisions with bounded capacity using close-to-optimal heuristics.
Collapse
Affiliation(s)
- Rubén Moreno-Bote
- Center for Brain and Cognition, Universitat Pompeu Fabra, 08002 Barcelona, Spain;
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08002 Barcelona, Spain
- Serra Húnter Fellow Programme, Universitat Pompeu Fabra, 08002 Barcelona, Spain
- Catalan Institution for Research and Advanced Studies-Academia, Universitat Pompeu Fabra, 08002 Barcelona, Spain
| | - Jorge Ramírez-Ruiz
- Center for Brain and Cognition, Universitat Pompeu Fabra, 08002 Barcelona, Spain
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08002 Barcelona, Spain
| | - Jan Drugowitsch
- Department of Neurobiology, Harvard Medical School, Boston, MA 02115
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455
- Center for Neural Engineering, University of Minnesota, Minneapolis, MN 55455
| |
Collapse
|
21
|
Hernandez JS, Binette AN, Rahman T, Tarantino JD, Moorman DE. Chemogenetic Inactivation of Orbitofrontal Cortex Decreases Cue-induced Reinstatement of Ethanol and Sucrose Seeking in Male and Female Wistar Rats. Alcohol Clin Exp Res 2020; 44:1769-1782. [PMID: 32628778 DOI: 10.1111/acer.14407] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2020] [Accepted: 06/24/2020] [Indexed: 12/12/2022]
Abstract
BACKGROUND The orbitofrontal cortex (OFC) encodes internal representations of outcomes and subjective value to facilitate flexible reward seeking. OFC activation is associated with drug seeking in both human subjects and animal models. OFC plays a role in alcohol use, but studies in animal models have produced conflicting results with some showing decreased seeking after OFC inactivation but others showing increased seeking or no changes. In part, this may be due to the different measures of alcohol seeking used (e.g., homecage drinking vs. operant seeking). METHODS We characterized the impact of transient inactivation of OFC (primarily lateral and, to a lesser extent, ventral subregions) using inhibitory hM4Di designer receptors exclusively activated by designer drugs (DREADDs). OFC neurons were transiently inhibited during 10% and 20% alcohol (ethanol, EtOH) and sucrose homecage consumption, fixed ratio (FR1) operant self-administration, and cue-induced reinstatement of either 10% EtOH or sucrose in male and female rats. RESULTS OFC inactivation did not affect sucrose or EtOH consumption in the homecage, nor did it influence seeking or consumption under FR1 operant conditions. In contrast, OFC inactivation suppressed cued-induced reinstatement for both EtOH and sucrose in both male and female rats. CONCLUSIONS Our results are aligned with previous work indicating a selective suppressive effect of OFC inactivation on reinstatement for alcohol and other drugs of abuse. They extend these findings to demonstrate no effect on homecage consumption or FR1 seeking as well as showing an impact of sucrose reinstatement. These data indicate that OFC plays a uniquely important role when reward seeking is driven by associations between external stimuli and internal representations of reward value, both for natural and drug rewards. They further implicate the OFC as a key structure driving relapse-associated seeking and potentially contributing to alcohol use disorder and other diseases of compulsive reward seeking.
Collapse
Affiliation(s)
- John S Hernandez
- From the, Neuroscience and Behavior Graduate Program (JSH, DEM), University of Massachusetts Amherst, Amherst, Massachusetts, USA
| | - Annalise N Binette
- Department of Psychological and Brain Sciences (ANB, TR, JDT, DEM), University of Massachusetts Amherst, Amherst, Massachusetts, USA
| | - Taryn Rahman
- Department of Psychological and Brain Sciences (ANB, TR, JDT, DEM), University of Massachusetts Amherst, Amherst, Massachusetts, USA
| | - Jeffrey D Tarantino
- Department of Psychological and Brain Sciences (ANB, TR, JDT, DEM), University of Massachusetts Amherst, Amherst, Massachusetts, USA
| | - David E Moorman
- From the, Neuroscience and Behavior Graduate Program (JSH, DEM), University of Massachusetts Amherst, Amherst, Massachusetts, USA.,Department of Psychological and Brain Sciences (ANB, TR, JDT, DEM), University of Massachusetts Amherst, Amherst, Massachusetts, USA
| |
Collapse
|
22
|
Neural Correlates of Strategy Switching in the Macaque Orbital Prefrontal Cortex. J Neurosci 2020; 40:3025-3034. [PMID: 32098903 DOI: 10.1523/jneurosci.1969-19.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Revised: 01/29/2020] [Accepted: 01/31/2020] [Indexed: 11/21/2022] Open
Abstract
We can adapt flexibly to environment changes and search for the most appropriate rule to a context. The orbital prefrontal cortex (PFo) has been associated with decision making, rule generation and maintenance, and more generally has been considered important for behavioral flexibility. To better understand the neural mechanisms underlying the flexible behavior, we studied the ability to generate a switching signal in monkey PFo when a strategy is changed. In the strategy task, we used a visual cue to instruct two male rhesus monkeys either to repeat their most recent choice (i.e., stay strategy) or to change it (i.e., shift strategy). To identify the strategy switching-related signal, we compared nonswitch and switch trials, which cued the same or a different strategy from the previous trial, respectively. We found that the switching-related signal emerged during the cue presentation and it was combined with the strategy signal in a subpopulation of cells. Moreover, the error analysis showed that the activity of the switch-related cells reflected whether the monkeys erroneously switched or not the strategy, rather than what was required for that trial. The function of the switching signal could be to prompt the use of different strategies when older strategies are no longer appropriate, conferring the ability to adapt flexibly to environmental changes. In our task, the switching signal might contribute to the implementation of the strategy cued, overcoming potential interference effects from the strategy previously cued. Our results support the idea that ascribes to PFo an important role for behavioral flexibility.SIGNIFICANCE STATEMENT We can flexibly adapt our behavior to a changing environment. One of the prefrontal areas traditionally associated with the ability to adapt to new contingencies is the orbital prefrontal cortex (PFo). We analyzed the switching related activity using a strategy task in which two rhesus monkeys were instructed by a visual cue either to repeat or change their most recent choice, respectively using a stay or a shift strategy. We found that PFo neurons were modulated by the strategy switching signal, pointing to the importance of PFo in behavioral flexibility by generating control over the switching of strategies.
Collapse
|
23
|
Cash-Padgett T, Hayden B. Behavioural variability contributes to over-staying in patchy foraging. Biol Lett 2020; 16:20190915. [PMID: 32156171 DOI: 10.1098/rsbl.2019.0915] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Foragers often systematically deviate from rate-maximizing choices in two ways: accuracy and precision. That is, they use suboptimal threshold values and also show variability in their application of those thresholds. We hypothesized that these biases are related and, more specifically, that foragers' widely known accuracy bias--over-staying--could be explained, at least in part, by their imprecision. To test this hypothesis, we analysed choices made by three rhesus macaques in a computerized patch foraging task. Confirming previously observed findings, we found high levels of variability. We then showed, through simulations, that this variability changed optimal thresholds, meaning that a forager aware of its own variability should increase its leaving threshold (i.e. over-stay) to increase performance. All subjects showed thresholds that were biased in the predicted direction. These results indicate that over-staying in patches may reflect, in part, an adaptation to behavioural variability.
Collapse
Affiliation(s)
- Tyler Cash-Padgett
- Department of Neuroscience, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455, USA.,Center for Neuroengineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Benjamin Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455, USA.,Center for Neuroengineering, University of Minnesota, Minneapolis, MN 55455, USA
| |
Collapse
|
24
|
Yoo SBM, Hayden BY. The Transition from Evaluation to Selection Involves Neural Subspace Reorganization in Core Reward Regions. Neuron 2020; 105:712-724.e4. [PMID: 31836322 PMCID: PMC7035164 DOI: 10.1016/j.neuron.2019.11.013] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 10/13/2019] [Accepted: 11/08/2019] [Indexed: 11/29/2022]
Abstract
Economic choice proceeds from evaluation, in which we contemplate options, to selection, in which we weigh options and choose one. These stages must be differentiated so that decision makers do not proceed to selection before evaluation is complete. We examined responses of neurons in two core reward regions, orbitofrontal (OFC) and ventromedial prefrontal cortex (vmPFC), during two-option choice with asynchronous offer presentation. Our data suggest that neurons selective during the first (presumed evaluation) and second (presumed comparison and selection) offer epochs come from a single pool. Stage transition is accompanied by a shift toward orthogonality in the low-dimensional population response manifold. Nonetheless, the relative position of each option in driving responses in the population subspace is preserved. The orthogonalization we observe supports the hypothesis that the transition from evaluation to selection leads to reorganization of response subspace and suggests a mechanism by which value-related signals are prevented from prematurely driving choice.
Collapse
Affiliation(s)
- Seng Bum Michael Yoo
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, University of Minnesota, Minneapolis, MN 55455, USA.
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, University of Minnesota, Minneapolis, MN 55455, USA
| |
Collapse
|
25
|
The Nucleus Accumbens Core Is Necessary for Responding to Incentive But Not Instructive Stimuli. J Neurosci 2019; 40:1332-1343. [PMID: 31862857 DOI: 10.1523/jneurosci.0194-19.2019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2019] [Revised: 12/11/2019] [Accepted: 12/12/2019] [Indexed: 11/21/2022] Open
Abstract
An abundant literature has highlighted the importance of the nucleus accumbens core (NAcC) in behavioral tasks dependent on external stimuli. Yet, some studies have also reported the absence of involvement of the NAcC in stimuli processing. We aimed at comparing, in male rats, the underlying neuronal determinants of incentive and instructive stimuli in the same task. We developed a variant of a GO/NOGO task that reveals important differences in these two types of stimuli. The incentive stimulus invites the rat to engage in the task sequence. Once the rat has decided to initiate a trial, it remains engaged in the task until the end of the trial. This task revealed the differential contribution of the NAcC to responding to different types of stimuli: responding to the incentive stimulus depended on NAcC AMPA/NMDA and dopamine D1 receptors, but the retrieval of the response associated with the instructive stimuli (lever pressing on GO, withholding on NOGO) did not. Our electrophysiological study showed that more NAcC neurons responded more strongly to the incentive than the instructive stimuli. Furthermore, when animals did not respond to the incentive stimulus, the induced excitation was suppressed for most projection neurons, whereas interneurons were strongly activated at a latency preceding that found in projection neurons. This work provides insight on the underlying neuronal processes explaining the preferential implication of the NAcC in deciding whether and when to engage in reward-seeking rather than to decide which action to perform.SIGNIFICANCE STATEMENT The nucleus accumbens core (NAcC) is essential to process information carried by reward-predicting stimuli. Yet, stimuli have distinct properties: incentive stimuli orient the attention toward reward-seeking, whereas instructive stimuli inform about the action to perform. Our study shows that, in male rats, NAcC perturbation with glutamate or dopamine antagonists impeded responses to the incentive but not to the instructive stimulus. NAcC neuronal recordings revealed a stronger representation of incentive than instructive stimuli. Furthermore, we found that interneurons are recruited when rats fail to respond to incentive stimuli. This work provides insight on the underlying neuronal processes explaining the preferential implication of the NAcC in deciding whether and when to engage in reward-seeking rather than to decide which action to perform.
Collapse
|
26
|
Balasubramani PP, Pesce MC, Hayden BY. Activity in orbitofrontal neuronal ensembles reflects inhibitory control. Eur J Neurosci 2019; 51:2033-2051. [PMID: 31803972 DOI: 10.1111/ejn.14638] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2018] [Revised: 10/28/2019] [Accepted: 11/28/2019] [Indexed: 11/27/2022]
Abstract
Stopping, or inhibition, is a form of self-control that is a core element of flexible and adaptive behavior. Its neural origins remain unclear. Some views hold that inhibition decisions reflect the aggregation of widespread and diverse pieces of information, including information arising in ostensible core reward regions (i.e., outside the canonical executive system). We recorded activity of single neurons in the orbitofrontal cortex (OFC) of macaques, a region associated with economic decisions, and whose role in inhibition is debated. Subjects performed a classic inhibition task known as the stop signal task. Ensemble decoding analyses reveal a clear firing rate pattern that distinguishes successful from failed inhibition and that begins after the stop signal and before the stop signal reaction time (SSRT). We also found a different and orthogonal ensemble pattern that distinguishes successful from failed stopping before the beginning of the trial. These signals were distinct from, and orthogonal to, value encoding, which was also observed in these neurons. The timing of the early and late signals was, respectively, consistent with the idea that neuronal activity in OFC encodes inhibition both proactively and reactively.
Collapse
Affiliation(s)
| | | | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
27
|
Sleezer BJ, Hayden BY. Neuroscience: Reevaluating the Role of Orbitofrontal Cortex. Curr Biol 2019; 29:R1314-R1316. [PMID: 31846680 DOI: 10.1016/j.cub.2019.10.063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A new optogenetic lesion study shows that the orbitofrontal cortex is essential for integrating information about recent rewards - which may either increase or decrease demand for more - with learned preferences to drive behavior.
Collapse
Affiliation(s)
- Brianna J Sleezer
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY 14853, USA
| | - Benjamin Yost Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, University of Minnesota, Minneapolis, MN 55455, USA.
| |
Collapse
|
28
|
Ebitz RB, Sleezer BJ, Jedema HP, Bradberry CW, Hayden BY. Tonic exploration governs both flexibility and lapses. PLoS Comput Biol 2019; 15:e1007475. [PMID: 31703063 PMCID: PMC6867658 DOI: 10.1371/journal.pcbi.1007475] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 11/20/2019] [Accepted: 10/10/2019] [Indexed: 11/20/2022] Open
Abstract
In many cognitive tasks, lapses (spontaneous errors) are tacitly dismissed as the result of nuisance processes like sensorimotor noise, fatigue, or disengagement. However, some lapses could also be caused by exploratory noise: randomness in behavior that facilitates learning in changing environments. If so, then strategic processes would need only up-regulate (rather than generate) exploration to adapt to a changing environment. This view predicts that more frequent lapses should be associated with greater flexibility because these behaviors share a common cause. Here, we report that when rhesus macaques performed a set-shifting task, lapse rates were negatively correlated with perseverative error frequency across sessions, consistent with a common basis in exploration. The results could not be explained by local failures to learn. Furthermore, chronic exposure to cocaine, which is known to impair cognitive flexibility, did increase perseverative errors, but, surprisingly, also improved overall set-shifting task performance by reducing lapse rates. We reconcile these results with a state-switching model in which cocaine decreases exploration by deepening attractor basins corresponding to rule states. These results support the idea that exploratory noise contributes to lapses, affecting rule-based decision-making even when it has no strategic value, and suggest that one key mechanism for regulating exploration may be the depth of rule states.
Collapse
Affiliation(s)
- R. Becket Ebitz
- Department of Neuroscience and Center for Magnetic Resonance Research University of Minnesota, Minneapolis, MN, United States of America
| | - Brianna J. Sleezer
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, United States of America
| | - Hank P. Jedema
- NIDA Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, United States of America
| | - Charles W. Bradberry
- NIDA Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, United States of America
| | - Benjamin Y. Hayden
- Department of Neuroscience and Center for Magnetic Resonance Research University of Minnesota, Minneapolis, MN, United States of America
| |
Collapse
|
29
|
Eisenreich BR, Hayden BY, Zimmermann J. Macaques are risk-averse in a freely moving foraging task. Sci Rep 2019; 9:15091. [PMID: 31636348 PMCID: PMC6803699 DOI: 10.1038/s41598-019-51442-z] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2019] [Accepted: 09/26/2019] [Indexed: 11/09/2022] Open
Abstract
Rhesus macaques (Macaca mulatta) appear to be robustly risk-seeking in computerized gambling tasks typically used for electrophysiology. This behavior distinguishes them from many other animals, which are risk-averse, albeit measured in more naturalistic contexts. We wondered whether macaques' risk preferences reflect their evolutionary history or derive from the less naturalistic elements of task design associated with the demands of physiological recording. We assessed macaques' risk attitudes in a task that is somewhat more naturalistic than many that have previously been used: subjects foraged at four feeding stations in a large enclosure. Patches (i.e., stations), provided either stochastically or non-stochastically depleting rewards. Subjects' patch residence times were longer at safe than at risky stations, indicating a preference for safe options. This preference was not attributable to a win-stay-lose-shift heuristic and reversed as the environmental richness increased. These findings highlight the lability of risk attitudes in macaques and support the hypothesis that the ecological validity of a task can influence the expression of risk preference.
Collapse
Affiliation(s)
- Benjamin R Eisenreich
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis, MN, 55455, USA.
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis, MN, 55455, USA
| | - Jan Zimmermann
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis, MN, 55455, USA
| |
Collapse
|
30
|
Widge AS, Heilbronner SR, Hayden BY. Prefrontal cortex and cognitive control: new insights from human electrophysiology. F1000Res 2019; 8:F1000 Faculty Rev-1696. [PMID: 31602292 PMCID: PMC6768099 DOI: 10.12688/f1000research.20044.1] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/23/2019] [Indexed: 12/21/2022] Open
Abstract
Cognitive control, the ability to regulate one's cognition and actions on the basis of over-riding goals, is impaired in many psychiatric conditions. Although control requires the coordinated function of several prefrontal cortical regions, it has been challenging to determine how they work together, in part because doing so requires simultaneous recordings from multiple regions. Here, we provide a précis of cognitive control and describe the beneficial consequences of recent advances in neurosurgical practice that make large-scale prefrontal cortical network recordings possible in humans. Such recordings implicate inter-regional theta (5-8 Hz) local field potential (LFP) synchrony as a key element in cognitive control. Major open questions include how theta might influence other oscillations within these networks, the precise timing of information flow between these regions, and how perturbations such as brain stimulation might demonstrate the causal role of LFP phenomena. We propose that an increased focus on human electrophysiology is essential for an understanding of the neural basis of cognitive control.
Collapse
Affiliation(s)
- Alik S. Widge
- Department of Psychiatry, University of Minnesota, 3001 6th St SE, Minneapolis, MN, 55455, USA
| | - Sarah R. Heilbronner
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, 2021 6th St SE, Minneapolis, MN, 55455, USA
| | - Benjamin Y. Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, 2021 6th St SE, Minneapolis, MN, 55455, USA
| |
Collapse
|
31
|
Mehta PS, Tu JC, LoConte GA, Pesce MC, Hayden BY. Ventromedial Prefrontal Cortex Tracks Multiple Environmental Variables during Search. J Neurosci 2019; 39:5336-5350. [PMID: 31028117 PMCID: PMC6607750 DOI: 10.1523/jneurosci.2365-18.2019] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2018] [Revised: 04/16/2019] [Accepted: 04/18/2019] [Indexed: 11/21/2022] Open
Abstract
To make efficient foraging decisions, we must combine information about the values of available options with nonvalue information. Some accounts of ventromedial PFC (vmPFC) suggest that it has a narrow role limited to evaluating immediately available options. We examined responses of neurons in area 14 (a putative macaque homolog of human vmPFC) as 2 male macaques performed a novel foraging search task. Although many neurons encoded the values of immediately available offers, they also independently encoded several other variables that influence choice, but that are conceptually distinct from offer value. These variables include average reward rate, number of offers viewed per trial, previous offer values, previous outcome sizes, and the locations of the currently attended offer. We conclude that, rather than serving as specialized economic value center, vmPFC plays a broad role in integrating relevant environmental information to drive foraging decisions.SIGNIFICANCE STATEMENT Decision makers must often choose whether to take an immediately available option or continue to search for a better one. We hypothesized that this process, which is integral to foraging theory, leaves neural signatures in the brain region ventromedial PFC. Subjects performed a novel foraging task in which they searched through differently valued options and attempted to balance their reward threshold with various time costs. We found that neurons not only encode the values of immediately available offers, but multiplexed these with environmental variables, including reward rate, number of offers viewed, previous offer values, and spatial information. We conclude that vmPFC plays a rich role in encoding and integrating multiple foraging-related variables during economic decisions.
Collapse
Affiliation(s)
- Priyanka S Mehta
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455, and
| | - Jiaxin Cindy Tu
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455, and
| | - Giuliana A LoConte
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455, and
| | - Meghan C Pesce
- Department of Brain and Cognitive Sciences University of Rochester, Rochester, New York 14611
| | - Benjamin Y Hayden
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota 55455, and
| |
Collapse
|
32
|
Monkeys are curious about counterfactual outcomes. Cognition 2019; 189:1-10. [PMID: 30889493 DOI: 10.1016/j.cognition.2019.03.009] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Revised: 03/11/2019] [Accepted: 03/13/2019] [Indexed: 11/22/2022]
Abstract
Many non-human animals show exploratory behaviors. It remains unclear whether any possess human-like curiosity. We previously proposed three criteria for applying the term curiosity to animal behavior: (1) the subject is willing to sacrifice reward to obtain information, (2) the information provides no immediate instrumental or strategic benefit, and (3) the amount the subject is willing to pay depends systematically on the amount of information available. In previous work on information-seeking in animals, information generally predicts upcoming rewards, and animals' decisions may therefore be a byproduct of reinforcement processes. Here we get around this potential confound by taking advantage of macaques' ability to reason counterfactually (that is, about outcomes that could have occurred had the subject chosen differently). Specifically, macaques sacrificed fluid reward to obtain information about counterfactual outcomes. Moreover, their willingness to pay scaled with the information (Shannon entropy) offered by the counterfactual option. These results demonstrate the existence of human-like curiosity in non-human primates according to our criteria, which circumvent several confounds associated with less stringent criteria.
Collapse
|
33
|
Moorman DE. The role of the orbitofrontal cortex in alcohol use, abuse, and dependence. Prog Neuropsychopharmacol Biol Psychiatry 2018; 87:85-107. [PMID: 29355587 PMCID: PMC6072631 DOI: 10.1016/j.pnpbp.2018.01.010] [Citation(s) in RCA: 69] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2017] [Revised: 12/22/2017] [Accepted: 01/13/2018] [Indexed: 12/21/2022]
Abstract
One of the major functions of the orbitofrontal cortex (OFC) is to promote flexible motivated behavior. It is no surprise, therefore, that recent work has demonstrated a prominent impact of chronic drug use on the OFC and a potential role for OFC disruption in drug abuse and addiction. Among drugs of abuse, the use of alcohol is particularly salient with respect to OFC function. Although a number of studies in humans have implicated OFC dysregulation in alcohol use disorders, animal models investigating the association between OFC and alcohol use are only beginning to be developed, and there is still a great deal to be revealed. The goal of this review is to consider what is currently known regarding the role of the OFC in alcohol use and dependence. I will first provide a brief, general overview of current views of OFC function and its contributions to drug seeking and addiction. I will then discuss research to date related to the OFC and alcohol use, both in human clinical populations and in non-human models. Finally I will consider issues and strategies to guide future study that may identify this brain region as a key player in the transition from moderated to problematic alcohol use and dependence.
Collapse
Affiliation(s)
- David E. Moorman
- Department of Psychological and Brain Sciences, Neuroscience and Behavior Graduate Program, University of Massachusetts Amherst, Amherst MA 01003 USA
| |
Collapse
|
34
|
Gmaz JM, Carmichael JE, van der Meer MA. Persistent coding of outcome-predictive cue features in the rat nucleus accumbens. eLife 2018; 7:37275. [PMID: 30234485 PMCID: PMC6195350 DOI: 10.7554/elife.37275] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Accepted: 09/15/2018] [Indexed: 01/09/2023] Open
Abstract
The nucleus accumbens (NAc) is important for learning from feedback, and for biasing and invigorating behaviour in response to cues that predict motivationally relevant outcomes. NAc encodes outcome-related cue features such as the magnitude and identity of reward. However, little is known about how features of cues themselves are encoded. We designed a decision making task where rats learned multiple sets of outcome-predictive cues, and recorded single-unit activity in the NAc during performance. We found that coding of cue identity and location occurred alongside coding of expected outcome. Furthermore, this coding persisted both during a delay period, after the rat made a decision and was waiting for an outcome, and after the outcome was revealed. Encoding of cue features in the NAc may enable contextual modulation of on-going behaviour, and provide an eligibility trace of outcome-predictive stimuli for updating stimulus-outcome associations to inform future behaviour.
Collapse
Affiliation(s)
- Jimmie M Gmaz
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, United States
| | - James E Carmichael
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, United States
| | | |
Collapse
|
35
|
Cash-Padgett T, Azab H, Yoo SBM, Hayden BY. Opposing pupil responses to offered and anticipated reward values. Anim Cogn 2018; 21:671-684. [PMID: 29971595 PMCID: PMC6232855 DOI: 10.1007/s10071-018-1202-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2018] [Revised: 06/04/2018] [Accepted: 06/27/2018] [Indexed: 01/01/2023]
Abstract
Previous studies have shown that the pupils dilate more in anticipation of larger rewards. This finding raises the possibility of a more general association between reward amount and pupil size. We tested this idea by characterizing macaque pupil responses to offered rewards during evaluation and comparison in a binary choice task. To control attention, we made use of a design in which offers occurred in sequence. By looking at pupil responses after choice but before reward, we confirmed the previously observed positive association between pupil size and anticipated reward values. Surprisingly, however, we find that pupil size is negatively correlated with the value of offered gambles before choice, during both evaluation and comparison stages of the task. These results demonstrate a functional distinction between offered and anticipated rewards and present evidence against a narrow version of the simulation hypothesis; the idea that we represent offers by reactivating states associated with anticipating them. They also suggest that pupil size is correlated with relative, not absolute, values of offers, suggestive of an accept-reject model of comparison.
Collapse
Affiliation(s)
- Tyler Cash-Padgett
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA.
| | - Habiba Azab
- Department of Brain and Cognitive Sciences and Center for Visual Sciences, Center for the Origins of Cognition, University of Rochester, Rochester, NY, USA
| | - Seng Bum Michael Yoo
- Department of Brain and Cognitive Sciences and Center for Visual Sciences, Center for the Origins of Cognition, University of Rochester, Rochester, NY, USA
| | - Benjamin Y Hayden
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA
| |
Collapse
|
36
|
Yoo SBM, Hayden BY. Economic Choice as an Untangling of Options into Actions. Neuron 2018; 99:434-447. [PMID: 30092213 PMCID: PMC6280664 DOI: 10.1016/j.neuron.2018.06.038] [Citation(s) in RCA: 60] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Revised: 05/21/2018] [Accepted: 06/26/2018] [Indexed: 10/28/2022]
Abstract
We propose that economic choice can be understood as a gradual transformation from a domain of options to one of the actions. We draw an analogy with the idea of untangling information in the form vision system and propose that form vision and economic choice may be two aspects of a larger process that sculpts actions based on sensory inputs. From this viewpoint, choice results from the accumulated effect of repetitions of simple computations. These may consist primarily of relative valuations (evaluations relative to the value of rejection, perhaps in a manner akin to divisive normalization) applied to individual offers. With regard to economic choice, cortical brain regions differ primarily in their position and in what information they prioritize, and do not-with a few exceptions-have categorically distinct roles. Each region's specific contribution is determined largely by its inputs; thus, understanding connectivity is crucial for understanding choice. This view suggests that there is no single site of choice, that there is no meaningful distinction between pre- and post-decisionality, and that there is no explicit representation of value in the brain.
Collapse
Affiliation(s)
- Seng Bum Michael Yoo
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55126, USA; Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY 14267, USA.
| | - Benjamin Yost Hayden
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55126, USA
| |
Collapse
|
37
|
Balasubramani PP, Moreno-Bote R, Hayden BY. Using a Simple Neural Network to Delineate Some Principles of Distributed Economic Choice. Front Comput Neurosci 2018; 12:22. [PMID: 29643773 PMCID: PMC5882864 DOI: 10.3389/fncom.2018.00022] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2017] [Accepted: 03/12/2018] [Indexed: 01/03/2023] Open
Abstract
The brain uses a mixture of distributed and modular organization to perform computations and generate appropriate actions. While the principles under which the brain might perform computations using modular systems have been more amenable to modeling, the principles by which the brain might make choices using distributed principles have not been explored. Our goal in this perspective is to delineate some of those distributed principles using a neural network method and use its results as a lens through which to reconsider some previously published neurophysiological data. To allow for direct comparison with our own data, we trained the neural network to perform binary risky choices. We find that value correlates are ubiquitous and are always accompanied by non-value information, including spatial information (i.e., no pure value signals). Evaluation, comparison, and selection were not distinct processes; indeed, value signals even in the earliest stages contributed directly, albeit weakly, to action selection. There was no place, other than at the level of action selection, at which dimensions were fully integrated. No units were specialized for specific offers; rather, all units encoded the values of both offers in an anti-correlated format, thus contributing to comparison. Individual network layers corresponded to stages in a continuous rotation from input to output space rather than to functionally distinct modules. While our network is likely to not be a direct reflection of brain processes, we propose that these principles should serve as hypotheses to be tested and evaluated for future studies.
Collapse
Affiliation(s)
- Pragathi P. Balasubramani
- Brain and Cognitive Sciences, Center for Visual Science, Center for the Origins of Cognition, University of Rochester, Rochester, NY, United States
| | - Rubén Moreno-Bote
- Department of Information and Communications Technologies, Center for Brain and Cognition, University Pompeu Fabra, Barcelona, Spain
- Serra Húnter Fellow Programme, University Pompeu Fabra, Barcelona, Spain
| | - Benjamin Y. Hayden
- Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minnesota, MN, United States
| |
Collapse
|
38
|
Yoo SBM, Sleezer BJ, Hayden BY. Robust Encoding of Spatial Information in Orbitofrontal Cortex and Striatum. J Cogn Neurosci 2018; 30:898-913. [PMID: 29561237 DOI: 10.1162/jocn_a_01259] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
Knowing whether core reward regions carry information about the positions of relevant objects is crucial for adjudicating between choice models. One limitation of previous studies, including our own, is that spatial positions can be consistently differentially associated with rewards, and thus position can be confounded with attention, motor plans, or target identity. We circumvented these problems by using a task in which value-and thus choices-was determined solely by a frequently changing rule, which was randomized relative to spatial position on each trial. We presented offers asynchronously, which allowed us to control for reward expectation, spatial attention, and motor plans in our analyses. We find robust encoding of the spatial position of both offers and choices in two core reward regions, orbitofrontal Area 13 and ventral striatum, as well as in dorsal striatum of macaques. The trial-by-trial correlation in noise in encoding of position was associated with variation in choice, an effect known as choice probability correlation, suggesting that the spatial encoding is associated with choice and is not incidental to it. Spatial information and reward information are not carried by separate sets of neurons, although the two forms of information are temporally dissociable. These results highlight the ubiquity of multiplexed information in association cortex and argue against the idea that these ostensible reward regions serve as part of a pure value domain.
Collapse
|
39
|
Rountree-Harrison D, Burton TJ, Leamey CA, Sawatari A. Environmental Enrichment Expedites Acquisition and Improves Flexibility on a Temporal Sequencing Task in Mice. Front Behav Neurosci 2018; 12:51. [PMID: 29599712 PMCID: PMC5862792 DOI: 10.3389/fnbeh.2018.00051] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2017] [Accepted: 02/28/2018] [Indexed: 01/09/2023] Open
Abstract
Environmental enrichment (EE) via increased opportunities for voluntary exercise, sensory stimulation and social interaction, can enhance the function of and behaviours regulated by cognitive circuits. Little is known, however, as to how this intervention affects performance on complex tasks that engage multiple, definable learning and memory systems. Accordingly, we utilised the Olfactory Temporal Order Discrimination (OTOD) task which requires animals to recall and report sequence information about a series of recently encountered olfactory stimuli. This approach allowed us to compare animals raised in either enriched or standard laboratory housing conditions on a number of measures, including the acquisition of a complex discrimination task, temporal sequence recall accuracy (i.e., the ability to accurately recall a sequences of events) and acuity (i.e., the ability to resolve past events that occurred in close temporal proximity), as well as cognitive flexibility tested in the style of a rule reversal and an Intra-Dimensional Shift (IDS). We found that enrichment accelerated the acquisition of the temporal order discrimination task, although neither accuracy nor acuity was affected at asymptotic performance levels. Further, while a subtle enhancement of overall performance was detected for both rule reversal and IDS versions of the task, accelerated performance recovery could only be attributed to the shift-like contingency change. These findings suggest that EE can affect specific elements of complex, multi-faceted cognitive processes.
Collapse
Affiliation(s)
- Darius Rountree-Harrison
- Discipline of Physiology, School of Medical Sciences and the Bosch Institute, University of Sydney, Sydney, NSW, Australia
| | - Thomas J Burton
- Discipline of Physiology, School of Medical Sciences and the Bosch Institute, University of Sydney, Sydney, NSW, Australia.,Animal Behavioural Facility, School of Medical Sciences and the Bosch Institute, University of Sydney, Sydney, NSW, Australia
| | - Catherine A Leamey
- Discipline of Physiology, School of Medical Sciences and the Bosch Institute, University of Sydney, Sydney, NSW, Australia
| | - Atomu Sawatari
- Discipline of Physiology, School of Medical Sciences and the Bosch Institute, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
40
|
Eisenreich BR, Akaishi R, Hayden BY. Control without Controllers: Toward a Distributed Neuroscience of Executive Control. J Cogn Neurosci 2017; 29:1684-1698. [PMID: 28430042 PMCID: PMC7162733 DOI: 10.1162/jocn_a_01139] [Citation(s) in RCA: 37] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Executive control refers to the regulation of cognition and behavior by mental processes and is a hallmark of higher cognition. Most approaches to understanding its mechanisms begin with the assumption that our brains have anatomically segregated and functionally specialized control modules. The modular approach is intuitive: Control is conceptually distinct from basic mental processing, so an organization that reifies that distinction makes sense. An alternative approach sees executive control as self-organizing principles of a distributed organization. In distributed systems, control and controlled processes are colocalized within large numbers of dispersed computational agents. Control then is often an emergent consequence of simple rules governing the interaction between agents. Because these systems are unfamiliar and unintuitive, here we review several well-understood examples of distributed control systems, group living insects and social animals, and emphasize their parallels with neural systems. We then reexamine the cognitive neuroscience literature on executive control for evidence that its neural control systems may be distributed.
Collapse
|
41
|
Selective Modulation of Orbitofrontal Network Activity during Negative Occasion Setting. J Neurosci 2017; 37:9415-9423. [PMID: 28847808 DOI: 10.1523/jneurosci.0572-17.2017] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2017] [Revised: 07/18/2017] [Accepted: 07/24/2017] [Indexed: 01/19/2023] Open
Abstract
Discrete cues can gain powerful control over behavior to help an animal anticipate and cope with upcoming events. This is important in conditions where understanding the relationship between complex stimuli provides a means to resolving situational ambiguity. However, it is unclear how cortical circuits generate and maintain these signals that conditionally regulate behavior. To address this, we established a Pavlovian serial feature-negative conditioning paradigm, where male mice are trained on a trial in which a conditioned stimulus (CS) is presented alone and followed by reward, or a feature-negative trial in which the CS is preceded by a feature cue indicating there is no reward. Mice learn to respond with anticipatory licking to a solitary CS, but significantly suppress their responding to the same cue during feature-negative trials. We show that the feature cue forms a selective association with its paired CS, because the ability of the feature to transfer its suppressive properties to a separately rewarded cue is limited. Next, to examine the underlying neural dynamics, we conduct recordings in the orbitofrontal cortex (OFC). We find that the feature cue significantly and selectively inhibits CS-evoked activity. Finally, we find that the feature triggers a distinct OFC network state during the delay period between the feature and CS, establishing a potential link between the feature and future events. Together, our findings suggest that OFC dynamics are modulated by the feature cue and its associated conditioned stimulus in a manner consistent with an occasion setting model.SIGNIFICANCE STATEMENT The ability of patterned cues to form an inhibitory relationship with ambiguously rewarded outcomes has been appreciated since early studies on learning and memory. However, it was often assumed that these cues, despite their hierarchical nature, still made direct associative links with neural rewarding events. This model was significantly challenged, largely by the work of Holland and colleagues, who demonstrated that under certain conditions cues can inherit occasion setting properties whereby they modulate the ability of a paired cue to elicit its conditioned response. Here we provide some of the first evidence that the activity of a cortical circuit is selectively modulated by such cues, thereby providing insight into the mechanisms of higher order learning.
Collapse
|
42
|
Reactivation of associative structure specific outcome responses during prospective evaluation in reward-based choices. Nat Commun 2017; 8:15821. [PMID: 28598438 PMCID: PMC5472730 DOI: 10.1038/ncomms15821] [Citation(s) in RCA: 37] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2016] [Accepted: 05/05/2017] [Indexed: 01/02/2023] Open
Abstract
Before making a reward-based choice, we must evaluate each option. Some theories propose that prospective evaluation involves a reactivation of the neural response to the outcome. Others propose that it calls upon a response pattern that is specific to each underlying associative structure. We hypothesize that these views are reconcilable: during prospective evaluation, offers reactivate neural responses to outcomes that are unique to each associative structure; when the outcome occurs, this pattern is activated, simultaneously, with a general response to the reward. We recorded single-units from macaque orbitofrontal cortex (Area 13) in a riskless choice task with interleaved described and experienced offer trials. Here we report that neural activations to offers and their outcomes overlap, as do neural activations to the outcomes on the two trial types. Neural activations to experienced and described offers are unrelated even though they predict the same outcomes. Our reactivation theory parsimoniously explains these results. How the brain evaluates options to make a reward-based choice is unclear. Here, authors show that, prior to choice, neural activity patterns to the potential outcomes are reactivated in macaque orbitofrontal cortex, in a way that reflects the unique event sequences leading up to the outcomes.
Collapse
|
43
|
Nogueira R, Abolafia JM, Drugowitsch J, Balaguer-Ballester E, Sanchez-Vives MV, Moreno-Bote R. Lateral orbitofrontal cortex anticipates choices and integrates prior with current information. Nat Commun 2017; 8:14823. [PMID: 28337990 PMCID: PMC5376669 DOI: 10.1038/ncomms14823] [Citation(s) in RCA: 74] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2016] [Accepted: 02/06/2017] [Indexed: 12/28/2022] Open
Abstract
Adaptive behavior requires integrating prior with current information to anticipate upcoming events. Brain structures related to this computation should bring relevant signals from the recent past into the present. Here we report that rats can integrate the most recent prior information with sensory information, thereby improving behavior on a perceptual decision-making task with outcome-dependent past trial history. We find that anticipatory signals in the orbitofrontal cortex about upcoming choice increase over time and are even present before stimulus onset. These neuronal signals also represent the stimulus and relevant second-order combinations of past state variables. The encoding of choice, stimulus and second-order past state variables resides, up to movement onset, in overlapping populations. The neuronal representation of choice before stimulus onset and its build-up once the stimulus is presented suggest that orbitofrontal cortex plays a role in transforming immediate prior and stimulus information into choices using a compact state-space representation. The orbitofrontal cortex encodes outcomes, expected rewards and values, but it is unclear how this region uses this information to inform action selection. Here, the authors show that lateral orbitofrontal cortex anticipates upcoming choices and combines recent prior information with current sensory information.
Collapse
Affiliation(s)
- Ramon Nogueira
- Center for Brain and Cognition and Department of Information and Communications Technologies, Universitat Pompeu Fabra, Barcelona 08018, Spain.,Research Unit, Parc Sanitari Sant Joan de Déu, Esplugues de Llobregat, Barcelona 08950, Spain
| | - Juan M Abolafia
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona 08036, Spain
| | - Jan Drugowitsch
- Département des Neurosciences Fondamentales, Université de Genève, Geneva 4 1211, Switzerland.,Department of Neurobiology, Harvard Medical School, Boston, Massachusetts 02115, USA
| | - Emili Balaguer-Ballester
- Department of Computing and Informatics, Faculty of Science and Technology, Bournemouth University, Poole BH12 5BB, UK.,Bernstein Center for Computational Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim/Heidelberg University, Mannheim D-68159, Germany
| | - Maria V Sanchez-Vives
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona 08036, Spain.,ICREA, Barcelona 08010, Spain
| | - Rubén Moreno-Bote
- Center for Brain and Cognition and Department of Information and Communications Technologies, Universitat Pompeu Fabra, Barcelona 08018, Spain.,Research Unit, Parc Sanitari Sant Joan de Déu, Esplugues de Llobregat, Barcelona 08950, Spain.,Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona 08018, Spain
| |
Collapse
|
44
|
Sleezer BJ, LoConte GA, Castagno MD, Hayden BY. Neuronal responses support a role for orbitofrontal cortex in cognitive set reconfiguration. Eur J Neurosci 2017; 45:940-951. [PMID: 28177158 DOI: 10.1111/ejn.13532] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2016] [Revised: 01/26/2017] [Accepted: 01/31/2017] [Indexed: 11/30/2022]
Abstract
We are often faced with the need to abandon no-longer beneficial rules and adopt new ones. This process, known as cognitive set reconfiguration, is a hallmark of executive control. Although cognitive functions like reconfiguration are most often associated with dorsal prefrontal structures, recent evidence suggests that the orbitofrontal cortex (OFC) may play an important role as well. We recorded the activity of OFC neurons while rhesus macaques performed an analogue of the Wisconsin Card Sorting Task that involved a trial and error stage. The OFC neurons demonstrated two types of switch-related activity, an early (switch-away) signal and a late (switch-to) signal, when the new task set was established. We also found a pattern of match modulation: a significant change in activity for the stimulus that matched the current perceptual rule (and would therefore be selected). These results extend our understanding of the executive functions of the OFC. They also allow us to directly compare the OFC with the complementary datasets we previously collected in the ventral (VS) and dorsal (DS) striatum. Although both effects are observed in all three areas, the timing of responses aligns the OFC more closely with DS than with VS.
Collapse
Affiliation(s)
- Brianna J Sleezer
- Department of Brain and Cognitive Sciences, Center for Visual Science and Center for the Origins of Cognition, University of Rochester, Rochester, NY, 14618, USA
| | - Giuliana A LoConte
- Department of Brain and Cognitive Sciences, Center for Visual Science and Center for the Origins of Cognition, University of Rochester, Rochester, NY, 14618, USA
| | - Meghan D Castagno
- Department of Brain and Cognitive Sciences, Center for Visual Science and Center for the Origins of Cognition, University of Rochester, Rochester, NY, 14618, USA
| | - Benjamin Y Hayden
- Department of Brain and Cognitive Sciences, Center for Visual Science and Center for the Origins of Cognition, University of Rochester, Rochester, NY, 14618, USA
| |
Collapse
|
45
|
Hunt LT, Hayden BY. A distributed, hierarchical and recurrent framework for reward-based choice. Nat Rev Neurosci 2017; 18:172-182. [PMID: 28209978 PMCID: PMC5621622 DOI: 10.1038/nrn.2017.7] [Citation(s) in RCA: 137] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Many accounts of reward-based choice argue for distinct component processes that are serial and functionally localized. In this Opinion article, we argue for an alternative viewpoint, in which choices emerge from repeated computations that are distributed across many brain regions. We emphasize how several features of neuroanatomy may support the implementation of choice, including mutual inhibition in recurrent neural networks and the hierarchical organization of timescales for information processing across the cortex. This account also suggests that certain correlates of value are emergent rather than represented explicitly in the brain.
Collapse
Affiliation(s)
- Laurence T Hunt
- Wellcome Trust Centre for Neuroimaging, University College London, 12 Queen Square, London WC1N 3BG, UK
| | - Benjamin Y Hayden
- Department of Brain and Cognitive Sciences, University of Rochester, 309 Meliora Hall, Rochester, New York 14618, USA
| |
Collapse
|