1
|
Bustamante LA, Barch DM, Solis J, Oshinowo T, Grahek I, Konova AB, Daw ND, Cohen JD. Major depression symptom severity associations with willingness to exert effort and patch foraging strategy. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.02.18.24302985. [PMID: 38947009 PMCID: PMC11213125 DOI: 10.1101/2024.02.18.24302985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Individuals with major depressive disorder (MDD) can experience reduced motivation and cognitive function, leading to challenges with goal-directed behavior. When selecting goals, people maximize 'expected value' by selecting actions that maximize potential reward while minimizing associated costs, including effort 'costs' and the opportunity cost of time. In MDD, differential weighing of costs and benefits are theorized mechanisms underlying changes in goal-directed cognition and may contribute to symptom heterogeneity. We used the Effort Foraging Task to quantify cognitive and physical effort costs, and patch leaving thresholds in low effort conditions (hypothesized to reflect perceived opportunity cost of time) and investigated their shared versus distinct relationships to clinical features in participants with MDD (N=52, 43 in-episode) and comparisons (N=27). Contrary to our predictions, none of the decision-making measures differed with MDD diagnosis. However, each of the measures were related to symptom severity, over and above effects of ability (i.e., performance). Greater anxiety symptoms were selectively associated with lower cognitive effort cost (i.e. greater willingness to exert effort). Anhedonia symptoms were associated with increased physical effort costs. Finally, greater physical anergia was related to decreased patch leaving thresholds. Markers of effort-based decision-making may inform understanding of MDD heterogeneity. Increased willingness to exert cognitive effort may contribute to anxiety symptoms such as rumination and worry. The association of decreased leaving thresholds with symptom severity is consistent with reward rate-based accounts of reduced vigor in MDD. Future research should address subtypes of depression with or without anxiety, which may relate differentially to cognitive effort decisions.
Collapse
|
2
|
Seamans JK, White S, Morningstar M, Emberly E, Linsenbardt D, Ma B, Czachowski CL, Lapish CC. Neural basis of cognitive control signals in anterior cingulate cortex during delay discounting. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.07.597894. [PMID: 38895238 PMCID: PMC11185781 DOI: 10.1101/2024.06.07.597894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Cognitive control involves allocating cognitive effort according to internal needs and task demands and the Anterior Cingulate Cortex (ACC) is hypothesized to play a central role in this process. We investigated the neural basis of cognitive control in the ACC of rats performing an adjusting-amount delay discounting task. Decision-making in this this task can be guided by using either a lever-value tracking strategy, requiring a 'resource-based' form of cognitive effort or a lever-biased strategy requiring a 'resistance-based' form of cognitive effort. We found that ACC ensembles always tightly tracked lever value on each trial, indicative of a resource-based control signal. These signals were prevalent in the neural recordings and were influenced by the delay. A shorter delay was associated with devaluing of the immediate option and a longer delay was associated with overvaluing of the immediate option. In addition, ACC theta (6-12Hz) oscillations were observed at the choice point of rats exhibiting a resistance-based strategy. These data provide candidates of neural activity patterns in the ACC that underlie the use of 'resource-based' and 'resistance-based' cognitive effort. Furthermore, these data illustrate how strategies can be engaged under different conditions in individual subjects.
Collapse
Affiliation(s)
- Jeremy K. Seamans
- Dept of Psychiatry, Djavad Mowafaghian Centre for Brain Health, 2211 Wesbrook Mall, UBC, Vancouver BC, V6T2B5
| | - Shelby White
- Stark Neuroscience Institute, Department of Anatomy, Cell Biology, and Physiology, Indianapolis, 46202, USA
| | | | - Eldon Emberly
- Department of Physics, Simon Fraser University, Burnaby, BC, V5A 1S6
| | - David Linsenbardt
- University of New Mexico, Department of Neurosciences, Albuquerque, 87131, USA
| | - Baofeng Ma
- Stark Neuroscience Institute, Department of Anatomy, Cell Biology, and Physiology, Indianapolis, 46202, USA
| | - Cristine L. Czachowski
- Indiana University-Purdue University, Indianapolis, Psychology Department, Indianapolis, 46202, USA
| | - Christopher C. Lapish
- Stark Neuroscience Institute, Department of Anatomy, Cell Biology, and Physiology, Indianapolis, 46202, USA
| |
Collapse
|
3
|
Bustamante LA, Oshinowo T, Lee JR, Tong E, Burton AR, Shenhav A, Cohen JD, Daw ND. Effort Foraging Task reveals positive correlation between individual differences in the cost of cognitive and physical effort in humans. Proc Natl Acad Sci U S A 2023; 120:e2221510120. [PMID: 38064507 PMCID: PMC10723129 DOI: 10.1073/pnas.2221510120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Accepted: 10/26/2023] [Indexed: 12/17/2023] Open
Abstract
Effort-based decisions, in which people weigh potential future rewards against effort costs required to achieve those rewards involve both cognitive and physical effort, though the mechanistic relationship between them is not yet understood. Here, we use an individual differences approach to isolate and measure the computational processes underlying effort-based decisions and test the association between cognitive and physical domains. Patch foraging is an ecologically valid reward rate maximization problem with well-developed theoretical tools. We developed the Effort Foraging Task, which embedded cognitive or physical effort into patch foraging, to quantify the cost of both cognitive and physical effort indirectly, by their effects on foraging choices. Participants chose between harvesting a depleting patch, or traveling to a new patch that was costly in time and effort. Participants' exit thresholds (reflecting the reward they expected to receive by harvesting when they chose to travel to a new patch) were sensitive to cognitive and physical effort demands, allowing us to quantify the perceived effort cost in monetary terms. The indirect sequential choice style revealed effort-seeking behavior in a minority of participants (preferring high over low effort) that has apparently been missed by many previous approaches. Individual differences in cognitive and physical effort costs were positively correlated, suggesting that these are perceived and processed in common. We used canonical correlation analysis to probe the relationship of task measures to self-reported affect and motivation, and found correlations of cognitive effort with anxiety, cognitive function, behavioral activation, and self-efficacy, but no similar correlations with physical effort.
Collapse
Affiliation(s)
- Laura A. Bustamante
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
- Department of Psychological and Brain Sciences, Washington University in Saint Louis, Saint Louis, MO63130
| | - Temitope Oshinowo
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Jeremy R. Lee
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Elizabeth Tong
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Allison R. Burton
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Amitai Shenhav
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI02912
- Carney Institute for Brain Science, Brown University, Providence, RI02906
| | - Jonathan D. Cohen
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Nathaniel D. Daw
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| |
Collapse
|
4
|
Banaie Boroujeni K, Watson M, Womelsdorf T. Gains and Losses Affect Learning Differentially at Low and High Attentional Load. J Cogn Neurosci 2022; 34:1952-1971. [PMID: 35802604 PMCID: PMC9830784 DOI: 10.1162/jocn_a_01885] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Prospective gains and losses influence cognitive processing, but it is unresolved how they modulate flexible learning in changing environments. The prospect of gains might enhance flexible learning through prioritized processing of reward-predicting stimuli, but it is unclear how far this learning benefit extends when task demands increase. Similarly, experiencing losses might facilitate learning when they trigger attentional reorienting away from loss-inducing stimuli, but losses may also impair learning by increasing motivational costs or when negative outcomes are overgeneralized. To clarify these divergent views, we tested how varying magnitudes of gains and losses affect the flexible learning of feature values in environments that varied attentional load by increasing the number of interfering object features. With this task design, we found that larger prospective gains improved learning efficacy and learning speed, but only when attentional load was low. In contrast, expecting losses impaired learning efficacy, and this impairment was larger at higher attentional load. These findings functionally dissociate the contributions of gains and losses on flexible learning, suggesting they operate via separate control mechanisms. One mechanism is triggered by experiencing loss and reduces the ability to reduce distractor interference, impairs assigning credit to specific loss-inducing features, and decreases efficient exploration during learning. The second mechanism is triggered by experiencing gains, which enhances prioritizing reward-predicting stimulus features as long as the interference of distracting features is limited. Taken together, these results support a rational theory of cognitive control during learning, suggesting that experiencing losses and experiencing distractor interference impose costs for learning.
Collapse
Affiliation(s)
| | - Marcus Watson
- Department of Biology, Centre for Vision Research, York University, 4700 Keele Street, Toronto, Ontario M6J 1P3, Canada
| | - Thilo Womelsdorf
- Department of Psychology, Vanderbilt University, Nashville, TN 37240.,Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37240
| |
Collapse
|
5
|
Choice history effects in mice and humans improve reward harvesting efficiency. PLoS Comput Biol 2021; 17:e1009452. [PMID: 34606493 PMCID: PMC8516315 DOI: 10.1371/journal.pcbi.1009452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 10/14/2021] [Accepted: 09/15/2021] [Indexed: 12/04/2022] Open
Abstract
Choice history effects describe how future choices depend on the history of past choices. In experimental tasks this is typically framed as a bias because it often diminishes the experienced reward rates. However, in natural habitats, choices made in the past constrain choices that can be made in the future. For foraging animals, the probability of earning a reward in a given patch depends on the degree to which the animals have exploited the patch in the past. One problem with many experimental tasks that show choice history effects is that such tasks artificially decouple choice history from its consequences on reward availability over time. To circumvent this, we use a variable interval (VI) reward schedule that reinstates a more natural contingency between past choices and future reward availability. By examining the behavior of optimal agents in the VI task we discover that choice history effects observed in animals serve to maximize reward harvesting efficiency. We further distil the function of choice history effects by manipulating first- and second-order statistics of the environment. We find that choice history effects primarily reflect the growth rate of the reward probability of the unchosen option, whereas reward history effects primarily reflect environmental volatility. Based on observed choice history effects in animals, we develop a reinforcement learning model that explicitly incorporates choice history over multiple time scales into the decision process, and we assess its predictive adequacy in accounting for the associated behavior. We show that this new variant, known as the double trace model, has a higher performance in predicting choice data, and shows near optimal reward harvesting efficiency in simulated environments. These results suggests that choice history effects may be adaptive for natural contingencies between consumption and reward availability. This concept lends credence to a normative account of choice history effects that extends beyond its description as a bias. Animals foraging for food in natural habitats compete to obtain better quality food patches. To achieve this goal, animals can rely on memory and choose the same patches that have provided higher quality of food in the past. However, in natural habitats simply identifying better food patches may not be sufficient to successfully compete with their conspecifics, as food resources can grow over time. Therefore, it makes sense to visit from time to time those patches that were associated with lower food quality in the past. This demands optimal foraging animals to keep in memory not only which food patches provided the best food quality, but also which food patches they visited recently. To see if animals track their history of visits and use it to maximize the food harvesting efficiency, we subjected them to experimental conditions that mimicked natural foraging behavior. In our behavioral tasks, we replaced food foraging behavior with a two choice task that provided rewards to mice and humans. By developing a new computational model and subjecting animals to various behavioral manipulations, we demonstrate that keeping a memory of past visits helps the animals to optimize the efficiency with which they can harvest rewards.
Collapse
|
6
|
Tanaka S, Taylor JE, Sakagami M. The effect of effort on reward prediction error signals in midbrain dopamine neurons. Curr Opin Behav Sci 2021. [DOI: 10.1016/j.cobeha.2021.07.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
7
|
Purcell JR, Jahn A, Fine JM, Brown JW. Neural correlates of visual attention during risky decision evidence integration. Neuroimage 2021; 234:117979. [PMID: 33771695 PMCID: PMC8159858 DOI: 10.1016/j.neuroimage.2021.117979] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 03/08/2021] [Accepted: 03/13/2021] [Indexed: 12/20/2022] Open
Abstract
Value-based decision-making is presumed to involve a dynamic integration process that supports assessing the potential outcomes of different choice options. Decision frameworks assume the value of a decision rests on both the desirability and risk surrounding an outcome. Previous work has highlighted neural representations of risk in the human brain, and their relation to decision choice. Key neural regions including the insula and anterior cingulate cortex (ACC) have been implicated in encoding the effects of risk on decision outcomes, including approach and avoidance. Yet, it remains unknown whether these regions are involved in the dynamic integration processes that precede and drive choice, and their relationship with ongoing attention. Here, we used concurrent fMRI and eye-tracking to discern neural activation related to visual attention preceding choice between sure-thing (i.e. safe) and risky gamble options. We found activation in both dorsal ACC (dACC) and posterior insula (PI) scaled in opposite directions with the difference in attention to risky rewards relative to risky losses. PI activation also differentiated foveations on both risky options (rewards and losses) relative to a sure-thing option. These findings point to ACC involvement in ongoing evaluation of risky but higher value options. The role of PI in risky outcomes points to a more general evaluative role in the decision-making that compares both safe and risky outcomes, irrespective of potential for gains or losses.
Collapse
Affiliation(s)
- John R Purcell
- Department of Psychological & Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA; Program in Neuroscience, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA.
| | - Andrew Jahn
- Department of Psychology, University of Michigan, East Hall, 530 Church St, #1265 Ann Arbor, MI 48109, USA.
| | - Justin M Fine
- Department of Psychological & Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA.
| | - Joshua W Brown
- Department of Psychological & Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA; Program in Neuroscience, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA.
| |
Collapse
|
8
|
Knauss ZT, Filipovic M, Smith KA, Queener MM, Lubera JA, Bolden-Hall NM, Smith JP, Goldsmith RS, Bischoff JE, Miller MK, Cromwell HC. Effort-reward balance and work motivation in rats: Effects of context and order of experience. Behav Processes 2020; 181:104239. [PMID: 32966870 DOI: 10.1016/j.beproc.2020.104239] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Revised: 08/10/2020] [Accepted: 08/28/2020] [Indexed: 12/28/2022]
Abstract
Being motivated means exerting effort toward a goal. The 'law of least work' emphasizes a preference for exerting relatively less effort. The law crosses boundaries among species and between physical and mental work. Organisms should be highly sensitive to shifts in effort-reward balance (ERB) in order to make optimal choices. We used a free operant-foraging task to investigate changes in ERB on choice between options requiring more or less effort. Results showed a consistent preference for the option with less effort and insensitivity to shifts in ERB. A second aim explored the influence of order of experience on effort choice. Choice for the more effortful option significantly increased after experiencing an equal effort-reward relationship during the initial free operant-foraging session. This relative increase in choice for the effortful option persisted even after effort-reward imbalance. The findings highlight the importance of contextual factors such as order of experience when examining the impact of shifting effort-reward associations. Instead of ignoring or reducing order effects, the sequence of experience (e.g. for shifts in ERB) could be manipulated to enhance or reduce value of outcomes or effort itself.
Collapse
Affiliation(s)
- Zackery T Knauss
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Marko Filipovic
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Kylee A Smith
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Melanie M Queener
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Joseph A Lubera
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Najae M Bolden-Hall
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Jasmine P Smith
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Robert S Goldsmith
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Jacob E Bischoff
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Melissa K Miller
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States
| | - Howard C Cromwell
- Department of Psychology and John Paul Scott Center for Neuroscience, Mind and Behavior, Bowling Green State University, Bowling Green, OH, 43403, United States.
| |
Collapse
|
9
|
The tenacious brain: How the anterior mid-cingulate contributes to achieving goals. Cortex 2019; 123:12-29. [PMID: 31733343 DOI: 10.1016/j.cortex.2019.09.011] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2018] [Revised: 08/20/2019] [Accepted: 09/20/2019] [Indexed: 12/30/2022]
Abstract
Tenacity-persistence in the face of challenge-has received increasing attention, particularly because it contributes to better academic achievement, career opportunities and health outcomes. We review evidence from non-human primate neuroanatomy and structural and functional neuroimaging in humans suggesting that the anterior mid cingulate cortex (aMCC) is an important network hub in the brain that performs the cost/benefit computations necessary for tenacity. Specifically, we propose that its position as a structural and functional hub allows the aMCC to integrate signals from diverse brain systems to predict energy requirements that are needed for attention allocation, encoding of new information, and physical movement, all in the service of goal attainment. We review and integrate research findings from studies of attention, reward, memory, affect, multimodal sensory integration, and motor control to support this hypothesis. We close by discussing the implications of our framework for educational achievement, exercise and eating disorders, successful aging, and neuropsychiatric disorders such as depression and dementia.
Collapse
|
10
|
Porter BS, Hillman KL, Bilkey DK. Anterior cingulate cortex encoding of effortful behavior. J Neurophysiol 2019; 121:701-714. [DOI: 10.1152/jn.00654.2018] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
An animal’s ability to assess the value of their behaviors to minimize energy use while maximizing goal achievement is critical to its survival. The anterior cingulate cortex (ACC) has been previously shown to play a critical role in this behavioral optimization process, especially when animals are faced with effortful behaviors. In the present study, we designed a novel task to investigate the role of the ACC in evaluating behaviors that varied in effort but all resulted in the same outcome. We recorded single unit activity from the ACC as rats ran back and forth in a shuttle box that could be tilted to different tilt angles (0, 15, and 25°) to manipulate effort. Overall, a majority of ACC neurons showed selective firing to specific effort conditions. During effort expenditure, ACC units showed a consistent firing rate bias toward the downhill route compared with the more difficult uphill route, regardless of the tilt angle of the apparatus. Once rats completed a run and received their fixed reward, ACC units also showed a clear firing rate preference for the single condition with the highest relative value (25° downhill). To assess effort preferences, we used a choice version of our task and confirmed that rats prefer downhill routes to uphill routes when given the choice. Overall, these results help to elucidate the functional role of the ACC in monitoring and evaluating effortful behaviors that may then bias decision-making toward behaviors with the highest utility. NEW & NOTEWORTHY We developed a novel effort paradigm to investigate how the anterior cingulate cortex (ACC) responds to behaviors with varied degrees of physical effort and how changes in effort influence the ACC’s evaluation of behavioral outcomes. Our results provide evidence for a wider role of the ACC in its ability to motivate effortful behaviors and evaluate the outcome of multiple behaviors within an environment.
Collapse
Affiliation(s)
- Blake S. Porter
- Department of Psychology, University of Otago, Dunedin, New Zealand
- Brain Health Research Centre, University of Otago, Dunedin, New Zealand
| | - Kristin L. Hillman
- Department of Psychology, University of Otago, Dunedin, New Zealand
- Brain Health Research Centre, University of Otago, Dunedin, New Zealand
| | - David K. Bilkey
- Department of Psychology, University of Otago, Dunedin, New Zealand
- Brain Health Research Centre, University of Otago, Dunedin, New Zealand
| |
Collapse
|
11
|
Izquierdo A, Aguirre C, Hart EE, Stolyarova A. Rodent Models of Adaptive Value Learning and Decision-Making. Methods Mol Biol 2019; 2011:105-119. [PMID: 31273696 DOI: 10.1007/978-1-4939-9554-7_7] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
Abstract
Real-world decisions are rarely as straightforward as choosing between clearly "good" vs. "bad" options. More often, options must be evaluated carefully because they differ in relative value. For example, we typically learn about (and make decisions between) options in comparison, where one outcome may be more costly or risky than the other. Several neuropsychiatric conditions are characterized by atypical evaluation of effort and risk costs, including major depression, schizophrenia, autism, obsessive-compulsive disorder, and substance use disorders. Aberrant value learning and decision-making have long been considered a cognitive-behavioral endophenotype of these disorders and can be modeled in rodents. This chapter presents two general methodological domains that the experimenter can manipulate in animal decision-making tasks: risk and effort. Here, we present detailed methods of rodent tasks frequently employed within these domains: probabilistic reversal learning (PRL) and effort choice. These tasks recruit regions within rodent frontal cortex, the amygdala, and the striatum, and performance is heavily modulated by dopamine, making these assays highly valid measures in the study of behavioral and substance addictions, in particular.
Collapse
Affiliation(s)
- Alicia Izquierdo
- Department of Psychology, University of California at Los Angeles, Los Angeles, CA, USA. .,The Brain Research Institute, University of California at Los Angeles, Los Angeles, CA, USA. .,Integrative Center for Learning and Memory, University of California at Los Angeles, Los Angeles, CA, USA. .,Integrative Center for Addictions, University of California at Los Angeles, Los Angeles, CA, USA.
| | - Claudia Aguirre
- Department of Psychology, University of California at Los Angeles, Los Angeles, CA, USA
| | - Evan E Hart
- Department of Psychology, University of California at Los Angeles, Los Angeles, CA, USA
| | - Alexandra Stolyarova
- Department of Psychology, University of California at Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
12
|
|
13
|
The roles of the anterior cingulate cortex and its dopamine receptors in self-paced cost-benefit decision making in rats. Learn Behav 2018; 45:89-99. [PMID: 27604387 DOI: 10.3758/s13420-016-0243-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
It has been shown that the anterior cingulate cortex (ACC) and its dopamine system are crucial for decision making that requires physical/emotional effort, but not for all forms of cost-benefit decision making. Previous studies had mostly employed behavioral tasks with two competing cost-reward options that were preset by the experimenters. However, few studies have been conducted using scenarios in which the subjects have full control over the energy/time expenditure required to obtain a proportional reward. Here, we assessed the roles of the ACC and its dopamine system in cost-benefit decision making by utilizing a "do more get more" (DMGM) task and a time-reward trade-off (TRTO) task, wherein the animals were able to self-determine how much effort or time to expend at a nosepoke operandum for a proportional reward. Our results showed that (1) ACC inactivation severely impaired DMGM task performance, with a reduction in the rate of correct responses and a decrease in the effort expended, but did not affect the TRTO task; and (2) blocking ACC D2 receptors had no impact on DMGM task performance in the baseline cost-benefit scenario, but it significantly reduced the attempts to invest increased effort for a large reward when the benefit-cost ratio was reduced by half. In contrast, blocking ACC D1 receptors had no effect on DMGM task performance. These findings suggest that the ACC is required for self-paced effort-based but not for time-reward trade-off decision making. Furthermore, ACC dopamine D2 but not D1 receptors are involved in DMGM decision making.
Collapse
|
14
|
Neuropsychiatric Phenotypes Produced by GABA Reduction in Mouse Cortex and Hippocampus. Neuropsychopharmacology 2018; 43:1445-1456. [PMID: 29362511 PMCID: PMC5916365 DOI: 10.1038/npp.2017.296] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/19/2017] [Revised: 10/25/2017] [Accepted: 11/24/2017] [Indexed: 01/09/2023]
Abstract
Whereas cortical GAD67 reduction and subsequent GABA level decrease are consistently observed in schizophrenia and depression, it remains unclear how these GABAergic abnormalities contribute to specific symptoms. We modeled cortical GAD67 reduction in mice, in which the Gad1 gene is genetically ablated from ~50% of cortical and hippocampal interneurons. Mutant mice showed a reduction of tissue GABA in the hippocampus and cortex including mPFC, and exhibited a cluster of effort-based behavior deficits including decreased home-cage wheel running and increased immobility in both tail suspension and forced swim tests. Since saccharine preference, progressive ratio responding to food, and learned helplessness task were normal, such avolition-like behavior could not be explained by anhedonia or behavioral despair. In line with the prevailing view that dopamine in anterior cingulate cortex (ACC) plays a role in evaluating effort cost for engaging in actions, we found that tail-suspension triggered dopamine release in ACC of controls, which was severely attenuated in the mutant mice. Conversely, ACC dopamine release by progressive ratio responding to reward, during which animals were allowed to effortlessly perform the nose-poking, was not affected in mutants. These results suggest that cortical GABA reduction preferentially impairs the effort-based behavior which requires much effort with little benefit, through a deficit of ACC dopamine release triggered by high-effort cost behavior, but not by reward-seeking behavior. Collectively, a subset of negative symptoms with a reduced willingness to expend costly effort, often observed in patients with schizophrenia and depression, may be attributed to cortical GABA level reduction.
Collapse
|
15
|
Padoa-Schioppa C, Conen KE. Orbitofrontal Cortex: A Neural Circuit for Economic Decisions. Neuron 2017; 96:736-754. [PMID: 29144973 PMCID: PMC5726577 DOI: 10.1016/j.neuron.2017.09.031] [Citation(s) in RCA: 137] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2017] [Revised: 09/14/2017] [Accepted: 09/20/2017] [Indexed: 11/24/2022]
Abstract
Economic choice behavior entails the computation and comparison of subjective values. A central contribution of neuroeconomics has been to show that subjective values are represented explicitly at the neuronal level. With this result at hand, the field has increasingly focused on the difficult question of where in the brain and how exactly subjective values are compared to make a decision. Here, we review a broad range of experimental and theoretical results suggesting that good-based decisions are generated in a neural circuit within the orbitofrontal cortex (OFC). The main lines of evidence supporting this proposal include the fact that goal-directed behavior is specifically disrupted by OFC lesions, the fact that different groups of neurons in this area encode the input and the output of the decision process, the fact that activity fluctuations in each of these cell groups correlate with choice variability, and the fact that these groups of neurons are computationally sufficient to generate decisions. Results from other brain regions are consistent with the idea that good-based decisions take place in OFC and indicate that value signals inform a variety of mental functions. We also contrast the present proposal with other leading models for the neural mechanisms of economic decisions. Finally, we indicate open questions and suggest possible directions for future research.
Collapse
Affiliation(s)
- Camillo Padoa-Schioppa
- Department of Neuroscience, Washington University in St. Louis, St. Louis, MO 63110, USA; Department of Economics, Washington University in St. Louis, St. Louis, MO 63110, USA; Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63110, USA.
| | - Katherine E Conen
- Department of Neuroscience, Washington University in St. Louis, St. Louis, MO 63110, USA
| |
Collapse
|
16
|
Tops M. Bored but not depleted: PRotective Inhibition of Self-regulation and Motivation (PRISM). Cortex 2017; 96:130-133. [PMID: 28784568 DOI: 10.1016/j.cortex.2017.07.008] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2017] [Accepted: 07/11/2017] [Indexed: 11/17/2022]
Affiliation(s)
- Mattie Tops
- Department of Clinical, Neuro & Developmental Psychology, VU University Amsterdam, Amsterdam, The Netherlands.
| |
Collapse
|
17
|
Shenhav A, Musslick S, Lieder F, Kool W, Griffiths TL, Cohen JD, Botvinick MM. Toward a Rational and Mechanistic Account of Mental Effort. Annu Rev Neurosci 2017; 40:99-124. [DOI: 10.1146/annurev-neuro-072116-031526] [Citation(s) in RCA: 443] [Impact Index Per Article: 63.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Amitai Shenhav
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, Rhode Island 02912
- Brown Institute for Brain Science, Brown University, Providence, Rhode Island 02912
| | - Sebastian Musslick
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey 08544
| | - Falk Lieder
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
| | - Wouter Kool
- Department of Psychology, Harvard University, Cambridge, Massachusetts 02138
| | - Thomas L. Griffiths
- Department of Psychology, University of California, Berkeley, California 94720
| | - Jonathan D. Cohen
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey 08544
- Department of Psychology, Princeton University, Princeton, New Jersey 08540
| | - Matthew M. Botvinick
- Google DeepMind, London M1C 4AG, United Kingdom
- Gatsby Computational Neuroscience Unit, University College London, London W1T 4JG, United Kingdom
| |
Collapse
|
18
|
Vassena E, Deraeve J, Alexander WH. Predicting Motivation: Computational Models of PFC Can Explain Neural Coding of Motivation and Effort-based Decision-making in Health and Disease. J Cogn Neurosci 2017; 29:1633-1645. [PMID: 28654358 DOI: 10.1162/jocn_a_01160] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
Human behavior is strongly driven by the pursuit of rewards. In daily life, however, benefits mostly come at a cost, often requiring that effort be exerted to obtain potential benefits. Medial PFC (MPFC) and dorsolateral PFC (DLPFC) are frequently implicated in the expectation of effortful control, showing increased activity as a function of predicted task difficulty. Such activity partially overlaps with expectation of reward and has been observed both during decision-making and during task preparation. Recently, novel computational frameworks have been developed to explain activity in these regions during cognitive control, based on the principle of prediction and prediction error (predicted response-outcome [PRO] model [Alexander, W. H., & Brown, J. W. Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338-1344, 2011], hierarchical error representation [HER] model [Alexander, W. H., & Brown, J. W. Hierarchical error representation: A computational model of anterior cingulate and dorsolateral prefrontal cortex. Neural Computation, 27, 2354-2410, 2015]). Despite the broad explanatory power of these models, it is not clear whether they can also accommodate effects related to the expectation of effort observed in MPFC and DLPFC. Here, we propose a translation of these computational frameworks to the domain of effort-based behavior. First, we discuss how the PRO model, based on prediction error, can explain effort-related activity in MPFC, by reframing effort-based behavior in a predictive context. We propose that MPFC activity reflects monitoring of motivationally relevant variables (such as effort and reward), by coding expectations and discrepancies from such expectations. Moreover, we derive behavioral and neural model-based predictions for healthy controls and clinical populations with impairments of motivation. Second, we illustrate the possible translation to effort-based behavior of the HER model, an extended version of PRO model based on hierarchical error prediction, developed to explain MPFC-DLPFC interactions. We derive behavioral predictions that describe how effort and reward information is coded in PFC and how changing the configuration of such environmental information might affect decision-making and task performance involving motivation.
Collapse
|
19
|
Hart EE, Gerson JO, Zoken Y, Garcia M, Izquierdo A. Anterior cingulate cortex supports effort allocation towards a qualitatively preferred option. Eur J Neurosci 2017; 46:1682-1688. [PMID: 28543944 DOI: 10.1111/ejn.13608] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2017] [Revised: 04/26/2017] [Accepted: 05/14/2017] [Indexed: 11/28/2022]
Abstract
The anterior cingulate cortex (ACC) is known to be involved in effortful choice, yet its role in cost-benefit evaluation of qualitatively different rewards (more/less preferred), beyond magnitude differences (larger/smaller), is poorly understood. Selecting between qualitatively different options is a decision type commonly faced by humans. Here, we assessed the role of ACC on a task that has primarily been used to probe striatal function in motivation. Rats were trained to stable performance on a progressive ratio schedule for sucrose pellets and were then given sham surgeries (control) or excitotoxic NMDA lesions of ACC. Subsequently, a choice was introduced: chow was concurrently available while animals could work for the preferred sucrose pellets. ACC lesions produced a significant decrease in lever presses for sucrose pellets compared to control, whereas chow consumption was unaffected. Lesions had no effect on sucrose pellet preference when both options were freely available. When laboratory chow was not concurrently available, ACC-lesioned rats exhibited similar lever pressing as controls. During a test under specific satiety for sucrose pellets, ACC-lesioned rats also showed intact devaluation effects. The effects of ACC lesions in our task are not mediated by decreased appetite, a change in food preference, a failure to update value or a learning deficit. Taken together, we found that ACC lesions decreased effort for a qualitatively preferred option. These results are discussed with reference to effects of striatal manipulations and our recent report of a role for basolateral amygdala in effortful choice.
Collapse
Affiliation(s)
- Evan E Hart
- Department of Psychology, University of California at Los Angeles, 502 Portola Plaza, 1285 Franz Hall, Los Angeles, CA, 90095-1563, USA
| | - Julian O Gerson
- Department of Psychology, University of California at Los Angeles, 502 Portola Plaza, 1285 Franz Hall, Los Angeles, CA, 90095-1563, USA
| | - Yael Zoken
- Department of Psychology, University of California at Los Angeles, 502 Portola Plaza, 1285 Franz Hall, Los Angeles, CA, 90095-1563, USA
| | - Marisella Garcia
- Department of Psychology, University of California at Los Angeles, 502 Portola Plaza, 1285 Franz Hall, Los Angeles, CA, 90095-1563, USA
| | - Alicia Izquierdo
- Department of Psychology, University of California at Los Angeles, 502 Portola Plaza, 1285 Franz Hall, Los Angeles, CA, 90095-1563, USA.,The Brain Research Institute, University of California at Los Angeles, Los Angeles, CA, USA.,Integrative Center for Learning and Memory, University of California at Los Angeles, Los Angeles, CA, USA.,Integrative Center for Addictions, University of California at Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
20
|
Vassena E, Holroyd CB, Alexander WH. Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort. Front Neurosci 2017. [PMID: 28634438 PMCID: PMC5459890 DOI: 10.3389/fnins.2017.00316] [Citation(s) in RCA: 61] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
In the last two decades the anterior cingulate cortex (ACC) has become one of the most investigated areas of the brain. Extensive neuroimaging evidence suggests countless functions for this region, ranging from conflict and error coding, to social cognition, pain and effortful control. In response to this burgeoning amount of data, a proliferation of computational models has tried to characterize the neurocognitive architecture of ACC. Early seminal models provided a computational explanation for a relatively circumscribed set of empirical findings, mainly accounting for EEG and fMRI evidence. More recent models have focused on ACC's contribution to effortful control. In parallel to these developments, several proposals attempted to explain within a single computational framework a wider variety of empirical findings that span different cognitive processes and experimental modalities. Here we critically evaluate these modeling attempts, highlighting the continued need to reconcile the array of disparate ACC observations within a coherent, unifying framework.
Collapse
Affiliation(s)
- Eliana Vassena
- Donders Center for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University NijmegenNijmegen, Netherlands.,Department of Experimental Psychology, Ghent UniversityGhent, Belgium
| | - Clay B Holroyd
- Department of Psychology, University of VictoriaVictoria, BC, Canada
| | | |
Collapse
|
21
|
Kim DJ, Lee AS, Yttredahl AA, Gómez-Rodríguez R, Anderson BJ. Repeated threat (without direct harm) alters metabolic capacity in select regions that drive defensive behavior. Neuroscience 2017; 353:106-118. [PMID: 28433648 DOI: 10.1016/j.neuroscience.2017.04.012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2016] [Revised: 04/07/2017] [Accepted: 04/10/2017] [Indexed: 10/19/2022]
Abstract
To understand the behavioral consequences of intermittent anticipatory stress resulting from threats without accompanying physiological challenges, we developed a semi-naturalistic rodent housing and foraging environment that can include threats that are unpredictable in timing. Behavior is automatically recorded while rats forage for food or water. Over three weeks, the threats have been shown to elicit risk assessment behaviors, increase defensive burying and increase adrenal gland weight. To identify brain regions activated by this manipulation, we measured cytochrome c oxidase (COX), which is tightly coupled to neural activity. Adolescent male Sprague-Dawley rats were randomly assigned to control (CT) or unpredictable threat/stress (ST) housing conditions consisting of two tub cages, one with food and another with water, separated by a tunnel. Over three weeks (P31-P52), the ST group received randomly timed (probability of 0.25), simultaneous presentations of ferret odor, an abrupt light, and sound at the center of the tunnel. The ST group had consistently fewer tunnel crossings than the CT group, but similar body weights. Group differences in COX activity were detected in regions implicated in the control of defensive burying. There was an increase in COX activity in the hypothalamic premammillary dorsal nucleus (PMD) and lateral septum (LS), whereas a decrease was observed in the periaqueductal gray (PAG) and CA3 region of the hippocampus. There were no significant differences in the anterior cingulate cortex, prefrontal cortex, striatum or motor cortex. The sites with changes in metabolic capacity are candidates for the sites of plasticity that may underlie the behavioral adaptations to intermittent threats.
Collapse
Affiliation(s)
- D J Kim
- Department of Psychology, Stony Brook University, Stony Brook, NY 11794-5230, United States; Graduate Program in Integrative Neuroscience, Stony Brook University, Stony Brook, NY 11794-5230, United States
| | - A S Lee
- Department of Psychology, Stony Brook University, Stony Brook, NY 11794-5230, United States
| | - A A Yttredahl
- Department of Psychology, Stony Brook University, Stony Brook, NY 11794-5230, United States; Graduate Program in Integrative Neuroscience, Stony Brook University, Stony Brook, NY 11794-5230, United States
| | - R Gómez-Rodríguez
- Department of Psychology, Stony Brook University, Stony Brook, NY 11794-5230, United States
| | - B J Anderson
- Department of Psychology, Stony Brook University, Stony Brook, NY 11794-5230, United States; Graduate Program in Integrative Neuroscience, Stony Brook University, Stony Brook, NY 11794-5230, United States.
| |
Collapse
|
22
|
Chong TTJ, Bonnelle V, Veromann KR, Juurmaa J, Taba P, Plant O, Husain M. Dissociation of reward and effort sensitivity in methcathinone-induced Parkinsonism. J Neuropsychol 2017; 12:291-297. [PMID: 28378511 PMCID: PMC6001457 DOI: 10.1111/jnp.12122] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2016] [Revised: 02/11/2017] [Indexed: 01/06/2023]
Abstract
Methcathinone‐induced Parkinsonism is a recently described extrapyramidal syndrome characterized by globus pallidus and substantia nigra lesions, which provides a unique model of basal ganglia dysfunction. We assessed motivated behaviour in this condition using a novel cost‐benefit decision‐making task, in which participants decided whether it was worth investing effort for reward. Patients showed a dissociation between reward and effort sensitivity, such that pallidonigral complex dysfunction caused them to become less sensitive to rewards, while normal sensitivity to effort costs was maintained.
Collapse
Affiliation(s)
- Trevor T-J Chong
- Monash Institute of Cognitive and Clinical Neurosciences, Monash University, Clayton, Victoria, Australia.,Department of Experimental Psychology, University of Oxford, UK.,Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | | | | | - Julius Juurmaa
- Department of Neurology and Neurosurgery, University of Tartu, Estonia
| | - Pille Taba
- Department of Neurology and Neurosurgery, University of Tartu, Estonia
| | - Olivia Plant
- Department of Experimental Psychology, University of Oxford, UK
| | - Masud Husain
- Department of Experimental Psychology, University of Oxford, UK.,Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| |
Collapse
|
23
|
Viswanathan V, Sheppard JP, Kim BW, Plantz CL, Ying H, Lee MJ, Raman K, Mulhern FJ, Block MP, Calder B, Lee S, Mortensen DT, Blood AJ, Breiter HC. A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior. Front Psychol 2017; 8:122. [PMID: 28270776 PMCID: PMC5318395 DOI: 10.3389/fpsyg.2017.00122] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2016] [Accepted: 01/17/2017] [Indexed: 11/13/2022] Open
Abstract
This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher "loss aversion." Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans.
Collapse
Affiliation(s)
- Vijay Viswanathan
- Medill Integrated Marketing Communications, Northwestern UniversityEvanston, IL, USA; Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA
| | - John P Sheppard
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Warren Wright Adolescent Center, Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of MedicineChicago, IL, USA
| | - Byoung W Kim
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Warren Wright Adolescent Center, Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of MedicineChicago, IL, USA; Laboratory of Neuroimaging and Genetics, and Mood and Motor Control Laboratory, Department of Psychiatry, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; MGH Center for Translational Research in Prescription Drug Abuse, Department of Anesthesia, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; Northwestern University and Massachusetts General Hospital Phenotype Genotype Project in Addiction and Mood DisordersChicago, IL, USA
| | - Christopher L Plantz
- Department of Materials Science and Engineering, University of Illinois at Urbana-Champaign Urbana, IL, USA
| | - Hao Ying
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Department of Electrical Engineering, Wayne State UniversityDetroit, MI, USA
| | - Myung J Lee
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Warren Wright Adolescent Center, Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of MedicineChicago, IL, USA; Laboratory of Neuroimaging and Genetics, and Mood and Motor Control Laboratory, Department of Psychiatry, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; MGH Center for Translational Research in Prescription Drug Abuse, Department of Anesthesia, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; Northwestern University and Massachusetts General Hospital Phenotype Genotype Project in Addiction and Mood DisordersChicago, IL, USA
| | - Kalyan Raman
- Medill Integrated Marketing Communications, Northwestern UniversityEvanston, IL, USA; Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA
| | - Frank J Mulhern
- Medill Integrated Marketing Communications, Northwestern UniversityEvanston, IL, USA; Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA
| | - Martin P Block
- Medill Integrated Marketing Communications, Northwestern UniversityEvanston, IL, USA; Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA
| | - Bobby Calder
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Department of Marketing, Kellogg School of Management, Northwestern UniversityEvanston, IL, USA
| | - Sang Lee
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Laboratory of Neuroimaging and Genetics, and Mood and Motor Control Laboratory, Department of Psychiatry, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; MGH Center for Translational Research in Prescription Drug Abuse, Department of Anesthesia, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; Northwestern University and Massachusetts General Hospital Phenotype Genotype Project in Addiction and Mood DisordersChicago, IL, USA
| | - Dale T Mortensen
- Department of Economics, Northwestern University College of Arts and Sciences Evanston, IL, USA
| | - Anne J Blood
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Laboratory of Neuroimaging and Genetics, and Mood and Motor Control Laboratory, Department of Psychiatry, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; MGH Center for Translational Research in Prescription Drug Abuse, Department of Anesthesia, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; Northwestern University and Massachusetts General Hospital Phenotype Genotype Project in Addiction and Mood DisordersChicago, IL, USA
| | - Hans C Breiter
- Applied Neuromarketing Consortium, Medill, Kellogg, and Feinberg Schools, Northwestern UniversityEvanston, IL, USA; Warren Wright Adolescent Center, Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of MedicineChicago, IL, USA; Laboratory of Neuroimaging and Genetics, and Mood and Motor Control Laboratory, Department of Psychiatry, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; MGH Center for Translational Research in Prescription Drug Abuse, Department of Anesthesia, Massachusetts General Hospital and Harvard Medical SchoolBoston, MA, USA; Northwestern University and Massachusetts General Hospital Phenotype Genotype Project in Addiction and Mood DisordersChicago, IL, USA
| |
Collapse
|
24
|
Anticevic A, Schleifer C, Youngsun TC. Emotional and cognitive dysregulation in schizophrenia and depression: understanding common and distinct behavioral and neural mechanisms. DIALOGUES IN CLINICAL NEUROSCIENCE 2016. [PMID: 26869843 PMCID: PMC4734880 DOI: 10.31887/dcns.2015.17.4/aanticevic] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Emerging behavioral and neuroimaging studies in schizophrenia (SCZ) and major depressive disorder (MD) are mapping mechanisms of co-occurring and distinct affective disturbances across these disorders. This constitutes a critical goal towards developing rationally guided therapies for upstream neural pathways that contribute to comorbid symptoms across disorders. We highlight the current state of the art in our understanding of emotional dysregulation in SCZ versus MD by focusing on broad domains of behavioral function that can map onto underlying neural systems, namely deficits in hedonics, anticipatory behaviors, computations underlying value and effort, and effortful goal-directed behaviors needed to pursue rewarding outcomes. We highlight unique disturbances in each disorder that may involve dissociable neural systems, but also possible interactions between affect and cognition in MD versus SCZ. Finally, we review computational and translational approaches that offer mechanistic insight into how cellular-level disruptions can lead to complex affective disturbances, informing development of therapies across MD and SCZ.
Collapse
Affiliation(s)
- Alan Anticevic
- Department of Psychiatry, Yale University School of Medicine; Interdepartmental Neuroscience Program, Yale University; NIAAA Center for the Translational Neuroscience of Alcoholism; Department of Psychology, Yale University; Division of Neurocognition, Neurogenetics & Neurocomputation, Yale University School of Medicine (Alan Anticevic) - New Haven, Connecticut, USA
| | | | | |
Collapse
|
25
|
Too Much of a Good Thing: A Neuro-Dynamic Personality Model Explaining Engagement and Its Protective Inhibition. ADVANCES IN MOTIVATION AND ACHIEVEMENT 2016. [DOI: 10.1108/s0749-742320160000019012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
26
|
Tricomi E, DePasque S. The Role of Feedback in Learning and Motivation. ADVANCES IN MOTIVATION AND ACHIEVEMENT 2016. [DOI: 10.1108/s0749-742320160000019015] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
27
|
Alcaraz F, Marchand AR, Courtand G, Coutureau E, Wolff M. Parallel inputs from the mediodorsal thalamus to the prefrontal cortex in the rat. Eur J Neurosci 2016; 44:1972-86. [PMID: 27319754 DOI: 10.1111/ejn.13316] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2015] [Revised: 06/17/2016] [Accepted: 06/17/2016] [Indexed: 12/22/2022]
Abstract
There is a growing interest in determining the functional contribution of thalamic inputs to cortical functions. In the context of adaptive behaviours, identifying the precise role of the mediodorsal thalamus (MD) in particular remains difficult despite the large amount of experimental data available. A better understanding of the thalamocortical connectivity of this region may help to capture its functional role. To address this issue, this study focused exclusively on the specific connections from the MD to the prefrontal cortex (PFC) by means of direct comparisons of labelling produced by single and dual injections of retrograde tracers in the different subdivisions of the PFC in the rat. We show that at least three parallel and essentially separate thalamocortical pathways originate from the MD, as follows: projections to the dorsal (1) and the ventral (2) subdivisions of the mPFC follow a mediolateral topography at the thalamic level (i.e. medial thalamic neurons target the mPFC ventrally whereas lateral thalamic neurons project dorsally), whereas a considerable innervation to the OFC (3) includes thalamic cells projecting to both the lateral and the ventral OFC subdivisions. These observations provide new insight on the functions of the MD and suggest a specific focus on each of these pathways for future functional studies.
Collapse
Affiliation(s)
- Fabien Alcaraz
- CNRS, INCIA, UMR 5287, 33076, Bordeaux, France.,Université de Bordeaux, INCIA, UMR 5287, 33076, Bordeaux, France
| | - Alain R Marchand
- CNRS, INCIA, UMR 5287, 33076, Bordeaux, France.,Université de Bordeaux, INCIA, UMR 5287, 33076, Bordeaux, France
| | - Gilles Courtand
- CNRS, INCIA, UMR 5287, 33076, Bordeaux, France.,Université de Bordeaux, INCIA, UMR 5287, 33076, Bordeaux, France
| | - Etienne Coutureau
- CNRS, INCIA, UMR 5287, 33076, Bordeaux, France.,Université de Bordeaux, INCIA, UMR 5287, 33076, Bordeaux, France
| | - Mathieu Wolff
- CNRS, INCIA, UMR 5287, 33076, Bordeaux, France.,Université de Bordeaux, INCIA, UMR 5287, 33076, Bordeaux, France
| |
Collapse
|
28
|
Khani A, Rainer G. Neural and neurochemical basis of reinforcement-guided decision making. J Neurophysiol 2016; 116:724-41. [PMID: 27226454 DOI: 10.1152/jn.01113.2015] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2015] [Accepted: 05/24/2016] [Indexed: 01/01/2023] Open
Abstract
Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.
Collapse
Affiliation(s)
- Abbas Khani
- Visual Cognition Laboratory, Department of Medicine, University of Fribourg, Switzerland
| | - Gregor Rainer
- Visual Cognition Laboratory, Department of Medicine, University of Fribourg, Switzerland
| |
Collapse
|
29
|
Bielser ML, Crézé C, Murray MM, Toepel U. Does my brain want what my eyes like? - How food liking and choice influence spatio-temporal brain dynamics of food viewing. Brain Cogn 2015; 110:64-73. [PMID: 26578256 DOI: 10.1016/j.bandc.2015.10.005] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2015] [Revised: 10/19/2015] [Accepted: 10/20/2015] [Indexed: 11/28/2022]
Abstract
How food valuation and decision-making influence the perception of food is of major interest to better understand food intake behavior and, by extension, body weight management. Our study investigated behavioral responses and spatio-temporal brain dynamics by means of visual evoked potentials (VEPs) in twenty-two normal-weight participants when viewing pairs of food photographs. Participants rated how much they liked each food item (valuation) and subsequently chose between the two alternative food images. Unsurprisingly, strongly liked foods were also chosen most often. Foods were rated faster as strongly liked than as mildly liked or disliked irrespective of whether they were subsequently chosen over an alternative. Moreover, strongly liked foods were subsequently also chosen faster than the less liked alternatives. Response times during valuation and choice were positively correlated, but only when foods were liked; the faster participants rated foods as strongly liked, the faster they were in choosing the food item over an alternative. VEP modulations by the level of liking attributed as well as the subsequent choice were found as early as 135-180ms after food image onset. Analyses of neural source activity patterns over this time interval revealed an interaction between liking and the subsequent choice within the insula, dorsal frontal and superior parietal regions. The neural responses to food viewing were found to be modulated by the attributed level of liking only when foods were chosen, not when they were dismissed for an alternative. Therein, the responses to disliked foods were generally greater than those to foods that were liked more. Moreover, the responses to disliked but chosen foods were greater than responses to disliked foods which were subsequently dismissed for an alternative offer. Our findings show that the spatio-temporal brain dynamics to food viewing are immediately influenced both by how much foods are liked and by choices taken on them. These valuation and choice processes are subserved by brain regions involved in salience and reward attribution as well as in decision-making processes, which are likely to influence prospective dietary choices in everyday life.
Collapse
Affiliation(s)
- Marie-Laure Bielser
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology and Department of Clinical Neurosciences, Vaudois University Hospital Center and University of Lausanne, Lausanne, Switzerland
| | - Camille Crézé
- Department of Physiology, University of Lausanne, Lausanne, Switzerland
| | - Micah M Murray
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology and Department of Clinical Neurosciences, Vaudois University Hospital Center and University of Lausanne, Lausanne, Switzerland; Electroencephalography Brain Mapping Core, Center for Biomedical Imaging (CIBM) of Lausanne and Geneva, Switzerland; Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN 37232, USA
| | - Ulrike Toepel
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology and Department of Clinical Neurosciences, Vaudois University Hospital Center and University of Lausanne, Lausanne, Switzerland.
| |
Collapse
|
30
|
Simon NW, Wood J, Moghaddam B. Action-outcome relationships are represented differently by medial prefrontal and orbitofrontal cortex neurons during action execution. J Neurophysiol 2015; 114:3374-85. [PMID: 26467523 DOI: 10.1152/jn.00884.2015] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2015] [Accepted: 10/13/2015] [Indexed: 01/18/2023] Open
Abstract
Internal representations of action-outcome relationships are necessary for flexible adaptation of motivated behavior in dynamic environments. Prefrontal cortex (PFC) is implicated in flexible planning and execution of goal-directed actions, but little is known about how information about action-outcome relationships is represented across functionally distinct regions of PFC. Here, we observe distinct patterns of action-evoked single unit activity in the medial prefrontal cortex (mPFC) and orbitofrontal cortex (OFC) during a task in which the relationship between outcomes and actions was independently manipulated. The mPFC encoded changes in the number of actions required to earn a reward, but not fluctuations in outcome magnitude. In contrast, OFC neurons decreased firing rates as outcome magnitude was increased, but were insensitive to changes in action requirement. A subset of OFC neurons also tracked outcome availability. Pre-outcome anticipatory activity in both mPFC and OFC was altered when reward expectation was reduced, but did not differ with outcome magnitude. These data provide novel evidence that PFC regions encode distinct information about the relationship between actions and impending outcomes during action execution.
Collapse
Affiliation(s)
- Nicholas W Simon
- University of Pittsburgh, Department of Neuroscience, Pittsburgh, Pennsylvania
| | - Jesse Wood
- University of Pittsburgh, Department of Neuroscience, Pittsburgh, Pennsylvania
| | - Bita Moghaddam
- University of Pittsburgh, Department of Neuroscience, Pittsburgh, Pennsylvania
| |
Collapse
|
31
|
Green MF, Horan WP, Barch DM, Gold JM. Effort-Based Decision Making: A Novel Approach for Assessing Motivation in Schizophrenia. Schizophr Bull 2015; 41:1035-44. [PMID: 26089350 PMCID: PMC4535644 DOI: 10.1093/schbul/sbv071] [Citation(s) in RCA: 101] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Because negative symptoms, including motivational deficits, are a critical unmet need in schizophrenia, there are many ongoing efforts to develop new pharmacological and psychosocial interventions for these impairments. A common challenge of these studies involves how to evaluate and select optimal endpoints. Currently, all studies of negative symptoms in schizophrenia depend on ratings from clinician-conducted interviews. Effort-based decision-making tasks may provide a more objective, and perhaps more sensitive, endpoint for trials of motivational negative symptoms. These tasks assess how much effort a person is willing to exert for a given level of reward. This area has been well-studied with animal models of effort and motivation, and effort-based decision-making tasks have been adapted for use in humans. Very recently, several studies have examined physical and cognitive types of effort-based decision-making tasks in cross-sectional studies of schizophrenia, providing evidence for effort-related impairment in this illness. This article covers the theoretical background on effort-based decision-making tasks to provide a context for the subsequent articles in this theme section. In addition, we review the existing literature of studies using these tasks in schizophrenia, consider some practical challenges in adapting them for use in clinical trials in schizophrenia, and discuss interpretive challenges that are central to these types of tasks.
Collapse
Affiliation(s)
- Michael F. Green
- Department of Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, CA;,Department of Veterans Affairs, Desert Pacific Mental Illness Research, Education, and Clinical Center, Los Angeles, CA;,*To whom correspondence should be addressed; 760 Westwood Plaza, Rm 27-462, Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, CA 90024-1759 US; tel: 310 268-3376, fax: 310 268-4056, e-mail:
| | - William P. Horan
- Department of Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, CA;,Department of Veterans Affairs, Desert Pacific Mental Illness Research, Education, and Clinical Center, Los Angeles, CA
| | - Deanna M. Barch
- Departments of Psychology, Psychiatry and Radiology, Washington University, St. Louis, MO
| | - James M. Gold
- Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore, MA
| |
Collapse
|
32
|
Piantadosi ST, Hayden BY. Utility-free heuristic models of two-option choice can mimic predictions of utility-stage models under many conditions. Front Neurosci 2015; 9:105. [PMID: 25914613 PMCID: PMC4391032 DOI: 10.3389/fnins.2015.00105] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2014] [Accepted: 03/12/2015] [Indexed: 11/13/2022] Open
Abstract
Economists often model choices as if decision-makers assign each option a scalar value variable, known as utility, and then select the option with the highest utility. It remains unclear whether as-if utility models describe real mental and neural steps in choice. Although choices alone cannot prove the existence of a utility stage, utility transformations are often taken to provide the most parsimonious or psychologically plausible explanation for choice data. Here, we show that it is possible to mathematically transform a large set of common utility-stage two-option choice models (specifically ones in which dimensions are can be decomposed into additive functions) into a heuristic model (specifically, a dimensional prioritization heuristic) that has no utility computation stage. We then show that under a range of plausible assumptions, both classes of model predict similar neural responses. These results highlight the difficulties in using neuroeconomic data to infer the existence of a value stage in choice.
Collapse
Affiliation(s)
- Steven T Piantadosi
- Department of Brain and Cognitive Sciences, University of Rochester Rochester, NY, USA
| | - Benjamin Y Hayden
- Department of Brain and Cognitive Sciences, University of Rochester Rochester, NY, USA ; Center for Visual Science, University of Rochester Rochester, NY, USA
| |
Collapse
|
33
|
Abstract
Humans exhibit a suite of biases when making economic decisions. We review recent research on the origins of human decision making by examining whether similar choice biases are seen in nonhuman primates, our closest phylogenetic relatives. We propose that comparative studies can provide insight into four major questions about the nature of human choice biases that cannot be addressed by studies of our species alone. First, research with other primates can address the evolution of human choice biases and identify shared versus human-unique tendencies in decision making. Second, primate studies can constrain hypotheses about the psychological mechanisms underlying such biases. Third, comparisons of closely related species can identify when distinct mechanisms underlie related biases by examining evolutionary dissociations in choice strategies. Finally, comparative work can provide insight into the biological rationality of economically irrational preferences.
Collapse
Affiliation(s)
- Laurie R Santos
- Department of Psychology, Yale University, New Haven, Connecticut 06511;
| | | |
Collapse
|
34
|
Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia. Curr Top Behav Neurosci 2015; 27:411-49. [PMID: 26026289 DOI: 10.1007/7854_2015_376] [Citation(s) in RCA: 140] [Impact Index Per Article: 15.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Motivational and hedonic impairments are core aspects of a variety of types of psychopathology. These impairments cut across diagnostic categories and may be critical to understanding major aspects of the functional impairments accompanying psychopathology. Given the centrality of motivational and hedonic systems to psychopathology, the Research Domain Criteria (RDoC) initiative includes a "positive valence" systems domain that outlines a number of constructs that may be key to understanding the nature and mechanisms of motivational and hedonic impairments in psychopathology. These component constructs include initial responsiveness to reward, reward anticipation or expectancy, incentive or reinforcement learning, effort valuation, and action selection. Here, we review behavioral and neuroimaging studies providing evidence for impairments in these constructs in individuals with psychosis versus in individuals with depressive pathology. There are important differences in the nature of reward-related and hedonic deficits associated with psychosis versus depression that have major implications for our understanding of etiology and treatment development. In particular, the literature strongly suggests the presence of impairments in in-the-moment hedonics or "liking" in individuals with depressive pathology, particularly among those who experience anhedonia. Such deficits may propagate forward and contribute to impairments in other constructs that are dependent on hedonic responses, such as anticipation, learning, effort, and action selection. Such hedonic impairments could reflect alterations in dopamine and/or opioid signaling in the striatum related to depression or specifically to anhedonia in depressed populations. In contrast, the literature points to relatively intact in-the-moment hedonic processing in psychosis, but provides much evidence for impairments in other components involved in translating reward to action selection. Particularly, individuals with schizophrenia exhibit altered reward prediction and associated striatal and prefrontal activation, impaired reward learning, and impaired reward-modulated action selection.
Collapse
|
35
|
Newman LA, Creer DJ, McGaughy JA. Cognitive control and the anterior cingulate cortex: how conflicting stimuli affect attentional control in the rat. ACTA ACUST UNITED AC 2014; 109:95-103. [PMID: 25051488 DOI: 10.1016/j.jphysparis.2014.06.004] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2014] [Revised: 06/03/2014] [Accepted: 06/23/2014] [Indexed: 12/01/2022]
Abstract
Converging evidence supports the hypothesis that the prefrontal cortex is critical for cognitive control. One prefrontal subregion, the anterior cingulate cortex, is hypothesized to be necessary to resolve response conflicts, disregard salient distractors and alter behavior in response to the generation of an error. These situations all involve goal-oriented monitoring of performance in order to effectively adjust cognitive processes. Several neuropsychological disorders, e.g., schizophrenia, attention deficit hyperactivity and obsessive compulsive disorder, are accompanied by morphological changes in the anterior cingulate cortex. These changes are hypothesized to underlie the impairments on tasks that require cognitive control found in these subjects. A novel conflict monitoring task was used to assess the effects on cognitive control of excitotoxic lesions to anterior cingulate cortex in rats. Prior to surgery all subjects showed improved accuracy on the second of two consecutive, incongruent trials. Lesions to the anterior cingulate cortex abolished this. Lesioned animals had difficulty in adjusting cognitive control on a trial-by-trial basis regardless of whether cognitive changes were increased or decreased. These results support a role for the anterior cingulate cortex in adjustments in cognitive control.
Collapse
Affiliation(s)
- Lori A Newman
- Psychology Department, University of New Hampshire, 10 Library Way, Durham, NH 03824, USA.
| | - David J Creer
- Psychology Department, University of New Hampshire, 10 Library Way, Durham, NH 03824, USA
| | - Jill A McGaughy
- Psychology Department, University of New Hampshire, 10 Library Way, Durham, NH 03824, USA.
| |
Collapse
|
36
|
Abstract
AbstractIn The Cognitive-Emotional Brain (Pessoa 2013), I describe the many ways that emotion and cognition interact and are integrated in the brain. The book summarizes five areas of research that support this integrative view and makes four arguments to organize each area. (1) Based on rodent and human data, I propose that the amygdala's functions go beyond emotion as traditionally conceived. Furthermore, the processing of emotion-laden information is capacity limited, thus not independent of attention and awareness. (2) Cognitive-emotional interactions in the human prefrontal cortex (PFC) assume diverse forms and are not limited to mutual suppression. Particularly, the lateral PFC is a focal point for cognitive-emotional interactions. (3) Interactions between motivation and cognition can be seen across a range of perceptual and cognitive tasks. Motivation shapes behavior in specific ways – for example, by reducing response conflict or via selective effects on working memory. Traditional accounts, by contrast, typically describe motivation as a global activation independent of particular control demands. (4) Perception and cognition are directly influenced by information with affective or motivational content in powerful ways. A dual competition model outlines a framework for such interactions at the perceptual and executive levels. A specific neural architecture is proposed that embeds emotional and motivational signals into perception and cognition through multiple channels. (5) A network perspective should supplant the strategy of understanding the brain in terms of individual regions. More broadly, in a network view of brain architecture, “emotion” and “cognition” may be used as labels of certain behaviors, but will not map cleanly into compartmentalized pieces of the brain.
Collapse
|
37
|
The motivation and pleasure dimension of negative symptoms: neural substrates and behavioral outputs. Eur Neuropsychopharmacol 2014; 24:725-36. [PMID: 24461724 PMCID: PMC4020953 DOI: 10.1016/j.euroneuro.2013.06.007] [Citation(s) in RCA: 234] [Impact Index Per Article: 23.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/21/2013] [Revised: 06/13/2013] [Accepted: 06/23/2013] [Indexed: 12/17/2022]
Abstract
A range of emotional and motivation impairments have long been clinically documented in people with schizophrenia, and there has been a resurgence of interest in understanding the psychological and neural mechanisms of the so-called "negative symptoms" in schizophrenia, given their lack of treatment responsiveness and their role in constraining function and life satisfaction in this illness. Negative symptoms comprise two domains, with the first covering diminished motivation and pleasure across a range of life domains and the second covering diminished verbal and non-verbal expression and communicative output. In this review, we focus on four aspects of the motivation/pleasure domain, providing a brief review of the behavioral and neural underpinnings of this domain. First, we cover liking or in-the-moment pleasure: immediate responses to pleasurable stimuli. Second, we cover anticipatory pleasure or wanting, which involves prediction of a forthcoming enjoyable outcome (reward) and feeling pleasure in anticipation of that outcome. Third, we address motivation, which comprises effort computation, which involves figuring out how much effort is needed to achieve a desired outcome, planning, and behavioral response. Finally, we cover the maintenance emotional states and behavioral responses. Throughout, we consider the behavioral manifestations and brain representations of these four aspects of motivation/pleasure deficits in schizophrenia. We conclude with directions for future research as well as implications for treatment.
Collapse
|
38
|
Vassena E, Silvetti M, Boehler CN, Achten E, Fias W, Verguts T. Overlapping neural systems represent cognitive effort and reward anticipation. PLoS One 2014; 9:e91008. [PMID: 24608867 PMCID: PMC3946624 DOI: 10.1371/journal.pone.0091008] [Citation(s) in RCA: 118] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2013] [Accepted: 02/07/2014] [Indexed: 11/18/2022] Open
Abstract
Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.
Collapse
Affiliation(s)
- Eliana Vassena
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging, Ghent University Hospital, Ghent, Belgium
- * E-mail:
| | - Massimo Silvetti
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging, Ghent University Hospital, Ghent, Belgium
| | - Carsten N. Boehler
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging, Ghent University Hospital, Ghent, Belgium
| | - Eric Achten
- Ghent Institute for Functional and Metabolic Imaging, Ghent University Hospital, Ghent, Belgium
| | - Wim Fias
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging, Ghent University Hospital, Ghent, Belgium
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging, Ghent University Hospital, Ghent, Belgium
| |
Collapse
|
39
|
Hillman KL. Cost-benefit analysis: the first real rule of fight club? Front Neurosci 2013; 7:248. [PMID: 24391531 PMCID: PMC3867679 DOI: 10.3389/fnins.2013.00248] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2013] [Accepted: 12/04/2013] [Indexed: 11/16/2022] Open
Abstract
Competition is ubiquitous among social animals. Vying against a conspecific to achieve a particular outcome often requires one to act aggressively, but this is a costly and inherently risky behavior. So why do we aggressively compete, or at the extreme, fight against others? Early work suggested that competitive aggression might stem from an innate aggressive tendency, emanating from subcortical structures. Later work highlighted key cortical regions that contribute toward an instrumental aggression network, one that is recruited or suppressed as needed to achieve a goal. Recent neuroimaging work hints that competitive aggression is upmost a cost-benefit decision, in that it appears to recruit many components of traditional, non-social decision-making networks. This review provides a historical glimpse into the neuroscience of competitive aggression, and proposes a conceptual advancement for studying competitive behavior by outlining how utility calculations of contested-for resources are skewed, pre- and post-competition. A basic multi-factorial model of utility assessment is proposed to account for competitive endowment effects that stem from the presence of peers, peer salience and disposition, and the tactical effort required for victory. In part, competitive aggression is a learned behavior that should only be repeated if positive outcomes are achieved. However, due to skewed utility assessments, deviations of associative learning occur. Hence truly careful cost-benefit analysis is warranted before choosing to vie against another.
Collapse
|
40
|
Shenhav A, Botvinick MM, Cohen JD. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013; 79:217-40. [PMID: 23889930 DOI: 10.1016/j.neuron.2013.07.007] [Citation(s) in RCA: 1249] [Impact Index Per Article: 113.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/11/2013] [Indexed: 12/19/2022]
Abstract
The dorsal anterior cingulate cortex (dACC) has a near-ubiquitous presence in the neuroscience of cognitive control. It has been implicated in a diversity of functions, from reward processing and performance monitoring to the execution of control and action selection. Here, we propose that this diversity can be understood in terms of a single underlying function: allocation of control based on an evaluation of the expected value of control (EVC). We present a normative model of EVC that integrates three critical factors: the expected payoff from a controlled process, the amount of control that must be invested to achieve that payoff, and the cost in terms of cognitive effort. We propose that dACC integrates this information, using it to determine whether, where and how much control to allocate. We then consider how the EVC model can explain the diverse array of findings concerning dACC function.
Collapse
Affiliation(s)
- Amitai Shenhav
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08540, USA
| | | | | |
Collapse
|
41
|
Neural substrates underlying effort computation in schizophrenia. Neurosci Biobehav Rev 2013; 37:2649-65. [PMID: 24035741 DOI: 10.1016/j.neubiorev.2013.09.001] [Citation(s) in RCA: 68] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2013] [Revised: 08/16/2013] [Accepted: 09/03/2013] [Indexed: 11/23/2022]
Abstract
The lack of initiative, drive or effort in patients with schizophrenia is linked to marked functional impairments. However, our assessment of effort and motivation is crude, relying on clinical rating scales based largely on patient recall. In order to better understand the neurobiology of effort in schizophrenia, we need more rigorous measurements of this construct. In the behavioural neuroscience literature, decades of work has been carried out developing various paradigms to examine the neural underpinnings of an animal's willingness to expend effort for a reward. Here, we shall review this literature on the nature of paradigms used in rodents to assess effort, as well as those used in humans. Next, the neurobiology of these effort-based decisions will be discussed. We shall then review what is known about effort in schizophrenia, and what might be inferred from experiments done in other human populations. Lastly, we shall discuss future directions of research that may assist in shedding light on the neurobiology of effort cost computations in schizophrenia.
Collapse
|
42
|
Abstract
A new study has used optogenetic methods to stimulate prefrontal-brainstem neuromodulatory pathways while animals face environmental stressors, the results providing further compelling evidence that prefrontal control of neuromodulatory function can have a dramatic effect on motivated behavior.
Collapse
|
43
|
Hernandez Lallement J, Kuss K, Trautner P, Weber B, Falk A, Fliessbach K. Effort increases sensitivity to reward and loss magnitude in the human brain. Soc Cogn Affect Neurosci 2012. [PMID: 23202663 DOI: 10.1093/scan/nss147] [Citation(s) in RCA: 52] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
It is ecologically adaptive that the amount of effort invested to achieve a reward increases the relevance of the resulting outcome. Here, we investigated the effect of effort on activity in reward and loss processing brain areas by using functional magnetic resonance imaging. In total, 28 subjects were endowed with monetary rewards of randomly varying magnitude after performing arithmetic calculations that were either difficult (high effort), easy (low effort) or already solved (no effort). Subsequently, a forced donation took place, where a varying part of the endowment was transferred to a charity organization, causing a loss for the subject. Results show that reward magnitude positively modulates activity in reward-processing brain areas (subgenual anterior cingulate cortex and nucleus accumbens) only in the high effort condition. Furthermore, anterior insular activity was positively modulated by loss magnitude only after high effort. The results strongly suggest an increasing relevance of outcomes with increasing previous effort.
Collapse
Affiliation(s)
- Julen Hernandez Lallement
- MD, Department of Psychiatry, University of Bonn Medical Center, Sigmund Freud-Str. 25, D-53127 Bonn, Germany.
| | | | | | | | | | | |
Collapse
|
44
|
Paredes-Ramos P, Miquel M, Manzo J, Pfaus JG, López-Meraz ML, Coria-Avila GA. Tickling in juvenile but not adult female rats conditions sexual partner preference. Physiol Behav 2012; 107:17-25. [DOI: 10.1016/j.physbeh.2012.05.017] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2012] [Revised: 05/16/2012] [Accepted: 05/20/2012] [Indexed: 10/28/2022]
|
45
|
Sip KE, Skewes JC, Marchant JL, McGregor WB, Roepstorff A, Frith CD. What if I Get Busted? Deception, Choice, and Decision-Making in Social Interaction. Front Neurosci 2012; 6:58. [PMID: 22529772 PMCID: PMC3328780 DOI: 10.3389/fnins.2012.00058] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2012] [Accepted: 04/01/2012] [Indexed: 11/13/2022] Open
Abstract
Deception is an essentially social act, yet little is known about how social consequences affect the decision to deceive. In this study, participants played a computerized game of deception without constraints on whether or when to attempt to deceive their opponent. Participants were questioned by an opponent outside the scanner about their knowledge of the content of a display. Importantly, questions were posed so that, in some conditions, it was possible to be deceptive, while in other conditions it was not. To simulate a realistic interaction, participants could be confronted about their claims by the opponent. This design, therefore, creates a context in which a deceptive participant runs the risk of being punished if their deception is detected. Our results show that participants were slower to give honest than to give deceptive responses when they knew more about the display and could use this knowledge for their own benefit. The condition in which confrontation was not possible was associated with increased activity in subgenual anterior cingulate cortex. The processing of a question which allows a deceptive response was associated with activation in right caudate and inferior frontal gyrus. Our findings suggest the decision to deceive is affected by the potential risk of social confrontation rather than the claim itself.
Collapse
Affiliation(s)
- Kamila E Sip
- Department of Psychology, Rutgers University Newark, New Jersey, USA
| | | | | | | | | | | |
Collapse
|
46
|
Abstract
Learning theory suggests that animals attend to pertinent environmental cues when reward contingencies unexpectedly change so that learning can occur. We have previously shown that activity in basolateral nucleus of amygdala (ABL) responds to unexpected changes in reward value, consistent with unsigned prediction error signals theorized by Pearce and Hall. However, changes in activity were present only at the time of unexpected reward delivery, not during the time when the animal needed to attend to conditioned stimuli that would come to predict the reward. This suggested that a different brain area must be signaling the need for attention necessary for learning. One likely candidate to fulfill this role is the anterior cingulate cortex (ACC). To test this hypothesis, we recorded from single neurons in ACC as rats performed the same behavioral task that we have used to dissociate signed from unsigned prediction errors in dopamine and ABL neurons. In this task, rats chose between two fluid wells that produced varying magnitudes of and delays to reward. Consistent with previous work, we found that ACC detected errors of commission and reward prediction errors. We also found that activity during cue sampling encoded reward size, but not expected delay to reward. Finally, activity in ACC was elevated during trials in which attention was increased following unexpected upshifts and downshifts in value. We conclude that ACC not only signals errors in reward prediction, as previously reported, but also signals the need for enhanced neural resources during learning on trials subsequent to those errors.
Collapse
|
47
|
Cowen SL, Davis GA, Nitz DA. Anterior cingulate neurons in the rat map anticipated effort and reward to their associated action sequences. J Neurophysiol 2012; 107:2393-407. [PMID: 22323629 DOI: 10.1152/jn.01012.2011] [Citation(s) in RCA: 79] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Goal-directed behaviors require the consideration and expenditure of physical effort. The anterior cingulate cortex (ACC) appears to play an important role in evaluating effort and reward and in organizing goal-directed actions. Despite agreement regarding the involvement of the ACC in these processes, the way in which effort-, reward-, and motor-related information is registered by networks of ACC neurons is poorly understood. To contrast ACC responses to effort, reward, and motor behaviors, we trained rats on a reversal task in which the selected paths on a track determined the level of effort or reward. Effort was presented in the form of an obstacle that was climbed to obtain reward. We used single-unit recordings to identify neural correlates of effort- and reward-guided behaviors. During periods of outcome anticipation, 52% of recorded ACC neurons responded to the specific route taken to the reward while 21% responded prospectively to effort and 12% responded prospectively to reward. In addition, effort- and reward-selective neurons typically responded to the route, suggesting that these cells integrated motor-related activity with expectations of future outcomes. Furthermore, the activity of ACC neurons did not discriminate between choice and forced trials or respond to a more generalized measure of outcome value. Nearly all neural responses to effort and reward occurred after path selection and were restricted to discrete temporal/spatial stages of the task. Together, these findings support a role for the ACC in integrating route-specific actions, effort, and reward in the service of sustaining discrete movements through an effortful series of goal-directed actions.
Collapse
Affiliation(s)
- Stephen L Cowen
- Neurosciences Institute, 10640 John Jay Hopkins Dr., San Diego, CA 92121, USA.
| | | | | |
Collapse
|
48
|
Hasler G. Can the neuroeconomics revolution revolutionize psychiatry? Neurosci Biobehav Rev 2011; 36:64-78. [PMID: 21550365 DOI: 10.1016/j.neubiorev.2011.04.011] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2011] [Revised: 04/07/2011] [Accepted: 04/19/2011] [Indexed: 01/18/2023]
Abstract
Neuroeconomics is a rapidly growing new research discipline aimed at describing the neural substrate of decision-making using incentivized decisions introduced in experimental economics. The novel combination of economic decision theory and neuroscience has the potential to better examine the interactions of social, psychological and neural factors with regard to motivational forces that may underlie psychiatric problems. Game theory will provide psychiatry with computationally principled measures of cognitive dysfunction. Given the relatively high heritability of these measures, they may contribute to improving phenotypic definitions of psychiatric conditions. The game-theoretical concepts of optimal behavior will allow description of psychopathology as deviation from optimal functioning. Neuroeconomists have successfully used normative or near-normative models to interpret the function of neurotransmitters; these models have the potential to significantly improve neurotransmitter theories of psychiatric disorders. This paper will review recent evidence from neuroeconomics and psychiatry in support of applying economic concepts such as risk/uncertainty preference, time preference and social preference to psychiatric research to improve diagnostic classification, prevention and therapy.
Collapse
Affiliation(s)
- Gregor Hasler
- Psychiatric University Hospital, University of Berne, Bolligenstrasse 111, 3000 Berne 60, Switzerland.
| |
Collapse
|
49
|
Bordner KA, Kitchen RR, Carlyle B, George ED, Mahajan MC, Mane SM, Taylor JR, Simen AA. Parallel declines in cognition, motivation, and locomotion in aging mice: association with immune gene upregulation in the medial prefrontal cortex. Exp Gerontol 2011; 46:643-59. [PMID: 21453768 DOI: 10.1016/j.exger.2011.03.003] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2010] [Revised: 03/15/2011] [Accepted: 03/21/2011] [Indexed: 01/19/2023]
Abstract
Aging in humans is associated with parallel changes in cognition, motivation, and motoric performance. Based on the human aging literature, we hypothesized that this constellation of age-related changes is mediated by the medial prefrontal cortex and that it would be observed in aging mice. Toward this end, we performed detailed assessments of cognition, motivation, and motoric behavior in aging mice. We assessed behavioral and cognitive performance in C57Bl/6 mice aged 6, 18, and 24 months, and followed this with microarray analysis of tissue from the medial prefrontal cortex and analysis of serum cytokine levels. Multivariate modeling of these data suggested that the age-related changes in cognition, motivation, motor performance, and prefrontal immune gene expression were highly correlated. Peripheral cytokine levels were also correlated with these variables, but less strongly than measures of prefrontal immune gene upregulation. To determine whether the observed immune gene expression changes were due to prefrontal microglial cells, we isolated CD11b-positive cells from the prefrontal cortex and subject them to next-generation RNA sequencing. Many of the immune changes present in whole medial prefrontal cortex were enriched in this cell population. These data suggest that, as in humans, cognition, motivation, and motoric performance in the mouse change together with age and are strongly associated with CNS immune gene upregulation.
Collapse
Affiliation(s)
- Kelly A Bordner
- Yale University School of Medicine, Department of Psychiatry, New Haven, CT 06511, USA.
| | | | | | | | | | | | | | | |
Collapse
|
50
|
Kahane G, Wiech K, Shackel N, Farias M, Savulescu J, Tracey I. The neural basis of intuitive and counterintuitive moral judgment. Soc Cogn Affect Neurosci 2011; 7:393-402. [PMID: 21421730 PMCID: PMC3324565 DOI: 10.1093/scan/nsr005] [Citation(s) in RCA: 61] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
Neuroimaging studies on moral decision-making have thus far largely focused on differences between moral judgments with opposing utilitarian (well-being maximizing) and deontological (duty-based) content. However, these studies have investigated moral dilemmas involving extreme situations, and did not control for two distinct dimensions of moral judgment: whether or not it is intuitive (immediately compelling to most people) and whether it is utilitarian or deontological in content. By contrasting dilemmas where utilitarian judgments are counterintuitive with dilemmas in which they are intuitive, we were able to use functional magnetic resonance imaging to identify the neural correlates of intuitive and counterintuitive judgments across a range of moral situations. Irrespective of content (utilitarian/deontological), counterintuitive moral judgments were associated with greater difficulty and with activation in the rostral anterior cingulate cortex, suggesting that such judgments may involve emotional conflict; intuitive judgments were linked to activation in the visual and premotor cortex. In addition, we obtained evidence that neural differences in moral judgment in such dilemmas are largely due to whether they are intuitive and not, as previously assumed, to differences between utilitarian and deontological judgments. Our findings therefore do not support theories that have generally associated utilitarian and deontological judgments with distinct neural systems.
Collapse
Affiliation(s)
- Guy Kahane
- Oxford Uehiro Centre for Practical Ethics, Littlegate House, St Ebbe's Street, Oxford OX1 1PT, UK.
| | | | | | | | | | | |
Collapse
|