Fundamental contribution by the basolateral amygdala to different forms of decision making

Prefrontal Dopamine D1 and D2 Receptors Regulate Dissociable Aspects of Decision Making via Distinct Ventral Striatal and Amygdalar Circuits

Mesocortical dopamine (DA) regulates a variety of cognitive functions via actions on D₁ and/or D₂ receptors. For example, risk/reward decision making is modulated differentially by these two receptors within the prefrontal cortex (PFC), with D₂ receptors enabling flexible decision making and D₁ receptors promoting persistence in choice biases. However, it is unclear how DA mediates opposing patterns of behavior by acting on different receptors within the same terminal region. We explored the possibility that DA may act on separate networks of PFC neurons that are modulated by D₁ or D₂ receptors and in turn interface with divergent downstream structures such as the basolateral amygdala (BLA) or nucleus accumbens (NAc). Decision making was assessed using a probabilistic discounting task in which well trained male rats chose between small/certain or large/risky rewards, with the odds of obtaining the larger reward changing systematically within a session. Selective disruption of D₁ or D₂ modulation of separate PFC output pathways was achieved using unilateral intra-PFC infusions of DA antagonists combined with contralateral inactivation of the BLA or NAc. Disrupting D₂ (but not D₁) modulation of PFC→BLA circuitry impaired adjustments in decision biases in response to changes in reward probabilities. In contrast, disrupting D₁ modulation of PFC→NAc networks reduced risky choice, attenuating reward sensitivity and increasing sensitivity to reward omissions. These findings reveal that mesocortical DA can facilitate dissociable components of reward seeking and action selection by acting on different functional networks of PFC neurons that can be distinguished by the subcortical projection targets with which they interface.SIGNIFICANCE STATEMENT Prefrontal cortical dopamine regulates a variety of executive functions governed by the frontal lobes via actions on D₁ and D₂ receptors. These receptors can in some instances mediate different patterns of behavior, but the mechanisms underlying these dissociable actions are unclear. Using a selective disconnection approach, we reveal that D₁ and D₂ receptors can facilitate diverse aspects of decision making by acting on separate networks of prefrontal neurons that interface with distinct striatal or amygdalar targets. These findings reveal an additional level of complexity in how mesocortical DA regulates different forms of cognition via actions on different receptors, highlighting how it may act upon distinct cortical microcircuits to drive different patterns of behavior.

Seeing through the smoke: Human and animal studies of cannabis use and endocannabinoid signalling in corticolimbic networks

Public opinion surrounding the recreational use and therapeutic potential of cannabis is shifting. This review describes new work examining the behavioural and neural effects of cannabis and the endocannabinoid system, highlighting key regions within corticolimbic brain circuits. First, we consider the role of human genetic factors and cannabis strain chemotypic differences in contributing to interindividual variation in the response to cannabinoids, such as THC, and review studies demonstrating that THC-induced impairments in decision-making processes are mediated by actions at prefrontal CB1 receptors. We further describe evidence that signalling through prefrontal or ventral hippocampal CB1 receptors modulates mesolimbic dopamine activity, aberrations of which may contribute to emotional processing deficits in schizophrenia. Lastly, we review studies suggesting that endocannabinoid tone in the amygdala is a critical regulator of anxiety, and report new data showing that FAAH activity is integral to this response. Together, these findings underscore the importance of cannabinoid signalling in the regulation of cognitive and affective behaviours, and encourage further research given their social, political, and therapeutic implications.

Neurocomputational mechanisms underlying subjective valuation of effort costs

In everyday life, we have to decide whether it is worth exerting effort to obtain rewards. Effort can be experienced in different domains, with some tasks requiring significant cognitive demand and others being more physically effortful. The motivation to exert effort for reward is highly subjective and varies considerably across the different domains of behaviour. However, very little is known about the computational or neural basis of how different effort costs are subjectively weighed against rewards. Is there a common, domain-general system of brain areas that evaluates all costs and benefits? Here, we used computational modelling and functional magnetic resonance imaging (fMRI) to examine the mechanisms underlying value processing in both the cognitive and physical domains. Participants were trained on two novel tasks that parametrically varied either cognitive or physical effort. During fMRI, participants indicated their preferences between a fixed low-effort/low-reward option and a variable higher-effort/higher-reward offer for each effort domain. Critically, reward devaluation by both cognitive and physical effort was subserved by a common network of areas, including the dorsomedial and dorsolateral prefrontal cortex, the intraparietal sulcus, and the anterior insula. Activity within these domain-general areas also covaried negatively with reward and positively with effort, suggesting an integration of these parameters within these areas. Additionally, the amygdala appeared to play a unique, domain-specific role in processing the value of rewards associated with cognitive effort. These results are the first to reveal the neurocomputational mechanisms underlying subjective cost–benefit valuation across different domains of effort and provide insight into the multidimensional nature of motivation.

Model-based fMRI in humans shows that cognitive and physical motivation are underpinned by overlapping neural substrates, but the amygdala plays a unique role in valuation of cognitive effort.

Rewards are rarely obtained without the motivation to exert effort. In humans, effort can be perceived in both the cognitive and physical domains, yet little is known about how the brain evaluates whether it is worth exerting different types of effort in return for rewards. In this study, we used functional magnetic resonance imaging (fMRI) to determine the neural and computational basis of effort processing. We developed two novel tasks that were either cognitively or physically effortful and had participants indicate their preference for a low-effort/low-reward versus a higher-effort/higher-reward version of each. Our results showed distinct patterns of reward devaluation across the different domains of effort. Furthermore, regardless of the type of effort involved, motivation was subserved by a large network of overlapping brain areas across the parieto-prefrontal cortex and insula. However, we also found that the amygdala plays a unique role in motivating cognitively—but not physically—effortful behaviours. These data impact current neuroeconomic theories of value-based decision making by revealing the neurocomputational signatures that underlie the variability in individuals’ motivation to exert different types of effort in return for reward.

Basolateral amygdala supports the maintenance of value and effortful choice of a preferred option

The basolateral amygdala (BLA) is known to be involved in appetitive behavior, yet its role in cost-benefit choice of qualitatively different rewards (more/less preferred), beyond magnitude differences (larger/smaller), is poorly understood. We assessed the effects of BLA inactivations on effortful choice behavior. Rats were implanted with cannulae in BLA and trained to stable lever pressing for sucrose pellets on a progressive ratio schedule. Rats were then introduced to a choice: chow was concurrently available while they could work for the preferred sucrose pellets. Rats were infused with either vehicle control (aCSF) or baclofen/muscimol prior to test. BLA inactivations produced a significant decrease in lever presses for sucrose pellets compared to vehicle, and chow consumption was unaffected. Inactivation had no effect on sucrose pellet preference when both options were freely available. Critically, when lab chow was not concurrently available, BLA inactivations had no effect on the number of lever presses for sucrose pellets, indicating that primary motivation in the absence of choice remains intact with BLA offline. After a test under specific satiety for sucrose pellets, BLA inactivation rendered animals less sensitive to devaluation relative to control. The effects of BLA inactivations in our task are not mediated by decreased appetite, an inability to perform the task, a change in food preference, or decrements in primary motivation. Taken together, BLA supports the specific value and effortful choice of a preferred option.

Rigid patterns of effortful choice behavior after acute stress in rats

Physical effort is a common cost of acquiring rewards, and decreased effort is a feature of many neuropsychiatric disorders. Stress affects performance on several tests of cognition and decision making in both humans and nonhumans. Only a few recent reports show impairing effects of stress in operant tasks involving effort and cognitive flexibility. Brain regions affected by stress, such as the medial prefrontal cortex and amygdala, are also implicated in mediating effortful choices. Here, we assessed effort-based decision making after an acute stress procedure known to induce persistent impairment in shuttle escape and elevated plasma corticosterone. In these animals, we also probed levels of polysialyted neural cell adhesion molecule (PSA-NCAM), a marker of structural plasticity, in medial frontal cortex and amygdala. We found that animals that consistently worked for high magnitude rewards continued to do so, even after acute shock stress. We also found that PSA-NCAM was increased in both regions after effortful choice experience but not after shock stress alone. These findings are discussed with reference to the existing broad literature on cognitive effects of stress and in the context of how acute stress may bias effortful decisions to a rigid pattern of responding.

Effects of NMDA receptor antagonists on probability discounting depend on the order of probability presentation

Risky decision making can be measured using a probability-discounting procedure, in which animals choose between a small, certain reinforcer and a large, uncertain reinforcer. Recent evidence has identified glutamate as a mediator of risky decision making, as blocking the N-methyl-d-aspartate (NMDA) receptor with MK-801 increases preference for a large, uncertain reinforcer. Because the order in which probabilities associated with the large reinforcer can modulate the effects of drugs on choice, the current study determined if NMDA receptor ligands alter probability discounting using ascending and descending schedules. Sixteen rats were trained in a probability-discounting procedure in which the odds against obtaining the large reinforcer increased (n=8) or decreased (n=8) across blocks of trials. Following behavioral training, rats received treatments of the NMDA receptor ligands MK-801 (uncompetitive antagonist; 0, 0.003, 0.01, or 0.03mg/kg), ketamine (uncompetitive antagonist; 0, 1.0, 5.0, or 10.0mg/kg), and ifenprodil (NR2B-selective non-competitive antagonist; 0, 1.0, 3.0, or 10.0mg/kg). Results showed discounting was steeper (indicating increased risk aversion) for rats on an ascending schedule relative to rats on the descending schedule. Furthermore, the effects of MK-801, ketamine, and ifenprodil on discounting were dependent on the schedule used. Specifically, the highest dose of each drug decreased risk taking in rats in the descending schedule, but only MK-801 (0.03mg/kg) increased risk taking in rats on an ascending schedule. These results show that probability presentation order modulates the effects of NMDA receptor ligands on risky decision making.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.

Risky choice and brain CRF after adolescent ethanol vapor exposure and social stress in adulthood

Adolescent ethanol exposure increases risky choice and alters corticotropin releasing factor (CRF) systems in adulthood. The impact of stress on risky choice after adolescent intermittent ethanol (AIE) exposure is not known. We investigated time-specific effects of AIE vapor exposure during early adolescence on risky choice after stress or no stress in adulthood. Male Wistar rats were exposed to air or AIE vapor on postnatal days 28-42 (adolescence) and were exposed to 10days of social defeat or no stress on postnatal days 172-181 (adulthood). Risky choice was assessed in the probability discounting task under baseline conditions and after days 1 and 10 of social defeat. CRF and CRF receptor 1 (CRFR1) mRNA levels were assessed in the prefrontal cortex (PFC) and the central nucleus of the amygdala (CeA) 24h post-stress to evaluate persistent effects of stress on the brain. AIE exposure had no effect on risky choice either at baseline or after social defeat. Additionally, neither acute nor chronic social defeat affected risky choice in air-exposed rats. In the PFC, chronic social defeat selectively decreased CRF mRNA levels in air-exposed rats and increased CRFR1 mRNA levels in all rats. AIE exposure increased CRF mRNA levels in the CeA with no effect of social stress. Our results indicate no effect of ethanol exposure via vapor during early adolescence on risky choice, while our previous findings indicated that AIE exposure via gavage affected risky choice. Both AIE exposure and social defeat altered CRF and CRFR1 mRNA levels in the brain.

Infection of male rats with Toxoplasma gondii induces effort-aversion in a T-maze decision-making task

Rats chronically infected with protozoan Toxoplasma gondii exhibit greater delay aversion in an inter-temporal task. Moreover T. gondii infection also results in dendritic atrophy of basolateral amygdala neurons. Basolateral amygdala is reported to bias decision making towards greater effortful alternatives. In this context, we report that T. gondii increases effort aversion in infected male rats. This host-parasite association has been widely studied in the context of loss of innate fear in the infected males. It is suggested that reduced fear towards predators reflects a parasitic behavioral manipulation to enhance trophic transmission of T. gondii. Observations reported here extend this paradigm away from a monolithic change in fear and towards a multi-dimensional change in decision making.

Modulation of risk/reward decision making by dopaminergic transmission within the basolateral amygdala

RATIONALE

Dopamine (DA) transmission within cortico-limbic-striatal circuitry is integral in modulating decisions involving reward uncertainty. The basolateral amygdala (BLA) also plays a role in these processes, yet how DA transmission within this nucleus regulates cost/benefit decision making is unknown.

OBJECTIVES

We investigated the contribution of DA transmission within the BLA to risk/reward decision making assessed with a probabilistic discounting task.

METHODS

Rats were well-trained to choose between a small/certain reward and a large/risky reward, with the probability of obtaining the larger reward decreasing (100-12.5 %) or increasing (12.5-100 %) over a session. We examined the effects of antagonizing BLA D1 (SCH 23390, 0.1-1 μg) or D2 (eticlopride, 0.1-1 μg) receptors, as well as intra-BLA infusions of agonists for D1 (SKF 81297, 0.1-1 μg) and D2 (quinpirole, 1-10 μg) receptors. We also assessed how DA receptor stimulation may induce differential effects related to baseline levels of risky choice.

RESULTS

BLA D1 receptor antagonism reduced risky choice by decreasing reward sensitivity, whereas D2 antagonism did not affect overall choice patterns. Stimulation of BLA D1 receptors optimized decision making in a baseline-dependent manner: in risk-averse rats, infusions of a lower dose of SKF81297 increased risky choice when reward probabilities were high (50 %), whereas in risk-prone rats, this drug reduced risky choice when probabilities were low (12.5 %). Quinpirole reduced risky choice in risk-prone rats, enhancing lose-shift behavior.

CONCLUSIONS

These data highlight previously uncharacterized roles for BLA DA D1 and D2 receptors in biasing choice during risk/reward decision making through mediation of reward/negative feedback sensitivity.

Dissociable contribution of nucleus accumbens and dorsolateral striatum to the acquisition of risk choice behavior in the rat

While a growing body of research has suggested that the mesocorticolimbic dopamine systems play a key role in decision making under risk, how the nucleus accumbens (NAC) is involved in the acquisition of risk choice behavior remains unclear. This study used a T-maze task to assess risk-based decision making in which the rat was required to assess the risk by choosing to enter either a small and certain reward arm or a large but uncertain reward arm of the maze. The latter option, when chosen, resulted in provision of 2, 4, or 8 sweeten pellets with a probability (p) of 0.5, 0.25, or 0.125, respectively. Thus the latter arm provided three different conditions of reward ratio, compared to the choice of former arm, which always provided 1 pellet with p=1. This risk choice task was then run with the expected value being equality between the binary choice options. The experimental rats first received an excitoneurotoxic lesion affecting either the NAC or the dorsolateral striatum (DLS) and this was followed by post-lesion behavioral examination. The sham lesion control rats acquired a stable risk choice with regard to each reward ratio over a 10-day test. The pattern of choice behavior appeared in risk-seeking when p=0.5 to obtain 2 pellets, and was risk-averse when larger reward resulted in lower p. The NAC lesion significantly disrupted the acquisition of the aforementioned risk choice behavior and apparently shifted the choice into a risk-averse style for all three reward ratios. No such effect was observed in the rats with DLS lesions. Neither the gross motor action nor the discrimination of different reward magnitudes was impaired by the lesions affecting either the NAC or DLS as assessed by an additional experiment. These findings suggest that firstly there is heterogeneity between NAC and DLS with respect to risk-based decision making, and that secondly the NAC is involved and critical to the acquisition of behavioral choice under risk, specially when the expected value of the reward under the two choice options is equal.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

Beta-adrenoreceptor blockade abolishes atomoxetine-induced risk taking

RATIONALE

Clinical studies have shown that patients with exaggerated risk-taking tendencies have high baseline levels of norepinephrine. In this work, we systemically manipulated norepinephrine levels in rats and studied their behavioral changes in a probabilistic discounting task, which is a paradigm for gauging risk taking.

METHODS

This study aims to explore the effects of the selective norepinephrine reuptake inhibitor (atomoxetine at doses of 0.6, 1.0 and 1.8 mg/kg), and receptor selective antagonists (propranolol at a single dose of 1.0/kg, and prazosin at a single dose of 0.1 mg/kg), on risk taking using a probabilistic discounting task. In this task, there were two levers available to rats: pressing the 'small/certain' lever guaranteed a single food pellet, and pressing the 'large/risky' lever yielded either four pellets or none. The probability of receiving four food pellets decreased across the four experimental blocks from 100% to 12.5%.

RESULTS

Atomoxetine increased the tendency to choose the large/risky lever. It significantly reduced the lose-shift effect (i.e. pressing a different lever after losing a trial), but did not affect the win-stay effect (i.e. pressing the same lever after winning a trial). Furthermore, co-administration of beta-adrenoreceptor antagonist, propranolol, eliminated the effects of atomoxetine on risk taking and the lose-shift effect; but co-administration of alpha1-adrenoreceptor antagonist, prazosin, did not.

CONCLUSIONS

Atomoxetine boosted NE levels and increased risk taking. This was because atomoxetine decreased rats' sensitivity to losses. These effects were likely mediated by beta-adrenoreceptor.

The basolateral amygdala in reward learning and addiction

Sophisticated behavioral paradigms partnered with the emergence of increasingly selective techniques to target the basolateral amygdala (BLA) have resulted in an enhanced understanding of the role of this nucleus in learning and using reward information. Due to the wide variety of behavioral approaches many questions remain on the circumscribed role of BLA in appetitive behavior. In this review, we integrate conclusions of BLA function in reward-related behavior using traditional interference techniques (lesion, pharmacological inactivation) with those using newer methodological approaches in experimental animals that allow in vivo manipulation of cell type-specific populations and neural recordings. Secondly, from a review of appetitive behavioral tasks in rodents and monkeys and recent computational models of reward procurement, we derive evidence for BLA as a neural integrator of reward value, history, and cost parameters. Taken together, BLA codes specific and temporally dynamic outcome representations in a distributed network to orchestrate adaptive responses. We provide evidence that experiences with opiates and psychostimulants alter these outcome representations in BLA, resulting in long-term modified action.

Noradrenergic signaling in the medial prefrontal cortex and amygdala differentially regulates vicarious trial-and-error in a spatial decision-making task

In uncertain choice situations, we deliberately search and evaluate possible options before taking an action. Once we form a preference regarding the current situation, we take an action more automatically and with less deliberation. In rats, the deliberation process can be seen in vicarious trial-and-error behavior (VTE), which is a head-orienting behavior toward options at a choice point. Recent neurophysiological findings suggest that VTE reflects the rat's thinking about future options as deliberation, expectation, and planning when rats feel conflict. VTE occurs depending on the demand: an increase occurs during initial learning, and a decrease occurs with progression in learning. However, the brain circuit underlying the regulation of VTE has not been thoroughly examined. In situations in which VTE often appears, the medial prefrontal cortex (mPFC) and the amygdala (AMY) are crucial for learning and decision making. Our previous study reported that noradrenaline regulates VTE. Here, to investigate whether the mPFC and AMY are involved in regulation of VTE, we examined the effects of local injection of clonidine, an alpha2 adrenergic autoreceptor agonist, into either region in rats during VTE and choice behavior during a T-maze choice task. Injection of clonidine into either region impaired selection of the advantageous choice in the task. Furthermore, clonidine injection into the mPFC suppressed occurrence of VTE in the early phase of the task, whereas injection into the AMY inhibited the decrease in VTE in the later phase and thus maintained a high level of VTE throughout the task. These results suggest that the mPFC and AMY play a role in the increase and decrease in VTE, respectively, and that noradrenergic mechanisms mediate the dynamic regulation of VTE over experiences.

Translational Rodent Paradigms to Investigate Neuromechanisms Underlying Behaviors Relevant to Amotivation and Altered Reward Processing in Schizophrenia

Amotivation and reward-processing deficits have long been described in patients with schizophrenia and considered large contributors to patients' inability to integrate well in society. No effective treatments exist for these symptoms, partly because the neuromechanisms mediating such symptoms are poorly understood. Here, we propose a translational neuroscientific approach that can be used to assess reward/motivational deficits related to the negative symptoms of schizophrenia using behavioral paradigms that can also be conducted in experimental animals. By designing and using objective laboratory behavioral tools that are parallel in their parameters in rodents and humans, the neuromechanisms underlying behaviors with relevance to these symptoms of schizophrenia can be investigated. We describe tasks that measure the motivation of rodents to expend physical and cognitive effort to gain rewards, as well as probabilistic learning tasks that assess both reward learning and feedback-based decision making. The latter tasks are relevant because of demonstrated links of performance deficits correlating with negative symptoms in patients with schizophrenia. These tasks utilize operant techniques in order to investigate neural circuits targeting a specific domain across species. These tasks therefore enable the development of insights into altered mechanisms leading to negative symptom-relevant behaviors in patients with schizophrenia. Such findings will then enable the development of targeted treatments for these altered neuromechanisms and behaviors seen in schizophrenia.

Noradrenergic modulation of risk/reward decision making

RATIONALE

Catecholamine transmission modulates numerous cognitive and reward-related processes that can subserve more complex functions such as cost/benefit decision making. Dopamine has been shown to play an integral role in decisions involving reward uncertainty, yet there is a paucity of research investigating the contributions of noradrenaline (NA) transmission to these functions.

OBJECTIVES

The present study was designed to elucidate the contribution of NA to risk/reward decision making in rats, assessed with a probabilistic discounting task.

METHODS

We examined the effects of reducing noradrenergic transmission with the α2 agonist clonidine (10-100 μg/kg), and increasing activity at α2A receptor sites with the agonist guanfacine (0.1-1 mg/kg), the α2 antagonist yohimbine (1-3 mg/kg), and the noradrenaline transporter (NET) inhibitor atomoxetine (0.3-3 mg/kg) on probabilistic discounting. Rats chose between a small/certain reward and a larger/risky reward, wherein the probability of obtaining the larger reward either decreased (100-12.5 %) or increased (12.5-100 %) over a session.

RESULTS

In well-trained rats, clonidine reduced risky choice by decreasing reward sensitivity, whereas guanfacine did not affect choice behavior. Yohimbine impaired adjustments in decision biases as reward probability changed within a session by altering negative feedback sensitivity. In a subset of rats that displayed prominent discounting of probabilistic rewards, the lowest dose of atomoxetine increased preference for the large/risky reward when this option had greater long-term utility.

CONCLUSIONS

These data highlight an important and previously uncharacterized role for noradrenergic transmission in mediating different aspects of risk/reward decision making and mediating reward and negative feedback sensitivity.

Anabolic-androgenic steroids and decision making: Probability and effort discounting in male rats

Anabolic-androgenic steroid (AAS) abuse is implicated in maladaptive behaviors such as increased aggression and risk taking. Impaired judgment due to changes in the mesocorticolimbic dopamine system may contribute to these behavioral changes. While AAS are known to influence dopamine function in mesocorticolimbic circuitry, the effects on decision making are unknown. This was the focus of the present study. Adolescent male Long-Evans rats were treated chronically with high-dose testosterone (7.5 mg/kg) or vehicle (13% cyclodextrin in water), and tested for cost/benefit decision making in two discounting paradigms. Rats chose between a small reward (1 sugar pellet) and a large discounted reward (3 or 4 pellets). Probability discounting (PD) measures sensitivity to reward uncertainty by decreasing the probability (100, 75, 50, 25, 0%) of receiving the large reward in successive blocks of each daily session. Effort discounting (ED) measures sensitivity to a work cost by increasing the lever presses required to earn the large reward (1, 2, 5, 10, 15 presses). In PD, testosterone-treated rats selected the large/uncertain reward significantly less than vehicle-treated controls. However, during ED, testosterone-treated rats selected the large/high effort reward significantly more than controls. These studies show that testosterone has divergent effects on different aspects of decision making. Specifically, testosterone increases aversion to uncertainty but decreases sensitivity to the output of effort for reward. These results have implications for understanding maladaptive behavioral changes in human AAS users.

Dissociable effects of basolateral amygdala lesions on decision making biases in rats when loss or gain is emphasized

Individuals switch from risk seeking to risk aversion when mathematically identical options are described in terms of loss versus gains, as exemplified in the reflection and framing effects. Determining the neurobiology underlying such cognitive biases could inform our understanding of decision making in health and disease. Although reports vary, data using human subjects have implicated the amygdala in such biases. Animal models enable more detailed investigation of neurobiological mechanisms. We therefore tested whether basolateral amygdala (BLA) lesions would affect risk preference for gains or losses in rats. Choices in both paradigms were always between options of equal expected value-a guaranteed outcome, or the 50:50 chance of double or nothing. In the loss-chasing task, most rats exhibited strong risk seeking preferences, gambling at the risk of incurring double the penalty, regardless of the size of the guaranteed loss. In the betting task, the majority of animals were equivocal in their choice, irrespective of bet size; however, a wager-sensitive subgroup progressively shifted away from the uncertain option as the bet size increased, which is reminiscent of risk aversion. BLA lesions increased preference for the smaller guaranteed loss in the loss-chasing task, without affecting choice on the betting task, which is indicative of reduced risk seeking for losses, but intact risk aversion for gains. These data support the hypothesis that the amygdala plays a more prominent role in choice biases related to losses. Given the importance of the amygdala in representing negative affect, the aversive emotional reaction to loss, rather than aberrant estimations of probability or loss magnitude, may underlie risk seeking for losses.

Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Over the past 20 years there has been a growing interest in the neural underpinnings of cost/benefit decision-making. Recent studies with animal models have made considerable advances in our understanding of how different prefrontal, striatal, limbic and monoaminergic circuits interact to promote efficient risk/reward decision-making, and how dysfunction in these circuits underlies aberrant decision-making observed in numerous psychiatric disorders. This review will highlight recent findings from studies exploring these questions using a variety of behavioral assays, as well as molecular, pharmacological, neurophysiological, and translational approaches. We begin with a discussion of how neural systems related to decision subcomponents may interact to generate more complex decisions involving risk and uncertainty. This is followed by an overview of interactions between prefrontal-amygdala-dopamine and habenular circuits in regulating choice between certain and uncertain rewards and how different modes of dopamine transmission may contribute to these processes. These data will be compared with results from other studies investigating the contribution of some of these systems to guiding decision-making related to rewards vs. punishment. Lastly, we provide a brief summary of impairments in risk-related decision-making associated with psychiatric disorders, highlighting recent translational studies in laboratory animals.

Dopamine D1/D2 Receptor Activity in the Nucleus Accumbens Core But Not in the Nucleus Accumbens Shell and Orbitofrontal Cortex Modulates Risk-Based Decision Making

BACKGROUND

It is well known that brain dopamine (DA) signals support risk-based decision making; however, the specific terminal regions of midbrain DA neurons through which DA signals mediate risk-based decision making are unknown.

METHODS

Using microinfusions of the D1/D2 receptor antagonist flupenthixol, we sought to explore the role of D1/D2 receptor activity in the rat orbitofrontal cortex (OFC) and core and shell regions of the nucleus accumbens (AcbC and AcbS, respectively) in the regulation of risky choices. A risk-discounting task was used that involves choices between a certain small-reward lever that always delivered 1 pellet or a risky large-reward lever which delivered 4 pellets but had a decreasing probability of receiving the reward across 4 subsequent within-session trial blocks (100%, 50%, 25%, 12.5%). To validate task sensitivity to experimental manipulations of DA activity, we also examined the effects of systemic amphetamine and flupenthixol.

RESULTS

Systemic amphetamine increased while systemic flupenthixol reduced risky choices. Results further demonstrate that rats that received intra-AcbC flupenthixol were able to track increasing risk associated with the risky lever but displayed a generally reduced preference for the risky lever across all trial blocks, including in the initial trial block (large reward at 100%). Microinfusions of flupenthixol into the AcbS or OFC did not alter risk-based decision making.

CONCLUSIONS

Our data suggest that intra-AcbC D1/D2 receptor signaling does not support the ability to track shifts in reward probabilities but does bias risk-based decision making. That is, it increased the rats' preference for the response option known to be associated with higher risk-related costs.

Dissociable roles for the basolateral amygdala and orbitofrontal cortex in decision-making under risk of punishment

Several neuropsychiatric disorders are associated with abnormal decision-making involving risk of punishment, but the neural basis of this association remains poorly understood. Altered activity in brain systems including the basolateral amygdala (BLA) and orbitofrontal cortex (OFC) can accompany these same disorders, and these structures are implicated in some forms of decision-making. The current study investigated the role of the BLA and OFC in decision-making under risk of explicit punishment. Rats were trained in the risky decision-making task (RDT), in which they chose between two levers, one that delivered a small safe reward, and the other that delivered a large reward accompanied by varying risks of footshock punishment. Following training, they received sham or neurotoxic lesions of BLA or OFC, followed by RDT retesting. BLA lesions increased choice of the large risky reward (greater risk-taking) compared to both prelesion performance and sham controls. When reward magnitudes were equated, both BLA lesion and control groups shifted their choice to the safe (no shock) reward lever, indicating that the lesions did not impair punishment sensitivity. In contrast to BLA lesions, OFC lesions significantly decreased risk-taking compared with sham controls, but did not impair discrimination between different reward magnitudes or alter baseline levels of anxiety. Finally, neither lesion significantly affected food-motivated lever pressing under various fixed ratio schedules, indicating that lesion-induced alterations in risk-taking were not secondary to changes in appetitive motivation. Together, these findings indicate distinct roles for the BLA and OFC in decision-making under risk of explicit punishment.

Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision-making tasks

Successful decision making often requires weighing a given option's costs against its associated benefits, an ability that appears perturbed in virtually every severe mental illness. Animal models of such cost/benefit decision making overwhelmingly implicate mesolimbic dopamine in our willingness to exert effort for a larger reward. Until recently, however, animal models have invariably manipulated the degree of physical effort, whereas human studies of effort have primarily relied on cognitive costs. Dopamine's relationship to cognitive effort has not been directly examined, nor has the relationship between individuals' willingness to expend mental versus physical effort. It is therefore unclear whether willingness to work hard in one domain corresponds to willingness in the other. Here we utilize a rat cognitive effort task (rCET), wherein animals can choose to allocate greater visuospatial attention for a greater reward, and a previously established physical effort-discounting task (EDT) to examine dopaminergic and noradrenergic contributions to effort. The dopamine antagonists eticlopride and SCH23390 each decreased willingness to exert physical effort on the EDT; these drugs had no effect on willingness to exert mental effort for the rCET. Preference for the high effort option correlated across the two tasks, although this effect was transient. These results suggest that dopamine is only minimally involved in cost/benefit decision making with cognitive effort costs. The constructs of mental and physical effort may therefore comprise overlapping, but distinct, circuitry, and therapeutic interventions that prove efficacious in one effort domain may not be beneficial in another.

Going for broke: dopamine influences risky choice

Dopamine neurons track reward by increasing or decreasing their firing rate when a reward is present or absent. In this issue of Neuron, Stopper et al. (2014) demonstrate that artificially eliminating these dopamine bursts or dips can alter risky decision-making.

Age differences in strategy selection and risk preference during risk-based decision making

Studies of the effects of aging on decision making suggest that choices can be altered in a variety of ways depending on the situation, the nature of the outcome and risk, or certainty levels. To better characterize how aging impacts decision making in rodents, young and aged Fischer 344 rats underwent a series of probabilistic discounting tasks in which reward magnitude and probabilities were manipulated. Young rats tended to choose 1 of 2 different strategies: (a) to press for the large/uncertain reward, regardless of the reward probability; or (b) to continually adapt their behavior according to the odds of winning. The first strategy was adopted by about half of the younger rats, the second by the remaining young animals and the entire group of aged rats. Additionally, we found that when the odds of winning were varied from uncertain to certain during a session, aged rats chose most often the lever associated with the small/certain reward. This is consistent with an interpretation of increased risk aversion. When this behavior was further characterized using a lose-shift analysis, it appears that older rats exhibited an increased sensitivity to negative feedback. In contrast, sensitivity to wins was unaltered in aged rats compared with young, suggesting that aging selectively impacts rat's behavior following losses. In line with some human aging studies, it appears that aged rats are either more risk averse or have a greater certainty bias, which may result from age differences in emotion regulation.

Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia

Abnormal reinforcement learning and representations of reward value are present in schizophrenia, and these impairments can manifest as deficits in risk/reward decision making. These abnormalities may be due in part to dopaminergic dysfunction within cortico-limbic-striatal circuitry. Evidence from studies with laboratory animal have revealed that normal DA activity within different nodes of these circuits is critical for mediating dissociable processes that can refine decision biases. Moreover, both phasic and tonic dopamine transmission appear to play separate yet complementary roles in these processes. Tonic dopamine release within the prefrontal cortex and nucleus accumbens, serves as a "running rate-meter" of reward and reflects contextual information such as reward uncertainty and overt choice behavior. On the other hand, manipulations of outcome-related phasic dopamine bursts and dips suggest these signals provide rapid feedback to allow for quick adjustments in choice as reward contingencies change. The lateral habenula is a key input to the DA system that phasic signals is necessary for expressing subjective decision biases; as suppression of activity within this nucleus leads to catastrophic impairments in decision making and random patterns of choice behavior. As schizophrenia is characterized by impairments in using positive and negative feedback to appropriately guide decision making, these findings suggest that these deficits in these processes may be mediated, at least in part, by abnormalities in both tonic and phasic dopamine transmission.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.

Dopamine-associated cached values are not sufficient as the basis for action selection

Phasic dopamine transmission is posited to act as a critical teaching signal that updates the stored (or "cached") values assigned to reward-predictive stimuli and actions. It is widely hypothesized that these cached values determine the selection among multiple courses of action, a premise that has provided a foundation for contemporary theories of decision making. In the current work we used fast-scan cyclic voltammetry to probe dopamine-associated cached values from cue-evoked dopamine release in the nucleus accumbens of rats performing cost-benefit decision-making paradigms to evaluate critically the relationship between dopamine-associated cached values and preferences. By manipulating the amount of effort required to obtain rewards of different sizes, we were able to bias rats toward preferring an option yielding a high-value reward in some sessions and toward instead preferring an option yielding a low-value reward in others. Therefore, this approach permitted the investigation of dopamine-associated cached values in a context in which reward magnitude and subjective preference were dissociated. We observed greater cue-evoked mesolimbic dopamine release to options yielding the high-value reward even when rats preferred the option yielding the low-value reward. This result identifies a clear mismatch between the ordinal utility of the available options and the rank ordering of their cached values, thereby providing robust evidence that dopamine-associated cached values cannot be the sole determinant of choices in simple economic decision making.

Subspecialization in the human posterior medial cortex

The posterior medial cortex (PMC) is particularly poorly understood. Its neural activity changes have been related to highly disparate mental processes. We therefore investigated PMC properties with a data-driven exploratory approach. First, we subdivided the PMC by whole-brain coactivation profiles. Second, functional connectivity of the ensuing PMC regions was compared by task-constrained meta-analytic coactivation mapping (MACM) and task-unconstrained resting-state correlations (RSFC). Third, PMC regions were functionally described by forward/reverse functional inference. A precuneal cluster was mostly connected to the intraparietal sulcus, frontal eye fields, and right temporo-parietal junction; associated with attention and motor tasks. A ventral posterior cingulate cortex (PCC) cluster was mostly connected to the ventromedial prefrontal cortex and middle left inferior parietal cortex (IPC); associated with facial appraisal and language tasks. A dorsal PCC cluster was mostly connected to the dorsomedial prefrontal cortex, anterior/posterior IPC, posterior midcingulate cortex, and left dorsolateral prefrontal cortex; associated with delay discounting. A cluster in the retrosplenial cortex was mostly connected to the anterior thalamus and hippocampus. Furthermore, all PMC clusters were congruently coupled with the default mode network according to task-unconstrained but not task-constrained connectivity. We thus identified distinct regions in the PMC and characterized their neural networks and functional implications.

Dissociable contributions of anterior cingulate cortex and basolateral amygdala on a rodent cost/benefit decision-making task of cognitive effort

Personal success often requires the choice to expend greater effort for larger rewards, and deficits in such effortful decision making accompany a number of illnesses including depression, schizophrenia, and attention-deficit/hyperactivity disorder. Animal models have implicated brain regions such as the basolateral amygdala (BLA) and anterior cingulate cortex (ACC) in physical effort-based choice, but disentangling the unique contributions of these two regions has proven difficult, and effort demands in industrialized society are predominantly cognitive in nature. Here we utilize the rodent cognitive effort task (rCET), a modification of the five-choice serial reaction-time task, wherein animals can choose to expend greater visuospatial attention to obtain larger sucrose rewards. Temporary inactivation (via baclofen-muscimol) of BLA and ACC showed dissociable effects: BLA inactivation caused hard-working rats to 'slack off' and 'slacker' rats to work harder, whereas ACC inactivation caused all animals to reduce willingness to expend mental effort. Furthermore, BLA inactivation increased the time needed to make choices, whereas ACC inactivation increased motor impulsivity. These data illuminate unique contributions of BLA and ACC to effort-based decision making, and imply overlapping yet distinct circuitry for cognitive vs physical effort. Our understanding of effortful decision making may therefore require expanding our models beyond purely physical costs.

Reducing substance use during adolescence: a translational framework for prevention

RATIONALE

Most substance use is initiated during adolescence when substantial development of relevant brain circuitry is still rapidly maturing. Developmental differences in reward processing, behavioral flexibility, and self-regulation lead to changes in resilience or vulnerability to drugs of abuse depending on exposure to risk factors. Intervention and prevention approaches to reducing addiction in teens may be able to capitalize on malleable brain systems in a predictable manner.

OBJECTIVE

This review will highlight what is known about how factors that increase vulnerability to addiction, including developmental stage, exposure to early life adversity (ranging from abuse, neglect, and bullying), drug exposure, and genetic predisposition, impact the development of relevant systems.

RESULTS AND CONCLUSIONS

Appropriate, early intervention may restore the normal course of an abnormal trajectory and reduce the likelihood of developing a substance use disorder (SUD) later in life. A considerable amount is known about the functional neuroanatomy and/or pharmacology of risky behaviors based on clinical and preclinical studies, but relatively little has been directly translated to reduce their impact on addiction in high-risk children or teenagers. An opportunity exists to effectively intervene before adolescence when substance use is likely to emerge.

Testosterone enhances risk tolerance without altering motor impulsivity in male rats

Anabolic-androgenic steroids (AAS) increase impulsive and uncontrolled aggressive ('roid rage) in humans and enhance agonistic behavior in animals. However, the underlying mechanisms for AAS-induced aggression remain unclear. Potential contributing elements include an increase risk-taking and/or motor impulsivity due to AAS. This study addressed the effects of chronic high-dose testosterone on risk tolerance using a risky decision-making task (RDT) and motor impulsivity with a go/no-go task in operant chambers. Male Long-Evans rats were treated for at least 4 weeks with testosterone (7.5mg/kg) or vehicle beginning in late adolescence. Testosterone was used because it is popular among human AAS users. In RDT testing, one lever was paired with delivery of a small "safe" food reward, while the other was paired with a large "risky" reward associated with an increasing risk of footshock (0%, 25%, 50%, 75%, 100%) in successive test blocks. Three shock intensities were used: 1.0, 1.2, and 1.4mA/kg. As shock intensity and risk of shock increased, preference for the lever signifying a large reward significantly declined for both vehicle- and testosterone-treated rats (p<0.05). There was also a significant effect of drug (p<0.05), where testosterone-treated rats showed greater preference for the large reward, compared to vehicle-treated controls. Increased preference for the large reward, despite risk of footshock, is consistent with increased risk tolerance. In go/no-go testing, rats were trained to press a single lever if the go cue was presented (stimulus light) or to refrain from pressing during the no-go cue (tone). There was no effect of testosterone on pre-cue responses, or performance in go and no-go trials. These results suggest that AAS may increase risk-tolerance without altering motor impulsivity.

Lateral/basolateral amygdala serotonin type-2 receptors modulate operant self-administration of a sweetened ethanol solution via inhibition of principal neuron activity

The lateral/basolateral amygdala (BLA) forms an integral part of the neural circuitry controlling innate anxiety and learned fear. More recently, BLA dependent modulation of self-administration behaviors suggests a much broader role in the regulation of reward evaluation. To test this, we employed a self-administration paradigm that procedurally segregates “seeking” (exemplified as lever-press behaviors) from consumption (drinking) directed at a sweetened ethanol solution. Microinjection of the nonselective serotonin type-2 receptor agonist, alpha-methyl-5-hydroxytryptamine (α-m5HT) into the BLA reduced lever pressing behaviors in a dose-dependent fashion. This was associated with a significant reduction in the number of response-bouts expressed during non-reinforced sessions without altering the size of a bout or the rate of responding. Conversely, intra-BLA α-m5HT only modestly effected consumption-related behaviors; the highest dose reduced the total time spent consuming a sweetened ethanol solution but did not inhibit the total number of licks, number of lick bouts, or amount of solution consumed during a session. In vitro neurophysiological characterization of BLA synaptic responses showed that α-m5HT significantly reduced extracellular field potentials. This was blocked by the 5-HT2A/C antagonist ketanserin suggesting that 5-HT2-like receptors mediate the behavioral effect of α-m5HT. During whole-cell patch current-clamp recordings, we subsequently found that α-m5HT increased action potential threshold and hyperpolarized the resting membrane potential of BLA pyramidal neurons. Together, our findings show that the activation of BLA 5-HT2A/C receptors inhibits behaviors related to reward-seeking by suppressing BLA principal neuron activity. These data are consistent with the hypothesis that the BLA modulates reward-related behaviors and provides specific insight into BLA contributions during operant self-administration of a sweetened ethanol solution.

Intersection of effort and risk: ethological and neurobiological perspectives

The physical effort required to seek out and extract a resource is an important consideration for a foraging animal. A second consideration is the variability or risk associated with resource delivery. An intriguing observation from ethological studies is that animals shift their preference from stable to variable food sources under conditions of increased physical effort or falling energetic reserves. Although theoretical models for this effect exist, no exploration into its biological basis has been pursued. Recent advances in understanding the neural basis of effort- and risk-guided decision making suggest that opportunities exist for determining how effort influences risk preference. In this review, we describe the intersection between the neural systems involved in effort- and risk-guided decision making and outline two mechanisms by which effort-induced changes in dopamine release may increase the preference for variable rewards.

Stress effects on framed decisions: there are differences for gains and losses

Recent studies have shown that acute stress can lead to riskier decision making. Yet, the underlying mechanisms of the stress effects on decisions under risk remain poorly understood. To gain a better understanding of decision-making processes and potential strategy application under stress, we investigated decision making in pure gain and loss domains with unequal expected values (EVs) across alternatives. We conducted an experimental study with a 2 × 2 design (stress vs. no stress and gain domain vs. loss domain). The Trier Social Stress Test (TSST) was utilized to induce acute stress. Controls performed the placebo-TSST (p-TSST). To validate the stress response we measured salivary cortisol and alpha-amylase concentrations. We used a modified version of the Game of Dice Task (GDT) to assess decision-making performance in a gain and a loss domain. Results showed that non-stressed participants made less risky decisions in the gain domain compared to those of the loss domain. This behavior is in accordance with previous studies and indicates the stability of the framing effect in even more complex tasks with changing EVs across alternatives. Stress did not alter risk taking behavior in the gain domain. Yet, in the loss domain stressed participants made less risky decisions compared to controls. Additionally, the data support earlier findings of longer reaction times in loss compared to gain domains due to higher cognitive effort for loss-framed decisions. It is discussed that stress may lead to reduced amygdala activation, which has been found to reduce riskier decisions in a loss domain. With respect to earlier results of riskier decisions in tasks that unite both gain and loss domains, it is discussed whether stress leads to a stronger evaluation of high gains and a neglect of losses.

The hippocampal-prefrontal pathway: the weak link in psychiatric disorders?

While the hippocampal formation and the prefrontal cortex each have a well-established role in cognitive and mnemonic processes, the extent and manner in which these structures interact to achieve these functions has not been fully delineated. Recent research in rodents compellingly supports the idea that the projection of neurons extending from the CA1 region of the hippocampus and from the subiculum to the prefrontal cortex, referred to here as the H-PFC pathway, is critically involved in aspects of cognition related to executive function and to emotional regulation. Concurrently, it is becoming evident that persons suffering from schizophrenia, depression, and post-traumatic stress disorder display structural anomalies and aberrant functional coupling within the hippocampal-prefrontal circuit. Considering that these disorders involve varying degrees of cognitive impairment and emotional dysregulation, dysfunction in the H-PFC pathway might therefore be the common element of their pathophysiology. This overlap might also be intertwined with the pathway's evident susceptibility to stress and with its relationship to the amygdala. In consequence, the H-PFC pathway is a potentially crucial element of the pathophysiology of several psychiatric diseases, and it offers a specific target for therapeutic intervention, which is consistent with the recent emphasis on reframing psychiatric diseases in terms of brain circuits.

Neural substrates underlying effort computation in schizophrenia

The lack of initiative, drive or effort in patients with schizophrenia is linked to marked functional impairments. However, our assessment of effort and motivation is crude, relying on clinical rating scales based largely on patient recall. In order to better understand the neurobiology of effort in schizophrenia, we need more rigorous measurements of this construct. In the behavioural neuroscience literature, decades of work has been carried out developing various paradigms to examine the neural underpinnings of an animal's willingness to expend effort for a reward. Here, we shall review this literature on the nature of paradigms used in rodents to assess effort, as well as those used in humans. Next, the neurobiology of these effort-based decisions will be discussed. We shall then review what is known about effort in schizophrenia, and what might be inferred from experiments done in other human populations. Lastly, we shall discuss future directions of research that may assist in shedding light on the neurobiology of effort cost computations in schizophrenia.

Functional disconnection of the orbitofrontal cortex and basolateral amygdala impairs acquisition of a rat gambling task and disrupts animals' ability to alter decision-making behavior after reinforcer devaluation

An inability to adjust choice preferences in response to changes in reward value may underlie key symptoms of many psychiatric disorders, including chemical and behavioral addictions. We developed the rat gambling task (rGT) to investigate the neurobiology underlying complex decision-making processes. As in the Iowa Gambling task, the optimal strategy is to avoid choosing larger, riskier rewards and to instead favor options associated with smaller rewards but less loss and, ultimately, greater long-term gain. Given the demonstrated importance of the orbitofrontal cortex (OFC) and basolateral amygdala (BLA) in acquisition of the rGT and Iowa Gambling task, we used a contralateral disconnection lesion procedure to assess whether functional connectivity between these regions is necessary for optimal decision-making. Disrupting the OFC-BLA pathway retarded acquisition of the rGT. Devaluing the reinforcer by inducing sensory-specific satiety altered decision-making in control groups. In contrast, disconnected rats did not update their choice preference following reward devaluation, either when the devalued reward was still delivered or when animals needed to rely on stored representations of reward value (i.e., during extinction). However, all rats exhibited decreased premature responding and slower response latencies after satiety manipulations. Hence, disconnecting the OFC and BLA did not affect general behavioral changes caused by reduced motivation, but instead prevented alterations in the value of a specific reward from contributing appropriately to cost-benefit decision-making. These results highlight the role of the OFC-BLA pathway in the decision-making process and suggest that communication between these areas is vital for the appropriate assessment of reward value to influence choice.

Amygdala inputs drive feedforward inhibition in the medial prefrontal cortex

Although interactions between the amygdala and prefrontal cortex (PFC) are critical for emotional guidance of behavior, the manner in which amygdala affects PFC function is not clear. Whereas basolateral amygdala (BLA) output neurons exhibit many characteristics associated with excitatory neurotransmission, BLA stimulation typically inhibits PFC cell firing. This apparent discrepancy could be explained if local PFC inhibitory interneurons were activated by BLA inputs. Here, we used in vivo juxtacellular and intracellular recordings in anesthetized rats to investigate whether BLA inputs evoke feedforward inhibition in the PFC. Juxtacellular recordings revealed that BLA stimulation evoked action potentials in PFC interneurons and silenced most pyramidal neurons. Intracellular recordings from PFC pyramidal neurons showed depolarizing postsynaptic potentials, with multiple components evoked by BLA stimulation. These responses exhibited a relatively negative reversal potential (Erev), suggesting the contribution of a chloride component. Intracellular administration or pressure ejection of the GABA-A antagonist picrotoxin resulted in action-potential firing during the BLA-evoked response, which had a more depolarized Erev. These results suggest that BLA stimulation engages a powerful inhibitory mechanism within the PFC mediated by local circuit interneurons.

Receptor-specific modulation of risk-based decision making by nucleus accumbens dopamine

The nucleus accumbens (NAc) serves as an integral node within cortico-limbic circuitry that regulates various forms of cost-benefit decision making. The dopamine (DA) system has also been implicated in enabling organisms to overcome a variety of costs to obtain more valuable rewards. However, it remains unclear how DA activity within the NAc may regulate decision making involving reward uncertainty. This study investigated the contribution of different DA receptor subtypes in the NAc to risk-based decision making, assessed with a probabilistic discounting task. In well-trained rats, D1 receptor blockade with SCH 23,390 decreased preference for larger, uncertain rewards, which was associated with enhanced negative-feedback sensitivity (ie, an increased tendency to select a smaller/certain option after an unrewarded risky choice). Treatment with a D1 agonist (SKF 81,297) optimized decision making, increasing choice of the risky option when reward probability was high, and decreasing preference under low probability conditions. In stark contrast, neither blockade of NAc D2 receptors with eticlopride, nor stimulation of these receptors with quinpirole or bromocriptine influenced risky choice. In comparison, infusion of the D3-preferring agonist PD 128,907 decreased reward sensitivity and risky choice. Collectively, these results show that mesoaccumbens DA refines risk-reward decision biases via dissociable mechanisms recruiting D1 and D3, but not D2 receptors. D1 receptor activity mitigates the effect of reward omissions on subsequent choices to promote selection of reward options that may have greater long-term utility, whereas excessive D3 receptor activity blunts the impact that larger/uncertain rewards have in promoting riskier choices.

Dissociable neural processes underlying risky decisions for self versus other

Previous neuroimaging studies on decision making have mainly focused on decisions on behalf of oneself. Considering that people often make decisions on behalf of others, it is intriguing that there is little neurobiological evidence on how decisions for others differ from those for oneself. The present study directly compared risky decisions for self with those for another person using functional magnetic resonance imaging (fMRI). Participants were asked to perform a gambling task on behalf of themselves (decision-for-self condition) or another person (decision-for-other condition) while in the scanner. Their task was to choose between a low-risk option (i.e., win or lose 10 points) and a high-risk option (i.e., win or lose 90 points) with variable levels of winning probability. Compared with choices regarding others, those regarding oneself were more risk-averse at lower winning probabilities and more risk-seeking at higher winning probabilities, perhaps due to stronger affective process during risky decisions for oneself compared with those for other. The brain-activation pattern changed according to the target, such that reward-related regions were more active in the decision-for-self condition than in the decision-for-other condition, whereas brain regions related to the theory of mind (ToM) showed greater activation in the decision-for-other condition than in the decision-for-self condition. Parametric modulation analysis using individual decision models revealed that activation of the amygdala and the dorsomedial prefrontal cortex (DMPFC) were associated with value computations for oneself and for another, respectively, during risky financial decisions. The results of the present study suggest that decisions for oneself and for other may recruit fundamentally distinct neural processes, which can be mainly characterized as dominant affective/impulsive and cognitive/regulatory processes, respectively.