Dopaminergic modulation of risk-based decision making

Noradrenergic modulation of risk/reward decision making

RATIONALE

Catecholamine transmission modulates numerous cognitive and reward-related processes that can subserve more complex functions such as cost/benefit decision making. Dopamine has been shown to play an integral role in decisions involving reward uncertainty, yet there is a paucity of research investigating the contributions of noradrenaline (NA) transmission to these functions.

OBJECTIVES

The present study was designed to elucidate the contribution of NA to risk/reward decision making in rats, assessed with a probabilistic discounting task.

METHODS

We examined the effects of reducing noradrenergic transmission with the α2 agonist clonidine (10-100 μg/kg), and increasing activity at α2A receptor sites with the agonist guanfacine (0.1-1 mg/kg), the α2 antagonist yohimbine (1-3 mg/kg), and the noradrenaline transporter (NET) inhibitor atomoxetine (0.3-3 mg/kg) on probabilistic discounting. Rats chose between a small/certain reward and a larger/risky reward, wherein the probability of obtaining the larger reward either decreased (100-12.5 %) or increased (12.5-100 %) over a session.

RESULTS

In well-trained rats, clonidine reduced risky choice by decreasing reward sensitivity, whereas guanfacine did not affect choice behavior. Yohimbine impaired adjustments in decision biases as reward probability changed within a session by altering negative feedback sensitivity. In a subset of rats that displayed prominent discounting of probabilistic rewards, the lowest dose of atomoxetine increased preference for the large/risky reward when this option had greater long-term utility.

CONCLUSIONS

These data highlight an important and previously uncharacterized role for noradrenergic transmission in mediating different aspects of risk/reward decision making and mediating reward and negative feedback sensitivity.

Anabolic-androgenic steroids and decision making: Probability and effort discounting in male rats

Anabolic-androgenic steroid (AAS) abuse is implicated in maladaptive behaviors such as increased aggression and risk taking. Impaired judgment due to changes in the mesocorticolimbic dopamine system may contribute to these behavioral changes. While AAS are known to influence dopamine function in mesocorticolimbic circuitry, the effects on decision making are unknown. This was the focus of the present study. Adolescent male Long-Evans rats were treated chronically with high-dose testosterone (7.5 mg/kg) or vehicle (13% cyclodextrin in water), and tested for cost/benefit decision making in two discounting paradigms. Rats chose between a small reward (1 sugar pellet) and a large discounted reward (3 or 4 pellets). Probability discounting (PD) measures sensitivity to reward uncertainty by decreasing the probability (100, 75, 50, 25, 0%) of receiving the large reward in successive blocks of each daily session. Effort discounting (ED) measures sensitivity to a work cost by increasing the lever presses required to earn the large reward (1, 2, 5, 10, 15 presses). In PD, testosterone-treated rats selected the large/uncertain reward significantly less than vehicle-treated controls. However, during ED, testosterone-treated rats selected the large/high effort reward significantly more than controls. These studies show that testosterone has divergent effects on different aspects of decision making. Specifically, testosterone increases aversion to uncertainty but decreases sensitivity to the output of effort for reward. These results have implications for understanding maladaptive behavioral changes in human AAS users.

Dissociable effects of basolateral amygdala lesions on decision making biases in rats when loss or gain is emphasized

Individuals switch from risk seeking to risk aversion when mathematically identical options are described in terms of loss versus gains, as exemplified in the reflection and framing effects. Determining the neurobiology underlying such cognitive biases could inform our understanding of decision making in health and disease. Although reports vary, data using human subjects have implicated the amygdala in such biases. Animal models enable more detailed investigation of neurobiological mechanisms. We therefore tested whether basolateral amygdala (BLA) lesions would affect risk preference for gains or losses in rats. Choices in both paradigms were always between options of equal expected value-a guaranteed outcome, or the 50:50 chance of double or nothing. In the loss-chasing task, most rats exhibited strong risk seeking preferences, gambling at the risk of incurring double the penalty, regardless of the size of the guaranteed loss. In the betting task, the majority of animals were equivocal in their choice, irrespective of bet size; however, a wager-sensitive subgroup progressively shifted away from the uncertain option as the bet size increased, which is reminiscent of risk aversion. BLA lesions increased preference for the smaller guaranteed loss in the loss-chasing task, without affecting choice on the betting task, which is indicative of reduced risk seeking for losses, but intact risk aversion for gains. These data support the hypothesis that the amygdala plays a more prominent role in choice biases related to losses. Given the importance of the amygdala in representing negative affect, the aversive emotional reaction to loss, rather than aberrant estimations of probability or loss magnitude, may underlie risk seeking for losses.

Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Over the past 20 years there has been a growing interest in the neural underpinnings of cost/benefit decision-making. Recent studies with animal models have made considerable advances in our understanding of how different prefrontal, striatal, limbic and monoaminergic circuits interact to promote efficient risk/reward decision-making, and how dysfunction in these circuits underlies aberrant decision-making observed in numerous psychiatric disorders. This review will highlight recent findings from studies exploring these questions using a variety of behavioral assays, as well as molecular, pharmacological, neurophysiological, and translational approaches. We begin with a discussion of how neural systems related to decision subcomponents may interact to generate more complex decisions involving risk and uncertainty. This is followed by an overview of interactions between prefrontal-amygdala-dopamine and habenular circuits in regulating choice between certain and uncertain rewards and how different modes of dopamine transmission may contribute to these processes. These data will be compared with results from other studies investigating the contribution of some of these systems to guiding decision-making related to rewards vs. punishment. Lastly, we provide a brief summary of impairments in risk-related decision-making associated with psychiatric disorders, highlighting recent translational studies in laboratory animals.

Dopaminergic modulation of the trade-off between probability and time in economic decision-making

Studies on animals and humans have demonstrated the importance of dopamine in modulating decision-making processes. In this work, we have tested dopaminergic modulation of economic decision-making and its neural correlates by administering either placebo or metoclopramide, a dopamine D2-receptor antagonist, to healthy subjects, during a functional MRI study. The decision-making task combined probability and time delay with a fixed monetary reward. For individual behavioral characterization, we used the Probability Time Trade-off (PTT) economic model, which integrates the traditional trade-offs of reward magnitude-time and reward magnitude-probability into a single measurement, thereby quantifying the subjective value of a delayed and probabilistic outcome. A regression analysis between BOLD signal and the PTT model index permitted to identify the neural substrate encoding the subjective reward-value. Behaviorally, medication reduced the rate of temporal discounting over probability, reflected in medicated subjects being more prone to postpone the reward in order to increase the outcome probability. In addition, medicated subjects showed less activity during the task in the postcentral gyrus as well as frontomedian areas, whereas there were no differences in the ventromedial orbitofrontal cortex (VMOFC) between groups when coding the subjective value. The present study demonstrates by means of behavior and imaging that dopamine modulation alters the probability-time trade-off in human economic decision-making.

Mesolimbic dopamine dynamically tracks, and is causally linked to, discrete aspects of value-based decision making

BACKGROUND

To make appropriate choices, organisms must weigh the costs and benefits of potential valuable outcomes, a process known to involve the nucleus accumbens (NAc) and its dopaminergic input. However, it is currently unknown if dopamine dynamically tracks alterations in expected reward value online as behavioral preferences change and if so, if it is causally linked to specific components of value such as reward magnitude and/or delay to reinforcement.

METHODS

Electrochemical methods were used to measure subsecond NAc dopamine release during a delay discounting task where magnitude was fixed but delay varied across blocks (n = 7 rats). Next, to assess whether this dopamine signaling was causally related to specific components of choice behavior, we employed selective optogenetic stimulation of dopamine terminals in the NAc using a modified delay discounting task in which both delay and magnitude varied independently (n = 23 rats).

RESULTS

Cues predictive of available choices evoked dopamine release that scaled with the rat's preferred choices and dynamically shifted as delay to reinforcement for the large reward increased. In the second experiment, dopamine signaling was causally related to features of decision making, as optogenetically enhanced dopamine release within the NAc during predictive cue presentation was sufficient to alter subsequent value-related choices. Importantly, this dopamine-mediated shift in choice was limited to delay-based, but not magnitude-based, decisions.

CONCLUSIONS

These findings indicate that NAc dopamine dynamically tracks delay discounting and establishes a causal role for this signaling in a subset of value-based associative strategies.

Dopamine D1/D2 Receptor Activity in the Nucleus Accumbens Core But Not in the Nucleus Accumbens Shell and Orbitofrontal Cortex Modulates Risk-Based Decision Making

BACKGROUND

It is well known that brain dopamine (DA) signals support risk-based decision making; however, the specific terminal regions of midbrain DA neurons through which DA signals mediate risk-based decision making are unknown.

METHODS

Using microinfusions of the D1/D2 receptor antagonist flupenthixol, we sought to explore the role of D1/D2 receptor activity in the rat orbitofrontal cortex (OFC) and core and shell regions of the nucleus accumbens (AcbC and AcbS, respectively) in the regulation of risky choices. A risk-discounting task was used that involves choices between a certain small-reward lever that always delivered 1 pellet or a risky large-reward lever which delivered 4 pellets but had a decreasing probability of receiving the reward across 4 subsequent within-session trial blocks (100%, 50%, 25%, 12.5%). To validate task sensitivity to experimental manipulations of DA activity, we also examined the effects of systemic amphetamine and flupenthixol.

RESULTS

Systemic amphetamine increased while systemic flupenthixol reduced risky choices. Results further demonstrate that rats that received intra-AcbC flupenthixol were able to track increasing risk associated with the risky lever but displayed a generally reduced preference for the risky lever across all trial blocks, including in the initial trial block (large reward at 100%). Microinfusions of flupenthixol into the AcbS or OFC did not alter risk-based decision making.

CONCLUSIONS

Our data suggest that intra-AcbC D1/D2 receptor signaling does not support the ability to track shifts in reward probabilities but does bias risk-based decision making. That is, it increased the rats' preference for the response option known to be associated with higher risk-related costs.

Dissociable roles for the basolateral amygdala and orbitofrontal cortex in decision-making under risk of punishment

Several neuropsychiatric disorders are associated with abnormal decision-making involving risk of punishment, but the neural basis of this association remains poorly understood. Altered activity in brain systems including the basolateral amygdala (BLA) and orbitofrontal cortex (OFC) can accompany these same disorders, and these structures are implicated in some forms of decision-making. The current study investigated the role of the BLA and OFC in decision-making under risk of explicit punishment. Rats were trained in the risky decision-making task (RDT), in which they chose between two levers, one that delivered a small safe reward, and the other that delivered a large reward accompanied by varying risks of footshock punishment. Following training, they received sham or neurotoxic lesions of BLA or OFC, followed by RDT retesting. BLA lesions increased choice of the large risky reward (greater risk-taking) compared to both prelesion performance and sham controls. When reward magnitudes were equated, both BLA lesion and control groups shifted their choice to the safe (no shock) reward lever, indicating that the lesions did not impair punishment sensitivity. In contrast to BLA lesions, OFC lesions significantly decreased risk-taking compared with sham controls, but did not impair discrimination between different reward magnitudes or alter baseline levels of anxiety. Finally, neither lesion significantly affected food-motivated lever pressing under various fixed ratio schedules, indicating that lesion-induced alterations in risk-taking were not secondary to changes in appetitive motivation. Together, these findings indicate distinct roles for the BLA and OFC in decision-making under risk of explicit punishment.

Role of ionotropic glutamate receptors in delay and probability discounting in the rat

RATIONALE

Discounting of delayed and probabilistic reinforcement is linked to increased drug use and pathological gambling. Understanding the neurobiology of discounting is important for designing treatments for these disorders. Glutamate is considered to be involved in addiction-like behaviors; however, the role of ionotropic glutamate receptors (iGluRs) in discounting remains unclear.

OBJECTIVES

The current study examined the effects of N-methyl-D-aspartate (NMDA) and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) glutamate receptor blockade on performance in delay and probability discounting tasks.

METHODS

Following training in either delay or probability discounting, rats (n = 12, each task) received pretreatments of the NMDA receptor antagonists MK-801 (0, 0.01, 0.03, 0.1, or 0.3 mg/kg, s.c.) or ketamine (0, 1.0, 5.0, or 10.0 mg/kg, i.p.), as well as the AMPA receptor antagonist CNQX (0, 1.0, 3.0, or 5.6 mg/kg, i.p.). Hyperbolic discounting functions were used to estimate sensitivity to delayed/probabilistic reinforcement and sensitivity to reinforcer amount.

RESULTS

An intermediate dose of MK-801 (0.03 mg/kg) decreased sensitivity to both delayed and probabilistic reinforcement. In contrast, ketamine did not affect the rate of discounting in either task but decreased sensitivity to reinforcer amount. CNQX did not alter sensitivity to reinforcer amount or delayed/probabilistic reinforcement.

CONCLUSIONS

These results show that blockade of NMDA receptors, but not AMPA receptors, decreases sensitivity to delayed/probabilistic reinforcement (MK-801) and sensitivity to reinforcer amount (ketamine). The differential effects of MK-801 and ketamine demonstrate that sensitivities to delayed/probabilistic reinforcement and reinforcer amount are pharmacologically dissociable.

Investigating the mechanism(s) underlying switching between states in bipolar disorder

Bipolar disorder (BD) is a unique disorder that transcends domains of function since the same patient can exhibit depression or mania, states with polar opposite mood symptoms. During depression, people feel helplessness, reduced energy, and risk aversion, while with mania behaviors include grandiosity, increased energy, less sleep, and risk preference. The neural mechanism(s) underlying each state are gaining clarity, with catecholaminergic disruption seen during mania, and cholinergic dysfunction during depression. The fact that the same patient cycles/switches between these states is the defining characteristic of BD however. Of greater importance therefore, is the mechanism(s) underlying cycling from one state - and its associated neural changes - to another, considered the 'holy grail' of BD research. Herein, we review studies investigating triggers that induce switching to these states. By identifying such triggers, researchers can study neural mechanisms underlying each state and importantly how such mechanistic changes can occur in the same subject. Current animal models of this switch are also discussed, from submissive- and dominant-behaviors to kindling effects. Focus however, is placed on how seasonal changes can induce manic and depressive states in BD sufferers. Importantly, changing photoperiod lengths can induce local switches in neurotransmitter expression in normal animals, from increased catecholaminergic expression during periods of high activity, to increased somatostatin and corticotrophin releasing factor during periods of low activity. Identifying susceptibilities to this switch would enable the development of targeted animal models. From animal models, targeted treatments could be developed and tested that would minimize the likelihood of switching.

Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision-making tasks

Successful decision making often requires weighing a given option's costs against its associated benefits, an ability that appears perturbed in virtually every severe mental illness. Animal models of such cost/benefit decision making overwhelmingly implicate mesolimbic dopamine in our willingness to exert effort for a larger reward. Until recently, however, animal models have invariably manipulated the degree of physical effort, whereas human studies of effort have primarily relied on cognitive costs. Dopamine's relationship to cognitive effort has not been directly examined, nor has the relationship between individuals' willingness to expend mental versus physical effort. It is therefore unclear whether willingness to work hard in one domain corresponds to willingness in the other. Here we utilize a rat cognitive effort task (rCET), wherein animals can choose to allocate greater visuospatial attention for a greater reward, and a previously established physical effort-discounting task (EDT) to examine dopaminergic and noradrenergic contributions to effort. The dopamine antagonists eticlopride and SCH23390 each decreased willingness to exert physical effort on the EDT; these drugs had no effect on willingness to exert mental effort for the rCET. Preference for the high effort option correlated across the two tasks, although this effect was transient. These results suggest that dopamine is only minimally involved in cost/benefit decision making with cognitive effort costs. The constructs of mental and physical effort may therefore comprise overlapping, but distinct, circuitry, and therapeutic interventions that prove efficacious in one effort domain may not be beneficial in another.

Age differences in strategy selection and risk preference during risk-based decision making

Studies of the effects of aging on decision making suggest that choices can be altered in a variety of ways depending on the situation, the nature of the outcome and risk, or certainty levels. To better characterize how aging impacts decision making in rodents, young and aged Fischer 344 rats underwent a series of probabilistic discounting tasks in which reward magnitude and probabilities were manipulated. Young rats tended to choose 1 of 2 different strategies: (a) to press for the large/uncertain reward, regardless of the reward probability; or (b) to continually adapt their behavior according to the odds of winning. The first strategy was adopted by about half of the younger rats, the second by the remaining young animals and the entire group of aged rats. Additionally, we found that when the odds of winning were varied from uncertain to certain during a session, aged rats chose most often the lever associated with the small/certain reward. This is consistent with an interpretation of increased risk aversion. When this behavior was further characterized using a lose-shift analysis, it appears that older rats exhibited an increased sensitivity to negative feedback. In contrast, sensitivity to wins was unaltered in aged rats compared with young, suggesting that aging selectively impacts rat's behavior following losses. In line with some human aging studies, it appears that aged rats are either more risk averse or have a greater certainty bias, which may result from age differences in emotion regulation.

Adolescent intermittent ethanol exposure is associated with increased risky choice and decreased dopaminergic and cholinergic neuron markers in adult rats

BACKGROUND

Binge drinking is prevalent during adolescence and may have effects on the adult brain and behavior. The present study investigated whether adolescent intermittent ethanol exposure alters adult risky choice and prefrontal dopaminergic and forebrain cholinergic neuronal marker levels in male Wistar rats.

METHODS

Adolescent (postnatal day 28-53) rats were administered 5 g/kg of 25% (vol/vol) ethanol 3 times/d in a 2-days-on/2-days-off exposure pattern. In adulthood, risky choice was assessed in the probability discounting task with descending and ascending series of large reward probabilities and after acute ethanol challenge. Immunohistochemical analyses assessed tyrosine hydroxylase, a marker of dopamine and norepinephrine in the prelimbic and infralimbic cortices, and choline acetyltransferase, a marker of cholinergic neurons, in the basal forebrain.

RESULTS

All of the rats preferred the large reward when it was delivered with high probability. When the large reward became unlikely, control rats preferred the smaller, safe reward, whereas adolescent intermittent ethanol-exposed rats continued to prefer the risky alternative. Acute ethanol had no effect on risky choice in either group of rats. Tyrosine hydroxylase (prelimbic cortex only) and choline acetyltransferase immunoreactivity levels were decreased in adolescent intermittent ethanol-exposed rats compared with controls. Risky choice was negatively correlated with choline acetyltransferase, implicating decreased forebrain cholinergic activity in risky choice.

CONCLUSIONS

The decreases in tyrosine hydroxylase and choline acetyltransferase immunoreactivity suggest that adolescent intermittent ethanol exposure has enduring neural effects that may lead to altered adult behaviors, such as increased risky decision making. In humans, increased risky decision making could lead to maladaptive, potentially harmful consequences.

Translational Models of Gambling-Related Decision-Making

Gambling is a harmless, recreational pastime that is ubiquitous across cultures. However, for some, gambling becomes a maladaptive and compulsive, and this syndrome is conceptualized as a behavioural addiction. Laboratory models that capture the key cognitive processes involved in gambling behaviour, and that can be translated across species, have the potential to make an important contribution to both decision neuroscience and the study of addictive disorders. The Iowa gambling task has been widely used to assess human decision-making under uncertainty, and this paradigm can be successfully modelled in rodents. Similar neurobiological processes underpin choice behaviour in humans and rats, and thus, a preference for the disadvantageous "high-risk, high-reward" options may reflect meaningful vulnerability for mental health problems. However, the choice behaviour operationalized by these tasks does not necessarily approximate the vulnerability to gambling disorder (GD) per se. We consider a number of psychological challenges that apply to modelling gambling in a translational way, and evaluate the success of the existing models. Heterogeneity in the structure of gambling games, as well as in the motivations of individuals with GD, is highlighted. The potential issues with extrapolating too directly from established animal models of drug dependency are discussed, as are the inherent difficulties in validating animal models of GD in the absence of any approved treatments for GD. Further advances in modelling the cognitive biases endemic in human decision-making, which appear to be exacerbated in GD, may be a promising line of research.

Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia

Abnormal reinforcement learning and representations of reward value are present in schizophrenia, and these impairments can manifest as deficits in risk/reward decision making. These abnormalities may be due in part to dopaminergic dysfunction within cortico-limbic-striatal circuitry. Evidence from studies with laboratory animal have revealed that normal DA activity within different nodes of these circuits is critical for mediating dissociable processes that can refine decision biases. Moreover, both phasic and tonic dopamine transmission appear to play separate yet complementary roles in these processes. Tonic dopamine release within the prefrontal cortex and nucleus accumbens, serves as a "running rate-meter" of reward and reflects contextual information such as reward uncertainty and overt choice behavior. On the other hand, manipulations of outcome-related phasic dopamine bursts and dips suggest these signals provide rapid feedback to allow for quick adjustments in choice as reward contingencies change. The lateral habenula is a key input to the DA system that phasic signals is necessary for expressing subjective decision biases; as suppression of activity within this nucleus leads to catastrophic impairments in decision making and random patterns of choice behavior. As schizophrenia is characterized by impairments in using positive and negative feedback to appropriately guide decision making, these findings suggest that these deficits in these processes may be mediated, at least in part, by abnormalities in both tonic and phasic dopamine transmission.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive.

Dopamine receptors antagonistically regulate behavioral choice between conflicting alternatives in C. elegans

Caenorhabditis elegans is a useful model to study the neuronal or molecular basis for behavioral choice, a specific form of decision-making. Although it has been implied that both D1-like and D2-like dopamine receptors may contribute to the control of decision-making in mammals, the genetic interactions between D1-like and D2-like dopamine receptors in regulating decision-making are still largely unclear. In the present study, we investigated the molecular control of behavioral choice between conflicting alternatives (diacetyl and Cu2+) by D1-like and D2-like dopamine receptors and their possible genetic interactions with C. elegans as the assay system. In the behavioral choice assay system, mutation of dop-1 gene encoding D1-like dopamine receptor resulted in the enhanced tendency to cross the Cu2+ barrier compared with wild-type. In contrast, mutations of dop-2 or dop-3 gene encoding D2-like dopamine receptor caused the weak tendency to cross the Cu2+ barrier compared with wild-type. During the control of behavioral choice, DOP-3 antagonistically regulated the function of DOP-1. The behavioral choice phenotype of dop-2; dop-1dop-3 triple mutant further confirmed the possible antagonistic function of D2-like dopamine receptor on D1-like dopamine receptor in regulating behavioral choice. The genetic assays further demonstrate that DOP-3 might act through Gαo signaling pathway encoded by GOA-1 and EGL-10, and DOP-1 might act through Gαq signaling pathway encoded by EGL-30 and EAT-16 to regulate the behavioral choice. DOP-1 might function in cholinergic neurons to regulate the behavioral choice, whereas DOP-3 might function in GABAergic neurons, RIC, and SIA neurons to regulate the behavioral choice. In this study, we provide the genetic evidence to indicate the antagonistic relationship between D1-like dopamine receptor and D2-like dopamine receptor in regulating the decision-making of animals. Our data will be useful for understanding the complex functions of dopamine receptors in regulating decision-making in animals.

The impact of stress in decision making in the context of uncertainty

For a number of decades, different fields of knowledge, including psychology, economics, and neurosciences, have focused their research efforts on a better understanding of the decision-making process. Making decisions based on the probability of future events is routine in everyday life; it occurs whenever individuals select an option from several alternatives, each one associated with a specific value. Sometimes subjects decide knowing the precise outcomes of each option, but commonly they have to decide without knowing the consequences (because either ambiguity or risk is involved). Stress has a broad impact on animal behaviors, affects brain regions involved in decision-making processes, and, when maladaptive, is a trigger for neuropsychiatric disorders. This Mini-Review provides a comprehensive overview on how stress impacts decision-making processes, particularly under uncertain conditions. Understanding this can prove to be useful for intervention related to impairments to decision-making processes that present in several stress-triggered neuropsychiatric disorders.

Reduced dopamine transporter functioning induces high-reward risk-preference consistent with bipolar disorder

Individuals with bipolar disorder (BD) exhibit deleterious decision making, negatively impacting their lives. Such aberrant decision making can be quantified using the Iowa Gambling Task (IGT), which requires choosing between advantageous and disadvantageous options based on different reward/punishment schedules. The mechanisms underlying this behavioral deficit are unknown, but may include the reduced dopamine transporter (DAT) functioning reported in BD patients. Using both human and mouse IGTs, we tested whether reduced DAT functioning would recreate patterns of deficient decision making of BD patients. We assessed the IGT performance of 16 BD subjects (7 female) and 17 healthy control (HC) subjects (12 female). We recorded standard IGT performance measures and novel post-reward and post-punishment decision-making strategies. We characterized a novel single-session mouse IGT using C57BL/6J mice (n = 44). The BD and HC IGT performances were compared with the effects of chronic (genetic knockdown (KD; n = 31) and wild-type (n = 28) mice) and acute (C57BL/6J mice (n = 89) treated with the DAT inhibitor GBR12909) reductions of DAT functioning in mice performing this novel IGT. BD patients exhibited impaired decision making compared with HC subjects. Both the good-performing DAT KD and GBR12909-treated mice exhibited poor decision making in the mouse IGT. The deficit of each population was driven by high-reward sensitivity. The single-session mouse IGT measures dynamic risk-based decision making similar to humans. Chronic and acute reductions of DAT functioning in mice impaired decision-making consistent with poor IGT performance of BD patients. Hyperdopaminergia caused by reduced DAT may impact poor decision making in BD patients, which should be confirmed in future studies.

Choice for response alternatives differing in reinforcement frequency in dopamine D2 receptor mutant and Swiss-Webster mice

RATIONALE

A previous study showed that dopamine (DA) D2 receptors (D2Rs) are involved in the reinforcing effectiveness of food, but the specific involvement of DA D2Rs in choice among food reinforcers remains unclear.

OBJECTIVES

The current study used genetic and pharmacological approaches to assess the role of D2Rs in choice among food-reinforcement frequencies using the generalized matching law (GML), which specifies that logged response and time allocation ratios vary linearly with logged reinforcer ratios.

METHODS

Congenic D2R knockout (KO) and wild-type (WT) mice were exposed to concurrent variable-interval schedules of reinforcement with scheduled relative-reinforcement rates from 4:1 to 1:4. Effects of the D2R antagonist (-)-eticlopride (0.1-1.0 mg/kg) were assessed in Swiss-Webster mice.

RESULTS

Response and time allocation ratios were related to obtained reinforcement ratios as predicted by the GML. GML fits accounted for ≥ 92 % of the variance in allocation ratios and did not differ in D2R KO and WT mice. Similarly, there were no significant effects of (-)-eticlopride dose on GML fits, despite effects on overall response rates.

CONCLUSIONS

The current results demonstrate that neither deletion nor acute blockade of D2Rs affects choice among response alternatives varying in food-reinforcement frequencies. Because previously published results suggest a role of D2Rs in choice between response alternatives differing in reinforcer magnitude and delay or magnitude and probability, the current findings suggest that D2Rs play a role in choice only among certain parameters of reinforcement. Furthermore, these findings suggest parameters of reinforcement may only be fungible in a complex manner.

The effects of acute pharmacological stimulation of the 5-HT, NA and DA systems on the cognitive judgement bias of rats in the ambiguous-cue interpretation paradigm

In the present study, we investigated the effects of acute pharmacological stimulation of the serotonergic (5-HT), noradrenergic (NA) and dopaminergic (DA) systems on the valence of cognitive judgement bias of rats in the ambiguous-cue interpretation (ACI) paradigm. To accomplish this goal, after initial behavioural training, different groups of rats received single injections of citalopram, desipramine or d-amphetamine and were subsequently tested with the ACI paradigm. Each drug was administered in 3 doses using a fully randomised Latin square design. Citalopram at the dose of 1mg/kg significantly biased animals towards positive interpretation of the ambiguous cue, while at higher doses (5 and 10mg/kg), the animals interpreted the ambiguous cue more negatively. Desipramine at all 3 tested doses (1, 2 and 5mg/kg) significantly biased animals towards negative interpretation of the ambiguous cue, while d-amphetamine at the dose of 1mg/kg induced positive bias, having no effects at lower doses (0.1 and 0.5mg/kg). Our results indicate that cognitive bias in rats can be influenced by acute pharmacological intervention.

A new approach to assess gambling-like behavior in laboratory rats: using intracranial self-stimulation as a positive reinforcer

Pathological gambling is one manifestation of impulse control disorders. The biological underpinnings of these disorders remain elusive and treatment is far from ideal. Animal models of impulse control disorders are a critical research tool for understanding this condition and for medication development. Modeling such complex behaviors is daunting, but by its deconstruction, scientists have recapitulated in animals critical aspects of gambling. One aspect of gambling is cost/benefit decision-making wherein one weighs the anticipated costs and expected benefits of a course of action. Risk/reward, delay-based and effort-based decision-making all represent cost/benefit choices. These features are studied in humans and have been translated to animal protocols to measure decision-making processes. Traditionally, the positive reinforcer used in animal studies is food. Here, we describe how intracranial self-stimulation can be used for cost/benefit decision-making tasks and overview our recent studies showing how pharmacological therapies alter these behaviors in laboratory rats. We propose that these models may have value in screening new compounds for the ability to promote and prevent aspects of gambling behavior.

Role of medial prefrontal and orbitofrontal monoamine transporters and receptors in performance in an adjusting delay discounting procedure

Performance in an adjusting delay discounting procedure is predictive of drug abuse vulnerability; however, the shared underlying specific prefrontal neural systems linking delay discounting and increased addiction-like behaviors are unclear. Rats received direct infusions of methylphenidate (MPH; 6.25, 25.0, or 100μg), amphetamine (AMPH; 0.25, 1.0, or 4.0μg), or atomoxetine (ATO; 1.0, 4.0, or 16.0μg) into either medial prefrontal cortex (mPFC) or orbitofrontal cortex (OFC) immediately prior to performance in an adjusting delay task. These drugs were examined because they are efficacious in treating impulse control disorders. Because dopamine (DA) and serotonin (5-HT) receptors are implicated in impulsive behavior, separate groups of rats received microinfusions of the DA receptor-selective drugs SKF 81297 (0.1 or 0.4µg), SCH 23390 (0.25 or 1.0µg), quinpirole (1.25 or 5.0µg), and eticlopride (0.25 or 1.0µg), or received microinfusions of the 5-HT receptor-selective drugs 8-OH-DPAT (0.025 or 0.1μg), WAY 100635 (0.01 or 0.04μg), DOI (2.5 or 10.0μg), and ketanserin (0.1 or 0.4μg). Impulsive choice was not altered significantly by MPH, AMPH, or ATO into either mPFC or OFC, indicating that neither of these prefrontal regions alone may mediate the systemic effect of ADHD medications on impulsive choice. However, quinpriole (1.25μg) and eticlopride infused into mPFC increased impulsive choice, whereas 8-OH-DPAT infused into OFC decreased impulsive choice. These latter results demonstrate that blockade of DA D2 receptors in mPFC or activation of 5-HT1A receptors in OFC increases impulsive choice in the adjusting delay procedure.

The role of dopamine in risk taking: a specific look at Parkinson's disease and gambling

An influential model suggests that dopamine signals the difference between predicted and experienced reward. In this way, dopamine can act as a learning signal that can shape behaviors to maximize rewards and avoid punishments. Dopamine is also thought to invigorate reward seeking behavior. Loss of dopamine signaling is the major abnormality in Parkinson’s disease. Dopamine agonists have been implicated in the occurrence of impulse control disorders in Parkinson’s disease patients, the most common being pathological gambling, compulsive sexual behavior, and compulsive buying. Recently, a number of functional imaging studies investigating impulse control disorders in Parkinson’s disease have been published. Here we review this literature, and attempt to place it within a decision-making framework in which potential gains and losses are evaluated to arrive at optimum choices. We also provide a hypothetical but still incomplete model on the effect of dopamine agonist treatment on these value and risk assessments. Two of the main brain structures thought to be involved in computing aspects of reward and loss are the ventral striatum (VStr) and the insula, both dopamine projection sites. Both structures are consistently implicated in functional brain imaging studies of pathological gambling in Parkinson’s disease.

A selective role for dopamine D₄ receptors in modulating reward expectancy in a rodent slot machine task

BACKGROUND

Cognitive distortions regarding gambling outcomes confer vulnerability to pathological gambling. Using a rat slot machine task (rSMT), we previously demonstrated that the nonspecific D₂ agonist quinpirole enhances erroneous expectations of reward on near-miss trials, suggesting a pivotal role for the D₂ receptor family in mediating the near-miss effect. Identifying which receptor subtype is involved could facilitate treatment development for compulsive slot machine play.

METHODS

Thirty-two male Long Evans rats learned the rSMT. Three flashing lights could be set to on or off. A win was signaled if all three lights were set to on, whereas any other light pattern indicated a loss. Rats then chose between responding on the collect lever, which delivered 10 sugar pellets on win trials but a 10-second time penalty on loss trials, or to start a new trial instead. Performance was assessed following systemic administration of selective D₂, D₃, and D₄ receptor ligands.

RESULTS

The selective D₂ antagonist L-741,626, the D₃ antagonist SB-277011-A, and the D₃ agonist PD128,907 had no effect. In contrast, the selective D₄ agonist PD168077 partially mimicked quinpirole's effects, increasing erroneous collect responses on nonwin trials, whereas the D₄ antagonist L-745,870 improved the error rate. L-745,870 was also the only antagonist that could attenuate the deleterious effects of quinpirole.

CONCLUSIONS

The dopamine D₄ receptor is critically involved in signaling reward expectancy in the rSMT. The ability of L-745,870 to reduce the classification of losses as wins suggests that D₄ antagonists could be effective in treating problematic slot machine play.

Nucleus accumbens neurons track behavioral preferences and reward outcomes during risky decision making

BACKGROUND

To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.

METHODS

Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.

RESULTS

At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.

CONCLUSIONS

Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.

Chronic alcohol intake during adolescence, but not adulthood, promotes persistent deficits in risk-based decision making

BACKGROUND

Adolescent alcohol use is a major public health concern and is strongly correlated with the development of alcohol abuse problems in adulthood. Adolescence is characterized by maturation and remodeling of brain regions implicated in decision making and therefore may be uniquely vulnerable to environmental insults such as alcohol exposure. We have previously demonstrated that voluntary alcohol consumption in adolescence results in maladaptive risk-based decision making in adulthood. However, it is unclear whether this effect on risk-based decision making can be attributed to chronic alcohol use in general or to a selective effect of alcohol use during the adolescent period.

METHODS

Ethanol (EtOH) was presented to adolescent (postnatal day [PND] 30 to 49) and adult rats (PND 80 to 99) for 20 days, either 24 hours or 1 h/d, in a gel matrix consisting of distilled water, gelatin, polycose (10%), and EtOH (10%). The 24-hour time course of EtOH intake was measured and compared between adolescent and adult animals. Following 20 days of withdrawal from EtOH, we assessed risk-based decision making with a concurrent instrumental probability-discounting task. Blood EtOH concentrations (BECs) were taken from trunk blood and assessed using the Analox micro-stat GM7 in separate groups of animals at different time points.

RESULTS

Unlike animals exposed to EtOH during adolescence, animals exposed to alcohol during adulthood did not display differences in risk preference compared to controls. Adolescent and adult rats displayed similar EtOH intake levels and patterns when given either 24- or 1-hour access per day. In addition, while both groups reached significant BEC levels, we failed to find a difference between adult and adolescent animals.

CONCLUSIONS

Here, we show that adolescent, but not adult, EtOH intake leads to a persistent increase in risk preference which cannot be attributed to differences in intake levels or BECs attained. Our findings support previous work implicating adolescence as a time period of heightened susceptibility to the long-term negative effects of alcohol exposure.

Dissecting impulsivity and its relationships to drug addictions

Addictions are often characterized as forms of impulsive behavior. That said, it is often noted that impulsivity is a multidimensional construct, spanning several psychological domains. This review describes the relationship between varieties of impulsivity and addiction-related behaviors, the nature of the causal relationship between the two, and the underlying neurobiological mechanisms that promote impulsive behaviors. We conclude that the available data strongly support the notion that impulsivity is both a risk factor for, and a consequence of, drug and alcohol consumption. While the evidence indicating that subtypes of impulsive behavior are uniquely informative--either biologically or with respect to their relationships to addictions--is convincing, multiple lines of study link distinct subtypes of impulsivity to low dopamine D2 receptor function and perturbed serotonergic transmission, revealing shared mechanisms between the subtypes. Therefore, a common biological framework involving monoaminergic transmitters in key frontostriatal circuits may link multiple forms of impulsivity to drug self-administration and addiction-related behaviors. Further dissection of these relationships is needed before the next phase of genetic and genomic discovery will be able to reveal the biological sources of the vulnerability for addiction indexed by impulsivity.

Affective and cognitive mechanisms of risky decision making

The ability to make advantageous decisions under circumstances in which there is a risk of adverse consequences is an important component of adaptive behavior; however, extremes in risk taking (either high or low) can be maladaptive and are characteristic of a number of neuropsychiatric disorders. To better understand the contributions of various affective and cognitive factors to risky decision making, cohorts of male Long-Evans rats were trained in a "Risky Decision making Task" (RDT), in which they made discrete trial choices between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of footshock. Experiment 1 evaluated the relative contributions of the affective stimuli (i.e., punishment vs. reward) to RDT performance by parametrically varying the magnitudes of the footshock and large reward. Varying the shock magnitude had a significant impact on choice of the large, "risky" reward, such that greater magnitudes were associated with reduced choice of the large reward. In contrast, varying the large, "risky" reward magnitude had minimal influence on reward choice. Experiment 2 compared individual variability in RDT performance with performance in an attentional set shifting task (assessing cognitive flexibility), a delayed response task (assessing working memory), and a delay discounting task (assessing impulsive choice). Rats characterized as risk averse in the RDT made more perseverative errors on the set shifting task than did their risk taking counterparts, whereas RDT performance was not related to working memory abilities or impulsive choice. In addition, rats that showed greater delay discounting (greater impulsive choice) showed corresponding poorer performance in the working memory task. Together, these results suggest that reward-related decision making under risk of punishment is more strongly influenced by the punishment than by the reward, and that risky and impulsive decision making are associated with distinct components of executive function.

Adolescent risk taking, cocaine self-administration, and striatal dopamine signaling

Poor decision making and elevated risk taking, particularly during adolescence, have been strongly linked to drug use; however the causal relationships among these factors are not well understood. To address these relationships, a rat model (the Risky Decision-making Task; RDT) was used to determine whether individual differences in risk taking during adolescence predict later propensity for cocaine self-administration and/or whether cocaine self-administration causes alterations in risk taking. In addition, the RDT was used to determine how risk taking is modulated by dopamine signaling, particularly in the striatum. Results from these experiments indicated that greater risk taking during adolescence predicted greater intake of cocaine during acquisition of self-administration in adulthood, and that adult cocaine self-administration in turn caused elevated risk taking that was present following 6 weeks of abstinence. Greater adolescent risk taking was associated with lower striatal D2 receptor mRNA expression, and pharmacological activation of D2/3 receptors in the ventral, but not dorsal, striatum induced a decrease in risk taking. These findings indicate that the relationship between elevated risk taking and cocaine self-administration is bi-directional, and that low striatal D2 receptor expression may represent a predisposing factor for both maladaptive decision making and cocaine use. Furthermore, these findings suggest that striatal D2 receptors represent a therapeutic target for attenuating maladaptive decision making when choices include risk of adverse consequences.

A novel risk-based decision-making paradigm

This paper presents a novel rodent decision-making task that explores uncertainty, independently of expectation and predictability. Using a 5-hole operating box, adult male Wistar rats were given choices between a small certain (safe) food reward and a large uncertain (risk) food reward. We found that animals strongly preferred the safe option when it had a fixed position or was cued with a light in a random placement scheme, but had no preference for safe or risk options when the latter were associated with light. Importantly, when the reward was manipulated animals could perceive alterations in the outcome value and biased their choice pattern to the most profitable option. In addition, we found that the D2/D3 agonist quinpirole biased all decisions toward risk in this paradigm. Finally, a c-fos analysis revealed that several brain areas known to be involved in decision-making mechanisms, including the medial prefrontal cortex, the orbitofrontal cortex, the nucleus accumbens and the striatum, were activated by the task. In summary, this paradigm is a useful and highly reliable tool to explore decision-making processes in contexts of uncertainty.

Testosterone enhances risk tolerance without altering motor impulsivity in male rats

Anabolic-androgenic steroids (AAS) increase impulsive and uncontrolled aggressive ('roid rage) in humans and enhance agonistic behavior in animals. However, the underlying mechanisms for AAS-induced aggression remain unclear. Potential contributing elements include an increase risk-taking and/or motor impulsivity due to AAS. This study addressed the effects of chronic high-dose testosterone on risk tolerance using a risky decision-making task (RDT) and motor impulsivity with a go/no-go task in operant chambers. Male Long-Evans rats were treated for at least 4 weeks with testosterone (7.5mg/kg) or vehicle beginning in late adolescence. Testosterone was used because it is popular among human AAS users. In RDT testing, one lever was paired with delivery of a small "safe" food reward, while the other was paired with a large "risky" reward associated with an increasing risk of footshock (0%, 25%, 50%, 75%, 100%) in successive test blocks. Three shock intensities were used: 1.0, 1.2, and 1.4mA/kg. As shock intensity and risk of shock increased, preference for the lever signifying a large reward significantly declined for both vehicle- and testosterone-treated rats (p<0.05). There was also a significant effect of drug (p<0.05), where testosterone-treated rats showed greater preference for the large reward, compared to vehicle-treated controls. Increased preference for the large reward, despite risk of footshock, is consistent with increased risk tolerance. In go/no-go testing, rats were trained to press a single lever if the go cue was presented (stimulus light) or to refrain from pressing during the no-go cue (tone). There was no effect of testosterone on pre-cue responses, or performance in go and no-go trials. These results suggest that AAS may increase risk-tolerance without altering motor impulsivity.

Impulsivity and risk taking in bipolar disorder and schizophrenia

Impulsive risk taking contributes to deleterious outcomes among clinical populations. Indeed, pathological impulsivity and risk taking are common in patients with serious mental illness, and have severe clinical repercussions including novelty seeking, response disinhibition, aggression, and substance abuse. Thus, the current study seeks to examine self-reported impulsivity (Barratt Impulsivity Scale) and performance-based behavioral risk taking (Balloon Analogue Risk Task) in bipolar disorder and schizophrenia. Participants included 68 individuals with bipolar disorder, 38 with schizophrenia, and 36 healthy controls. Self-reported impulsivity was elevated in the bipolar group compared with schizophrenia patients and healthy controls, who did not differ from each other. On the risk-taking task, schizophrenia patients were significantly more risk averse than the bipolar patients and controls. Aside from the diagnostic group differences, there was a significant effect of antipsychotic (AP) medication within the bipolar group: bipolar patients taking AP medications were more risk averse than those not taking AP medications. This difference in risk taking because of AP medications was not explained by history of psychosis. Similarly, the differences in risk taking between schizophrenia and bipolar disorder were not fully explained by AP effects. Implications for clinical practice and future research are discussed.

What's better for me? Fundamental role for lateral habenula in promoting subjective decision biases

The lateral habenula (LHb) is believed to convey an aversive or “anti-reward” signal, but its contribution to reward-related action selection is unknown. We found that LHb inactivation abolished choice biases, making rats indifferent when choosing between rewards associated with different subjective costs and magnitudes, but not larger/smaller rewards of equal cost. Thus, instead of serving as an aversion center, the evolutionarily-conserved LHb acts as preference center integral for expressing subjective decision biases.

Intersection of effort and risk: ethological and neurobiological perspectives

The physical effort required to seek out and extract a resource is an important consideration for a foraging animal. A second consideration is the variability or risk associated with resource delivery. An intriguing observation from ethological studies is that animals shift their preference from stable to variable food sources under conditions of increased physical effort or falling energetic reserves. Although theoretical models for this effect exist, no exploration into its biological basis has been pursued. Recent advances in understanding the neural basis of effort- and risk-guided decision making suggest that opportunities exist for determining how effort influences risk preference. In this review, we describe the intersection between the neural systems involved in effort- and risk-guided decision making and outline two mechanisms by which effort-induced changes in dopamine release may increase the preference for variable rewards.

Dopamine modulates risk-taking as a function of baseline sensation-seeking trait

Trait sensation-seeking, defined as a need for varied, complex, and intense sensations, represents a relatively underexplored hedonic drive in human behavioral neuroscience research. It is related to increased risk for a range of behaviors including substance use, gambling, and risky sexual practice. Individual differences in self-reported sensation-seeking have been linked to brain dopamine function, particularly at D2-like receptors, but so far no causal evidence exists for a role of dopamine in sensation-seeking behavior in humans. Here, we investigated the effects of the selective D2/D3 agonist cabergoline on performance of a probabilistic risky choice task in healthy humans using a sensitive within-subject, placebo-controlled design. Cabergoline significantly influenced the way participants combined different explicit signals regarding probability and loss when choosing between response options associated with uncertain outcomes. Importantly, these effects were strongly dependent on baseline sensation-seeking score. Overall, cabergoline increased sensitivity of choice to information about probability of winning; while decreasing discrimination according to magnitude of potential losses associated with different options. The largest effects of the drug were observed in participants with lower sensation-seeking scores. These findings provide evidence that risk-taking behavior in humans can be directly manipulated by a dopaminergic drug, but that the effectiveness of such a manipulation depends on baseline differences in sensation-seeking trait. This emphasizes the importance of considering individual differences when investigating manipulation of risky decision-making, and may have relevance for the development of pharmacotherapies for disorders involving excessive risk-taking in humans, such as pathological gambling.

Risk-taking behavior: dopamine D2/D3 receptors, feedback, and frontolimbic activity

Decision-making involves frontolimbic and dopaminergic brain regions, but how prior choice outcomes, dopamine neurotransmission, and frontostriatal activity are integrated to affect choices is unclear. We tested 60 healthy volunteers using the Balloon Analogue Risk Task (BART) during functional magnetic resonance imaging. In the BART, participants can pump virtual balloons to increase potential monetary reward or cash out to receive accumulated reward; each pump presents greater risk and potential reward (represented by the pump number). In a separate session, we measured striatal D2/D3 dopamine receptor binding potential (BPND) with positron emission tomography in 13 of the participants. Losses were followed by fewer risky choices than wins; and during risk-taking after loss, amygdala and hippocampal activation exhibited greater modulation by pump number than after a cash-out event. Striatal D2/D3 BPND was positively related to the modulation of ventral striatal activation when participants decided to cash out and negatively to the number of pumps in the subsequent trial; but negatively related to the modulation of prefrontal cortical activation by pump number when participants took risk, and to overall earnings. These findings provide in vivo evidence for a potential mechanism by which dopaminergic neurotransmission may modulate risk-taking behavior through an interactive system of frontal and striatal activity.

Assaying the effect of levodopa on the evaluation of risk in healthy humans

In humans, dopamine is implicated in reward and risk-based decision-making. However, the specific effects of dopamine augmentation on risk evaluation are unclear. Here we sought to measure the effect of 100 mg oral levodopa, which enhances synaptic release of dopamine, on choice behaviour in healthy humans. We use a paradigm without feedback or learning, which solely isolates effects on risk evaluation. We present two studies (n = 20; n = 20) employing a randomised, placebo-controlled, within-subjects design. We manipulated different dimensions of risk in a controlled economic paradigm. We test effects on risk-reward tradeoffs, assaying both aversion to variance (the spread of possible outcomes) and preference for relative losses and gains (asymmetry of outcomes - skewness), dissociating this from potential non-specific effects on choice randomness using behavioural modelling. There were no systematic effects of levodopa on risk attitudes, either for variance or skewness. However, there was a drift towards more risk-averse behaviour over time, indicating that this paradigm was sensitive to detect changes in risk-preferences. These findings suggest that levodopa administration does not change the evaluation of risk. One possible reason is that dopaminergic influences on decision making may be due to changing the response to reward feedback.

Functional disconnection of the orbitofrontal cortex and basolateral amygdala impairs acquisition of a rat gambling task and disrupts animals' ability to alter decision-making behavior after reinforcer devaluation

An inability to adjust choice preferences in response to changes in reward value may underlie key symptoms of many psychiatric disorders, including chemical and behavioral addictions. We developed the rat gambling task (rGT) to investigate the neurobiology underlying complex decision-making processes. As in the Iowa Gambling task, the optimal strategy is to avoid choosing larger, riskier rewards and to instead favor options associated with smaller rewards but less loss and, ultimately, greater long-term gain. Given the demonstrated importance of the orbitofrontal cortex (OFC) and basolateral amygdala (BLA) in acquisition of the rGT and Iowa Gambling task, we used a contralateral disconnection lesion procedure to assess whether functional connectivity between these regions is necessary for optimal decision-making. Disrupting the OFC-BLA pathway retarded acquisition of the rGT. Devaluing the reinforcer by inducing sensory-specific satiety altered decision-making in control groups. In contrast, disconnected rats did not update their choice preference following reward devaluation, either when the devalued reward was still delivered or when animals needed to rely on stored representations of reward value (i.e., during extinction). However, all rats exhibited decreased premature responding and slower response latencies after satiety manipulations. Hence, disconnecting the OFC and BLA did not affect general behavioral changes caused by reduced motivation, but instead prevented alterations in the value of a specific reward from contributing appropriately to cost-benefit decision-making. These results highlight the role of the OFC-BLA pathway in the decision-making process and suggest that communication between these areas is vital for the appropriate assessment of reward value to influence choice.

Medial prefrontal cortex lesions impair decision-making on a rodent gambling task: reversal by D1 receptor antagonist administration

Decision-making is a complex cognitive process that is impaired in a number of psychiatric disorders. In the laboratory, decision-making is frequently assessed using "gambling" tasks that are designed to simulate real-life decisions in terms of uncertainty, reward and punishment. Here, we investigate whether lesions of the medial prefrontal cortex (PFC) cause impairments in decision-making using a rodent gambling task (rGT). In this task, rats have to decide between 1 of 4 possible options: 2 options are considered "advantageous" and lead to greater net rewards (food pellets) than the other 2 "disadvantageous" options. Once rats attained stable levels of performance on the rGT they underwent sham or excitoxic lesions of the medial PFC and were allowed to recover for 1 week. Following recovery, rats were retrained for 5 days and then the effects of a dopamine D1-like receptor antagonist (SCH23390) or a D2-like receptor antagonist (haloperidol) on performance were assessed. Lesioned rats exhibited impaired decision-making: they made fewer advantageous choices and chose the most optimal choice less frequently than did sham-operated rats. Administration of SCH23390 (0.03 mg/kg), but not haloperidol (0.015-0.03 mg/kg) attenuated the lesion-induced decision-making deficit. These results indicate that the medial PFC is important for decision-making and that excessive signaling at D1 receptors may contribute to decision-making impairments.

Receptor-specific modulation of risk-based decision making by nucleus accumbens dopamine

The nucleus accumbens (NAc) serves as an integral node within cortico-limbic circuitry that regulates various forms of cost-benefit decision making. The dopamine (DA) system has also been implicated in enabling organisms to overcome a variety of costs to obtain more valuable rewards. However, it remains unclear how DA activity within the NAc may regulate decision making involving reward uncertainty. This study investigated the contribution of different DA receptor subtypes in the NAc to risk-based decision making, assessed with a probabilistic discounting task. In well-trained rats, D1 receptor blockade with SCH 23,390 decreased preference for larger, uncertain rewards, which was associated with enhanced negative-feedback sensitivity (ie, an increased tendency to select a smaller/certain option after an unrewarded risky choice). Treatment with a D1 agonist (SKF 81,297) optimized decision making, increasing choice of the risky option when reward probability was high, and decreasing preference under low probability conditions. In stark contrast, neither blockade of NAc D2 receptors with eticlopride, nor stimulation of these receptors with quinpirole or bromocriptine influenced risky choice. In comparison, infusion of the D3-preferring agonist PD 128,907 decreased reward sensitivity and risky choice. Collectively, these results show that mesoaccumbens DA refines risk-reward decision biases via dissociable mechanisms recruiting D1 and D3, but not D2 receptors. D1 receptor activity mitigates the effect of reward omissions on subsequent choices to promote selection of reward options that may have greater long-term utility, whereas excessive D3 receptor activity blunts the impact that larger/uncertain rewards have in promoting riskier choices.