Contributions of medial prefrontal cortex to decision making involving risk of punishment

Effects of maternal separation on punishment-driven risky decision making in adolescence and adulthood

Early life adversity (ELA) is associated with a multitude of neural and behavioral aberrations. To develop treatments to mitigate the effects of ELA, it is critical to determine which aspects of cognition are affected and when these disturbances manifest across the lifespan. Here, we tested the effects of maternal separation, an established rodent model of ELA, on punishment-driven risky decision-making longitudinally in both adolescence (25-55 days old) and adulthood (80-100 days old). Risk-taking was assessed with the Risky Decision-making Task, wherein rats choose between a small, safe reward and a large reward accompanied by an escalating risk of punishment (foot shock). We observed that rats exposed to maternal separation were more prone to risk-taking than controls during adolescence, and demonstrated reduced latency to make both risky and safe decisions. Interestingly, this augmented risk-taking was no longer evident in adulthood. Males and females displayed comparable levels of risk-taking during adolescence then diverged in adulthood, with adult males displaying a sharp increase in risk-taking. Finally, we observed that risk-taking changed across the lifespan in rats exposed to maternal separation, but not in control rats. Collectively, these data reveal that ELA engenders risk-taking in adolescence but not adulthood, and that sex differences in risky decision-making are not evident until adulthood. This has important implications for the development of both behavioral and biological treatments to improve decision-making during the vulnerable adolescent period.

Orbitofrontal and Prelimbic Cortices Serve Complementary Roles in Adapting Reward Seeking to Learned Anxiety

BACKGROUND

Anxiety is a common symptom of several mental health disorders and adversely affects motivated behaviors. Anxiety can emerge from associating risk of future harm while engaged in goal-guided actions. Using a recently developed behavioral paradigm to model this aspect of anxiety, we investigated the role of 2 cortical subregions, the prelimbic medial frontal cortex (PL) and lateral orbitofrontal cortex (lOFC), which have been implicated in anxiety and outcome expectation, in flexible representation of actions associated with harm risk.

METHODS

A seek-take reward-guided instrumental task design was used to train animals (N = 8) to associate the seek action with a variable risk of punishment. After learning, animals underwent extinction training for this association. Fiber photometry was used to measure and compare neuronal activity in the PL and lOFC during learning and extinction.

RESULTS

Animals increased action suppression in response to punishment contingencies. This increase dissipated after extinction training. These behavioral changes were associated with region-specific changes in neuronal activity. PL neuronal activity preferentially adapted to the threat of punishment, whereas lOFC activity adapted to safe aspects of the task. Moreover, correlated activity between these regions was suppressed during actions associated with harm risk, suggesting that these regions may guide behavior independently under anxiety.

CONCLUSIONS

These findings suggest that the PL and lOFC serve distinct but complementary roles in the representation of learned anxiety. This dissociation may provide a mechanism to explain how overlapping cortical systems are implicated in reward-guided action execution during anxiety.

Dissociable Roles of the mPFC-to-VTA Pathway in the Control of Impulsive Action and Risk-Related Decision-Making in Roman High- and Low-Avoidance Rats

BACKGROUND

Impulsive action and risk-related decision-making (RDM) are associated with various psychiatric disorders, including drug abuse. Both behavioral traits have also been linked to reduced frontocortical activity and alterations in dopamine function in the ventral tegmental area (VTA). However, despite direct projections from the medial prefrontal cortex (mPFC) to the VTA, the specific role of the mPFC-to-VTA pathway in controlling impulsive action and RDM remains unexplored.

METHODS

We used positron emission tomography with [18F]-fluorodeoxyglucose to evaluate brain metabolic activity in Roman high- (RHA) and low-avoidance (RLA) rats, which exhibit innate differences in impulsive action and RDM. Notably, we used a viral-based double dissociation chemogenetic strategy to isolate, for the first time to our knowledge, the role of the mPFC-to-VTA pathway in controlling these behaviors. We selectively activated the mPFC-to-VTA pathway in RHA rats and inhibited it in RLA rats, assessing the effects on impulsive action and RDM in the rat gambling task.

RESULTS

Our results showed that RHA rats displayed higher impulsive action, less optimal decision-making, and lower cortical activity than RLA rats at baseline. Chemogenetic activation of the mPFC-to-VTA pathway reduced impulsive action in RHA rats, whereas chemogenetic inhibition had the opposite effect in RLA rats. However, these manipulations did not affect RDM. Thus, by specifically targeting the mPFC-to-VTA pathway in a phenotype-dependent way, we reverted innate patterns of impulsive action but not RDM.

CONCLUSION

Our findings suggest a dissociable role of the mPFC-to-VTA pathway in impulsive action and RDM, highlighting its potential as a target for investigating impulsivity-related disorders.

Activation of the mPFC-NAc Pathway Reduces Motor Impulsivity but Does Not Affect Risk-Related Decision-Making in Innately High-Impulsive Male Rats

Attention-deficit/hyperactivity disorder (ADHD) and substance use disorders (SUD) are characterized by exacerbated motor and risk-related impulsivities, which are associated with decreased cortical activity. In rodents, the medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been separately implicated in impulsive behaviors, but studies on the specific role of the mPFC-NAc pathway in these behaviors are limited. Here, we investigated whether heightened impulsive behaviors are associated with reduced mPFC activity in rodents and determined the involvement of the mPFC-NAc pathway in motor and risk-related impulsivities. We used the Roman High- (RHA) and Low-Avoidance (RLA) rat lines, which display divergent phenotypes in impulsivity. To investigate alterations in cortical activity in relation to impulsivity, regional brain glucose metabolism was measured using positron emission tomography and [18F]-fluorodeoxyglucose ([18F]FDG). Using chemogenetics, the activity of the mPFC-NAc pathway was either selectively activated in high-impulsive RHA rats or inhibited in low-impulsive RLA rats, and the effects of these manipulations on motor and risk-related impulsivity were concurrently assessed using the rat gambling task. We showed that basal [18F]FDG uptake was lower in the mPFC and NAc of RHA compared to RLA rats. Activation of the mPFC-NAc pathway in RHA rats reduced motor impulsivity, without affecting risk-related decision-making. Conversely, inhibition of the mPFC-NAc pathway had no effect in RLA rats. Our results suggest that the mPFC-NAc pathway controls motor impulsivity, but has limited involvement in risk-related decision-making in our current model. Our findings suggest that reducing fronto-striatal activity may help attenuate motor impulsivity in patients with impulse control dysregulation.

Impaired neuronal macroautophagy in the prelimbic cortex contributes to comorbid anxiety-like behaviors in rats with chronic neuropathic pain

A large proportion of patients with chronic pain experience co-morbid anxiety. The medial prefrontal cortex (mPFC) is proposed to underlie this comorbidity, but the molecular and neuronal mechanisms are not fully understood. Here, we reported that impaired neuronal macroautophagy in the prelimbic cortical (PrL) subregion of the mPFC paralleled the occurrence of anxiety-like behaviors in rats with chronic spared nerve injury (SNI). Intriguingly, such macroautophagy impairment was mainly observed in a FOS/c-Fos+ neuronal subpopulation in the PrL. Chemogenetic inactivation of this comorbid anxiety-related neuronal ensemble relieved pain-induced anxiety-like behaviors. Rescuing macroautophagy impairment in this neuronal ensemble relieved chronic pain-associated anxiety and mechanical allodynia and restored synaptic homeostasis at the molecular level. By contrast, artificial disruption of macroautophagy induced early-onset co-morbid anxiety in neuropathic rats, but not general anxiety in normal rats. Taken together, our work identifies causal linkage between PrL neuronal macroautophagy dysfunction and comorbid anxiety in neuropathic pain and provides novel insights into the role of PrL by differentiating its contribution in pain-induced comorbid anxiety from its modulation over general anxiety-like behaviors.Abbreviation: AAV: adeno-associated viruses; ACC: anterior cingulate cortex; ATG5: autophagy related 5; ATG7: autophagy related 7; ATG12: autophagy related 12; CAMK2/CaMKII: calcium/calmodulin-dependent protein kinase II; CNO: clozapine-N-oxide; CQ: chloroquine; DIA: data independent acquisition; DIO: double floxed inverse orf; DLG4/PSD-95: discs large MAGUK scaffold protein 4; Dox: doxycycline; GABA: γ-aminobutyric acid; GFP: green fluorescent protein; GO: gene ontology; Gi: inhibitory guanine nucleotide-binding proteins; HsCHRM4/M4D: human cholinergic receptor muscarinic 4; HsSYN: human synapsin; KEGG: Kyoto encyclopedia of genes and genomes; LAMP1: lysosomal-associated membrane protein 1; LC3-II: PE conjugated microtubule-associated protein 1 light chain3; MAP1LC3/LC3: microtubule-associated protein 1 light chain 3; mPFC: medial prefrontal cortex; P2A: 2A self-cleaving peptide; PPI: protein-protein interaction networks; PrL: prelimbic cortex; RBFOX3/NeuN: RNA binding protein, fox-1 homolog (C. elegans) 3; rtTA: reverse tetracycline-transactivator; SDS-PAGE: sodium dodecylsulfate-polyacrylamide gel electrophoresis; SHANK3: SH3 and multiple ankyrin repeat domains 3; SLC1A1/EAAC1: solute carrier family 1 (neuronal/epithelial high affinity glutamate transporter, systemXag), member 1; SNAP23: synaptosomal-associated protein 23; SNI:spared nerve injury; SQSTM1/p62: sequestosome 1; SYT3: synaptotagmin 3; TRE: tetracycline-responsive element; TRE3G: third-generation tetracycline-responsive element.

Methamphetamine increases risky choice in rats, but only when magnitude and probability of reinforcement are manipulated within a session

Risky choice is associated with maladaptive behaviors, particularly substance use disorders. Current animal models of risky choice are often confounded by other constructs like behavioral flexibility and suboptimal choice. The purpose of the current experiment was to determine if the psychostimulant methamphetamine, a drug whose popularity has increased in recent years, increases risky choice in an equivalent expected value (EEV) task. In the EEV task, rats are given a choice between two reinforcer alternatives that differ in magnitude and probability of delivery, but have equivalent expected value. Forty-eight Sprague Dawley rats were tested in three versions of the EEV task. In the first version of the EEV task, both reinforcer magnitude and probability were adjusted across blocks of trials for both alternatives. In the second and the third versions of the EEV task, reinforcer magnitude was held constant across each block of trials (either 1 vs. 2 pellets or 4 vs. 5 pellets). We found that male rats preferred the "riskier" option, except when reinforcer magnitudes were held constant at 4 and 5 pellets across each block of trials. Methamphetamine (0.5 mg/kg) increased preference for the risky option in both males and females, but only when both reinforcer magnitude and probability were manipulated across blocks of trials for each alternative. The current results demonstrate that both magnitude of reinforcement and probability of reinforcement interact to influence risky choice. Overall, this study provides additional support for using reinforcers with expected value to measure risky choice.

Acute stress differentially alters reward-related decision making and inhibitory control under threat of punishment

Acute stress has various effects on cognition, executive function and certain forms of cost/benefit decision making. Recent studies in rodents indicate that acute stress differentially alters reward-related decisions involving particular types of costs and slows choice latencies. Yet, how stress alters decisions where rewards are linked to punishment is less clear. We examined how 1 h restraint stress, followed by behavioral testing 10 min later altered action-selection on two tasks involving reward-seeking under threat of punishment in well-trained male and female rats. One study used a risky decision-making task involving choice between a small/safe reward and a large/risky one that could coincide with shock, delivered with a probability that increased over blocks of trials. Stress increased risk aversion and punishment sensitivity, reducing preference for the larger/risky reward, while increasing decision latencies and trial omissions in both sexes, when rats were teste. A second study used a "behavioral control" task, requiring inhibition of approach towards a readily available reward associated with punishment. Here, food pellets were delivered over discrete trials, half of which coincided with a 12 s audiovisual cue, signalling that reward retrieval prior to cue termination would deliver shock. Stress exerted sex- and timing-dependent effects on inhibitory control. Males became more impulsive and received more shocks on the stress test, whereas females were unaffected on the stress test, and were actually less impulsive when tested 24 h later. None of the effects of restraint stress were recapitulated by systemic treatment with physiological doses of corticosterone. These findings suggest acute stress induces qualitatively distinct and sometimes sex-dependent effects on punished reward-seeking that are critically dependent on whether animals must either choose between different actions or withhold them to obtain rewards and avoid punishment.

Lateral Orbitofrontal Cortex Encodes Presence of Risk and Subjective Risk Preference During Decision-Making

Adaptive decision-making requires consideration of objective risks and rewards associated with each option, as well as subjective preference for risky/safe alternatives. Inaccurate risk/reward estimations can engender excessive risk-taking, a central trait in many psychiatric disorders. The lateral orbitofrontal cortex (lOFC) has been linked to many disorders associated with excessively risky behavior and is ideally situated to mediate risky decision-making. Here, we used single-unit electrophysiology to measure neuronal activity from lOFC of freely moving rats performing in a punishment-based risky decision-making task. Subjects chose between a small, safe reward and a large reward associated with either 0% or 50% risk of concurrent punishment. lOFC activity repeatedly encoded current risk in the environment throughout the decision-making sequence, signaling risk before, during, and after a choice. In addition, lOFC encoded reward magnitude, although this information was only evident during action selection. A Random Forest classifier successfully used neural data accurately to predict the risk of punishment in any given trial, and the ability to predict choice via lOFC activity differentiated between and risk-preferring and risk-averse rats. Finally, risk preferring subjects demonstrated reduced lOFC encoding of risk and increased encoding of reward magnitude. These findings suggest lOFC may serve as a central decision-making hub in which external, environmental information converges with internal, subjective information to guide decision-making in the face of punishment risk.

Choice impulsivity after repeated social stress is associated with increased perineuronal nets in the medial prefrontal cortex

Repeated stress can predispose to substance abuse. However, behavioral and neurobiological adaptations that link stress to substance abuse remain unclear. This study investigates whether intermittent social defeat (ISD), a stress protocol that promotes drug-seeking behavior, alters intertemporal decision-making and cortical inhibitory function in the medial prefrontal cortex (mPFC). Male long evans rats were trained in a delay discounting task (DDT) where rats make a choice between a fast (1 s) small reward (1 sugar pellet) and a large reward (3 sugar pellets) that comes with a time delay (10 s or 20 s). A decreased preference for delayed rewards was used as an index of choice impulsivity. Rats were exposed to ISD and tested in the DDT 24 h after each stress episode, and one- and two-weeks after the last stress episode. Immunohistochemistry was performed in rat's brains to evaluate perineuronal nets (PNNs) and parvalbumin GABA interneurons (PV) labeling as markers of inhibitory function in mPFC. ISD significantly decreased the preference for delayed large rewards in low impulsive, but not high impulsive, animals. ISD also increased the density of PNNs in the mPFC. These results suggest that increased choice impulsivity and cortical inhibition predispose animals to seek out rewards after stress.

Purposive decision-making task in mice using touchscreen operant apparatus

Purposive decision-making, based on sensory input and memory, is a component of executive functioning. Evaluating executive functioning is crucial for understanding neuropsychiatric disorders and brain injuries. However, there's a lack of mouse tests for this purpose. To address this, we developed a novel touchscreen task to assess purposive decision-making in mice. In the present task, the mice had to touch the correct window (left or right), with a visual stimulus as a cue for decision-making. The mice gradually acquired a relationship between the visual stimuli and the action they should take. Each mouse made the correct choice more than 80% of the time based on the visual cue and memory and knowledge of themselves. We could clearly determine when the mice saw the visual cue. The present task offers a valuable tool for investigating the neural mechanisms behind decision-making.

Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation

BACKGROUND

Acute stress alters risk-based decision-making; however, the underlying neural and neurochemical substrates are underexplored. Given their well-documented stress-inducing effects in humans and laboratory animals, glucocorticoids such as cortisol and corticosterone and the α2-adrenoceptor antagonist yohimbine represent potent pharmacological tools to mimic some characteristics of acute stress.

METHODS

Here, we analyzed the effects of the pharmacological stressors corticosterone and yohimbine given systemically on risk-based decision-making in male rats. Moreover, we investigated whether pharmacological stressor effects on risk-based decision-making involve dopamine D1 receptor stimulation in the dorsal prelimbic cortex (PL). We used a risk discounting task that requires choosing between a certain/small reward lever that always delivered 1 pellet and a risky/large reward lever that delivered 4 pellets with a decreasing probability across subsequent trials.

RESULTS

Systemic administration of yohimbine increased the preference for the risky/large reward lever. By contrast, systemic single administration of corticosterone did not significantly promote risky choice. Moreover, co-administration of corticosterone did not enhance the effects of yohimbine on risky choice. The data further show that the increased preference for the risky/large reward lever under systemic yohimbine was lowered by a concurrent pharmacological blockade of dopamine D1 receptors in the PL.

CONCLUSIONS

Our rodent data provide causal evidence that stimulation of PL D1 receptors may represent a neurochemical mechanism by which the acute pharmacological stressor yohimbine, and possibly nonpharmacological stressors as well, promote risky choice.

Effects of reproductive experience on cost-benefit decision making in female rats

Many individuals undergo mating and/or other aspects of reproductive experience at some point in their lives, and pregnancy and childbirth in particular are associated with alterations in the prevalence of several psychiatric disorders. Research in rodents shows that maternal experience affects spatial learning and other aspects of hippocampal function. In contrast, there has been little work in animal models concerning how reproductive experience affects cost-benefit decision making, despite the relevance of this aspect of cognition for psychiatric disorders. To begin to address this issue, reproductively experienced (RE) and reproductively naïve (RN) female Long-Evans rats were tested across multiple tasks that assess different forms of cost-benefit decision making. In a risky decision-making task, in which rats chose between a small, safe food reward and a large food reward accompanied by variable probabilities of punishment, RE females chose the large risky reward significantly more frequently than RN females (greater risk taking). In an intertemporal choice task, in which rats chose between a small, immediate food reward and a large food reward delivered after a variable delay period, RE females chose the large reward less frequently than RN females. Together, these results show distinct effects of reproductive experience on different forms of cost-benefit decision making in female rats, and highlight reproductive status as a variable that could influence aspects of cognition relevant for psychiatric disorders.

Effects of fentanyl self-administration on risk-taking behavior in male rats

RATIONALE

Individuals with opioid use disorder (OUD) exhibit impaired decision making and elevated risk-taking behavior. In contrast to the effects of natural and semi-synthetic opioids, however, the impact of synthetic opioids on decision making is still unknown.

OBJECTIVES

The objective of the current study was to determine how chronic exposure to the synthetic opioid fentanyl alters risk-based decision making in adult male rats.

METHODS

Male rats underwent 14 days of intravenous fentanyl or oral sucrose self-administration. After 3 weeks of abstinence, rats were tested in a decision-making task in which they chose between a small, safe food reward and a large food reward accompanied by variable risk of footshock punishment. Following testing in the decision-making task, rats were tested in control assays that assessed willingness to work for food and shock reactivity. Lastly, rats were tested on a probabilistic reversal learning task to evaluate enduring effects of fentanyl on behavioral flexibility.

RESULTS

Relative to rats in the sucrose group, rats in the fentanyl group displayed greater choice of the large, risky reward (risk taking), an effect that was present as long as 7 weeks into abstinence. This increased risk taking was driven by enhanced sensitivity to the large rewards and diminished sensitivity to punishment. The fentanyl-induced elevation in risk taking was not accompanied by alterations in food motivation or shock reactivity or impairments in behavioral flexibility.

CONCLUSIONS

Results from the current study reveal that the synthetic opioid fentanyl leads to long-lasting increases in risk taking in male rats. Future experiments will extend this work to females and identify neural mechanisms that underlie these drug-induced changes in risk taking.

Cocaine intake correlates with risk-taking behavior and affects estrous cycling in female Sprague-Dawley rats

Navigating complex decisions and considering their relative risks and rewards is an important cognitive ability necessary for survival. However, use of and dependence on illicit drugs can result in long-lasting changes to this risk/reward calculus in individuals with substance use disorder. Recent work has shown that chronic exposure to cocaine causes long-lasting increases in risk taking in male and female rats, but there are still significant gaps in our understanding of the relationship between cocaine use and changes in risk taking. For example, it is unclear whether the magnitude of cocaine intake dictates the extent to which risk taking is altered. To address this, male and female Sprague-Dawley rats underwent cocaine (or sucrose) self-administration and, following a period of abstinence, were trained and tested in a rodent model of risky decision making. In this behavioral task, rats made discrete-trial choices between a lever associated with a small food reward (i.e., "safe" option) and a lever associated with a larger food reward accompanied by a variable risk of footshock delivery (i.e., "risky" option). Surprisingly, and in contrast to prior work in Long-Evans rats, there were no effects of cocaine self-administration on choice of the large, risky reward (i.e., risk taking) during abstinence in males or females. There was, however, a significant relationship between cocaine intake and risk taking in female rats, with greater intake associated with greater preference for the large, risky reward. Relative to their sucrose counterparts, female rats in the cocaine group also exhibited irregular estrous cycles, characterized by prolonged estrus and/or diestrus phases. Collectively, these data suggest that there may be strain differences in the effects of cocaine on risk taking and highlight the impact that chronic cocaine exposure has on hormonal cyclicity in females. Future work will focus on understanding the neural mechanisms underlying cocaine's intake-dependent effects on risk taking in females, and whether this is directly related to cocaine-induced alterations in neuroendocrine function.

Circuit and Cell-Specific Contributions to Decision Making Involving Risk of Explicit Punishment in Male and Female Rats

Decision making is a complex cognitive process that recruits a distributed network of brain regions, including the basolateral amygdala (BLA) and nucleus accumbens shell (NAcSh). Recent work suggests that communication between these structures, as well as activity of cells expressing dopamine (DA) D2 receptors (D2R) in the NAcSh, are necessary for some forms of decision making; however, the contributions of this circuit and cell population during decision making under risk of punishment are unknown. The current experiments addressed this question using circuit-specific and cell type-specific optogenetic approaches in rats during a decision making task involving risk of punishment. In experiment 1, Long-Evans rats received intra-BLA injections of halorhodopsin or mCherry (control) and in experiment 2, D2-Cre transgenic rats received intra-NAcSh injections of Cre-dependent halorhodopsin or mCherry. Optic fibers were implanted in the NAcSh in both experiments. Following training in the decision making task, BLA→NAcSh or D2R-expressing neurons were optogenetically inhibited during different phases of the decision process. Inhibition of the BLA→NAcSh during deliberation (the time between trial initiation and choice) increased preference for the large, risky reward (increased risk taking). Similarly, inhibition during delivery of the large, punished reward increased risk taking, but only in males. Inhibition of D2R-expressing neurons in the NAcSh during deliberation increased risk taking. In contrast, inhibition of these neurons during delivery of the small, safe reward decreased risk taking. These findings extend our knowledge of the neural dynamics of risk taking, revealing sex-dependent circuit recruitment and dissociable activity of selective cell populations during decision making.SIGNIFICANCE STATEMENT Until recently, the ability to dissect the neural substrates of decision making involving risk of punishment (risk taking) in a circuit-specific and cell-specific manner has been limited by the tools available for use in rats. Here, we leveraged the temporal precision of optogenetics, together with transgenic rats, to probe contributions of a specific circuit and cell population to different phases of risk-based decision making. Our findings reveal basolateral amygdala (BLA)→nucleus accumbens shell (NAcSh) is involved in evaluation of punished rewards in a sex-dependent manner. Further, NAcSh D2 receptor (D2R)-expressing neurons make unique contributions to risk taking that vary across the decision making process. These findings advance our understanding of the neural principles of decision making and provide insight into how risk taking may become compromised in neuropsychiatric diseases.

The differential neural substrates for reward choice under gain-loss contexts and risk in alcohol use disorder: Evidence from a voxel-based meta-analysis

BACKGROUND

Making a risky decision is a complex process that involves the evaluation of both the values of the options and the associated risk level; this process is distinct from reward processing in gain versus loss contexts. Although disrupted reward processing in mesolimbic dopamine circuitry is suggested to underlie pathological incentive processing in patients with alcohol use disorder (AUD), the differential neural processes subserving these motivational tendencies for risk situations or gain/loss choices in decision-making have not been identified.

METHODS

To examine the common or distinct neural mechanisms in the evaluation of risk versus outcomes for AUD, we conducted two separate coordinate-based meta-analyses of functional neuroimaging studies by using Seed-Based d Mapping software to evaluate 13 studies investigating gain and loss processing and 10 studies investigating risky decision-making.

RESULTS

During gain and loss processing, relative to healthy controls, AUD patients showed reduced activation in the mesocortical-limbic circuit, including the orbital prefrontal cortex (OFC), dorsal striatum, insula, hippocampus, cerebellum, cuneus cortex and superior temporal gyrus, but hyperactivation in the inferior temporal gyrus and paracentral lobule (extending to the middle cingulate cortex (MCC) and precuneus). During decision-making under risk, AUD patients exhibited hypoactivity of the prefrontal and cingulate cortices, including the posterior cingulate cortex (extending to the MCC), middle frontal gyrus, medial prefrontal cortex, dorsolateral prefrontal cortex, OFC and anterior cingulate cortex.

CONCLUSIONS

Our results extend existing neurological evidence by showing that a reduced response in the mesocortical-limbic circuit is found in gain versus loss processing, with decreased responsivity in cortical regions in risk decision-making. Our results implicate dissociable neural circuit responses for gain-loss processing and risk decision-making, which contribute to a better understanding of the pathophysiological mechanism underlying nondrug incentive and risk processing in individuals with AUD.

Temporal Dynamics Underlying Prelimbic Prefrontal Cortical Regulation of Action Selection and Outcome Evaluation during Risk/Reward Decision-Making

Risk/reward decision-making is a dynamic process that includes periods of deliberation before action selection and evaluation of the action outcomes that bias subsequent choices. Inactivation of the prelimbic (PL) cortex has revealed its integral role in updating decision biases in the face of changes in probabilistic reward contingencies, yet how phasic PL signals during different phases of the decision process influence choice remains unclear. We used temporally specific optogenetic inhibition to selectively disrupt PL activity coinciding with action selection and outcome phases to examine how these signals influence choice. Male rats expressing the inhibitory opsin eArchT within PL excitatory neurons were well trained on a probabilistic discounting task, entailing choice between small/certain versus large/risky rewards, the probability of which varied over a session (50-12.5%). During testing, brief light pulses suppressed PL activity before choice or after different outcomes. Prechoice suppression reduced bias toward more preferred/higher utility options and disrupted how recent outcomes influenced subsequent choice. Inhibition during risky losses induced a similar profile, but here, the impact of reward omissions were either amplified or diminished, relative to the context of the estimated profitability of the risky option. Inhibition during large or small reward receipt reduced risky choice when this option was more profitable, suggesting these signals can both reinforce rewarded risky choices and also act as a relative value comparator signal that augments incentive for larger rewards. These findings reveal multifaceted contributions by the PL in implementing decisions and integrating action-outcome feedback to assign context to the decision space.SIGNIFICANCE STATEMENT The PL prefrontal cortex plays an integral role in guiding risk/reward decisions, but how activity in this region during different phases of the decision process influences choice is unclear. By using temporally specific optogenetic manipulations of this activity, the present study unveiled previously uncharacterized and differential contributions by PL in implementing decision policies and how evaluation of decision outcomes shape subsequent choice. These findings provide novel insight into the dynamic processes engaged by the PL that underlie action selection in situations involving reward uncertainty that may aid in understanding the mechanism underlying normal and aberrant decision-making processes.

Age-Related Changes in Risky Decision Making and Associated Neural Circuitry in a Rat Model

Altered decision making at advanced ages can have a significant impact on an individual's quality of life and the ability to maintain personal independence. Relative to young adults, older adults make less impulsive and less risky choices; although these changes in decision making could be considered beneficial, they can also lead to choices with potentially negative consequences (e.g., avoidance of medical procedures). Rodent models of decision making have been invaluable for dissecting cognitive and neurobiological mechanisms that contribute to age-related changes in decision making, but they have predominantly used costs related to timing or probability of reward delivery and have not considered other equally important costs, such as the risk of adverse consequences. The current study therefore used a rat model of decision making involving risk of explicit punishment to examine age-related changes in this form of choice behavior in male rats, and to identify potential cognitive and neurobiological mechanisms that contribute to these changes. Relative to young rats, aged rats displayed greater risk aversion, which was not attributable to reduced motivation for food, changes in shock sensitivity, or impaired cognitive flexibility. Functional MRI analyses revealed that, overall, functional connectivity was greater in aged rats compared with young rats, particularly among brain regions implicated in risky decision making such as basolateral amygdala, orbitofrontal cortex, and ventral tegmental area. Collectively, these findings are consistent with greater risk aversion found in older humans, and reveal age-related changes in brain connectivity.

Differential transcriptome profile underlying risky choice in a rat gambling task

BACKGROUND AND AIMS

Proper measurement of expected risk is important for making rational decisions, and maladaptive decision making may underlie various psychiatric disorders. However, differentially expressed genetic profiling involved in this process is still largely unknown. A rodent version of the gambling task (rGT) has been developed to measure decision-making by adopting the same principle of Iowa Gambling Task in humans. In the present study, we examined using next-generation sequencing (NGS) technique whether there are differences in gene expression profiles in the medial prefrontal cortex (mPFC) and the nucleus accumbens (NAc) when rats make different choices toward risk in rGT.

METHODS

Rats were trained in a touch screen chamber to learn the relationships between 4 different light signals on the window of the screen and accompanied reward outcomes or punishments set up with different magnitudes and probabilities. Once they showed a stabilized pattern of preference upon free choice, rats were classified into risk-averse or risk-seeking groups. After performing the rGT, rats were decapitated, the mPFC and the NAc was dissected out, and NGS was performed with the total RNA extracted.

RESULTS

We found that 477 and 36 genes were differentially expressed (approximately 75 and 83% out of them were downregulated) in the mPFC and the NAc, respectively, in risk-seeking compared to risk-averse rats. Among those, we suggested a few top ranked genes that may contribute to promoting risky choices.

DISCUSSION AND CONCLUSIONS

Our findings provide insights into transcriptional components underlying risky choices in rats.

Lateral Orbitofrontal Cortex and Basolateral Amygdala Regulate Sensitivity to Delayed Punishment during Decision-making

In real-world decision-making scenarios, negative consequences do not always occur immediately after a choice. This delay between action and outcome drives the underestimation, or "delay discounting", of punishment. While the neural substrates underlying sensitivity to immediate punishment have been well-studied, there has been minimal investigation of delayed consequences. Here, we assessed the role of lateral orbitofrontal cortex (LOFC) and basolateral amygdala (BLA), two regions implicated in cost/benefit decision-making, in sensitivity to delayed vs immediate punishment. The delayed punishment decision-making task (DPDT) was used to measure delay discounting of punishment in rodents. During DPDT, rats choose between a small, single pellet reward and a large, three pellet reward accompanied by a mild foot shock. As the task progresses, the shock is preceded by a delay that systematically increases or decreases throughout the session. We observed that rats avoid choices associated with immediate punishment, then shift preference toward these options when punishment is delayed. LOFC inactivation did not influence choice of rewards with immediate punishment, but decreased choice of delayed punishment. We also observed that BLA inactivation reduced choice of delayed punishment for ascending but not descending delays. Inactivation of either brain region produced comparable effects on decision-making in males and females, but there were sex differences observed in omissions and latency to make a choice. In summary, both LOFC and BLA contribute to the delay discounting of punishment and may serve as promising therapeutic targets to improve sensitivity to delayed punishment during decision-making.Significance StatementNegative consequences occurring after a delay are often underestimated, which can lead to maladaptive decision-making. While sensitivity to immediate punishment during reward-seeking has been well-studied, the neural substrates underlying sensitivity to delayed punishment remain unclear. Here, we used the Delayed Punishment Decision-making Task to determine that lateral orbitofrontal cortex and basolateral amygdala both regulate the discounting of delayed punishment, suggesting that these regions may be potential targets to improve decision-making in psychopathology.

Regulation of sex differences in risk-based decision making by gonadal hormones: Insights from rodent models

Men and women differ in their ability to evaluate options that vary in their rewards and the risks that are associated with these outcomes. Most studies have shown that women are more risk averse than men and that gonadal hormones significantly contribute to this sex difference. Gonadal hormones can influence risk-based decision making (i.e., risk taking) by modulating the neurobiological substrates underlying this cognitive process. Indeed, estradiol, progesterone and testosterone modulate activity in the prefrontal cortex, amygdala and nucleus accumbens associated with reward and risk-related information. The use of animal models of decision making has advanced our understanding of the intersection between the behavioral, neural and hormonal mechanisms underlying sex differences in risk taking. This review will outline the current state of this literature, identify the current gaps in knowledge and suggest the neurobiological mechanisms by which hormones regulate risky decision making. Collectively, this knowledge can be used to understand the potential consequences of significant hormonal changes, whether endogenously or exogenously induced, on risk-based decision making as well as the neuroendocrinological basis of neuropsychiatric diseases that are characterized by impaired risk taking, such as substance use disorder and schizophrenia.

The Neuromodulatory Role of the Noradrenergic and Cholinergic Systems and Their Interplay in Cognitive Functions: A Focused Review

The noradrenergic and cholinergic modulation of functionally distinct regions of the brain has become one of the primary organizational principles behind understanding the contribution of each system to the diversity of neural computation in the central nervous system. Decades of work has shown that a diverse family of receptors, stratified across different brain regions, and circuit-specific afferent and efferent projections play a critical role in helping such widespread neuromodulatory systems obtain substantial heterogeneity in neural information processing. This review briefly discusses the anatomical layout of both the noradrenergic and cholinergic systems, as well as the types and distributions of relevant receptors for each system. Previous work characterizing the direct and indirect interaction between these two systems is discussed, especially in the context of higher order cognitive functions such as attention, learning, and the decision-making process. Though a substantial amount of work has been done to characterize the role of each neuromodulator, a cohesive understanding of the region-specific cooperation of these two systems is not yet fully realized. For the field to progress, new experiments will need to be conducted that capitalize on the modular subdivisions of the brain and systematically explore the role of norepinephrine and acetylcholine in each of these subunits and across the full range of receptors expressed in different cell types in these regions.

Neural Connectivity Underlying Reward and Emotion-Related Processing: Evidence From a Large-Scale Network Analysis

Neuroimaging techniques have advanced our knowledge about neurobiological mechanisms of reward and emotion processing. It remains unclear whether reward and emotion-related processing share the same neural connection topology and how intrinsic brain functional connectivity organization changes to support emotion- and reward-related prioritized effects in decision-making. The present study addressed these challenges using a large-scale neural network analysis approach. We applied this approach to two independent functional magnetic resonance imaging datasets, where participants performed a reward value or emotion associative matching task with tight control over experimental conditions. The results revealed that interaction between the Default Mode Network, Frontoparietal, Dorsal Attention, and Salience networks engaged distinct topological structures to support the effects of reward, positive and negative emotion processing. Detailed insights into the properties of these connections are important for understanding in detail how the brain responds in the presence of emotion and reward related stimuli. We discuss the linking of reward- and emotion-related processing to emotional regulation, an important aspect of regulation of human behavior in relation to mental health.

GABAB receptors in prelimbic cortex and basolateral amygdala differentially influence intertemporal decision making and decline with age

The ability to decide adaptively between immediate vs. delayed gratification (intertemporal choice) is critical for well-being and is associated with a range of factors that influence quality of life. In contrast to young adults, many older adults show enhanced preference for delayed gratification; however, the neural mechanisms underlying this age difference in intertemporal choice are largely un-studied. Changes in signaling through GABA_B receptors (GABA_BRs) mediate several age-associated differences in cognitive processes linked to intertemporal choice. The current study used a rat model to determine how GABA_BRs in two brain regions known to regulate intertemporal choice (prelimbic cortex; PrL and basolateral amygdala; BLA) contribute to age differences in this form of decision making in male rats. As in humans, aged rats showed enhanced preference for large, delayed over small, immediate rewards during performance in an intertemporal choice task in operant test chambers. Activation of PrL GABA_BRs via microinfusion of the agonist baclofen increased choice of large, delayed rewards in young adult rats but did not influence choice in aged rats. Conversely, infusion of baclofen into the BLA strongly reduced choice of large, delayed rewards in both young adult and aged rats. Aged rats further showed a significant reduction in expression of GABA_BR1 subunit isoforms in the prefrontal cortex, a discovery that is consonant with the null effect of intra-PrL baclofen on intertemporal choice in aged rats. In contrast, expression of GABA_BR subunits was generally conserved with age in the BLA. Jointly, these findings elucidate a role for GABA_BRs in intertemporal choice and identify fundamental features of brain maturation and aging that mediate an improved ability to delay gratification.

Neural correlates and determinants of approach-avoidance conflict in the prelimbic prefrontal cortex

The recollection of environmental cues associated with threat or reward allows animals to select the most appropriate behavioral responses. Neurons in the prelimbic (PL) cortex respond to both threat- and reward-associated cues. However, it remains unknown whether PL regulates threat-avoidance vs. reward-approaching responses when an animals’ decision depends on previously associated memories. Using a conflict model in which male Long–Evans rats retrieve memories of shock- and food-paired cues, we observed two distinct phenotypes during conflict: (1) rats that continued to press a lever for food (Pressers) and (2) rats that exhibited a complete suppression in food seeking (Non-pressers). Single-unit recordings revealed that increased risk-taking behavior in Pressers is associated with persistent food-cue responses in PL, and reduced spontaneous activity in PL glutamatergic (PL^GLUT) neurons during conflict. Activating PL^GLUT neurons in Pressers attenuated food-seeking responses in a neutral context, whereas inhibiting PL^GLUT neurons in Non-pressers reduced defensive responses and increased food approaching during conflict. Our results establish a causal role for PL^GLUT neurons in mediating individual variability in memory-based risky decision-making by regulating threat-avoidance vs. reward-approach behaviors.

Aversive stimuli bias corticothalamic responses to motivationally significant cues

Making predictions about future rewards or punishments is fundamental to adaptive behavior. These processes are influenced by prior experience. For example, prior exposure to aversive stimuli or stressors changes behavioral responses to negative- and positive-value predictive cues. Here, we demonstrate a role for medial prefrontal cortex (mPFC) neurons projecting to the paraventricular nucleus of the thalamus (PVT; mPFC→PVT) in this process. We found that a history of aversive stimuli negatively biased behavioral responses to motivationally relevant cues in mice and that this negative bias was associated with hyperactivity in mPFC→PVT neurons during exposure to those cues. Furthermore, artificially mimicking this hyperactive response with selective optogenetic excitation of the same pathway recapitulated the negative behavioral bias induced by aversive stimuli, whereas optogenetic inactivation of mPFC→PVT neurons prevented the development of the negative bias. Together, our results highlight how information flow within the mPFC→PVT circuit is critical for making predictions about motivationally-relevant outcomes as a function of prior experience.

The role of the medial prefrontal cortex in cognition, ageing and dementia

Humans require a plethora of higher cognitive skills to perform executive functions, such as reasoning, planning, language and social interactions, which are regulated predominantly by the prefrontal cortex. The prefrontal cortex comprises the lateral, medial and orbitofrontal regions. In higher primates, the lateral prefrontal cortex is further separated into the respective dorsal and ventral subregions. However, all these regions have variably been implicated in several fronto-subcortical circuits. Dysfunction of these circuits has been highlighted in vascular and other neurocognitive disorders. Recent advances suggest the medial prefrontal cortex plays an important regulatory role in numerous cognitive functions, including attention, inhibitory control, habit formation and working, spatial or long-term memory. The medial prefrontal cortex appears highly interconnected with subcortical regions (thalamus, amygdala and hippocampus) and exerts top-down executive control over various cognitive domains and stimuli. Much of our knowledge comes from rodent models using precise lesions and electrophysiology readouts from specific medial prefrontal cortex locations. Although, anatomical disparities of the rodent medial prefrontal cortex compared to the primate homologue are apparent, current rodent models have effectively implicated the medial prefrontal cortex as a neural substrate of cognitive decline within ageing and dementia. Human brain connectivity-based neuroimaging has demonstrated that large-scale medial prefrontal cortex networks, such as the default mode network, are equally important for cognition. However, there is little consensus on how medial prefrontal cortex functional connectivity specifically changes during brain pathological states. In context with previous work in rodents and non-human primates, we attempt to convey a consensus on the current understanding of the role of predominantly the medial prefrontal cortex and its functional connectivity measured by resting-state functional MRI in ageing associated disorders, including prodromal dementia states, Alzheimer's disease, post-ischaemic stroke, Parkinsonism and frontotemporal dementia. Previous cross-sectional studies suggest that medial prefrontal cortex functional connectivity abnormalities are consistently found in the default mode network across both ageing and neurocognitive disorders such as Alzheimer's disease and vascular cognitive impairment. Distinct disease-specific patterns of medial prefrontal cortex functional connectivity alterations within specific large-scale networks appear to consistently feature in the default mode network, whilst detrimental connectivity alterations are associated with cognitive impairments independently from structural pathological aberrations, such as grey matter atrophy. These disease-specific patterns of medial prefrontal cortex functional connectivity also precede structural pathological changes and may be driven by ageing-related vascular mechanisms. The default mode network supports utility as a potential biomarker and therapeutic target for dementia-associated conditions. Yet, these associations still require validation in longitudinal studies using larger sample sizes.

Reward/Punishment-Based Decision Making in Rodents

Deficits in decision making are at the heart of many psychiatric diseases, such as substance abuse disorders and attention deficit hyperactivity disorder. Consequently, rodent models of decision making are germane to understanding the neural mechanisms underlying adaptive choice behavior and how such mechanisms can become compromised in pathological conditions. A critical factor that must be integrated with reward value to ensure optimal decision making is the occurrence of consequences, which can differ based on probability (risk of punishment) and temporal contiguity (delayed punishment). This article will focus on two models of decision making that involve explicit punishment, both of which recapitulate different aspects of consequences during human decision making. We will discuss each behavioral protocol, the parameters to consider when designing an experiment, and finally how such animal models can be utilized in studies of psychiatric disease. © 2020 Wiley Periodicals LLC. Basic Protocol 1: Behavioral training Support Protocol: Equipment testing Alternate Protocol: Reward discrimination Basic Protocol 2: Risky decision-making task (RDT) Basic Protocol 3: Delayed punishment decision-making task (DPDT).

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Long-term Effects of Maternal Separation on Anxiety-Like Behavior and Neuroendocrine Parameters in Adult Balb/c Mice

Introduction: Disruption of maternal care using maternal separation (MS) models has provided significant evidence of the deleterious long-term effects of early life stress. Several preclinical studies investigating MS showed multiple behavioral and biomolecular alterations. However, there is still conflicting results from MS studies, which represents a challenge for reliability and replicability of those findings. Objective: To address that, this study was conducted to investigate whether MS would affect anxiety-like behaviors using a battery of classical tasks, as well as central and peripheral stress-related biomarkers. Methods: Male Balb/c mice were exposed to MS from postnatal day (PND) 2 to 14 for 180-min per day. Two independent cohorts were performed to evaluate both baseline and anxiety-like behavior responses to MS at PND60. We performed composite scores to evaluate MS effects on anxiety and risk assessment phenotypes. Also, we assessed mRNA gene expression in the medial pre-frontal cortex (mPFC) of glucocorticoid and mineralocorticoid receptors (GR and MR) using real-time PCR and peripheral corticosterone levels (CORT) to investigate possible neurobiological correlates to anxiety behaviors. Results: We found increased anxiety-like behavior and decreased risk assessment and exploratory behaviors in MS mice. The animals exposed to MS also presented a decrease in MR mRNA expression and higher levels of CORT compared to controls. Conclusions: Our findings reinforce the body of evidence suggesting that long-term MS induces effects on anxiety and risk assessment phenotypes following the exposure to a standardized MS protocol. Moreover, MS affected the expression of MR mRNA and induced significant changes on CORT response. This data highlights that the reprograming MS effects on HPA axis could be mediate by MR gene expression in mPFC and chronic overactivity of peripheral CORT levels.

Differential effects of glutamate N-methyl-D-aspartate receptor antagonists on risky choice as assessed in the risky decision task

RATIONALE

Risky choice can be measured using the risky decision task (RDT). In the RDT, animals choose between a large, risky option that is paired with probabilistic foot shock and a small, safe option that is never paired with shock. To date, studies examining the neurochemical basis of decision-making in the RDT have focused primarily on the dopaminergic system but have not focused on the glutamatergic system, which has been implicated in risky decision-making.

OBJECTIVES

Because glutamate is known to play a critical role in decision-making, we wanted to determine the contribution of the glutamatergic system to performance in the RDT.

METHODS

In the experiment, 32 rats (16 male; 16 female) were tested in the RDT. The probability of receiving a foot shock increased across the session (ascending schedule) for half of the rats but decreased across the session (descending schedule) for half of the rats. Following training, rats received injections of the N-methyl-D-aspartate (NMDA) receptor competitive antagonist CGS 19755 (0, 1.0, 2.5, 5.0 mg/kg; s.c.) and the GluN2B-selective antagonist Ro 63-1908 (0, 0.1, 0.3, 1.0 mg/kg; s.c.).

RESULTS

CGS 19755 (2.5 and 5.0 mg/kg) increased risky choice in males and females trained on the ascending schedule. Ro 63-1908 (1.0 mg/kg) decreased risky choice, but only in male rats trained on the ascending schedule.

CONCLUSIONS

Although NMDA receptor antagonists differentially alter risky choice in the RDT, the current results show that NMDA receptors are an important mediator of decision-making involving probabilistic delivery of positive punishment.

Involvement of noradrenergic and serotonergic systems in risk-based decisions between options of equivalent expected value in rats

Risk perception is an important factor that may mediate risk-based decision-making processes regulated by noradrenergic (NA) and serotonergic (5-HT) systems. Most risk-based decision-making models involve complex factors, such as risk perception or reward value, such that the final decision is the result of the interactions among these factors. However, the contribution of risk perception per se in risk decisions has remained unclear. Therefore, in the present study, we made some modifications to the classical probabilistic discounting task (PDT) to focus on the impact of risk perception and noradrenergic/serotonergic systems on decision-making behavior. Meanwhile, we conducted an elevated plus-maze (EPM) test to detect the correlation between anxiety and choice behavior. In the current study, rats had to choose between a "certain" lever that delivered a certain number of pellets and a "risky" lever that delivered eight pellets in a probabilistic manner (descending: 50%, 25%, 12.5% or ascending 12.5%, 25%, 50% of the time). The long-term rewarding values of the two levers were always identical in each block within each session. According to their baseline performances in choosing the risky lever, rats were divided into the risk-prefer group and risk-averse group. The results showed that there was a significant correlation between open arm time in EPM and risky choice for both descending order and ascending order, indicating that highly anxious rats more often preferred the safe option under risk. Pharmacological stimulation of α2-adrenergic receptors via dexmedetomidine (0.01 mg/kg) decreased the preference of probabilistic rewards in the risk-prefer group, while blocking α2 receptors by atipamezole (0.3 mg/kg) also reduced risky choices. The NA reuptake inhibitor, atomoxetine, increased the preference for risky choices in the risk-prefer group, the effect of which was attained via multiple superimposed doses. Administration of the 5-HT_2A receptor agonist, DOI (0.1 mg/kg), increased risk-taking behavior in the risk-prefer group. Taken together, these results suggest that NA may be more inclined to process negative information such as loss or uncertainty in the regulation of risk-related decision making, whereas 5-HT may function primarily to increase risk-taking behavior. Our findings may help to further elucidate how noradrenergic and serotonergic systems differentially affect individuals with different risk preferences in terms of regulating risk perception in risk-related decision making.

Cracking the EMDR code: Recruitment of sensory, memory and emotional networks during bilateral alternating auditory stimulation

INTRODUCTION

The inability to extinguish a conditioned fear is thought to be at the core of post-traumatic stress disorder. Eye movement desensitization and reprocessing therapy has been efficacious for post-traumatic stress disorder, but the brain mechanisms underlying the effect are still unknown. The core effect of eye movement desensitization and reprocessing therapy seems to rely on the simultaneous association of bilateral alternating stimulation and the recall of the traumatic memory. To shed light on how eye movement desensitization and reprocessing therapy functions, we aimed to highlight the structures activated by bilateral alternating stimulation during fear extinction and its recall.

METHODS

We included 38 healthy participants in this study. Participants were examined twice in functional magnetic resonance imaging, over 2 consecutive days. On the first day, they performed two fear conditioning and extinction procedures, one with and one without the bilateral alternating stimulation during the fear extinction learning phase in a counter-balanced order across the participants. On the second day, participants completed the fear extinction recall procedure, in the same order as the previous day. Statistical significance of maps was set at p < 0.05 after correction for family-wise error at the cluster level.

RESULTS

The analysis revealed significant activation with versus without bilateral alternating stimulation at the early extinction in the bilateral auditory areas, the right precuneus, and the left medial frontal gyrus. The same pattern was found in the early recall on the second day. The connectivity analysis found a significant increase in connectivity during bilateral alternating stimulation versus without bilateral alternating stimulation in the early extinction and recall between the two superior temporal gyri, the precuneus, the middle frontal gyrus and a set of structures involved in multisensory integration, executive control, emotional processing, salience and memory.

CONCLUSION

We show for the first time that in the eye movement desensitization and reprocessing therapy the bilateral alternating stimulation is not a simple sensory signal and can activate large emotional neural networks.

Pair housing, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effect of probability presentation order on amphetamine-induced changes in risky choice

Probability discounting is often measured with independent schedules. Independent schedules have several limitations, such as confounding preference for one alternative with frequency of reward presentation and generating ceiling/floor effects at certain probabilities. To address this potential caveat, a controlled reinforcer frequency schedule can be used, in which the manipulandum that leads to reinforcement is pseudo-randomly determined before each trial. This schedule ensures subjects receive equal presentations of the small and large magnitude reinforcers across each block of trials. A total of 24 pair-housed and 11 individually housed female Sprague Dawley rats were tested in a controlled reinforcer frequency procedure. For half of the rats, the odds against (OA) receiving the large magnitude reinforcer increased across the session (ascending schedule); the OA decreased across the session for half of the rats (descending schedule). Following training, rats received treatments of amphetamine (AMPH; 0, 0.25, 0.5, 1.0 mg/kg; s.c.). For pair-housed rats, AMPH (0.5 mg/kg) increased risky choice, regardless of probability presentation order, whereas a higher dose of AMPH (1.0 mg/kg) decreased discriminability of reinforcer magnitude for rats trained on the descending schedule only. For individually housed rats, probability presentation order modulated the effects of AMPH on probability discounting, as AMPH (0.25 and 0.5 mg/kg) increased risky choice in rats trained on the ascending schedule but not on the descending schedule. These results show that pair-housing animals, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effects of probability presentation order on drug effects on risky choice.

Prefrontal Cortex Representation of Learning of Punishment Probability During Reward-Motivated Actions

Actions executed toward obtaining a reward are frequently associated with the probability of harm occurring during action execution. Learning this probability allows for appropriate computation of future harm to guide action selection. Impaired learning of this probability may be critical for the pathogenesis of anxiety or reckless and impulsive behavior. Here we designed a task for punishment probability learning during reward-guided actions to begin to understand the neuronal basis of this form of learning, and the biological or environmental variables that influence action selection after learning. Male and female Long-Evans rats were trained in a seek-take behavioral paradigm where the seek action was associated with varying probability of punishment. The take action remained safe and was followed by reward delivery. Learning was evident as subjects selectively adapted seek action behavior as a function of punishment probability. Recording of neural activity in the mPFC during learning revealed changes in phasic mPFC neuronal activity during risky-seek actions but not during the safe take actions or reward delivery, revealing that this region is involved in learning of probabilistic punishment. After learning, the variables that influenced behavior included reinforcer and punisher value, pretreatment with the anxiolytic diazepam, and biological sex. In particular, females were more sensitive to probabilistic punishment than males. These data demonstrate that flexible encoding of risky actions by mPFC is involved in probabilistic punishment learning and provide a novel behavioral approach for studying the pathogenesis of anxiety and impulsivity with inclusion of sex as a biological variable.SIGNIFICANCE STATEMENT Actions we choose to execute toward obtaining a reward are often associated with the probability of harm occurring. Impaired learning of this probability may be critical for the pathogenesis of anxiety or reckless behavior and impulsivity. We developed a behavioral model to assess this mode of learning. This procedure allowed us to determine biological and environmental factors that influence the resistance of reward seeking to probabilistic punishment and to identify the mPFC as a region that flexibly adapts its response to risky actions as contingencies are learned.

Touchscreen-based assessment of risky-choice in mice

Addictions are characterized by choices made to satisfy the addiction despite the risk it could produce an adverse consequence. Here, we developed a murine version of a 'risky decision-making' task (RDT), in which mice could respond on a touchscreen panel to obtain either a large milkshake reward associated with varying probability of footshock, or a smaller amount of the same reward that was never punished. Results showed that (the following font is incorrectly smaller/subscripted) mice shifted choice from the large to small reward stimulus as shock probability increased. Immunohistochemical analysis revealed more Fos-positive cells in prelimbic cortex (PL) and basal amygdala (BA) after RDT testing, and a strong anti-correlation between infralimbic cortex (IL) activity and choice of the large reward stimulus under likely (75-100 % probability) punishment. These findings establish an assay for risky choice in mice and provide preliminary insight into the underlying neural substrates.

Prefrontal Regulation of Punished Ethanol Self-administration

BACKGROUND

A clinical hallmark of alcohol use disorder is persistent drinking despite potential adverse consequences. The ventromedial prefrontal cortex (vmPFC) and dorsomedial prefrontal cortex (dmPFC) are positioned to exert top-down control over subcortical regions, such as the nucleus accumbens shell (NAcS) and basolateral amygdala, which encode positive and negative valence of ethanol (EtOH)-related stimuli. Prior rodent studies have implicated these regions in regulation of punished EtOH self-administration (EtOH-SA).

METHODS

We conducted in vivo electrophysiological recordings in mouse vmPFC and dmPFC to obtain neuronal correlates of footshock-punished EtOH-SA. Ex vivo recordings were performed in NAcS D₁ receptor-expressing medium spiny neurons receiving vmPFC input to examine punishment-related plasticity in this pathway. Optogenetic photosilencing was employed to assess the functional contribution of the vmPFC, dmPFC, vmPFC projections to NAcS, or vmPFC projections to basolateral amygdala, to punished EtOH-SA.

RESULTS

Punishment reduced EtOH lever pressing and elicited aborted presses (lever approach followed by rapid retraction). Neurons in the vmPFC and dmPFC exhibited phasic firing to EtOH lever presses and aborts, but only in the vmPFC was there a population-level shift in coding from lever presses to aborts with punishment. Closed-loop vmPFC, but not dmPFC, photosilencing on a postpunishment probe test negated the reduction in EtOH lever presses but not in aborts. Punishment was associated with altered plasticity at vmPFC inputs to D₁ receptor-expressing medium spiny neurons in the NAcS. Photosilencing vmPFC projections to the NAcS, but not to the basolateral amygdala, partially reversed suppression of EtOH lever presses on probe testing.

CONCLUSIONS

These findings demonstrate a key role for the vmPFC in regulating EtOH-SA after punishment, with implications for understanding the neural basis of compulsive drinking in alcohol use disorder.

Distinct relationships between risky decision making and cocaine self-administration under short- and long-access conditions

Substance use is strongly associated with impaired decision making, with cocaine use particularly linked to elevated risky and impulsive choice. It is not clear, however, whether such maladaptive decision making is a consequence of cocaine use or instead precedes and predisposes individuals to cocaine use. The current study was designed to specifically address the latter possibility with respect to risky choice in both male and female rats. Rats were first trained in a "Risky Decision-making Task" (RDT), in which they made discrete choices between a small, "safe" food reward and a large, "risky" food reward accompanied by increasing probabilities of mild footshock punishment. After reaching stable performance, rats underwent jugular catheter surgery followed by either short-access cocaine self-administration sessions (2 h, 0.5 mg/kg/infusion) for 5 days or long-access cocaine self-administration sessions (6 h, 0.5 mg/kg/infusion) for 14 days. Under short-access conditions, there was no relationship between risk preference and changes in cocaine intake over time, but greater risk aversion in females predicted greater overall cocaine intake. Under long-access conditions, heightened risk taking predicted greater escalation of cocaine intake over the course of self-administration, supporting the notion that pre-existing risk-taking behavior predicts cocaine intake. Collectively, results from these experiments have implications for understanding and identifying pre-existing vulnerabilities to substance use, which may lead to strategies to prevent development of substance use disorders.

Contribution of the prefrontal cortex and basolateral amygdala to behavioral decision-making under reward/punishment conflict

RATIONALE

Control of reward-seeking behavior under conditions of punishment is an important function for survival.

OBJECTIVES AND METHODS

We designed a task in which rats could choose to either press a lever and obtain a food pellet accompanied by a footshock or refrain from pressing the lever to avoid footshock, in response to tone presentation. In the task, footshock intensity steadily increased, and the task was terminated when the lever press probability reached < 25% (last intensity). Rats were trained until the last intensity was stable. Subsequently, we investigated the effects of the pharmacological inactivation of the ventromedial prefrontal cortex (vmPFC), lateral orbitofrontal cortex (lOFC), and basolateral amygdala (BLA) on task performance.

RESULTS

Bilateral inactivation of the vmPFC, lOFC, and BLA did not alter lever press responses at the early stage of the task. The number of lever presses increased following vmPFC and BLA inactivation but decreased following lOFC inactivation during the later stage of the task. The last intensity was elevated by vmPFC or BLA inactivation but lowered by lOFC inactivation. Disconnection of the vmPFC-BLA pathway induced behavioral alterations that were similar to vmPFC or BLA inactivation. Inactivation of any regions did not alter footshock sensitivity and anxiety levels.

CONCLUSIONS

Our results demonstrate a strong role of the vmPFC and BLA and their interactions in reward restraint to avoid punishment and a prominent role of the lOFC in reward-seeking under reward/punishment conflict situations.

Dissociable roles for the ventral and dorsal medial prefrontal cortex in cue-guided risk/reward decision making

Converging evidence from studies with animals and humans have implicated separate regions of the medial prefrontal cortex (mPFC) corresponding to the anterior cingulate cortex (ACC), in mediating different aspects of reward-related decisions involving uncertainty or risk. However, the dissociable contributions of subregions of the ACC remain unclear, as discrepancies exist between human neuroimaging findings and preclinical rodent studies. To clarify how ventral vs. dorsal regions of the mPFC contribute to risk/reward decision making, the present study assessed the effects of inactivation of different subregions on performance of a "Blackjack task" that measured cue-guided decision making and shares similarities with paradigms used with humans. Male, Long-Evans rats were well-trained to choose between a Small/Certain reward vs a Large/Risky reward delivered with variable probabilities (i.e., good vs. poor-odds, 50% vs. 12.5%). The odds of obtaining the larger reward was signaled by auditory cues at the start of each trial. Inactivation of the ventral, infralimbic region of the mPFC increased risky choice selectively when the odds of winning were poor. By contrast, inactivation of the prelimbic and anterior cingulate regions of the dorsal mPFC led to suboptimal reductions in risky choice on good-odds trials. The effects of prelimbic vs anterior cingulate inactivations were associated with context-dependent alterations in reward vs negative feedback, respectively. These results further clarify the distinct yet complementary manners in which separate ACC regions promote optimal risk/reward decision making and complement neuroimaging findings that activity in human ventral vs dorsal ACC promotes risk aversion or risky choices.

Effects of d-amphetamine and MK-801 on impulsive choice: Modulation by schedule of reinforcement and delay length

Procedural modifications can modulate drug effects in delay discounting, such as signaling the delay to reinforcement and altering the order in which delays are presented. Although the schedule of reinforcement can alter the rate at which animals discount a reinforcer, research has not determined if animals trained on different schedules of reinforcement are differentially affected by pharmacological manipulations. Similarly, research has not determined if using different delays to reinforcement can modulate drug effects in delay discounting. Male Sprague Dawley rats (n = 36) were split into four groups and were trained in a delay-discounting procedure. The schedule of reinforcement (fixed ratio [FR] 1 vs. FR 10) and delays to reinforcement (0, 5, 10, 20, and 50 s vs. 0, 10, 30, 60, 100 s) were manipulated for each group. Following behavioral training, rats were treated with d-amphetamine (0, 0.25, 0.5, and 1.0 mg/kg) and MK-801 (0, 0.03, and 0.06 mg/kg). Results showed that amphetamine decreased impulsive choice when a FR 1 schedule was used, but only when the short delay sequence was used. Conversely, amphetamine decreased impulsive choice when a FR 10 schedule was used, but only when rats were trained on the long delay sequence. MK-801 decreased impulsive choice in rats trained on a FR 1 schedule, regardless of delay sequence, but did not alter choice in rats trained on a FR 10 schedule. These results show that schedule of reinforcement and delay length can modulate drug effects in delay discounting.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

Dopamine signals related to appetitive and aversive events in paradigms that manipulate reward and avoidability

Using environmental cues to acquire good and avoid harmful things is critical for survival. Rewarding and aversive outcomes both drive behavior through reinforcement learning and sometimes occur together in the environment, but it remains unclear how these signals are encoded within the brain and if signals for positive and negative reinforcement are encoded similarly. Recent studies demonstrate that the dopaminergic system and interconnected brain regions process both positive and negative reinforcement necessary for approach and avoidance behaviors, respectively. Here, we review these data with a special focus on behavioral paradigms that manipulate both expected reward and the avoidability of aversive events to reveal neural correlates related to value, prediction error encoding, motivation, and salience.

Deconstructing value-based decision making via temporally selective manipulation of neural activity: Insights from rodent models

The ability to choose among options that differ in their rewards and costs (value-based decision making) has long been a topic of interest for neuroscientists, psychologists, and economists alike. This is likely because this is a cognitive process in which all animals (including humans) engage on a daily basis, be it routine (which road to take to work) or consequential (which graduate school to attend). Studies of value-based decision making (particularly at the preclinical level) often treat it as a uniform process. The results of such studies have been invaluable for our understanding of the brain substrates and neurochemical systems that contribute to decision making involving a range of different rewards and costs. Value-based decision making is not a unitary process, however, but is instead composed of distinct cognitive operations that function in concert to guide choice behavior. Within this conceptual framework, it is therefore important to consider that the known neural substrates supporting decision making may contribute to temporally distinct and dissociable components of the decision process. This review will describe this approach for investigating decision making, drawing from published studies that have used techniques that allow temporal dissection of the decision process, with an emphasis on the literature in animal models. The review will conclude with a discussion of the implications of this work for understanding pathological conditions that are characterized by impaired decision making.

Optogenetic dissection of basolateral amygdala contributions to intertemporal choice in young and aged rats

Across species, aging is associated with an increased ability to choose delayed over immediate gratification. These experiments used young and aged rats to test the role of the basolateral amygdala (BLA) in intertemporal decision making. An optogenetic approach was used to inactivate the BLA in young and aged rats at discrete time points during choices between levers that yielded a small, immediate vs. a large, delayed food reward. BLA inactivation just prior to decisions attenuated impulsive choice in both young and aged rats. In contrast, inactivation during receipt of the small, immediate reward increased impulsive choice in young rats but had no effect in aged rats. BLA inactivation during the delay or intertrial interval had no effect at either age. These data demonstrate that the BLA plays multiple, temporally distinct roles during intertemporal choice, and show that the contribution of BLA to choice behavior changes across the lifespan.

Examining the neurochemical underpinnings of animal models of risky choice: Methodological and analytic considerations

Because risky choice is associated with several psychiatric conditions, recent research has focused on examining the underlying neurochemical processes that control risk-based decision-making. Not surprisingly, several tasks have been developed to study the neural mechanisms involved in risky choice. The current review will briefly discuss the major tasks used to measure risky choice and will summarize the contribution of several major neurotransmitter systems to this behavior. To date, the most common measures of risky choice are the probability discounting task, the risky decision task, and the rat gambling task. Across these three tasks, the contribution of the dopaminergic system has been most studied, although the effects of serotonergic, adrenergic, cholinergic, and glutamatergic ligands will be discussed. Drug effects across these tasks have been inconsistent, which makes determining the precise role of neurotransmitter systems in risky choice somewhat difficult. Furthermore, procedural differences can modulate drug effects in these procedures, and the way data are analyzed can alter the interpretations one makes concerning pharmacological manipulations. By taking these methodological/analytic considerations into account, we may better elucidate the neurochemistry of risky decision-making. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Recent Updates in Modeling Risky Decision Making in Rodents

Excessive preference for risky over safe options is a hallmark of several psychiatric disorders. Here we describe a behavioral task that models such risky decision making in rats. In this task, rats are given choices between small, safe rewards and large rewards accompanied by risk of footshock punishment. The risk of punishment changes within a test session, allowing quantification of decision making at different levels of risk. Importantly, this task can yield a wide degree of reliable individual variability, allowing the characterization of rats as "risk-taking" or "risk-averse." The task has been demonstrated to be effective for testing the effects of pharmacological agents and neurobiological manipulations, and the individual variability (which mimics the human population) allows assessment of behavioral and neurobiological distinctions among subjects based on their risk-taking profile.