Prefrontal Dopamine D1 and D2 Receptors Regulate Dissociable Aspects of Decision Making via Distinct Ventral Striatal and Amygdalar Circuits

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

RATIONALE

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

OBJECTIVE

We determined how 14 daily THC injections (5 mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

METHODS

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impact probabilistic discounting.

RESULTS

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

CONCLUSIONS

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine neurons or their projections to mPFC.

Dopamine in the prefrontal cortex plays multiple roles in the executive function of patients with Parkinson's disease

Parkinson's disease can affect not only motor functions but also cognitive abilities, leading to cognitive impairment. One common issue in Parkinson's disease with cognitive dysfunction is the difficulty in executive functioning. Executive functions help us plan, organize, and control our actions based on our goals. The brain area responsible for executive functions is called the prefrontal cortex. It acts as the command center for the brain, especially when it comes to regulating executive functions. The role of the prefrontal cortex in cognitive processes is influenced by a chemical messenger called dopamine. However, little is known about how dopamine affects the cognitive functions of patients with Parkinson's disease. In this article, the authors review the latest research on this topic. They start by looking at how the dopaminergic system, is altered in Parkinson's disease with executive dysfunction. Then, they explore how these changes in dopamine impact the synaptic structure, electrical activity, and connection components of the prefrontal cortex. The authors also summarize the relationship between Parkinson's disease and dopamine-related cognitive issues. This information may offer valuable insights and directions for further research and improvement in the clinical treatment of cognitive impairment in Parkinson's disease.

Why Don't You Just Eat? Neuroscience and the Enigma of Eating Disorders

Eating disorders are severe psychiatric illnesses that are associated with high mortality. Research has identified environmental, psychological, and biological risk factors that could contribute to the psychopathology of eating disorders. Nevertheless, the patterns of self-starvation, binge eating, and purging behaviors are difficult to reconcile with the typical mechanisms that regulate appetite, hunger, and satiety. Here, the authors present a neuroscience and human brain imaging-based model to help explain the detrimental and often persistent behavioral patterns seen in individuals with eating disorders and why it is so difficult to overcome them. This model incorporates individual motivations to change eating, fear conditioning, biological adaptations of the brain and body, and the development of a vicious cycle that drives the individual to perpetuate those behaviors. This knowledge helps to explain these illnesses to patients and their families, and to develop more effective treatments, including biological interventions.

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

Rationale

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

Objective

We determined how 14 daily THC injections (5mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

Methods

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impacts probabilistic discounting.

Results

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

Conclusions

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine projections to mPFC, or via alterations of non-VTA dopamine neurons.

The Effectiveness of Transcranial Direct Current Stimulation (tDCS) in Binge Eating Disorder (BED)-Review and Insight into the Mechanisms of Action

INTRODUCTION

Binge eating disorder (BED) is the most common eating disorder among those contributing to the development of obesity, and thus acts as a significant burden on the lives and health of patients. It is characterized by complex neurobiology, which includes changes in brain activity and neurotransmitter secretion. Existing treatments are moderately effective, and so the search for new therapies that are effective and safe is ongoing.

AIM AND METHODS

This review examines the use of transcranial direct current stimulation (tDCS) in the treatment of binge eating disorder. Searches were conducted on the PubMed/Medline, Research Gate, and Cochrane databases.

RESULTS

Six studies were found that matched the review topic. All of them used the anodal stimulation of the right dorsolateral prefrontal cortex (DLPFC) in BED patients. tDCS proved effective in reducing food cravings, the desire to binge eat, the number of binging episodes, and food intake. It also improved the outcomes of inhibitory control and the treatment of eating disorder psychopathology. The potential mechanisms of action of tDCS in BED are explained, limitations in current research are outlined, and recommendations for future research are provided.

CONCLUSIONS

Preliminary evidence suggests that the anodal application of tDCS to the right DLPFC reduces the symptoms of BED. However, caution should be exercised in the broader use of tDCS in this context due to the small number of studies performed and the small number of patients included. Future studies should incorporate neuroimaging and neurophysiological measurements to elucidate the potential mechanisms of action of tDCS in BED.

Toluene alters the intrinsic excitability and excitatory synaptic transmission of basolateral amygdala neurons

Introduction

Inhalant abuse is an important health issue especially among children and adolescents who often encounter these agents in the home. Research into the neurobiological targets of inhalants has lagged behind that of other drugs such as alcohol and psychostimulants. However, studies from our lab and others have begun to reveal how inhalants such as the organic solvent toluene affect neurons in key addiction related areas of the brain including the ventral tegmental area, nucleus accumbens and medial prefrontal cortex. In the present study, we extend these findings and examine the effect of toluene on electrophysiological responses of pyramidal neurons in the basolateral amygdala BLA, a region important for generating emotional and reward based information needed to guide future behavior.

Methods

Whole-cell patch-clamp electrophysiology recordings of BLA pyramidal neurons in rat brain slices were used to assess toluene effects on intrinsic excitability and excitatory glutamatergic synaptic transmission.

Results

Acute application of 3 mM but not 0.3 mM toluene produced a small but significant (~20%) increase in current-evoked action potential (AP) firing that reversed following washout of the toluene containing solution. The change in firing during exposure to 3 mM toluene was accompanied by selective changes in AP parameters including reduced latency to first spike, increased AP rise time and decay and a reduction in the fast after-hyperpolization. To examine whether toluene also affects excitatory synaptic signaling, we expressed channelrhodopsin-2 in medial prefrontal cortex neurons and elicited synaptic currents in BLA neurons via light pulses. Toluene (3 mM) reduced light-evoked AMPA-mediated synaptic currents while a lower concentration (0.3 mM) had no effect. The toluene-induced reduction in AMPA-mediated BLA synaptic currents was prevented by the cannabinoid receptor-1 antagonist AM281.

Discussion

These findings are the first to demonstrate effects of acute toluene on BLA pyramidal neurons and add to existing findings showing that abused inhalants such as toluene have significant effects on neurons in brain regions involved in natural and drug induced reward.

Accentuated Paralimbic and Reduced Mesolimbic D2/3-Impulsivity Associations in Parkinson's Disease

Impulsivity is a behavioral trait that is elevated in many neuropsychiatric disorders. Parkinson's disease (PD) patients can exhibit a specific pattern of reward-seeking impulsive-compulsive behaviors (ICBs), as well as more subtle changes to generalized trait impulsivity. Prior studies in healthy controls (HCs) suggest that trait impulsivity is regulated by D2/3 autoreceptors in mesocorticolimbic circuits. While altered D2/3 binding is noted in ICB+ PD patients, there is limited prior assessment of the trait impulsivity-D2/3 relationship in PD, and no prior direct comparison with patterns in HCs. We examined 54 PD (36 M; 18 F) and 31 sex- and age-matched HC (21 M; 10 F) subjects using [18F]fallypride, a high-affinity D2/3 receptor ligand, to measure striatal and extrastriatal D2/3 nondisplaceable binding potential (BPND). Subcortical and cortical assessment exclusively used ROI or exploratory-voxelwise methods, respectively. All completed the Barratt Impulsiveness Scale, a measure of trait impulsivity. Subcortical ROI analyses indicated a negative relationship between trait impulsivity and D2/3 BPND in the ventral striatum and amygdala of HCs but not in PD. By contrast, voxelwise methods demonstrated a positive trait impulsivity-D2/3 BPND correlation in ventral frontal olfactocentric-paralimbic cortex of subjects with PD but not HCs. Subscale analysis also highlighted different aspects of impulsivity, with significant interactions between group and motor impulsivity in the ventral striatum, and attentional impulsivity in the amygdala and frontal paralimbic cortex. These results suggest that dopamine functioning in distinct regions of the mesocorticolimbic circuit influence aspects of impulsivity, with the relative importance of regional dopamine functions shifting in the neuropharmacological context of PD.SIGNIFICANCE STATEMENT The biological determinants of impulsivity have broad clinical relevance, from addiction to neurodegenerative disorders. Here, we address biomolecular distinctions in Parkinson's disease. This is the first study to evaluate a large cohort of Parkinson's disease patients and age-matched healthy controls with a measure of trait impulsivity and concurrent [18F]fallypride PET, a method that allows quantification of D2/3 receptors throughout the mesocorticolimbic network. We demonstrate widespread differences in the trait impulsivity-dopamine relationship, including (1) loss of subcortical relationships present in the healthy brain and (2) emergence of a new relationship in a limbic cortical area. This illustrates the loss of mechanisms of behavioral regulation present in the healthy brain while suggesting a potential compensatory response and target for future investigation.

Acetylcholine and noradrenaline enhance foraging optimality in humans

Foraging theory prescribes when optimal foragers should leave the current option for more rewarding alternatives. Actual foragers often exploit options longer than prescribed by the theory, but it is unclear how this foraging suboptimality arises. We investigated whether the upregulation of cholinergic, noradrenergic, and dopaminergic systems increases foraging optimality. In a double-blind, between-subject design, participants (N = 160) received placebo, the nicotinic acetylcholine receptor agonist nicotine, a noradrenaline reuptake inhibitor reboxetine, or a preferential dopamine reuptake inhibitor methylphenidate, and played the role of a farmer who collected milk from patches with different yield. Across all groups, participants on average overharvested. While methylphenidate had no effects on this bias, nicotine, and to some extent also reboxetine, significantly reduced deviation from foraging optimality, which resulted in better performance compared to placebo. Concurring with amplified goal-directedness and excluding heuristic explanations, nicotine independently also improved trial initiation and time perception. Our findings elucidate the neurochemical basis of behavioral flexibility and decision optimality and open unique perspectives on psychiatric disorders affecting these functions.

Using lickometry to infer differential contributions of salience network regions during compulsion-like alcohol drinking

Alcohol use disorder extracts substantial personal, social and clinical costs, and continued intake despite negative consequences (compulsion-like consumption) can contribute strongly. Here we discuss lickometry, a simple method where lick times are determined across a session, while analysis across many aspects of licking can offer important insights into underlying psychological and action strategies, including their brain mechanisms. We first describe studies implicating anterior insula (AIC) and dorsal medial prefrontal cortex (dMPF) in compulsion-like responding for alcohol, then review work suggesting that AIC/ventral frontal cortex versus dMPF regulate different aspects of behavior (oral control and overall response strategy, versus moment-to-moment action organization). We then detail our lickometer work comparing alcohol-only drinking (AOD) and compulsion-like drinking under moderate- or higher-challenge (ModChD or HiChD, using quinine-alcohol). Many studies have suggested utilization of one of two main strategies, with higher motivation indicated by more bouts, and greater palatability suggested by longer, faster bouts. Instead, ModChD shows decreased variability in many lick measures, which is unexpected but consistent with the suggested importance of automaticity for addiction. Also surprising is that HiChD retains several behavior changes seen with ModChD, reduced tongue variability and earlier bout start, even though intake is otherwise disrupted. Since AIC-related measures are retained under both moderate- and higher-challenge, we propose a novel hypothesis that AIC sustains overall commitment regardless of challenge level, while disordered licking during HiChD mirrors the effects of dMPF inhibition. Thus, while AIC provides overall drive despite challenge, the ability to act is ultimately determined within the dMPF.

Distinct cortico-striatal compartments drive competition between adaptive and automatized behavior

Cortical and basal ganglia circuits play a crucial role in the formation of goal-directed and habitual behaviors. In this study, we investigate the cortico-striatal circuitry involved in learning and the role of this circuitry in the emergence of inflexible behaviors such as those observed in addiction. Specifically, we develop a computational model of cortico-striatal interactions that performs concurrent goal-directed and habit learning. The model accomplishes this by distinguishing learning processes in the dorsomedial striatum (DMS) that rely on reward prediction error signals as distinct from the dorsolateral striatum (DLS) where learning is supported by salience signals. These striatal subregions each operate on unique cortical input: the DMS receives input from the prefrontal cortex (PFC) which represents outcomes, and the DLS receives input from the premotor cortex which determines action selection. Following an initial learning of a two-alternative forced choice task, we subjected the model to reversal learning, reward devaluation, and learning a punished outcome. Behavior driven by stimulus-response associations in the DLS resisted goal-directed learning of new reward feedback rules despite devaluation or punishment, indicating the expression of habit. We repeated these simulations after the impairment of executive control, which was implemented as poor outcome representation in the PFC. The degraded executive control reduced the efficacy of goal-directed learning, and stimulus-response associations in the DLS were even more resistant to the learning of new reward feedback rules. In summary, this model describes how circuits of the dorsal striatum are dynamically engaged to control behavior and how the impairment of executive control by the PFC enhances inflexible behavior.

The Effects of the Inhalant Toluene on Cognitive Function and Behavioral Flexibility: A Review of Recent Findings

Substance use disorder (SUD) is characterized, in part, by lack of control over drug seeking and taking. The prefrontal cortex (PFC) is highly involved in control of behavior and deficits in PFC structure and function have been demonstrated in clinical and preclinical studies of SUD. Of the various classes of drugs associated with the development of SUD, inhalants are among the least studied despite their widespread use among adolescents and children. In this work, we review what is currently known regarding the sites and mechanisms of action of inhalants with a focus on the volatile solvent toluene that is contained in a wide variety of legal and easily obtained products. We then describe how inhalants including toluene affect various behaviors with an emphasis on those associated with PFC function and how chronic use of inhalants alters brain structure and neuronal signaling. Findings from these studies highlight advances made in recent years that have expanded our understanding of the effects of inhalants on brain structure and reinforce the need for continued work in this field.

The medial orbitofrontal cortex governs reward-related circuits in an age-dependent manner

Nucleus accumbens (NAc) neurons integrate excitatory inputs from cortical and limbic structures, contributing to critical cognitive functions, including decision-making. As these afferents mature from adolescence through adulthood, incoming signals to the NAc may summate differently between age groups. Decision-making evaluates both reward and risk before action selection, suggesting an interplay between reward- and risk-related circuits. Medial orbitofrontal cortex (MO)-NAc circuits permit risk assessment behaviors and likely underlie risk information incorporation. As adolescents make reward-centric choices regardless of risk, we hypothesized the impact of MO activity alters reward-related NAc circuits in an age-dependent manner. To test this hypothesis, we used single-unit electrophysiology to measure MO train stimulation's effect on reward-related pathways, specifically the basolateral amygdala (BLA)-NAc circuit, in adult and adolescent rats. MO train stimulation altered the strength but not the timing of BLA-NAc interactions in a frequency-dependent manner. In adults, MO train stimulation produced a frequency-dependent, bidirectional effect on BLA-evoked NAc AP probability. Contrastingly, MO train stimulation uniformly attenuated BLA-NAc interactions in adolescents. While the mature MO can govern reward-related circuits in an activity-dependent manner, perhaps to adapt to positive or negative decision-making outcomes, the adolescent MO may be less able to bidirectionally impact reward-related pathways resulting in biased decision-making.

Temporal Dynamics Underlying Prelimbic Prefrontal Cortical Regulation of Action Selection and Outcome Evaluation during Risk/Reward Decision-Making

Risk/reward decision-making is a dynamic process that includes periods of deliberation before action selection and evaluation of the action outcomes that bias subsequent choices. Inactivation of the prelimbic (PL) cortex has revealed its integral role in updating decision biases in the face of changes in probabilistic reward contingencies, yet how phasic PL signals during different phases of the decision process influence choice remains unclear. We used temporally specific optogenetic inhibition to selectively disrupt PL activity coinciding with action selection and outcome phases to examine how these signals influence choice. Male rats expressing the inhibitory opsin eArchT within PL excitatory neurons were well trained on a probabilistic discounting task, entailing choice between small/certain versus large/risky rewards, the probability of which varied over a session (50-12.5%). During testing, brief light pulses suppressed PL activity before choice or after different outcomes. Prechoice suppression reduced bias toward more preferred/higher utility options and disrupted how recent outcomes influenced subsequent choice. Inhibition during risky losses induced a similar profile, but here, the impact of reward omissions were either amplified or diminished, relative to the context of the estimated profitability of the risky option. Inhibition during large or small reward receipt reduced risky choice when this option was more profitable, suggesting these signals can both reinforce rewarded risky choices and also act as a relative value comparator signal that augments incentive for larger rewards. These findings reveal multifaceted contributions by the PL in implementing decisions and integrating action-outcome feedback to assign context to the decision space.SIGNIFICANCE STATEMENT The PL prefrontal cortex plays an integral role in guiding risk/reward decisions, but how activity in this region during different phases of the decision process influences choice is unclear. By using temporally specific optogenetic manipulations of this activity, the present study unveiled previously uncharacterized and differential contributions by PL in implementing decision policies and how evaluation of decision outcomes shape subsequent choice. These findings provide novel insight into the dynamic processes engaged by the PL that underlie action selection in situations involving reward uncertainty that may aid in understanding the mechanism underlying normal and aberrant decision-making processes.

Long-term memory, synaptic plasticity and dopamine in rodent medial prefrontal cortex: Role in executive functions

Mnemonic functions, supporting rodent behavior in complex tasks, include both long-term and (short-term) working memory components. While working memory is thought to rely on persistent activity states in an active neural network, long-term memory and synaptic plasticity contribute to the formation of the underlying synaptic structure, determining the range of possible states. Whereas, the implication of working memory in executive functions, mediated by the prefrontal cortex (PFC) in primates and rodents, has been extensively studied, the contribution of long-term memory component to these tasks received little attention. This review summarizes available experimental data and theoretical work concerning cellular mechanisms of synaptic plasticity in the medial region of rodent PFC and the link between plasticity, memory and behavior in PFC-dependent tasks. A special attention is devoted to unique properties of dopaminergic modulation of prefrontal synaptic plasticity and its contribution to executive functions.

Advances in the Therapeutic Use of Non-Ergot Dopamine Agonists in the Treatment of Motor and Non-Motor Symptoms of Parkinson's Disease

Dopamine (DA) agonists, as an excellent dopamine replacement therapy for patients with early and advanced Parkinson's disease (PD), play a vital role in controlling motor and several nonmotor symptoms. Besides, the application of DA agonists may delay levodopa therapy and the associated risk of motor complications. Indeed, each DA agonist has unique pharmacokinetic and pharmacodynamic characteristics and therefore has different therapeutic efficacy and safety profile. The comorbidities, significant non-motor manifestations, concomitant medications, and clinical features of PD individuals should guide the selection of a specific DA agonist to provide a more patient-tailored treatment option. Thorough knowledge of DA agonists helps clinicians better balance clinical efficacy and side effects. Therefore, this review refers to recent English-written articles on DA agonist therapy for PD patients and summarizes the latest findings on non-ergot DA agonists as well as the advantages and disadvantages of each compound to help clinicians in the selection of a specific DA agonist. In addition, novel D1/D5 partial agonists and new formulations of DA agonists are also discussed.

Prefrontal Dopaminergic Regulation of Cue-Guided Risky Decision-Making Performance in Rats

Risky decision-making is the decision made by individuals when they know the probability of each outcome. In order to survive in unpredictable environments, it is necessary for individuals to assess the probability of events occurring to an make appropriate decisions. There are few studies on the neural basis of risky decision-making behavior guided by external cues, which is related to the relative paucity of animal behavioral paradigms. Previous studies have shown that the prefrontal cortex (PFC) plays a key role in risk-based decision-making. The PFC receives projections from the dopamine (DA) system from the ventral tegmental area of the midbrain. The mesocorticolimbic DA system regulates the judgments of reward and value in decision-making. However, the specific receptor mechanism for prefrontal DA regulation of cue-guided risky decision-making behavior remains unclear. Here we established a cue-guided risky decision-making behavioral paradigm (RDM task) to detect the behavior of rats making decisions between a small certain reward and a large uncertain reward in a self-paced manner. The D1 receptor antagonist SCH-23390 (5 mM) or agonist SKF-82958 (5 mM), and the D2 receptor antagonist thioridazine hydrochloride (5 mM) or agonist MLS-1547 (5 mM) was injected into the mPFC, respectively, to investigate how the behavior in the RDM task was changed. The results showed that: (1) rats were able to master the operation of the cue-guided RDM task in a self-paced way; (2) a majority of rats were inclined to choose risk rather than a safe option when the reward expectations were equal; and (3) risk selection was reduced upon inhibition of D1 receptors or stimulation of D2 receptors, but increased upon stimulation of D1 receptors or inhibition of D2 receptors, suggesting that the RDM performance is regulated by D1 and D2 receptors in the mPFC. The present results suggest that DA receptors in the mPFC of rats are involved in regulating cue-guided RDM behavior, with differential involvement of D1 and D2 receptors in the regulation.

Cannabinoid receptor type 1 antagonists alter aspects of risk/reward decision making independent of toluene-mediated effects

Drugs of abuse including cannabis and inhalants impair risk/reward decision making. Cannabis use is often concurrent with inhalant intoxication; yet, preclinical studies investigating the role of endocannabinoids in inhalant misuse are limited. To address this gap in the literature, we used the well-validated probabilistic discounting task to assess risk/reward decision making in rodents following combinations of toluene vapor (a common inhalant) and manipulations of cannabinoid receptor type 1 (CB1R) signaling. As reported previously, acute exposure to toluene vapor disrupted behavioral flexibility during probabilistic discounting. Systemic administration of the CB1R inverse agonist AM281 did not prevent toluene-induced alterations in risky choices, but did independently reduce win-stay behavior, increase choice latency, and increase omissions. Toluene-induced deficits in probabilistic discounting are thought to involve impaired medial prefrontal cortex (mPFC) activity. As we previously reported that some of toluene's inhibitory effects on glutamatergic signaling in the mPFC are endocannabinoid-dependent, we tested the hypothesis that mPFC CB1R activity mediates toluene-induced deficits in discounting. However, bilateral injection of the CB1R inverse agonist AM251 prior to toluene vapor exposure had no effect on toluene-induced changes in risk behavior. In a final set of experiments, we injected the CB1R inverse agonist AM251 (5 and 50 ng), the CB1R agonist WIN55,212-2 (50 ng and 500 ng), or vehicle into the mPFC prior to testing. While mPFC CB1R stimulation did not affect any of the measures tested, the CB1R inverse agonist caused a dose-dependent reduction in win-stay behavior without altering any other measures. Together, these studies indicate that toluene-induced deficits in probabilistic discounting are largely distinct from CB1R-dependent effects that include decreased effectiveness of positive reinforcement (mPFC CB1Rs), decision making speed, and task engagement (non-mPFC CB1Rs).

Dorsal-to-ventral imbalance in the superior longitudinal fasciculus mediates methylphenidate's effect on beta oscillations in ADHD

While pharmacological treatment with methylphenidate (MPH) is a first line intervention for ADHD, its mechanisms of action have yet to be elucidated. We here seek to identify the white matter tracts that mediate MPH's effect on beta oscillations. We implemented a double-blind placebo-controlled crossover design, where boys diagnosed with ADHD underwent behavioral and MEG measurements during a spatial attention task while on and off MPH. The results were compared with an age/IQ-matched control group. Estimates of white matter tracts were obtained using diffusion tensor imaging (DTI). Via a stepwise model selection strategy, we identified the fiber tracts (regressors) significantly predicting values of the dependent variables of interest (i.e., oscillatory power, behavioral performance, and clinical symptoms): the anterior thalamic radiation (ATR), the superior longitudinal fasciculus ("parietal endings") (SLFp), and superior longitudinal fasciculus ("temporal endings") (SLFt). ADHD symptoms severity was associated with lower fractional anisotropy (FA) within the ATR. In addition, individuals with relatively higher FA in SLFp compared to SLFt, led to stronger behavioral effects of MPH in the form of faster and more accurate responses. Furthermore, the same parietotemporal FA gradient explained the effects of MPH on beta modulation: subjects with ADHD exhibiting higher FA in SLFp compared to SLFt also displayed greater effects of MPH on beta power during response preparation. Our data suggest that the behavioral deficits and aberrant oscillatory modulations observed in ADHD depend on a possibly detrimental structural connectivity imbalance within the SLF, caused by a diffusivity gradient in favor of parietal rather than temporal, fiber tracts.

Acute restraint stress redirects prefrontal cortex circuit function through mGlu5 receptor plasticity on somatostatin-expressing interneurons

Inhibitory interneurons orchestrate prefrontal cortex (PFC) activity, but we have a limited understanding of the molecular and experience-dependent mechanisms that regulate synaptic plasticity across PFC microcircuits. We discovered that mGlu5 receptor activation facilitates long-term potentiation at synapses from the basolateral amygdala (BLA) onto somatostatin-expressing interneurons (SST-INs) in mice. This plasticity appeared to be recruited during acute restraint stress, which induced intracellular calcium mobilization within SST-INs and rapidly potentiated postsynaptic strength onto SST-INs. Restraint stress and mGlu5 receptor activation each augmented BLA recruitment of SST-IN phasic feedforward inhibition, shunting information from other excitatory inputs, including the mediodorsal thalamus. Finally, studies using cell-type-specific mGlu5 receptor knockout mice revealed that mGlu5 receptor function in SST-expressing cells is necessary for restraint stress-induced changes to PFC physiology and related behaviors. These findings provide new insights into interneuron-specific synaptic plasticity mechanisms and suggest that SST-IN microcircuits may be promising targets for treating stress-induced psychiatric diseases.

Event-based control of autonomic and emotional states by the anterior cingulate cortex

Despite being an intensive area of research, the function of the anterior cingulate cortex (ACC) remains somewhat of a mystery. Human imaging studies implicate the ACC in various cognitive functions, yet surgical ACC lesions used to treat emotional disorders have minimal lasting effects on cognition. An alternative view is that ACC regulates autonomic states, consistent with its interconnectivity with autonomic control regions and that stimulation evokes changes in autonomic/emotional states. At the cellular level, ACC neurons are highly multi-modal and promiscuous, and can represent a staggering array of task events. These neurons nevertheless combine to produce highly event-specific ensemble patterns that likely alter activity in downstream regions controlling emotional and autonomic tone. Since neuromodulators regulate the strength of the ensemble activity patterns, they would regulate the impact these patterns have on downstream targets. Through these mechanisms, the ACC may determine how strongly to react to the very events its ensembles represent. Pathologies arise when specific event-related representations gain excessive control over autonomic/emotional states.

Sex differences in learning from exploration

Sex-based modulation of cognitive processes could set the stage for individual differences in vulnerability to neuropsychiatric disorders. While value-based decision making processes in particular have been proposed to be influenced by sex differences, the overall correct performance in decision making tasks often show variable or minimal differences across sexes. Computational tools allow us to uncover latent variables that define different decision making approaches, even in animals with similar correct performance. Here, we quantify sex differences in mice in the latent variables underlying behavior in a classic value-based decision making task: a restless 2-armed bandit. While male and female mice had similar accuracy, they achieved this performance via different patterns of exploration. Male mice tended to make more exploratory choices overall, largely because they appeared to get 'stuck' in exploration once they had started. Female mice tended to explore less but learned more quickly during exploration. Together, these results suggest that sex exerts stronger influences on decision making during periods of learning and exploration than during stable choices. Exploration during decision making is altered in people diagnosed with addictions, depression, and neurodevelopmental disabilities, pinpointing the neural mechanisms of exploration as a highly translational avenue for conferring sex-modulated vulnerability to neuropsychiatric diagnoses.

Dopamine neurons gate the intersection of cocaine use, decision making, and impulsivity

Gambling and substance use disorders are highly comorbid. Both clinical populations are impulsive and exhibit risky decision-making. Drug-associated cues have long been known to facilitate habitual drug-seeking, and the salient audiovisual cues embedded within modern gambling products may likewise encourage problem gambling. The dopamine neurons of the ventral tegmental area (VTA) are exquisitely sensitive to drugs of abuse, uncertain rewards, and reward-paired cues and may therefore be the common neural substrate mediating synergistic features of both disorders. To test this hypothesis, we first gained specific inhibitory control over VTA dopamine neurons by transducing a floxed inhibitory DREADD (AAV5-hSyn-DIO-hM4D(Gi)-mCherry) in rats expressing Cre recombinase in tyrosine hydroxylase neurons. We then trained rats in our cued rat gambling task (crGT), inhibiting dopamine neurons throughout task acquisition and performance, before allowing them to self-administer cocaine in the same diurnal period as crGT sessions. The trajectories of addiction differ in women and men, and the dopamine system may differ functionally across the sexes; therefore, we used male and female rats here. We found that inhibition of VTA dopamine neurons decreased cue-induced risky choice and reduced motor impulsivity in males, but surprisingly, enhanced risky decision making in females. Inhibiting VTA dopamine neurons also prevented cocaine-induced changes in decision making in both sexes, but nevertheless drove all animals to consume more cocaine. These findings show that chronic dampening of dopamine signalling can have both protective and deleterious effects on addiction-relevant behaviours, depending on biological sex and dependent variable of interest.

DAT1 polymorphism associated with poor decision-making in males with antisocial personality disorder and high psychopathic traits

Studies suggest that abnormalities of the dopaminergic system underlie decision-making deficits, a hallmark of antisocial personality disorder (ASPD) and psychopathy. The dopamine transporter gene (DAT1) is of particular interest due to a polymorphism that controls dopamine transporter (DAT) activity. However, the association between DAT1 genotypes and decision-making in ASPD has never been studied. The current study investigated the effect of DAT1 genotype on decision-making, as measured by the Iowa Gambling Task (IGT), in ASPD and healthy controls. A total of 17 participants with ASPD and 16 healthy control participants without ASPD were sampled. The Hare Psychopathy Checklist-Revised and the IGT were administered to all participants. All participants provided blood samples for genotyping. Data revealed a novel interaction effect between DAT1 genotype and diagnosis, whereby ASPD participants with low DAT activity genotypes performed significantly worse on the IGT and selected from disadvantageous decks more often, whereas the low DAT activity genotype in the healthy control group was associated with better performance on the IGT, and they selected from disadvantageous decks less often. We demonstrate, for the first time, that low DAT activity genotypes in ASPD with high psychopathic traits contribute to poor decision-making.

Prolonged Consumption of Sweetened Beverages Lastingly Deteriorates Cognitive Functions and Reward Processing in Mice

We investigated the detrimental effects of chronic consumption of sweet or sweetened beverages in mice. We report that consumption of beverages containing small amounts of sucrose during several weeks impaired reward systems. This is evidenced by robust changes in the activation pattern of prefrontal brain regions associated with abnormal risk-taking and delayed establishment of decision-making strategy. Supporting these findings, we find that chronic consumption of low doses of artificial sweeteners such as saccharin disrupts brain regions' activity engaged in decision-making and reward processes. Consequently, this leads to the rapid development of inflexible decisions, particularly in a subset of vulnerable individuals. Our data also reveal that regular consumption, even at low doses, of sweet or sweeteners dramatically alters brain neurochemistry, i.e., dopamine content and turnover, and high cognitive functions, while sparing metabolic regulations. Our findings suggest that it would be relevant to focus on long-term consequences on the brain of sweet or sweetened beverages in humans, especially as they may go metabolically unnoticed.

Medial orbitofrontal cortex dopamine D1/D2 receptors differentially modulate distinct forms of probabilistic decision-making

Efficient decision-making involves weighing the costs and benefits associated with different actions and outcomes to maximize long-term utility. The medial orbitofrontal cortex (mOFC) has been implicated in guiding choice in situations involving reward uncertainty, as inactivation in rats alters choice involving probabilistic rewards. The mOFC receives considerable dopaminergic input, yet how dopamine (DA) modulates mOFC function has been virtually unexplored. Here, we assessed how mOFC D₁ and D₂ receptors modulate two forms of reward seeking mediated by this region, probabilistic reversal learning and probabilistic discounting. Separate groups of well-trained rats received intra-mOFC microinfusions of selective D₁ or D₂ antagonists or agonists prior to task performance. mOFC D₁ and D₂ blockade had opposing effects on performance during probabilistic reversal learning and probabilistic discounting. D₁ blockade impaired, while D₂ blockade increased the number of reversals completed, both mediated by changes in errors and negative feedback sensitivity apparent during the initial discrimination of the task, which suggests changes in probabilistic reinforcement learning rather than flexibility. Similarly, D₁ blockade reduced, while D₂ blockade increased preference for larger/risky rewards. Excess D₁ stimulation had no effect on either task, while excessive D₂ stimulation impaired probabilistic reversal performance, and reduced both profitable risky choice and overall task engagement. These findings highlight a previously uncharacterized role for mOFC DA, showing that D₁ and D₂ receptors play dissociable and opposing roles in different forms of reward-related action selection. Elucidating how DA biases behavior in these situations will expand our understanding of the mechanisms regulating optimal and aberrant decision-making.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

From Desire to Dread-A Neurocircuitry Based Model for Food Avoidance in Anorexia Nervosa

Anorexia nervosa is a severe psychiatric illness associated with food avoidance. Animal models from Berridge et al. over the past decade showed that environmental ambience, pleasant or fear inducing, can trigger either appetitive (desire) or avoidance (dread) behaviors in animals via frontal cortex, nucleus accumbens dopamine D1 and D2 receptors, and hypothalamus. Those mechanisms could be relevant for understanding anorexia nervosa. However, models that translate animal research to explain the psychopathology of anorexia nervosa are sparse. This article reviews animal and human research to find evidence for whether this model can explain food avoidance behaviors in anorexia nervosa. Research on anorexia nervosa suggests fear conditioning to food, activation of the corticostriatal brain circuitry, sensitization of ventral striatal dopamine response, and alterations in hypothalamic function. The results support the applicability of the animal neurocircuitry derived model and provide directions to further study the pathophysiology that underlies anorexia nervosa.

The PI3-Kinase p110β Isoform Controls Severity of Cocaine-Induced Sequelae and Alters the Striatal Transcriptome

BACKGROUND

The PI3-kinase (PI3K) complex is a well-validated target for mitigating cocaine-elicited sequelae, but pan-PI3K inhibitors are not viable long-term treatment options. The PI3K complex is composed of p110 catalytic and regulatory subunits, which can be individually manipulated for therapeutic purposes. However, this possibility has largely not been explored in behavioral contexts.

METHODS

Here, we inhibited PI3K p110β in the medial prefrontal cortex (mPFC) of cocaine-exposed mice. Behavioral models for studying relapse, sensitization, and decision-making biases were paired with protein quantification, RNA sequencing, and cell type-specific chemogenetic manipulation and RNA quantification to determine whether and how inhibiting PI3K p110β confers resilience to cocaine.

RESULTS

Viral-mediated PI3K p110β silencing reduced cue-induced reinstatement of cocaine seeking by half, blocked locomotor sensitization, and restored mPFC synaptic marker content after exposure to cocaine. Cocaine blocked the ability of mice to select actions based on their consequences, and p110β inhibition restored this ability. Silencing dopamine D₂ receptor-expressing excitatory mPFC neurons mimicked cocaine, impairing goal-seeking behavior, and again, p110β inhibition restored goal-oriented action. We verified the presence of p110β in mPFC neurons projecting to the dorsal striatum and orbitofrontal cortex and found that inhibiting p110β in the mPFC altered the expression of functionally defined gene clusters within the dorsal striatum and not orbitofrontal cortex.

CONCLUSIONS

Subunit-selective PI3K silencing potently mitigates drug seeking, sensitization, and decision-making biases after exposure to cocaine. We suggest that inhibiting PI3K p110β provides neuroprotection against cocaine by triggering coordinated corticostriatal adaptations.

Medial prefrontal cortical control of reward- and aversion-based behavioral output: Bottom-up modulation

How does the brain guide our actions? This is a complex issue, where the medial prefrontal cortex (mPFC) plays a crucial role. The mPFC is essential for cognitive flexibility and decision making. These functions are related to reward- and aversion-based learning, which ultimately drive behavior. Though, cortical projections and modulatory systems that may regulate those processes in the mPFC are less understood. How does the mPFC regulate approach-avoidance behavior in the case of conflicting aversive and appetitive stimuli? This is likely dependent on the bottom-up neuromodulation of the mPFC projection neurons. In this review, we integrate behavioral-, pharmacological-, and viral-based circuit manipulation data showing the involvement of mPFC dopaminergic, noradrenergic, cholinergic, and serotoninergic inputs in reward and aversion processing. Given that an incorrect balance of reward and aversion value could be a key problem in mental diseases such as substance use disorders, we discuss outstanding questions for future research on the role of mPFC modulation in reward and aversion.

Pharmacological blockade of dopamine D1- or D2-receptor in the prefrontal cortex induces attentional impairment in the object-based attention test through different neuronal circuits in mice

Dopamine is a key neurotransmitter that regulates attention through dopamine D1 and D2-receptors in the prefrontal cortex (PFC). We previously developed an object-based attention test (OBAT) to evaluate attention in mice. Disruption of the dopaminergic neuronal system in the PFC induced attentional impairment in the OBAT. However, previous studies have not systematically examined which specific brain regions are associated with the blockade of PFC dopamine D1 and D2-receptors in the OBAT. In this study, we investigated the association of dopamine D1 and D2-receptors in the PFC with attention and neuronal activity in diverse brain regions. We found that both dopamine D1 and D2-receptor antagonists induced attentional impairment in the OBAT by bilateral microinjection into the PFC of mice, suggesting that both dopamine D1 and D2-receptors were associated with attention in the OBAT. Our analysis of the neuronal activity as indicated by c-Fos expression in 11 different brain regions showed that based on the antagonist types, there was selective activation of several brain regions. Overall, this study suggests that both dopamine D1 and D2-receptors play a role in attention through different neuronal circuits in the PFC of mice.

Dorsomedial striatal contributions to different forms of risk/reward decision making

Optimal decision making involving reward uncertainty is integral to adaptive goal-directed behavior. In some instances, these decisions are guided by internal representations of reward history, whereas in other situations, external cues inform a decision maker about how likely certain actions are to yield reward. Different regions of the frontal lobe form distributed networks with striatal and amygdalar regions that facilitate different types of risk/reward decision making. The dorsal medial striatum (DMS) is one key output region of the prefrontal cortex, yet there have been few preclinical studies investigating the involvement of the DMS in different forms of risk/reward decision making. The present study addressed this issue, wherein separate groups of male rats were trained on one of two tasks where they chose between a small/certain or a large/risky reward. In a probabilistic discounting task, reward probabilities changed systematically over blocks of trials (100-6.25% or 6.25-100%), requiring rats to use internal representations of reward history to guide choice. Cue-guided decision-making was assessed with a "Blackjack" task, where different auditory cues indicated the odds associated with the large/risky option (50 or 12.5%). Inactivation of the DMS with GABA agonists impaired adjustments in choice biases during probabilistic discounting, resulting in either increases or decreases in risky choice as the probabilities associated with the large/risky reward decreased or increased over a session. In comparison, DMS inactivation increased risky choices on poor-odds trials on the Blackjack task, which was associated with a reduced impact that non-rewarded choices had on subsequent choices. DMS inactivation also impaired performance of an auditory conditional discrimination. These findings highlight a previously uncharacterized role for the DMS in facilitating flexible action selection during multiple forms of risk/reward decision making.

Divergent projections of the prelimbic cortex bidirectionally regulate active avoidance

The prefrontal cortex (PFC) integrates incoming information to guide our actions. When motivation for food-seeking competes with avoidance of danger, the PFC likely plays a role in selecting the optimal choice. In platform-mediated active avoidance, rats avoid a tone-signaled footshock by stepping onto a nearby platform, delaying access to sucrose pellets. This avoidance requires prelimbic (PL) PFC, basolateral amygdala (BLA), and ventral striatum (VS). We previously showed that inhibitory tone responses of PL neurons correlate with avoidability of shock (Diehl et al., 2018). Here, we optogenetically modulated PL terminals in VS and BLA to identify PL outputs regulating avoidance. Photoactivating PL-VS projections reduced avoidance, whereas photoactivating PL-BLA projections increased avoidance. Moreover, photosilencing PL-BLA or BLA-VS projections reduced avoidance, suggesting that VS receives opposing inputs from PL and BLA. Bidirectional modulation of avoidance by PL projections to VS and BLA enables the animal to make appropriate decisions when faced with competing drives.

Retrograde Labeling Illuminates Distinct Topographical Organization of D1 and D2 Receptor-Positive Pyramidal Neurons in the Prefrontal Cortex of Mice

The cortex plays an important role in regulating motivation and cognition, and does so by regulating multiple subcortical brain circuits. Glutamatergic pyramidal neurons in the prefrontal cortex (PFC) are topographically organized in different subregions such as the prelimbic, infralimbic (IL), and orbitofrontal and project to topographically-organized subcortical target regions. Dopamine D1 and D2 receptors are expressed on glutamatergic pyramidal neurons in the PFC. However, it is unclear whether D1 and D2 receptor-expressing pyramidal neurons in the PFC are also topographically organized. We used a retrograde adeno-associated virus (AAVRG)-based approach to illuminate the topographical organization of D1 and D2 receptor-expressing neurons, projecting to distinct striatal and midbrain subregions. Our experiments reveal that AAVRG injection in the nucleus accumbens (NAcc) or dorsal striatum (dSTR) of D1Cre mice labeled distinct neuronal subpopulations in medial orbitofrontal or prelimbic PFC, respectively. However, AAVRG injection in NAcc or dSTR of D2Cre mice labeled medial orbitofrontal, but not medial prelimbic PFC, respectively. Additionally, D2R+ but not D1R+ PFC neurons were labeled on injection of AAVRG in substantia nigra pars compacta (SNpc). Thus, our data are the first to highlight a unique dopamine receptor-specific topographical pattern in the PFC, which could have profound implications for corticostriatal signaling in the basal ganglia.

Cell-Type-Specific D1 Dopamine Receptor Modulation of Projection Neurons and Interneurons in the Prefrontal Cortex

Dopamine modulation in the prefrontal cortex (PFC) mediates diverse effects on neuronal physiology and function, but the expression of dopamine receptors at subpopulations of projection neurons and interneurons remains unresolved. Here, we examine D1 receptor expression and modulation at specific cell types and layers in the mouse prelimbic PFC. We first show that D1 receptors are enriched in pyramidal cells in both layers 5 and 6, and that these cells project to intratelencephalic targets including contralateral cortex, striatum, and claustrum rather than to extratelencephalic structures. We then find that D1 receptors are also present in interneurons and enriched in superficial layer VIP-positive (VIP+) interneurons that coexpresses calretinin but absent from parvalbumin-positive (PV+) and somatostatin-positive (SOM+) interneurons. Finally, we determine that D1 receptors strongly and selectively enhance action potential firing in only a subset of these corticocortical neurons and VIP+ interneurons. Our findings define several novel subpopulations of D1+ neurons, highlighting how modulation via D1 receptors can influence both excitatory and disinhibitory microcircuits in the PFC.

Prefrontal cortical and nucleus accumbens contributions to discriminative conditioned suppression of reward-seeking

Fear can potently inhibit ongoing behavior, including reward-seeking, yet the neural circuits that underlie such suppression remain to be clarified. Prior studies have demonstrated that distinct subregions of the rodent medial prefrontal cortex (mPFC) differentially affect fear behavior, whereby fear expression is promoted by the more dorsal prelimbic cortex (PL) and inhibited by the more ventral infralimbic cortex (IL). These mPFC regions project to subregions of the nucleus accumbens, the core (NAcC) and shell (NAcS), that differentially contribute to reward-seeking as well as affective processes that may be relevant to fear expression. Here, we investigated how these mPFC and NAc subregions contribute to discriminative fear conditioning, assessed by conditioned suppression of reward-seeking. Bilateral inactivation of the NAcS or PL reduced the expression of conditioned suppression to a shock-associated CS+, whereas NAcC inactivation reduced reward-seeking without affecting suppression. IL inactivation caused a general reduction in conditioned suppression following discriminative conditioning, but not when using a single-stimulus design. Pharmacological disconnection of the PL → NAcS pathway revealed that this projection mediates conditioned suppression. These data add to a growing literature implicating discrete cortico-striatal pathways in the suppression of reward-seeking in response to aversive stimuli. Dysfunction within related structures may contribute to aberrant patterns of behavior in psychiatric illnesses including substance use disorders.

Involvement of noradrenergic and serotonergic systems in risk-based decisions between options of equivalent expected value in rats

Risk perception is an important factor that may mediate risk-based decision-making processes regulated by noradrenergic (NA) and serotonergic (5-HT) systems. Most risk-based decision-making models involve complex factors, such as risk perception or reward value, such that the final decision is the result of the interactions among these factors. However, the contribution of risk perception per se in risk decisions has remained unclear. Therefore, in the present study, we made some modifications to the classical probabilistic discounting task (PDT) to focus on the impact of risk perception and noradrenergic/serotonergic systems on decision-making behavior. Meanwhile, we conducted an elevated plus-maze (EPM) test to detect the correlation between anxiety and choice behavior. In the current study, rats had to choose between a "certain" lever that delivered a certain number of pellets and a "risky" lever that delivered eight pellets in a probabilistic manner (descending: 50%, 25%, 12.5% or ascending 12.5%, 25%, 50% of the time). The long-term rewarding values of the two levers were always identical in each block within each session. According to their baseline performances in choosing the risky lever, rats were divided into the risk-prefer group and risk-averse group. The results showed that there was a significant correlation between open arm time in EPM and risky choice for both descending order and ascending order, indicating that highly anxious rats more often preferred the safe option under risk. Pharmacological stimulation of α2-adrenergic receptors via dexmedetomidine (0.01 mg/kg) decreased the preference of probabilistic rewards in the risk-prefer group, while blocking α2 receptors by atipamezole (0.3 mg/kg) also reduced risky choices. The NA reuptake inhibitor, atomoxetine, increased the preference for risky choices in the risk-prefer group, the effect of which was attained via multiple superimposed doses. Administration of the 5-HT_2A receptor agonist, DOI (0.1 mg/kg), increased risk-taking behavior in the risk-prefer group. Taken together, these results suggest that NA may be more inclined to process negative information such as loss or uncertainty in the regulation of risk-related decision making, whereas 5-HT may function primarily to increase risk-taking behavior. Our findings may help to further elucidate how noradrenergic and serotonergic systems differentially affect individuals with different risk preferences in terms of regulating risk perception in risk-related decision making.

Risk-based decision making in rats: Modulation by sex and amphetamine

Decision-making is a complex process essential to daily adaptation in many species. Risk is an inherent aspect of decision-making and it is influenced by gonadal hormones. Testosterone and 17β-estradiol may modulate decision making and impact the mesocorticolimbic dopamine pathway. Here, we explored sex differences, the effect of gonadal hormones and the dopamine agonist amphetamine on risk-based decision making. Intact or gonadectomised (GDX) male and female rats underwent to a probabilistic discounting task. High and low doses of testosterone propionate (1.0 or 0.2 mg) and 17β-estradiol benzoate (0.3 μg) were administered to assess acute effects on risk-based decision making. After 3-days of washout period, intact and GDX rats received high or low (0.5 or 0.125 mg/kg) doses of amphetamine and re-tested in the probabilistic discounting task. Under baseline conditions, males made more risky choices during probability discounting compared to female rats, particularly in the lower probability blocks, but GDX did not influence risky choice. The high, but not the low dose, of testosterone modestly reduced risky decision making in GDX male rats. Conversely, 17β-estradiol had no significant effect on risky choice regardless of GDX status in either sex. Lastly, a higher dose of amphetamine increased risky decision making in both intact males and females, but had no effect in GDX rats. These findings demonstrated sex differences in risk-based decision making, with males showing a stronger bias toward larger, uncertain rewards. GDX status influenced the effects of amphetamine, suggesting different dopaminergic regulation in risk-based choices among males and females.

Prefrontal D1 Dopamine-Receptor Neurons and Delta Resonance in Interval Timing

Considerable evidence has shown that prefrontal neurons expressing D1-type dopamine receptors (D1DRs) are critical for working memory, flexibility, and timing. This line of work predicts that frontal neurons expressing D1DRs mediate cognitive processing. During timing tasks, one form this cognitive processing might take is time-dependent ramping activity-monotonic changes in firing rate over time. Thus, we hypothesized the prefrontal D1DR+ neurons would strongly exhibit time-dependent ramping during interval timing. We tested this idea using an interval-timing task in which we used optogenetics to tag D1DR+ neurons in the mouse medial frontal cortex (MFC). While 23% of MFC D1DR+ neurons exhibited ramping, this was significantly less than untagged MFC neurons. By contrast, MFC D1DR+ neurons had strong delta-frequency (1-4 Hz) coherence with other MFC ramping neurons. This coherence was phase-locked to cue onset and was strongest early in the interval. To test the significance of these interactions, we optogenetically stimulated MFC D1DR+ neurons early versus late in the interval. We found that 2-Hz stimulation early in the interval was particularly effective in rescuing timing-related behavioral performance deficits in dopamine-depleted animals. These findings provide insight into MFC networks and have relevance for disorders such as Parkinson's disease and schizophrenia.

Heroin delay discounting and impulsivity: Modulation by DRD1 genetic variation

BACKGROUND

Dopamine D1 receptors (encoded by DRD1) are implicated in drug addiction and high-risk behaviors. Delay discounting (DD) procedures measure decisional balance between choosing smaller/sooner rewards vs larger/later rewards. Individuals with higher DD (rapid discounting) are prone to maladaptive behaviors that provide immediate reinforcement (eg, substance use). DRD1 variants have been linked with increased DD (in healthy volunteers) and opioid abuse. This study determined whether four dopaminergic functional variants modulated heroin DD and impulsivity.

METHODS

Substance use, DD, and genotype data (DRD1 rs686 and rs5326, DRD3 rs6280, COMT rs4680) were obtained from 106 current heroin users. Subjects completed an array of DD choices during two imagined conditions: heroin satiation and withdrawal. Rewards were expressed as $10 heroin bag units, with maximum delayed amount of 30 bags. Delays progressively increased from 3 to 96 hours.

RESULTS

DRD1 rs686 (A/A, n = 25; G/A, n = 56; G/G, n = 25) was linearly related to the difference in heroin DD (area under the curve; AUC) between the heroin satiation and withdrawal conditions; specifically, G/G homozygotes had a significantly smaller (satiation minus withdrawal) AUC difference score had higher drug-use impulsivity questionnaire scores, relative to A/A homozygotes, with G/A intermediate. DRD3 and COMT variants were not associated with these DD and impulsivity outcomes.

CONCLUSION

DRD1 rs686 modulated the difference in heroin DD score between pharmacological states and was associated with drug-use impulsivity. These data support a role of DRD1 in opioid DD and impulsive behaviors.

Using a dependent schedule to measure risky choice in male rats: Effects of d-amphetamine, methylphenidate, and methamphetamine

Risky choice is the tendency to choose a large, uncertain reward over a small, certain reward, and is typically measured with probability discounting, in which the probability of obtaining the large reinforcer decreases across blocks of trials. One caveat to traditional procedures is that independent schedules are used, in which subjects can show exclusive preference for one alternative relative to the other. For example, some rats show exclusive preference for the small, certain reinforcer as soon as delivery of the large reinforcer becomes probabilistic. Therefore, determining if a drug increases risk aversion (i.e., decreases responding for the probabilistic alternative) is difficult (due to floor effects). The overall goal of this experiment was to use a concurrent-chains procedure that incorporated a dependent schedule during the initial link, thus preventing animals from showing exclusive preference for one alternative relative to the other. To determine how pharmacological manipulations alter performance in this task, male Sprague-Dawley rats (n = 8) received injections of amphetamine (0, 0.25, 0.5, 1.0 mg/kg), methylphenidate (0, 0.3, 1.0, 3.0 mg/kg), and methamphetamine (0, 0.5, 1.0, 2.0 mg/kg). Amphetamine (0.25 mg/kg) and methylphenidate (3.0 mg/kg) selectively increased risky choice, whereas higher doses of amphetamine (0.5 and 1.0 kg/mg) and each dose of methamphetamine impaired stimulus control (i.e., flattened the discounting function). These results show that dependent schedules can be used to measure risk-taking behavior and that psychostimulants promote suboptimal choice when this schedule is used. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Dopaminergic D1 Receptor Stimulation Affects Effort and Risk Preferences

BACKGROUND

Activation of D₁ receptors has been related to successful goal-directed behavior, but it remains unclear whether D₁ receptor activation causally tips the balance of weighing costs and benefits in humans. Here, we tested the impact of pharmacologically stimulated D₁ receptors on sensitivity to risk, delay, and effort costs in economic choice and investigated whether D₁ receptor stimulation would bias preferences toward options with increased costs in a cost-specific manner.

METHODS

In a randomized, double-blind, placebo-controlled, parallel-group phase 1 study, 120 healthy young volunteers received either placebo or 1 of 3 doses (6 mg, 15 mg, or 30 mg) of a novel, selective D₁ agonist (PF-06412562). After drug administration, participants performed decision tasks measuring their preferences for risky, delayed, and effortful outcomes.

RESULTS

Higher doses of the D₁ agonist increased the willingness to exert physical effort for reward as well as reduced the preference for risky outcomes. We observed no effects on preferences for delayed rewards.

CONCLUSIONS

The current results provide evidence that D₁ receptor stimulation causally affects core aspects of cost-benefit decision making in humans.

Dissociable roles for the ventral and dorsal medial prefrontal cortex in cue-guided risk/reward decision making

Converging evidence from studies with animals and humans have implicated separate regions of the medial prefrontal cortex (mPFC) corresponding to the anterior cingulate cortex (ACC), in mediating different aspects of reward-related decisions involving uncertainty or risk. However, the dissociable contributions of subregions of the ACC remain unclear, as discrepancies exist between human neuroimaging findings and preclinical rodent studies. To clarify how ventral vs. dorsal regions of the mPFC contribute to risk/reward decision making, the present study assessed the effects of inactivation of different subregions on performance of a "Blackjack task" that measured cue-guided decision making and shares similarities with paradigms used with humans. Male, Long-Evans rats were well-trained to choose between a Small/Certain reward vs a Large/Risky reward delivered with variable probabilities (i.e., good vs. poor-odds, 50% vs. 12.5%). The odds of obtaining the larger reward was signaled by auditory cues at the start of each trial. Inactivation of the ventral, infralimbic region of the mPFC increased risky choice selectively when the odds of winning were poor. By contrast, inactivation of the prelimbic and anterior cingulate regions of the dorsal mPFC led to suboptimal reductions in risky choice on good-odds trials. The effects of prelimbic vs anterior cingulate inactivations were associated with context-dependent alterations in reward vs negative feedback, respectively. These results further clarify the distinct yet complementary manners in which separate ACC regions promote optimal risk/reward decision making and complement neuroimaging findings that activity in human ventral vs dorsal ACC promotes risk aversion or risky choices.

Vulnerable and resilient cognitive performance related to early life stress: The potential mediating role of dopaminergic receptors in the medial prefrontal cortex of adult mice

RATIONALE

Exposure to early life stress (ELS) is known to have pronounced effects on the prefrontal cortex (PFC). However, not all individuals exposed to ELS manifest the same neurobiological and cognitive phenotypes when adults. Dopamine signaling could be a key factor in understanding the effects of stress on PFC-related cognitive function.

OBJECTIVES

We aimed to investigate the differential effects of ELS on cognitive performance of adult mice and the dopaminergic receptors expression in the PFC.

METHODS

BALB/c males were exposed to the maternal separation (MS) procedure and their cognitive performance on the eight-arm radial maze (8-RAM) were assessed during adulthood. For molecular-level assessments, we performed mRNA expression analyses for dopamine receptors-DRD1, DRD2, DRD3-and Hers1 expression in the medial PFC.

RESULTS

While MS produced an overall impairment on 8-RAM, the stressed animals could be divided in two groups based on their performance: those with impaired cognitive performance (vulnerable to maternal separation, V-MS) and those without any impairment (resilient to maternal separation, R-MS). V-MS animals showed increased DRD1 and DRD2 expression in comparison with other groups. Errors on 8-RAM were also positively correlated with DRD1 and DRD2 mRNA expression.

CONCLUSIONS

Our findings suggest a potential role of the dopaminergic system in the programming mechanisms of cognitive vulnerability and resilience related to ELS.

Mesolimbic dopamine D2 receptors and neural representations of subjective value

The process by which the value of delayed rewards is discounted varies from person to person. It has been suggested that these individual differences in subjective valuation of delayed rewards are supported by mesolimbic dopamine D2-like receptors (D2Rs) in the ventral striatum. However, no study to date has documented an association between direct measures of dopamine receptors and neural representations of subjective value in humans. Here, we examined whether individual differences in D2R availability were related to neural subjective value signals during decision making. Human participants completed a monetary delay discounting task during an fMRI scan and on a separate visit completed a PET scan with the high affinity D2R tracer [18 F]fallypride. Region-of-interest analyses revealed that D2R availability in the ventral striatum was positively correlated with subjective value-related activity in the ventromedial prefrontal cortex and midbrain but not with choice behavior. Whole-brain analyses revealed a positive correlation between ventral striatum D2R availability and subjective value-related activity in the left inferior frontal gyrus and superior insula. These findings identify a link between a direct measure of mesolimbic dopamine function and subjective value representation in humans and suggest a mechanism by which individuals vary in neural representation of discounted subjective value.

The Abused Inhalant Toluene Impairs Medial Prefrontal Cortex Activity and Risk/Reward Decision-Making during a Probabilistic Discounting Task

Inhalant (e.g., toluene) misuse is linked to behavioral and cognitive deficits in humans, yet preclinical studies of the effect of inhalants on higher-order cognition are limited. We addressed this gap in the literature by examining the effect of toluene vapor exposure on risk/reward decision-making in male and female Sprague-Dawley rats using a probabilistic discounting task. In this task, rodents chose a risky/large reward or a safe/small reward, with the odds of risky reinforcement descending or ascending throughout the test session. We observed a dose-dependent, sex-independent deficit in behavioral flexibility during probabilistic discounting caused by acute toluene exposure. Rats exposed to toluene vapor during adolescence and tested as adults performed comparably to air-treated controls and were susceptible to the effects of an acute toluene challenge. These behavioral flexibility deficits observed suggests dysfunctional medial prefrontal cortex (mPFC) activity. To address this hypothesis, we virally expressed the genetically encoded calcium sensor GCaMP6f in glutamatergic mPFC neurons and monitored calcium transients in real-time using in vivo fiber photometry. mPFC activity peaked before either lever press during free-choice trials in toluene- and air-treated animals. During forced-choice trials, GCaMP6f transients shifted from pre-risky to pre-safe choice, an effect mitigated by acute toluene exposure. mPFC activity decreased during rewarded trials, with larger decreases following risky/large wins compared with safe/small wins. Toluene-treated animals also had decreased mPFC activity during rewarded trials, but there was no distinction between risky/large wins and safe/small wins. These results provide physiological evidence for mPFC-dependent behavioral deficits caused by toluene.SIGNIFICANCE STATEMENT Inhalants (e.g., toluene) are an understudied class of drugs of abuse that cause devastating behavioral and cognitive deficits in humans. Understanding the neurobiological interactions of toluene vapor using animal models is important for developing effective treatment strategies for inhalant addicts. Here we find that toluene vapor reduces behavioral flexibility in rodents making risk/reward-based decisions. The medial prefrontal cortex (mPFC) drives behavioral flexibility during this type of decision-making and we show that toluene reduces the ability of mPFC neurons to track optimal choices as reward probabilities change. Toluene also reduces these neurons' ability to distinguish between small and large rewards. A combination of these factors likely leads to the impaired performance in probabilistic discounting following acute toluene exposure.