A neuronal mechanism underlying decision-making deficits during hyperdopaminergic states

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

RATIONALE

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

OBJECTIVE

We determined how 14 daily THC injections (5 mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

METHODS

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impact probabilistic discounting.

RESULTS

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

CONCLUSIONS

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine neurons or their projections to mPFC.

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

Rationale

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ 9 -tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

Objective

We determined how 14 daily THC injections (5mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

Methods

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impacts probabilistic discounting.

Results

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

Conclusions

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine neurons or their projections to mPFC.

Mesolimbic Neural Response Dynamics Predict Future Individual Alcohol Drinking in Mice

BACKGROUND

Individual variability in response to rewarding stimuli is a striking but understudied phenomenon. The mesolimbic dopamine system is critical in encoding the reinforcing properties of both natural reward and alcohol; however, how innate or baseline differences in the response dynamics of this circuit define individual behavior and shape future vulnerability to alcohol remain unknown.

METHODS

Using naturalistic behavioral assays, a voluntary alcohol drinking paradigm, in vivo fiber photometry, in vivo electrophysiology, and chemogenetics, we investigated how differences in mesolimbic neural circuit activity contribute to the individual variability seen in reward processing and, by proxy, alcohol drinking.

RESULTS

We first characterized heterogeneous behavioral and neural responses to natural reward and defined how these baseline responses predicted future individual alcohol-drinking phenotypes in male mice. We then determined spontaneous ventral tegmental area dopamine neuron firing profiles associated with responses to natural reward that predicted alcohol drinking. Using a dual chemogenetic approach, we mimicked specific mesolimbic dopamine neuron firing activity before or during voluntary alcohol drinking to link unique neurophysiological profiles to individual phenotype. We show that hyperdopaminergic individuals exhibit a lower neuronal response to both natural reward and alcohol that predicts lower levels of alcohol consumption in the future.

CONCLUSIONS

These findings reveal unique, circuit-specific neural signatures that predict future individual vulnerability or resistance to alcohol and expand the current knowledge base on how some individuals are able to titrate their alcohol consumption whereas others go on to engage in unhealthy alcohol-drinking behaviors.

Neuromodulator regulation and emotions: insights from the crosstalk of cell signaling

The unraveling of the regulatory mechanisms that govern neuronal excitability is a major challenge for neuroscientists worldwide. Neurotransmitters play a critical role in maintaining the balance between excitatory and inhibitory activity in the brain. The balance controls cognitive functions and emotional responses. Glutamate and γ-aminobutyric acid (GABA) are the primary excitatory and inhibitory neurotransmitters of the brain, respectively. Disruptions in the balance between excitatory and inhibitory transmission are implicated in several psychiatric disorders, including anxiety disorders, depression, and schizophrenia. Neuromodulators such as dopamine and acetylcholine control cognition and emotion by regulating the excitatory/inhibitory balance initiated by glutamate and GABA. Dopamine is closely associated with reward-related behaviors, while acetylcholine plays a role in aversive and attentional behaviors. Although the physiological roles of neuromodulators have been extensively studied neuroanatomically and electrophysiologically, few researchers have explored the interplay between neuronal excitability and cell signaling and the resulting impact on emotion regulation. This review provides an in-depth understanding of "cell signaling crosstalk" in the context of neuronal excitability and emotion regulation. It also anticipates that the next generation of neurochemical analyses, facilitated by integrated phosphorylation studies, will shed more light on this topic.

Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation

BACKGROUND

Acute stress alters risk-based decision-making; however, the underlying neural and neurochemical substrates are underexplored. Given their well-documented stress-inducing effects in humans and laboratory animals, glucocorticoids such as cortisol and corticosterone and the α2-adrenoceptor antagonist yohimbine represent potent pharmacological tools to mimic some characteristics of acute stress.

METHODS

Here, we analyzed the effects of the pharmacological stressors corticosterone and yohimbine given systemically on risk-based decision-making in male rats. Moreover, we investigated whether pharmacological stressor effects on risk-based decision-making involve dopamine D1 receptor stimulation in the dorsal prelimbic cortex (PL). We used a risk discounting task that requires choosing between a certain/small reward lever that always delivered 1 pellet and a risky/large reward lever that delivered 4 pellets with a decreasing probability across subsequent trials.

RESULTS

Systemic administration of yohimbine increased the preference for the risky/large reward lever. By contrast, systemic single administration of corticosterone did not significantly promote risky choice. Moreover, co-administration of corticosterone did not enhance the effects of yohimbine on risky choice. The data further show that the increased preference for the risky/large reward lever under systemic yohimbine was lowered by a concurrent pharmacological blockade of dopamine D1 receptors in the PL.

CONCLUSIONS

Our rodent data provide causal evidence that stimulation of PL D1 receptors may represent a neurochemical mechanism by which the acute pharmacological stressor yohimbine, and possibly nonpharmacological stressors as well, promote risky choice.

Activity in the Dorsomedial Striatum Underlies Serial Reversal Learning Performance Under Probabilistic Uncertainty

Background

Corticostriatal circuits, particularly the dorsomedial striatum (DMS) and lateral orbitofrontal cortex, are critical for navigating reversal learning under probabilistic uncertainty. These same areas are implicated in the reversal learning impairments observed in individuals with psychosis as well as their psychotic symptoms, suggesting that they may share a common neurobiological substrate. To address this question, we used psychostimulant exposure and specific activation of the DMS during reversal learning in mice to assess corticostriatal activity.

Methods

We used amphetamine treatment to induce psychosis-relevant neurobiology in male mice during reversal learning and to examine pathway-specific corticostriatal activation. To determine the causal role of DMS activity, we used chemogenetics to drive midbrain inputs during a range of probabilistic contingencies.

Results

Mice treated with amphetamine showed altered punishment learning, which was associated with decreased shifting after losses and increased perseverative errors after reversals. Reversal learning performance and strategies were dependent on increased activity in lateral orbitofrontal cortex to DMS circuits as well as in the DMS itself. Specific activation of midbrain to DMS circuits also decreased shifting after losses and reversal learning performance. However, these alterations were dependent on the probabilistic contingency.

Conclusions

Our work suggests that the DMS plays a multifaceted role in reversal learning. Increasing DMS activity impairs multiple reversal learning processes dependent on the level of uncertainty, confirming its role in the maintenance and selection of incoming cortical inputs. Together, these outcomes suggest that elevated dopamine levels in the DMS could contribute to decision-making impairments in individuals with psychosis.

The Addiction-Susceptibility TaqIA/Ankk1 Controls Reward and Metabolism Through D2 Receptor-Expressing Neurons

BACKGROUND

A large body of evidence highlights the importance of genetic variants in the development of psychiatric and metabolic conditions. Among these, the TaqIA polymorphism is one of the most commonly studied in psychiatry. TaqIA is located in the gene that codes for the ankyrin repeat and kinase domain containing 1 kinase (Ankk1) near the dopamine D2 receptor (D2R) gene. Homozygous expression of the A1 allele correlates with a 30% to 40% reduction of striatal D2R, a typical feature of addiction, overeating, and other psychiatric pathologies. The mechanisms by which the variant influences dopamine signaling and behavior are unknown.

METHODS

Here, we used transgenic and viral-mediated strategies to reveal the role of Ankk1 in the regulation of activity and functions of the striatum.

RESULTS

We found that Ankk1 is preferentially enriched in striatal D2R-expressing neurons and that Ankk1 loss of function in the dorsal and ventral striatum leads to alteration in learning, impulsivity, and flexibility resembling endophenotypes described in A1 carriers. We also observed an unsuspected role of Ankk1 in striatal D2R-expressing neurons of the ventral striatum in the regulation of energy homeostasis and documented differential nutrient partitioning in humans with or without the A1 allele.

CONCLUSIONS

Overall, our data demonstrate that the Ankk1 gene is necessary for the integrity of striatal functions and reveal a new role for Ankk1 in the regulation of body metabolism.

Circuit and Cell-Specific Contributions to Decision Making Involving Risk of Explicit Punishment in Male and Female Rats

Decision making is a complex cognitive process that recruits a distributed network of brain regions, including the basolateral amygdala (BLA) and nucleus accumbens shell (NAcSh). Recent work suggests that communication between these structures, as well as activity of cells expressing dopamine (DA) D2 receptors (D2R) in the NAcSh, are necessary for some forms of decision making; however, the contributions of this circuit and cell population during decision making under risk of punishment are unknown. The current experiments addressed this question using circuit-specific and cell type-specific optogenetic approaches in rats during a decision making task involving risk of punishment. In experiment 1, Long-Evans rats received intra-BLA injections of halorhodopsin or mCherry (control) and in experiment 2, D2-Cre transgenic rats received intra-NAcSh injections of Cre-dependent halorhodopsin or mCherry. Optic fibers were implanted in the NAcSh in both experiments. Following training in the decision making task, BLA→NAcSh or D2R-expressing neurons were optogenetically inhibited during different phases of the decision process. Inhibition of the BLA→NAcSh during deliberation (the time between trial initiation and choice) increased preference for the large, risky reward (increased risk taking). Similarly, inhibition during delivery of the large, punished reward increased risk taking, but only in males. Inhibition of D2R-expressing neurons in the NAcSh during deliberation increased risk taking. In contrast, inhibition of these neurons during delivery of the small, safe reward decreased risk taking. These findings extend our knowledge of the neural dynamics of risk taking, revealing sex-dependent circuit recruitment and dissociable activity of selective cell populations during decision making.SIGNIFICANCE STATEMENT Until recently, the ability to dissect the neural substrates of decision making involving risk of punishment (risk taking) in a circuit-specific and cell-specific manner has been limited by the tools available for use in rats. Here, we leveraged the temporal precision of optogenetics, together with transgenic rats, to probe contributions of a specific circuit and cell population to different phases of risk-based decision making. Our findings reveal basolateral amygdala (BLA)→nucleus accumbens shell (NAcSh) is involved in evaluation of punished rewards in a sex-dependent manner. Further, NAcSh D2 receptor (D2R)-expressing neurons make unique contributions to risk taking that vary across the decision making process. These findings advance our understanding of the neural principles of decision making and provide insight into how risk taking may become compromised in neuropsychiatric diseases.

Inhibition of ventral tegmental area projections to the nucleus accumbens shell increases premature responding in the five-choice serial reaction time task in rats

Exaggerated impulsivity and attentional impairments are hallmarks of certain disorders of behavioural control such as attention-deficit/hyperactivity disorder (ADHD), schizophrenia and addiction. Pharmacological studies have implicated elevated dopamine (DA) levels in the nucleus accumbens shell (NAcbS) in impulsive actions. The NAcbS receives its DA input from the ventral tegmental area (VTA), and we have previously shown that optogenetic activation of VTA-NAcbS projections impaired impulse control and attention in the five-choice serial reaction time task (5-CSRTT) in rats. To better understand the role of VTA-NAcbS projections in impulsivity and attention, the present study sought to inhibit this projection using optogenetics. We demonstrate that inhibiting VTA-NAcbS efferents during the last seconds of the inter-trial interval (i.e. immediately before presentation of the instructive cue) induces exaggerated impulsive action, in the absence of changes in attentional or motivational parameters in the 5-CSRTT. Together with our earlier observations, this suggests that impulse control in the 5-CSRTT is tightly controlled by VTA-NAcbS activity, with deviations in both directions resulting in increased impulsivity.

Altered neural correlates of optimal decision-making in individuals with depressive status

Making optimal decisions by computing risk and benefit is necessary for humans. However, whether individuals with depressive status could utilize the optimal strategy to guide decision and its neural correlates remain unclear. The current study explored these issues by combining a decision task and high temporal-resolution electroencephalogram (EEG). The decision task involved an eight-box trial in which participants successively decided whether to open a box containing a potential reward or punishment, deciding to stop guaranteed they would retain the rewards already accumulated. Theoretically, the optimal strategy in the task was to stop at the fourth box, which had the largest expected value. We found that individuals with depressive status stopped fewer trials at the fourth box, relative to healthy controls, indicating their impaired optimal strategy during decision-making. Moreover, compared to healthy controls, individuals with depressive status showed weaker P2 amplitude and weaker beta-band oscillation at the frontocentral scalp when deciding whether to open the fourth box. Additionally, for healthy controls but not for individuals with depressive status, the P2 amplitude fully mediated the relationship between participants' degree of expected benefit (as reflected by the recreational risk-taking scale) and the frequency of trials stopped at the fourth box. Overall, this study revealed that the P2 amplitude and beta-band oscillation might explain the altered optimal decision-making in individuals with depressive status.

Attention and working memory in patients with prolactinomas: a case-control study

Prolactinomas (prolactin-secreting adenomas) are the most common type of hormone-secreting pituitary tumor. Mounting evidence indicates that excess prolactin impairs cognitive function, but specific assessments of attention in patients with prolactinomas are lacking. Case-control study gathered 54 participants-27 patients with prolactinoma and 27 healthy controls. Neuropsychological assessment included a comprehensive set of diagnostic methods for the evaluation of attention and working memory. Patients showed slower information processing, expressed as a longer working time on the d2 Test of Attention and Color Trails Test (CTT-2), and lower attention-switching shown in the CTT-2 and in two subtests of the Tests of Everyday Attention (Visual Elevator), and Telephone Search While Counting. Working memory disturbances were observed in Digit Span and Symbol Span tests. A level of prolactin correlated negatively with scores in some of the neuropsychological tests measuring attentional switching (Visual Elevator), spatial screening and working memory (CTT-2), spatial working memory (Symbol Span) and auditory-verbal working memory (Digit Span backwards). There were no significant correlations between cognitive performance and tumor size. In conclusion, patients with prolactinoma suffer from impaired cognitive functions, including attention and working memory. Comprehensive neuropsychological assessment should be a permanent element of the diagnostics of this group of patients.

Social Play Behavior Is Critical for the Development of Prefrontal Inhibitory Synapses and Cognitive Flexibility in Rats

Sensory driven activity during early life is critical for setting up the proper connectivity of the sensory cortices. We ask here whether social play behavior, a particular form of social interaction that is highly abundant during postweaning development, is equally important for setting up connections in the developing prefrontal cortex (PFC). Young male rats were deprived from social play with peers during the period in life when social play behavior normally peaks [postnatal day 21-42] (SPD rats), followed by resocialization until adulthood. We recorded synaptic currents in layer 5 cells in slices from medial PFC of adult SPD and control rats and observed that inhibitory synaptic currents were reduced in SPD slices, while excitatory synaptic currents were unaffected. This was associated with a decrease in perisomatic inhibitory synapses from parvalbumin-positive GABAergic cells. In parallel experiments, adult SPD rats achieved more reversals in a probabilistic reversal learning (PRL) task, which depends on the integrity of the PFC, by using a more simplified cognitive strategy than controls. Interestingly, we observed that one daily hour of play during SPD partially rescued the behavioral performance in the PRL, but did not prevent the decrease in PFC inhibitory synaptic inputs. Our data demonstrate the importance of unrestricted social play for the development of inhibitory synapses in the PFC and cognitive skills in adulthood and show that specific synaptic alterations in the PFC can result in a complex behavioral outcome.SIGNIFICANCE STATEMENT This study addressed the question whether social play behavior in juvenile rats contributes to functional development of the prefrontal cortex (PFC). We found that rats that had been deprived from juvenile social play (social play deprivation - SPD) showed a reduction in inhibitory synapses in the PFC and a simplified strategy to solve a complex behavioral task in adulthood. Providing one daily hour of play during SPD partially rescued the cognitive skills in these rats, but did not prevent the reduction in PFC inhibitory synapses. Our results demonstrate a key role for unrestricted juvenile social play in PFC development and emphasize the complex relation between PFC circuit connectivity and cognitive function.

How Can Animal Models Inform the Understanding of Cognitive Inflexibility in Patients with Anorexia Nervosa?

Deficits in cognitive flexibility are consistently seen in patients with anorexia nervosa (AN). This type of cognitive impairment is thought to be associated with the persistence of AN because it leads to deeply ingrained patterns of thought and behaviour that are highly resistant to change. Neurobiological drivers of cognitive inflexibility have some commonalities with the abnormal brain functional outcomes described in patients with AN, including disrupted prefrontal cortical function, and dysregulated dopamine and serotonin neurotransmitter systems. The activity-based anorexia (ABA) model recapitulates the key features of AN in human patients, including rapid weight loss caused by self-starvation and hyperactivity, supporting its application in investigating the cognitive and neurobiological causes of pathological weight loss. The aim of this review is to describe the relationship between AN, neural function and cognitive flexibility in human patients, and to highlight how new techniques in behavioural neuroscience can improve the utility of animal models of AN to inform the development of novel therapeutics.

Role of dopamine and clinical heterogeneity in cognitive dysfunction in Parkinson's disease

Parkinson's disease (PD) is commonly treated with dopaminergic medication, which enhances some, while impairing other cognitive functions. It can even contribute to impulse control disorder and addiction. We describe the history of research supporting the dopamine overdose hypothesis, which accounts for the large within-patient variability in dopaminergic medication effects across different tasks by referring to the spatially non-uniform pattern of dopamine depletion in dorsal versus ventral striatum. However, there is tremendous variability in dopaminergic medication effects not just within patients across distinct tasks, but also across different patients. In the second part of this chapter we review recent studies addressing the large individual variability in the negative side effects of dopaminergic medication on functions that implicate dopamine, such as value-based learning and choice. These studies begin to unravel the mechanisms of dopamine overdosing, thus revising the strict version of the overdose hypothesis. For example, the work shows that the canonical boosting of reward-versus punishment-based choice by medication is greater in patients with depression and a non-tremor phenotype, which both implicate, among other pathology, more rather than less severe dysregulation of the mesolimbic dopamine system. Future longitudinal cohort studies are needed to identify how to optimally combine different clinical, personality, cognitive, neural, genetic and molecular predictors of detrimental medication effects in order to account for as much of the relevant variability as possible. This will provide a useful tool for precision neurology, allowing individual and contextual tailoring of (the dose of) dopaminergic medication in order to maximize its cognitive benefits, yet minimize its side effects.

Cognitive performance during adulthood in a rat model of neonatal diffuse white matter injury

RATIONALE

Infants born prematurely risk developing diffuse white matter injury (WMI), which is associated with impaired cognitive functioning and an increased risk of autism spectrum disorder. Recently, our rat model of preterm diffuse WMI induced by combined fetal inflammation and postnatal hypoxia showed impaired motor performance, anxiety-like behaviour and autism-like behaviour in juvenile rats, especially males. Immunohistochemistry showed delayed myelination in the sensory cortex and impaired oligodendrocyte differentiation.

OBJECTIVE

To assess long-term cognitive deficits in this double-hit rat model of diffuse WMI, animals were screened on impulsivity, attention and cognitive flexibility in adulthood using the 5-choice serial reaction time task (5CSRTT) and a probabilistic reversal learning task, tests that require a proper functioning prefrontal cortex. Thereafter, myelination deficits were evaluated by immunofluorescent staining in adulthood.

RESULTS

Overall, little effect of WMI or sex was found in the cognitive tasks. WMI animals showed subtle differences in performance in the 5CSRTT. Manipulating 5CSRTT parameters resulted in performance patterns previously seen in the literature. Sex differences were found in perseverative responses and omitted trials: female WMI rats seem to be less flexible in the 5CSRTT but not in the reversal learning task. Males collected rewards faster in the probabilistic reversal learning task. These findings are explained by temporally rather than permanently affected myelination and by the absence of extensive injury to prefrontal cortical subregions, confirmed by immunofluorescent staining in both adolescence and adulthood.

CONCLUSION

This rat model of preterm WMI does not lead to long-term cognitive deficits as observed in prematurely born human infants.

Reinforcement learning detuned in addiction: integrative and translational approaches

Suboptimal decision-making strategies have been proposed to contribute to the pathophysiology of addiction. Decision-making, however, arises from a collection of computational components that can independently influence behavior. Disruptions in these different components can lead to decision-making deficits that appear similar behaviorally, but differ at the computational, and likely the neurobiological, level. Here, we discuss recent studies that have used computational approaches to investigate the decision-making processes underlying addiction. Studies in animal models have found that value updating following positive, but not negative, outcomes is predictive of drug use, whereas value updating following negative, but not positive, outcomes is disrupted following drug self-administration. We contextualize these findings with studies on the circuit and biological mechanisms of decision-making to develop a framework for revealing the biobehavioral mechanisms of addiction.

Increased elasticity of sucrose demand during hyperdopaminergic states in rats

RATIONALE

Deficits in cost-benefit decision-making are a core feature of several psychiatric disorders, including substance addiction, eating disorders and bipolar disorder. Mesocorticolimbic dopamine signalling has been implicated in various processes related to cognition and reward, but its precise role in reward valuation and cost-benefit trade-off decisions remains incompletely understood.

OBJECTIVES

We assessed the role of mesocorticolimbic dopamine signalling in the relationship between price and consumption of sucrose, to better understand its role in cost-benefit decisions.

METHODS

Dopamine neurons in the ventral tegmental area (VTA) were chemogenetically activated in rats, and a behavioural economics approach was used to quantify the relationship between price and consumption of sucrose. Motivation for sucrose was also assessed under a progressive ratio (PR) schedule of reinforcement. To further gauge the role of dopamine in cost-benefit trade-offs for sucrose, the effects of treatment with D-amphetamine and the dopamine receptor antagonist alpha-flupentixol were assessed.

RESULTS

Chemogenetic activation of VTA dopamine neurons increased demand elasticity, while responding for sucrose under a PR schedule of reinforcement was augmented upon stimulation of VTA dopamine neurons. Treatment with amphetamine partially replicated the effects of chemogenetic dopamine neuron activation, whereas treatment with alpha-flupentixol reduced free consumption of sucrose and had mixed effects on demand elasticity.

CONCLUSIONS

Stimulation of mesocorticolimbic dopaminergic neurotransmission altered cost-benefit trade-offs in a complex manner. It reduced the essential value of palatable food, increased incentive motivation and left free consumption unaltered. Together, these findings imply that mesocorticolimbic dopamine signalling differentially influences distinct components of cost expenditure processes aimed at obtaining rewards.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Acute intranasal dopamine application counteracts the reversal learning deficit of spontaneously hypertensive rats in an attentional set-shifting task

RATIONALE

Studies on the attention-deficit/hyperactivity disorder (ADHD) have concluded that the disorder might be caused by a deficit in the inhibitory control of executive functions because of dopamine hypofunction. Recently, the intranasal route has emerged as an effective alternative means for sending dopamine directly to the brain. However, whether the treatment can ameliorate the deficits of inhibitory control in ADHD remains unknown.

OBJECTIVES

Investigating the effects of acute intranasal dopamine (IN-DA) on the inhibitory control of executive functions of an ADHD rodent model.

METHODS

We trained an animal model of ADHD, the spontaneously hypertensive rat (SHR), and Wistar rats as controls, in an attentional set-shifting task (ASST) in which dopamine (0.15 mg/kg, 0.3 mg/kg, or vehicle) was intranasally administered before the final test.

RESULTS

IN-DA application dose-dependently improved the performance and reduced errors of SHR in the initial reversal learning. The effect size was comparable to that of a peripheral injection of 0.6 mg/kg methylphenidate. In control Wistar rats, the highest dose of intranasal dopamine (0.3 mg/kg) induced deficits in the reversal learning of extradimensional discriminations.

CONCLUSIONS

The findings suggest that the IN-DA treatment has potential for use in the treatment of ADHD; however, caution must be exercised when determining the dosage to be administered, because too much dopamine may have negative effects.

ACE2 expression in rat brain: Implications for COVID-19 associated neurological manifestations

We examined cell type-specific expression and distribution of rat brain angiotensin-converting enzyme 2 (ACE2), the receptor for SARS-CoV-2, in the rodent brain. ACE2 is ubiquitously present in brain vasculature, with the highest density of ACE2 expressing capillaries found in the olfactory bulb, the hypothalamic paraventricular, supraoptic, and mammillary nuclei, the midbrain substantia nigra and ventral tegmental area, and the hindbrain pontine nucleus, the pre-Bötzinger complex, and nucleus of tractus solitarius. ACE2 was expressed in astrocytes and astrocytic foot processes, pericytes and endothelial cells, key components of the blood-brain barrier. We found discrete neuronal groups immunopositive for ACE2 in brainstem respiratory rhythm generating centers, including the pontine nucleus, the parafascicular/retrotrapezoid nucleus, the parabrachial nucleus, the Bötzinger, and pre-Bötzinger complexes and the nucleus of tractus solitarius; in the arousal-related pontine reticular nucleus and gigantocellular reticular nuclei; in brainstem aminergic nuclei, including substantia nigra, ventral tegmental area, dorsal raphe, and locus coeruleus; in the epithalamic habenula, hypothalamic paraventricular and supramammillary nuclei; and in the hippocampus. Identification of ACE2-expressing neurons in rat brain within well-established functional circuits facilitates prediction of possible neurological manifestations of brain ACE2 dysregulation during and after COVID-19 infection.

Temporally Specific Roles of Ventral Tegmental Area Projections to the Nucleus Accumbens and Prefrontal Cortex in Attention and Impulse Control

Deficits in impulse control and attention are prominent in the symptomatology of mental disorders such as attention deficit hyperactivity disorder (ADHD), substance addiction, schizophrenia, and bipolar disorder, yet the underlying mechanisms are incompletely understood. Frontostriatal structures, such as the nucleus accumbens (NAcb), the medial prefrontal cortex (mPFC), and their dopaminergic innervation from the ventral tegmental area (VTA) have been implicated in impulse control and attention. What remains unclear is how the temporal pattern of activity of these VTA projections contributes to these processes. Here, we optogenetically stimulated VTA dopamine (DA) cells, as well as VTA projections to the NAcb core (NAcbC), NAcb shell (NAcbS), and the mPFC in male rats performing the 5-choice serial reaction time task (5-CSRTT). Our data show that stimulation of VTA DA neurons, and VTA projections to the NAcbC and the mPFC immediately before presentation of the stimulus cue, impaired attention but spared impulse control. Importantly, in addition to reducing attention, activation of VTA-NAcbS also increased impulsivity when tested under a longer intertrial interval (ITI), to provoke impulsive behavior. Optogenetic stimulation at the beginning of the ITI only partially replicated these effects. In sum, our data show how attention and impulsivity are modulated by neuronal activity in distinct ascending output pathways from the VTA in a temporally specific manner. These findings increase our understanding of the intricate mechanisms by which mesocorticolimbic circuits contribute to cognition.SIGNIFICANCE STATEMENT Deficits in impulse control and attention are prominent in the symptomatology of several mental disorders, yet the brain mechanisms involved are incompletely understood. Since frontostriatal circuits have been implicated in impulse control and attention, we here examined the role of ascending projections from the midbrain ventral tegmental area (VTA) to the nucleus accumbens (NAcb) and prefrontal cortex (PFC). Using optogenetics to individually stimulate these projections with time-locked precision, we distinguished the role that each of these projections plays, in both impulse control and attention. As such, our study enhances our understanding of the neuronal circuitry that drives impulsive and attentive behavior.

Impulsivity in Parkinson's disease patients treated with subthalamic nucleus deep brain stimulation-An exploratory study

BACKGROUND

Deep brain stimulation of the subthalamic nucleus (STN-DBS) is a recognized treatment in Parkinson's disease (PD). Knowledge is still limited regarding the possible impact of STN-DBS on personality traits and the personality characteristics of PD patients who undergo surgery.

METHODS

To assess personality traits in relation to STN-DBS we did an ancillary protocol as part of a prospective randomized study that compared two surgical strategies. Patients were assessed with the Temperament and Character Inventory (TCI), the Urgency, Premeditation, Perseverance and Sensation Seeking impulse behavior scale, the Eysenck Personality Questionnaire (EPQ) and the Toronto Alexithymia Scale preoperatively and after one year of STN-DBS. EPQ and TCI baseline scores were compared with mean scores of healthy reference populations.

RESULTS

After 12-months of STN-DBS, there was a significant decline in Persistence compared to baseline. Preoperatively, the STN-DBS patients had significantly lower Persistence and Self-Transcendence scores, and significantly higher scores on Novelty-Seeking, Self-Directedness, Cooperativeness and on Social Conformity than referenced populations. No difference was found in Neuroticism or Harm-Avoidance scores. The baseline prevalence of alexithymia was low and at 1-year follow-up there was no significant change in alexithymia scores.

CONCLUSIONS

We found a higher baseline level of impulsivity in PD patients who underwent STN-DBS. After one year of STN-DBS, our results indicated that the treatment may affect the patients' personality by increasing certain aspects of impulsivity. There was no effect on alexithymia. The preoperative personality profile of PD patients might influence the outcome of STN-DBS.

Distinct roles for dopamine clearance mechanisms in regulating behavioral flexibility

Dopamine plays a crucial role in adaptive behavior, and dysfunctional dopamine is implicated in multiple psychiatric conditions characterized by inflexible or inconsistent choices. However, the precise relationship between dopamine and flexible decision making remains unclear. One reason is that, while many studies have focused on the activity of dopamine neurons, efficient dopamine signaling also relies on clearance mechanisms, notably the dopamine transporter (DAT), which predominates in striatum, and catechol-O-methyltransferase (COMT), which predominates in cortex. The exact locus, extent, and timescale of the effects of DAT and COMT are uncertain. Moreover, there is limited data on how acute disruption of either mechanism affects flexible decision making strategies mediated by cortico-striatal networks. To address these issues, we combined pharmacological modulation of DAT and COMT with electrochemistry and behavior in mice. DAT blockade, but not COMT inhibition, regulated sub-second dopamine release in the nucleus accumbens core, but surprisingly neither clearance mechanism affected evoked release in prelimbic cortex. This was not due to a lack of sensitivity, as both amphetamine and atomoxetine changed the kinetics of sub-second release. In a multi-step decision making task where mice had to respond to reversals in either reward probabilities or the choice sequence to reach the goal, DAT blockade selectively impaired, and COMT inhibition improved, performance after reward reversals, but neither manipulation affected the adaptation of choices after action-state transition reversals. Together, our data suggest that DAT and COMT shape specific aspects of behavioral flexibility by regulating different aspects of the kinetics of striatal and cortical dopamine, respectively.

Dorsal and ventral striatal dopamine D1 and D2 receptors differentially modulate distinct phases of serial visual reversal learning

Impaired cognitive flexibility in visual reversal-learning tasks has been observed in a wide range of neurological and neuropsychiatric disorders. Although both human and animal studies have implicated striatal D2-like and D1-like receptors (D2R; D1R) in this form of flexibility, less is known about the contribution they make within distinct sub-regions of the striatum and the different phases of visual reversal learning. The present study investigated the involvement of D2R and D1R during the early (perseverative) phase of reversal learning as well as in the intermediate and late stages (new learning) after microinfusions of D2R and D1R antagonists into the nucleus accumbens core and shell (NAcC; NAcS), the anterior and posterior dorsomedial striatum (DMS) and the dorsolateral striatum (DLS) on a touchscreen visual serial reversal-learning task. Reversal learning was improved after dopamine receptor blockade in the nucleus accumbens; the D1R antagonist, SCH23390, in the NAcS and the D2R antagonist, raclopride, in the NAcC selectively reduced early, perseverative errors. In contrast, reversal learning was impaired by D2R antagonism, but not D1R antagonism, in the dorsal striatum: raclopride increased errors in the intermediate phase after DMS infusions, and increased errors across phases after DLS infusions. These findings indicate that D1R and D2R modulate different stages of reversal learning through effects localised to different sub-regions of the striatum. Thus, deficits in behavioral flexibility observed in disorders linked to dopamine perturbations may be attributable to specific D1R and D2R dysfunction in distinct striatal sub-regions.

Oscillotherapeutics - Time-targeted interventions in epilepsy and beyond

Oscillatory brain activities support many physiological functions from motor control to cognition. Disruptions of the normal oscillatory brain activities are commonly observed in neurological and psychiatric disorders including epilepsy, Parkinson's disease, Alzheimer's disease, schizophrenia, anxiety/trauma-related disorders, major depressive disorders, and drug addiction. Therefore, these disorders can be considered as common oscillation defects despite having distinct behavioral manifestations and genetic causes. Recent technical advances of neuronal activity recording and analysis have allowed us to study the pathological oscillations of each disorder as a possible biomarker of symptoms. Furthermore, recent advances in brain stimulation technologies enable time- and space-targeted interventions of the pathological oscillations of both neurological disorders and psychiatric disorders as possible targets for regulating their symptoms.

Modulation of value-based decision making behavior by subregions of the rat prefrontal cortex

RATIONALE

During value-based decision-making, organisms make choices on the basis of reward expectations, which have been formed during prior action-outcome learning. Although it is known that neuronal manipulations of different subregions of the rat prefrontal cortex (PFC) have qualitatively different effects on behavioral tasks involving value-based decision-making, it is unclear how these regions contribute to the underlying component processes.

OBJECTIVES

Assessing how different regions of the rodent PFC contribute to component processes of value-based decision-making behavior, including reward (or positive feedback) learning, punishment (or negative feedback) learning, response persistence, and exploration versus exploitation.

METHODS

We performed behavioral modeling of data of rats in a probabilistic reversal learning task after pharmacological inactivation of five PFC subregions, to assess how inactivation of these different regions affected the structure of responding of animals in the task.

RESULTS

Our results show reductions in reward and punishment learning after PFC subregion inactivation. The prelimbic, infralimbic, lateral orbital, and medial orbital PFC particularly contributed to punishment learning, and the prelimbic and lateral orbital PFC to reward learning. In addition, response persistence depended on the infralimbic and medial orbital PFC. As a result, pharmacological inactivation of the infralimbic and lateral orbitofrontal cortex reduced the number of reversals achieved, whereas inactivation of the prelimbic and medial orbitofrontal cortex decreased the number of rewards obtained. Finally, using simulated data, we explain discrepancies with a previous study and demonstrate complex, interacting relationships between conventional measures of probabilistic reversal learning performance, such as win-stay/lose-switch behavior, and component processes of value-based decision-making.

CONCLUSIONS

Together, our data suggest that distinct components of value-based learning and decision-making are generated in medial and orbital PFC regions, displaying functional specialization and overlap, with a prominent role of large parts of the PFC in negative feedback processing.

Dopaminergic contributions to behavioral control under threat of punishment in rats

RATIONALE

Excessive intake of rewards, such as food and drugs, often has explicit negative consequences, including the development of obesity and addiction, respectively. Thus, choosing not to pursue reward is the result of a cost/benefit decision, proper execution of which requires inhibition of behavior. An extensive body of preclinical and clinical evidence implicates dopamine in certain forms of inhibition of behavior, but it is not fully known how it contributes to behavioral inhibition under threat of explicit punishment.

OBJECTIVES

To assess the involvement of midbrain dopamine neurons and their corticostriatal output regions, the ventral striatum and prefrontal cortex, in control over behavior under threat of explicit (foot shock) punishment in rats.

METHODS

We used a recently developed behavioral inhibition task, which assesses the ability of rats to exert behavioral restraint at the mere sight of food reward, under threat of foot shock punishment. Using in vivo fiber photometry, chemogenetics, c-Fos immunohistochemistry, and behavioral pharmacology, we investigated how dopamine neurons in the ventral tegmental area, as well as its output areas, the ventral striatum and prefrontal cortex, contribute to behavior in this task.

RESULTS

Using this multidisciplinary approach, we found little evidence for a direct involvement of ascending midbrain dopamine neurons in inhibitory control over behavior under threat of punishment. For example, photometry recordings suggested that VTA DA neurons do not directly govern control over behavior in the task, as no differences were observed in neuronal population activity during successful versus unsuccessful behavioral control. In addition, chemogenetic and pharmacological manipulations of the mesocorticolimbic DA system had little or no effect on the animals' ability to exert inhibitory control over behavior. Rather, the dopamine system appeared to have a role in the motivational components of reward pursuit.

CONCLUSIONS

Together, our data provide insight into the mesocorticolimbic mechanisms behind motivated behaviors by showing a modulatory role of dopamine in the expression of cost/benefit decisions. In contrast to our expectations, dopamine did not appear to directly mediate the type of behavioral control that is tested in our task.

Differential contributions of striatal dopamine D1 and D2 receptors to component processes of value-based decision making

Dopamine has been implicated in value-based learning and decision making by signaling reward prediction errors and facilitating cognitive flexibility, incentive motivation, and voluntary movement. Dopamine receptors can roughly be divided into the D1 and D2 subtypes, and it has been hypothesized that these two types of receptors have an opposite function in facilitating reward-related and aversion-related behaviors, respectively. Here, we tested the contribution of striatal dopamine D1 and D2 receptors to processes underlying value-based learning and decision making in rats, employing a probabilistic reversal learning paradigm. Using computational trial-by-trial analysis of task behavior after systemic or intracranial treatment with dopamine D1 and D2 receptor agonists and antagonists, we show that negative feedback learning can be modulated through D2 receptor signaling and positive feedback learning through D1 receptor signaling in the ventral striatum. Furthermore, stimulation of D2 receptors in the ventral or dorsolateral (but not dorsomedial) striatum promoted explorative choice behavior, suggesting an additional function of dopamine in these areas in value-based decision making. Finally, treatment with most dopaminergic drugs affected response latencies and number of trials completed, which was also seen after infusion of D2, but not D1 receptor-acting drugs into the striatum. Together, our data support the idea that dopamine D1 and D2 receptors have complementary functions in learning on the basis of emotionally valenced feedback, and provide evidence that dopamine facilitates value-based and motivated behaviors through distinct striatal regions.

Dopaminergic medication reduces striatal sensitivity to negative outcomes in Parkinson's disease

Reduced levels of dopamine in Parkinson's disease contribute to changes in learning, resulting from the loss of midbrain neurons that transmit a dopaminergic teaching signal to the striatum. Dopamine medication used by patients with Parkinson's disease has previously been linked to behavioural changes during learning as well as to adjustments in value-based decision-making after learning. To date, however, little is known about the specific relationship between dopaminergic medication-driven differences during learning and subsequent changes in approach/avoidance tendencies in individual patients. Twenty-four Parkinson's disease patients ON and OFF dopaminergic medication and 24 healthy controls subjects underwent functional MRI while performing a probabilistic reinforcement learning experiment. During learning, dopaminergic medication reduced an overemphasis on negative outcomes. Medication reduced negative (but not positive) outcome learning rates, while concurrent striatal blood oxygen level-dependent responses showed reduced prediction error sensitivity. Medication-induced shifts in negative learning rates were predictive of changes in approach/avoidance choice patterns after learning, and these changes were accompanied by systematic striatal blood oxygen level-dependent response alterations. These findings elucidate the role of dopamine-driven learning differences in Parkinson's disease, and show how these changes during learning impact subsequent value-based decision-making.

Optogenetic and chemogenetic approaches to manipulate attention, impulsivity and behavioural flexibility in rodents

Studies manipulating neural activity acutely with optogenetic or chemogenetic intervention in behaving rodents have increased considerably in recent years. More often, these circuit-level neural manipulations are tested within an existing framework of behavioural testing that strives to model complex executive functions or symptomologies relevant to multidimensional psychiatric disorders in humans, such as attentional control deficits, impulsivity or behavioural (in)flexibility. This methods perspective argues in favour of carefully implementing these acute circuit-based approaches to better understand and model cognitive symptomologies or their similar isomorphic animal behaviours, which often arise and persist in overlapping brain circuitries. First, we offer some practical considerations for combining long-term, behavioural paradigms with optogenetic or chemogenetic interventions. Next, we examine how cell-type or projection-specific manipulations to the ascending neuromodulatory systems, local brain region or descending cortical glutamatergic projections influence aspects of cognitive control. For this, we primarily focus on the influence exerted on attentional and motor impulsivity performance in the (3-choice or) 5-choice serial reaction time task, and impulsive, risky or inflexible choice biases during alternative preference, reward discounting or reversal learning tasks.

Insensitivity to Losses: A Core Feature in Patients With Anorexia Nervosa?

BACKGROUND

Patients with anorexia nervosa (AN) demonstrate aberrations in choice behavior, including impairments in laboratory measures of decision making. Although a wealth of studies suggest that these aberrations arise from alterations in value processing, it remains unclear by which core component of value processing this is mediated.

METHODS

We fit trial-by-trial data of patients with AN (n = 60 first cohort, n = 216 second cohort) and healthy control participants (n = 55) performing the Iowa Gambling Task to a computational model based on prospect utility theory. We determined, per participant, the best-fit model parameters and compared these between the groups.

RESULTS

Analyses revealed a decreased estimate of model parameter λ in patients with AN, indicative of an attenuation of loss-aversive behavior in the Iowa Gambling Task. In comparison, measures of reward sensitivity, value-based learning, and exploration versus exploitation were unaltered in patients with AN. A measurement in a second independent cohort replicated the finding that loss aversion, typically observed in healthy individuals, is reduced in patients with AN.

CONCLUSIONS

We show that patients with AN, in contrast to healthy control participants, demonstrate reduced loss-aversive behavior. This finding provides important fundamental insights into the decision-making capacity of patients with AN, suggesting alterations in the mechanisms involved in value processing related to negative feedback.

Corticolimbic Mechanisms of Behavioral Inhibition under Threat of Punishment

Being able to limit the pursuit of reward to prevent negative consequences is an important expression of behavioral inhibition. Everyday examples of an inability to exert such control over behavior are the overconsumption of food and drugs of abuse, which are important factors in the development of obesity and addiction, respectively. Here, we use a behavioral task that assesses the ability of male rats to exert behavioral restraint at the mere sight of palatable food during the presentation of an audiovisual threat cue to investigate the corticolimbic underpinnings of behavioral inhibition. We demonstrate a prominent role for the medial prefrontal cortex in the exertion of control over behavior under threat of punishment. Moreover, task engagement relies on function of the ventral striatum, whereas the basolateral amygdala mediates processing of the threat cue. Together, these data show that inhibition of reward pursuit requires the coordinated action of a network of corticolimbic structures.SIGNIFICANCE STATEMENT There is a need for translational models that allow to dissect mechanisms underlying the processes involved in controlling behavior. In this study, we present a novel behavioral task that assesses the ability of rats to exert behavioral restraint over the consumption of a visually present sucrose pellet during the presentation of an audiovisual threat cue. This task requires relatively little behavioral training and it discerns distinct behavioral impairments, including a failure to retrieve stimulus value, a reduced task engagement, and compromised inhibition of behavior. Using pharmacological inactivations of different regions of the corticolimbic system of the rat, we demonstrate dissociable roles for the prefrontal cortex, amygdala, and striatum in inhibition of reward pursuit under threat of punishment.

An Intersectional Approach to Target Neural Circuits With Cell- and Projection-Type Specificity: Validation in the Mesolimbic Dopamine System

Development of tools to manipulate activity of specific neurons is important for dissecting the function of neural circuits. Viral vectors and conditional transgenic animal lines that target recombinases to specific cells facilitate the successful manipulation and recording of specific subsets of neurons. So far, it has been possible to target neuronal subtypes within a certain brain region based on transcriptional control regions from a gene selectively expressed in those cells or based upon its projections. Nevertheless, there are only a few tools available that combine this and target a neuronal subtype within a projection. We tested a viral vector system, consisting of a canine adenovirus type 2 expressing a Cre-dependent Flp recombinase (CavFlexFlp) and an adeno-associated viral (AAV) vector expressing a Flp-dependent cDNA, which targets neurons in a subtype- and projection-specific manner. As proof of principle we targeted expression of a Designer Receptor Exclusively Activated by Designer Drugs (DREADD) to the dopamine neurons of the mesolimbic projection, which allows the transient activation of neurons by the ligand Clozapine-N-Oxide (CNO). We validated that the system specifically targets dopamine neurons and that chemogenetic activation of these neurons induces an increase in locomotor activity. We thus validated a valuable tool that allows in vivo neuronal activation in a projection- and subtype-specific manner.

How Reward and Aversion Shape Motivation and Decision Making: A Computational Account

Processing rewarding and aversive signals lies at the core of many adaptive behaviors, including value-based decision making. The brain circuits processing these signals are widespread and include the prefrontal cortex, amygdala and striatum, and their dopaminergic innervation. In this review, we integrate historic findings on the behavioral and neural mechanisms of value-based decision making with recent, groundbreaking work in this area. On the basis of this integrated view, we discuss a neuroeconomic framework of value-based decision making, use this to explain the motivation to pursue rewards and how motivation relates to the costs and benefits associated with different courses of action. As such, we consider substance addiction and overeating as states of altered value-based decision making, in which the expectation of reward chronically outweighs the costs associated with substance use and food consumption, respectively. Together, this review aims to provide a concise and accessible overview of important literature on the neural mechanisms of behavioral adaptation to reward and aversion and how these mediate motivated behaviors.

Reinforcement learning across the rat estrous cycle

Reinforcement learning, the process by which an organism flexibly adapts behavior in response to reward and punishment, is vital for the proper execution of everyday behaviors, and its dysfunction has been implicated in a wide variety of mental disorders. Here, we use computational trial-by-trial analysis of data of female rats performing a probabilistic reward learning task and demonstrate that core computational processes underlying value-based decision making fluctuate across the estrous cycle, providing a neuroendocrine substrate by which gonadal hormones may influence adaptive behavior.

Limbic control over the homeostatic need for sodium

The homeostatic need for sodium is one of the strongest motivational drives known in animals. Although the brain regions involved in the sensory detection of sodium levels have been mapped relatively well, data about the neural basis of the motivational properties of salt appetite, including a role for midbrain dopamine cells, have been inconclusive. Here, we employed a combination of fiber photometry, behavioral pharmacology and c-Fos immunohistochemistry to study the involvement of the mesocorticolimbic dopamine system in salt appetite in rats. We observed that sodium deficiency affected the responses of dopaminergic midbrain neurons to salt tasting, suggesting that these neurons encode appetitive properties of sodium. We further observed a significant reduction in the consumption of salt after pharmacological inactivation of the nucleus accumbens (but not the medial prefrontal cortex), and microstructure analysis of licking behavior suggested that this was due to decreased motivation for, but not appreciation of salt. However, this was not dependent on dopaminergic neurotransmission in that area, as infusion of a dopamine receptor antagonist into the nucleus accumbens did not alter salt appetite. We conclude that the nucleus accumbens, but not medial prefrontal cortex, is important for the behavioral expression of salt appetite by mediating its motivational component, but that the switch in salt appreciation after sodium depletion, although detected by midbrain dopamine neurons, must arise from other areas.

Translational tests involving non-reward: methodological considerations

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson's disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Dopamine D2-like receptor stimulation blocks negative feedback in visual and spatial reversal learning in the rat: behavioural and computational evidence

RATIONALE

Dopamine D2-like receptors (D2R) are important drug targets in schizophrenia and Parkinson's disease, but D2R ligands also cause cognitive inflexibility such as poor reversal learning. The specific role of D2R in reversal learning remains unclear.

OBJECTIVES

We tested the hypotheses that D2R agonism impairs reversal learning by blocking negative feedback and that antagonism of D1-like receptors (D1R) impairs learning from positive feedback.

METHODS

Male Lister Hooded rats were trained on a novel visual reversal learning task. Performance on "probe trials", during which the correct or incorrect stimulus was presented with a third, probabilistically rewarded (50% of trials) and therefore intermediate stimulus, revealed individual learning curves for the processes of positive and negative feedback. The effects of D2R and D1R agonists and antagonists were evaluated. A separate cohort was tested on a spatial probabilistic reversal learning (PRL) task after D2R agonism. Computational reinforcement learning modelling was applied to choice data from the PRL task to evaluate the contribution of latent factors.

RESULTS

D2R agonism with quinpirole dose-dependently impaired both visual reversal and PRL. Analysis of the probe trials on the visual task revealed a complete blockade of learning from negative feedback at the 0.25 mg/kg dose, while learning from positive feedback was intact. Estimated parameters from the model that best described the PRL choice data revealed a steep and selective decrease in learning rate from losses. D1R antagonism had a transient effect on the positive probe trials.

CONCLUSIONS

D2R stimulation impairs reversal learning by blocking the impact of negative feedback.

Dopaminergic genes are associated with both directed and random exploration

In order to maximize long-term rewards, agents must balance exploitation (choosing the option with the highest payoff) and exploration (gathering information about options that might have higher payoffs). Although the optimal solution to this trade-off is intractable, humans make use of two effective strategies: selectively exploring options with high uncertainty (directed exploration), and increasing the randomness of their choices when they are more uncertain (random exploration). Using a task that independently manipulates these two forms of exploration, we show that single nucleotide polymorphisms related to dopamine are associated with individual differences in exploration strategies. Variation in a gene linked to prefrontal dopamine (COMT) predicted the degree of directed exploration, as well as the overall randomness of responding. Variation in a gene linked to striatal dopamine (DARPP-32) predicted the degree of both directed and random exploration. These findings suggest that dopamine makes multiple contributions to exploration, depending on its afferent target.

Neural Representation of Motor Output, Context and Behavioral Adaptation in Rat Medial Prefrontal Cortex During Learned Behavior

Selecting behavioral outputs in a dynamic environment is the outcome of integrating multiple information streams and weighing possible action outcomes with their value. Integration depends on the medial prefrontal cortex (mPFC), but how mPFC neurons encode information necessary for appropriate behavioral adaptation is poorly understood. To identify spiking patterns of mPFC during learned behavior, we extracellularly recorded neuronal action potential firing in the mPFC of rats performing a whisker-based "Go"/"No-go" object localization task. First, we identify three functional groups of neurons, which show different degrees of spiking modulation during task performance. One group increased spiking activity during correct "Go" behavior (positively modulated), the second group decreased spiking (negatively modulated) and one group did not change spiking. Second, the relative change in spiking was context-dependent and largest when motor output had contextual value. Third, the negatively modulated population spiked more when rats updated behavior following an error compared to trials without integration of error information. Finally, insufficient spiking in the positively modulated population predicted erroneous behavior under dynamic "No-go" conditions. Thus, mPFC neuronal populations with opposite spike modulation characteristics differentially encode context and behavioral updating and enable flexible integration of error corrections in future actions.