Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia

Effects of Maternal Separation on Effort-based Responding for Sucrose Are Associated with c-Fos Expression in the Nucleus Accumbens Core

In both people and animals, exposure to adverse experiences early in life can alter neurodevelopment and lead to long-term behavioral effects, including effects on reward processing. In the current study, we use a well-validated rodent model of maternal neglect, maternal separation (MS), to investigate the impact of early life adversity on reward learning and motivation and identify associated modifications in cellular activation in reward-relevant areas. Litters of Long-Evans rats were separated from the dam for either 15 min (brief) or 180 min (prolonged)/day from postnatal day (PND)2 to PND14. As adults, offspring were trained to lever press for a sucrose pellet using fixed ratio (FR) schedules and motivation was tested using a progressive ratio (PR) schedule over 10 daily sessions to assess sustained effects on effort-based responding. Immunohistochemical staining for c-Fos was conducted in a subset of animals that underwent an additional PR session. While there were no effects on reward learning, both MS180 males and females demonstrated increased effort-based responding on the first day of PR testing, while only MS180 males demonstrated a sustained increase in effort across all 10 days. MS180-induced changes in c-Fos expression in the dorsal and ventral striatum were observed, with subregion-specific effects along the rostrocaudal axis. Moreover, regression analyses suggest that motivated responding for a sucrose food reward in MS180-exposed, but not MS15-exposed animals, was associated with increased c-Fos expression in the rostral nucleus accumbens core. These findings implicate specific striatal regions in sex-specific modulation of sustained effort-based reward behavior following early life adversity.

Quantitative and qualitative sex difference in habenula-induced inhibition of midbrain dopamine neurons in the rat

Introduction

Clinically relevant sex differences have been noted in a number of affective, behavioral, cognitive, and neurological health disorders. Midbrain dopamine neurons are implicated in several of these same disorders and consequently are under investigation for their potential role in the manifestation of these sex differences. The lateral habenula exerts significant inhibitory control over dopamine neuronal firing, yet little is known about sex differences in this particular neurocircuit.

Methods

We performed in vivo, single unit, extracellular recordings of dopamine neurons in female and male anesthetized rats in response to single pulse stimulation of the lateral habenula. In addition, we assessed baseline firing properties of lateral habenula neurons and, by immunochemical means, assessed the distribution of estrogen receptor alpha cells in the lateral habenula.

Results

Habenula-induced inhibition of dopamine neuronal firing is reduced in female rats relative to male rats. In addition, male rats had a higher prevalence of rebound excitation. Furthermore, the firing pattern of lateral habenula neurons was less variable in female rats, and female rats had a higher density of estrogen receptor alpha positive cells in the lateral habenula.

Discussion

We found that the dopamine neuronal response to habenular stimulation is both qualitatively and quantitatively different in female and male rats. These novel findings together with reports in the contemporary literature lead us to posit that the sex difference in dopamine inhibition seen here relate to differential firing properties of lateral habenula neurons resulting from the presence of sex hormones. Further work is needed to test this hypothesis, which may have implications for understanding the etiology of several mental health disorders including depression, schizophrenia, and addiction.

Learning without contingencies: A loss of synergy between memory and reward circuits in schizophrenia

Motivational deficits in schizophrenia may interact with foundational cognitive processes including learning and memory to induce impaired cognitive proficiency. If such a loss of synergy exists, it is likely to be underpinned by a loss of synchrony between the brains learning and reward sub-networks. Moreover, this loss should be observed even during tasks devoid of explicit reward contingencies given that such tasks are better models of real world performance than those with artificial contingencies. Here we applied undirected functional connectivity (uFC) analyses to fMRI data acquired while participants engaged in an associative learning task without contingencies or feedback. uFC was estimated and inter-group differences (between schizophrenia patients and controls, n = 54 total, n = 28 patients) were assessed within and between reward (VTA and NAcc) and learning/memory (Basal Ganglia, DPFC, Hippocampus, Parahippocampus, Occipital Lobe) sub-networks. The task paradigm itself alternated between Encoding, Consolidation, and Retrieval conditions, and uFC differences were quantified for each of the conditions. Significantly reduced uFC dominated the connectivity profiles of patients across all conditions. More pertinent to our motivations, these reductions were observed within and across classes of sub-networks (reward-related and learning/memory related). We suggest that disrupted functional connectivity between reward and learning sub-networks may drive many of the performance deficits that characterize schizophrenia. Thus, cognitive deficits in schizophrenia may in fact be underpinned by a loss of synergy between reward-sensitivity and cognitive processes.

Insular and Striatal Correlates of Uncertain Risky Reward Pursuit in Schizophrenia

BACKGROUND AND HYPOTHESIS

Risk-taking in specific contexts can be beneficial, leading to rewarding outcomes. Schizophrenia is associated with disadvantageous decision-making, as subjects pursue uncertain risky rewards less than controls. However, it is unclear whether this behavior is associated with more risk sensitivity or less reward incentivization. Matching on demographics and intelligence quotient (IQ), we determined whether risk-taking was more associated with brain activation in regions affiliated with risk evaluation or reward processing.

STUDY DESIGN

Subjects (30 schizophrenia/schizoaffective disorder, 30 controls) completed a modified, fMRI Balloon Analogue Risk Task. Brain activation was modeled during decisions to pursue risky rewards and parametrically modeled according to risk level.

STUDY RESULTS

The schizophrenia group exhibited less risky-reward pursuit despite previous adverse outcomes (Average Explosions; F(1,59) = 4.06, P = .048) but the comparable point at which risk-taking was volitionally discontinued (Adjusted Pumps; F(1,59) = 2.65, P = .11). Less activation was found in schizophrenia via whole brain and region of interest (ROI) analyses in the right (F(1,59) = 14.91, P < 0.001) and left (F(1,59) = 16.34, P < 0.001) nucleus accumbens (NAcc) during decisions to pursue rewards relative to riskiness. Risk-taking correlated with IQ in schizophrenia, but not controls. Path analyses of average ROI activation revealed less statistically determined influence of anterior insula upon dorsal anterior cingulate bilaterally (left: χ2 = 12.73, P < .001; right: χ2 = 9.54, P = .002) during risky reward pursuit in schizophrenia.

CONCLUSIONS

NAcc activation in schizophrenia varied less according to the relative riskiness of uncertain rewards compared to controls, suggesting aberrations in reward processing. The lack of activation differences in other regions suggests similar risk evaluation. Less insular influence on the anterior cingulate may relate to attenuated salience attribution or inability for risk-related brain region collaboration to sufficiently perceive situational risk.

Sex-specific decision-making impairments and striatal dopaminergic changes after binge drinking history in rats

Binge drinking (BD) is a harmful behavior for health and is a predictive factor for the development of alcohol addiction. Weak decision-making (DM) capacities could play a role in the vulnerability to BD which in turn would lead to DM impairments, thus perpetuating BD. Longitudinal preclinical studies are however lacking and necessary to understand this complex relationship. Both DM and BD are influenced by sex and involve dopamine release in the core of the nucleus accumbens, a central mechanism regulated by dopamine D2/3 autoreceptors. In this context, we used an operant self-administration procedure of BD in male and female rats, and longitudinally assessed DM capacity, memory and anxiety-like behavior. To better understand the mechanisms potentially involved in the relationship between DM and BD, ex vivo dopamine transmission was assessed short term after the end of the binge exposure in the core of the nucleus accumbens (NAc) using the fast-scan cyclic voltammetry (FSCV) technique and the D2/3 agonist quinpirole. We found important basal sex differences in DM, with female rats showing better performances at baseline. Choice processes were impaired exclusively in males after BD history, associated with a decrease in impulse control in both sexes, while memory and anxiety-like behavior were not affected. Our neurobiological results demonstrate that BD did not affect basal dopamine signaling in the NAc core, regardless of the sex, but reveal changes in the sensitivity to the inhibitory effects of quinpirole in females. DM impairments were neither associated with changes in basal dopamine signaling nor pre-synaptic D2 activity. Overall, our findings show that BD affects both DM processes and dopamine transmission in the core of the NAc in a sex-related manner, further suggesting that these effects may play a role in the vicious cycle leading to BD perpetuation and the early onset of AUD. Our results may inform novel strategies for therapeutic and prevention interventions.

Altered static and dynamic functional connectivity of habenula in first-episode, drug-naïve schizophrenia patients, and their association with symptoms including hallucination and anxiety

BACKGROUND AND OBJECTIVE

The pathogenesis of schizophrenia (SCH) is related to the dysfunction of monoamine neurotransmitters, and the habenula participates in regulating the synthesis and release of dopamine. We examined the static functional connectivity (sFC) and dynamic functional connectivity (dFC) of habenula in first-episode schizophrenia patients using resting state functional magnetic resonance imaging (rs-fMRI) in this study.

METHODS

A total of 198 first-Episode, drug-Naïve schizophrenia patients and 199 healthy controls (HC) underwent rs-fMRI examinations. The sFC and dFC analysis with habenula as seed was performed to produce a whole-brain diagram initially, which subsequently were compared between SCH and HC groups. Finally, the correlation analysis of sFC and dFC values with the Positive and Negative Symptom Scale (PANSS) were performed.

RESULTS

Compared with the HC groups, the left habenula showed increased sFC with the bilateral middle temporal gyrus, bilateral superior temporal gyrus, and right temporal pole in the SCH group, and the right habenula exhibited increased sFC with the left middle temporal gyrus, left superior temporal gyrus, and left angular gyrus. Additionally, compared with the HC group, the left habenula showed decreased dFC with the bilateral cuneus gyrus and bilateral calcarine gyrus in the SCH group. The PANSS negative sub-scores were positively correlated with the sFC values of the bilateral habenula with the bilateral middle temporal gyrus, superior temporal gyrus and angular gyrus. The PANSS general sub-scores were positively correlated with the sFC values of the right habenula with the left middle temporal gyrus and left superior temporal gyrus. The hallucination scores of PANSS were negatively correlated with the sFC values of the left habenula with the bilateral cuneus gyrus and bilateral calcarine gyrus; The anxiety scores of PANSS were positively correlated with the dFC values of the left habenula with the right temporal pole.

CONCLUSION

This study provides evidence that the habenula of the first-episode schizophrenia patients presented abnormal static functional connectivity with temporal lobe and angular gyrus, and additionally showed weakened stability of functional connectivity in occipital lobe. This abnormality is closely related to the symptoms of hallucination and anxiety in schizophrenia, which may indicate that the habenula involved in the pathophysiology of schizophrenia by affecting the dopamine pathway.

Involvement of the habenula in the pathophysiology of autism spectrum disorder

The habenula is a small epithalamic structure with widespread connections to multiple cortical, subcortical and brainstem regions. It has been identified as the central structure modulating the reward value of social interactions, behavioral adaptation, sensory integration and circadian rhythm. Autism spectrum disorder (ASD) is characterized by social communication deficits, restricted interests, repetitive behaviors, and is frequently associated with altered sensory perception and mood and sleep disorders. The habenula is implicated in all these behaviors and results of preclinical studies suggest a possible involvement of the habenula in the pathophysiology of this disorder. Using anatomical magnetic resonance imaging and automated segmentation we show that the habenula is significantly enlarged in ASD subjects compared to controls across the entire age range studied (6-30 years). No differences were observed between sexes. Furthermore, support-vector machine modeling classified ASD with 85% accuracy (model using habenula volume, age and sex) and 64% accuracy in cross validation. The Social Responsiveness Scale (SRS) significantly differed between groups, however, it was not related to individual habenula volume. The present study is the first to provide evidence in human subjects of an involvement of the habenula in the pathophysiology of ASD.

Deep Brain Stimulation of the Habenula: Systematic Review of the Literature and Clinical Trial Registries

The habenula is a small bilateral epithalamic structure that plays a key role in the regulation of the main monoaminergic systems. It is implicated in many aspects of behavior such as reward processing, motivational behavior, behavioral adaptation, and sensory integration. A role of the habenula has been indicated in the pathophysiology of a number of neuropsychiatric disorders such as depression, addiction, obsessive-compulsive disorder, and bipolar disorder. Neuromodulation of the habenula using deep brain stimulation (DBS) as potential treatment has been proposed and a first successful case of habenula DBS was reported a decade ago. To provide an overview of the current state of habenula DBS in human subjects for the treatment of neuropsychiatric disorders we conducted a systematic review of both the published literature using PUBMED and current and past registered clinical trials using ClinicalTrials.gov as well as the International Clinical Trials Registry Platform. Using PRISMA guidelines five articles and five registered clinical trials were identified. The published articles detailed the results of habenula DBS for the treatment of schizophrenia, depression, obsessive-compulsive disorder, and bipolar disorder. Four are single case studies; one reports findings in two patients and positive clinical outcome is described in five of the six patients. Of the five registered clinical trials identified, four investigate habenula DBS for the treatment of depression and one for obsessive-compulsive disorder. One trial is listed as terminated, one is recruiting, two are not yet recruiting and the status of the fifth is unknown. The planned enrollment varies between 2 to 13 subjects and four of the five are open label trials. While the published studies suggest a potential role of habenula DBS for a number of indications, future trials and studies are necessary. The outcomes of the ongoing clinical trials will provide further valuable insights. Establishing habenula DBS, however, will depend on successful randomized clinical trials to confirm application and clinical benefit of this promising intervention.

The role of dopamine pharmacotherapy and addiction-like behaviors in Parkinson's disease

Addictions involve a spectrum of behaviors that encompass features of impulsivity and compulsivity, herein referred to as impulsive-compulsive spectrum disorders (ICSDs). The etiology of ICSDs likely involves a complex interplay among neurobiological, psychological and social risk factors. Neurobiological risk factors include the status of the neuroanatomical circuits that govern ICSDs. These circuits can be altered by disease, as well as exogenous influences such as centrally-acting pharmacologics. The 'poster child' for this scenario is Parkinson's disease (PD) medically managed by pharmacological treatments. PD is a progressive neurodegenerative disease that involves a gradual loss of dopaminergic neurons largely within nigrostriatal projections. Replacement therapy includes dopamine receptor agonists that directly activate postsynaptic dopamine receptors (bypassing the requirement for functioning presynaptic terminals). Some clinically useful dopamine agonists, e.g., pramipexole and ropinirole, exhibit high affinity for the D2/D3 receptor subtypes. These agonists provide excellent relief from PD motor symptoms, but some patients exhibit debilitating ICSD. Teasing out the neuropsychiatric contribution of PD-associated pathology from the drugs used to treat PD motor symptoms is challenging. In this review, we posit that modern clinical and preclinical research converge on the conclusion that dopamine replacement therapy can mediate addictions in PD and other neurological disorders. We provide five categories of evidences that align with this position: (i) ICSD prevalence is greater with D2/D3 receptor agonist therapy vs PD alone. (ii) Capacity of dopamine replacement therapy to produce addiction-like behaviors is independent of disease for which the therapy is being provided. (iii) ICSD-like behaviors are recapitulated in laboratory rats with and without PD-like pathology. (iv) Behavioral pathology co-varies with drug exposure. (v) ICSD Features of ICSDs are consistent with agonist pharmacology and neuroanatomical substrates of addictions. Considering the underpinnings of ICSDs in PD should not only help therapeutic decision-making in neurological disorders, but also apprise ICSDs in general.

Dopaminergic signaling of uncertainty and the aetiology of gambling addiction

Although there is increasing clinical recognition of behavioral addictions, of which gambling disorder is the prototype example, there is a limited understanding of the psychological properties of (non-substance-related) behaviors that enable them to become 'addictive' in a way that is comparable to drugs of abuse. According to an influential application of reinforcement learning to substance addictions, the direct effects of drugs to release dopamine can create a perpetual escalation of incentive salience. This article focusses on reward uncertainty, which is proposed to be the core feature of gambling that creates the capacity for addiction. We describe the neuro-dynamics of the dopamine response to uncertainty that may allow a similar escalation of incentive salience, and its relevance to behavioral addictions. We review translational evidence from both preclinical animal models and human clinical research, including studies in people with gambling disorder. Further, we describe the evidence for 1) the effects of the omission of expected reward as a stressor and to promote sensitization, 2) the effect of the resolution of reward uncertainty as a source of value, 3) structural characteristics of modern Electronic Gaming Machines (EGMs) in leveraging these mechanisms, 4) analogies to the aberrant salience hypothesis of psychosis for creating and maintaining gambling-related cognitive distortions. This neurobiologically-inspired model has implications for harm profiling of other putative behavioral addictions, as well as offering avenues for enhancing neurological, pharmacological and psychological treatments for gambling disorder, and harm reduction strategies for EGM design.

Fully Automated Habenula Segmentation Provides Robust and Reliable Volume Estimation Across Large Magnetic Resonance Imaging Datasets, Suggesting Intriguing Developmental Trajectories in Psychiatric Disease

Studies of habenula (Hb) function and structure provided evidence of its involvement in psychiatric disorders, including schizophrenia and bipolar disorder. Previous studies using magnetic resonance imaging (manual/semiautomated segmentation) have reported conflicting results. Aiming to improve Hb segmentation reliability and the study of large datasets, we describe a fully automated protocol that was validated against manual segmentations and applied to 3 datasets (childhood/adolescence and adult bipolar disorder and schizophrenia). It achieved reliable Hb segmentation, providing robust volume estimations across a large age range and varying image acquisition parameters. Applying it to clinically relevant datasets, we found smaller Hb volumes in the adult bipolar disorder dataset and larger volumes in the adult schizophrenia dataset compared with healthy control subjects. There are indications that Hb volume in both groups shows deviating developmental trajectories early in life. This technique sets a precedent for future studies, as it allows for fast and reliable Hb segmentation and will be publicly available.

Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task

The orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC) are known to participate in risk-based decision-making. However, whether neuronal activities of these two brain regions play similar or differential roles during different stages of risk-based decision-making process remains unknown. Here we conducted multi-channel in vivo recordings in the OFC and mPFC simultaneously when rats were performing a gambling task. Rats were trained to update strategy as the task was shifted in two stages. Behavioral testing suggests that rats exhibited different risk preferences and response latencies to food rewards during stage-1 and stage-2. Indeed, the firing patterns and numbers of non-specific neurons and nosepoking-predicting neurons were similar in OFC and mPFC. However, there were no reward-expecting neurons and significantly more reward-excitatory neurons (fired as rats received rewards) in the mPFC. Further analyses suggested that nosepoking-predicting neurons may encode the overall value of reward and strategy, whereas reward-expecting neurons show more intensive firing to a big food reward in the OFC. Nosepoking-predicting neurons in mPFC showed no correlation with decision-making strategy updating, whereas the response of reward-excitatory neurons in mPFC, which were barely observed in OFC, were inhibited during nosepoking, but were enhanced in the post-nosepoking period. These findings indicate that neurons in the OFC and mPFC exhibit distinct responses in decision-making process during reward consumption and strategy updating. Specifically, OFC encodes the overall value of a choice and is thus important for learning and strategy updating, whereas mPFC plays a key role in monitoring and execution of a strategy.

Oxytocin pathway gene networks in the human brain

Oxytocin is a neuropeptide involved in animal and human reproductive and social behavior. Three oxytocin signaling genes have been frequently implicated in human social behavior: OXT (structural gene for oxytocin), OXTR (oxytocin receptor), and CD38 (oxytocin secretion). Here, we characterized the distribution of OXT, OXTR, and CD38 mRNA across the human brain by creating voxel-by-voxel volumetric expression maps, and identified putative gene pathway interactions by comparing gene expression patterns across 20,737 genes. Expression of the three selected oxytocin pathway genes was enriched in subcortical and olfactory regions and there was high co-expression with several dopaminergic and muscarinic acetylcholine genes, reflecting an anatomical basis for critical gene pathway interactions. fMRI meta-analysis revealed that the oxytocin pathway gene maps correspond with the processing of anticipatory, appetitive, and aversive cognitive states. The oxytocin signaling system may interact with dopaminergic and muscarinic acetylcholine signaling to modulate cognitive state processes involved in complex human behaviors.

Dopaminergic Neurotransmission in Patients With Parkinson's Disease and Impulse Control Disorders: A Systematic Review and Meta-Analysis of PET and SPECT Studies

Background: Around 30% Parkinson's disease (PD) patients develop impulse control disorders (ICDs) to D_2/3 dopamine agonists and, to a lesser extent, levodopa. We aim to investigate striatal dopaminergic function in PD patients with and without ICD.

Methods: PubMed, Science Direct, EBSCO, and ISI Web of Science databases were searched (from inception to March 7, 2018) to identify PET or SPECT studies reporting striatal dopaminergic function in PD patients with ICD (ICD+) compared to those without ICD (ICD–). Studies which included drug naïve patients, explored non-pharmacological procedures (e.g., deep brain stimulation), and those using brain blood perfusion or non-dopaminergic markers were excluded. Standardized mean difference (SDM) was used and random-effect models were applied. Separate meta-analyses were performed for dopamine transporter level, dopamine release, and dopamine receptors availability in the putamen, caudate, dorsal, and ventral striatum.

Results: A total of 238 studies were title and abstract screened, of which 19 full-texts were assessed. Nine studies (ICD+: N = 117; ICD–: N = 175 patients) were included in the analysis. ICD+ showed a significant reduction of dopamine transporter binding in the putamen (SDM = −0.46; 95% CI: −0.80, −0.11; Z = 2.61; p = 0.009), caudate (SDM = −0.38; 95% CI: −0.73, −0.04; Z = 2.18; p = 0.03) and dorsal striatum (SDM = −0.45; 95% CI: −0.77, −0.13; Z = 2.76; p = 0.006), and increased dopamine release to reward-related stimuli/gambling tasks in the ventral striatum (SDM = −1.04; 95% CI: −1.73, −0.35; Z = 2.95; p = 0.003). Dopamine receptors availability did not differ between groups. Heterogeneity was low for dopamine transporter in the dorsal striatum (I² = 0%), putamen (I² = 0%) and caudate (I² = 0%), and pre-synaptic dopamine release in the dorsal (I² = 0%) and ventral striatum (I² = 0%); heterogeneity was high for dopamine transporter levels in the ventral striatum (I² = 80%), and for dopamine receptors availability in the ventral (I² = 89%) and dorsal (I² = 86%) striatum, putamen (I² = 93%), and caudate (I² = 71%).

Conclusions: ICD+ patients show lower dopaminergic transporter levels in the dorsal striatum and increased dopamine release in the ventral striatum when engaged in reward-related stimuli/gambling tasks. This dopaminergic imbalance might represent a biological substrate for ICD in PD. Adequately powered longitudinal studies with drug naïve patients are needed to understand whether these changes may represent biomarkers of premorbid vulnerability to ICD.

GluD1, linked to schizophrenia, controls the burst firing of dopamine neurons

Human mutations of the GRID1 gene encoding the orphan delta1 glutamate receptor-channel (GluD1) are associated with schizophrenia but the explicit role of GluD1 in brain circuits is unknown. Based on the known function of its paralog GluD2 in cerebellum, we searched for a role of GluD1 in slow glutamatergic transmission mediated by metabotropic receptor mGlu1 in midbrain dopamine neurons, whose dysfunction is a hallmark of schizophrenia. We found that an mGlu1 agonist elicits a slow depolarizing current in HEK cells co-expressing mGlu1 and GluD1, but not in cells expressing mGlu1 or GluD1 alone. This current is abolished by additional co-expression of a dominant-negative GluD1 dead pore mutant. We then characterized mGlu1-dependent currents in dopamine neurons from midbrain slices. Both the agonist-evoked and the slow postsynaptic currents are abolished by expression of the dominant-negative GluD1 mutant, pointing to the involvement of native GluD1 channels in these currents. Likewise, both mGlu1-dependent currents are suppressed in GRID1 knockout mice, which reportedly display endophenotypes relevant for schizophrenia. It is known that mGlu1 activation triggers the transition from tonic to burst firing of dopamine neurons, which signals salient stimuli and encodes reward prediction. In vivo recordings of dopamine neurons showed that their spontaneous burst firing is abolished in GRID1 knockout mice or upon targeted expression of the dominant-negative GluD1 mutant in wild-type mice. Our results de-orphanize GluD1, unravel its key role in slow glutamatergic transmission and provide insights into how GRID1 gene alterations can lead to dopaminergic dysfunctions in schizophrenia.

Dopamine and Stress System Modulation of Sex Differences in Decision Making

Maladaptive decision making is associated with several neuropsychiatric disorders, including problem gambling and suicidal behavior. The prevalence of these disorders is higher in men vs women, suggesting gender-dependent regulation of their pathophysiology underpinnings. We assessed sex differences in decision making using the rat version of the Iowa gambling task. Female rats identified the most optimal choice from session 1, whereas male rats from session 5. Male, but not female rats, progressively improved their advantageous option responding and surpassed females. Estrus cycle phase did not affect decision making. To test whether pharmacological manipulations targeting the dopaminergic and stress systems affect decision making in a sex-dependent manner, male and female rats received injections of a dopamine D₂ receptor (D₂R) antagonist (eticlopride), D₂R agonist (quinpirole), corticotropin-releasing factor 1 (CRF₁) antagonist (antalarmin), and α₂-adrenergic receptor antagonist (yohimbine; used as a pharmacological stressor). Alterations in mRNA levels of D₂R and CRF₁ were also assessed. Eticlopride decreased advantageous responding in male, but not female rats, whereas quinpirole decreased advantageous responding specifically in females. Yohimbine dose-dependently decreased advantageous responding in female rats, whereas decreased advantageous responding was only observed at higher doses in males. Antalarmin increased optimal choice responding only in female rats. Higher Drd2 and Crhr1 expression in the amygdala were observed in female vs male rats. Higher amygdalar Crhr1 expression was negatively correlated with advantageous responding specifically in females. This study demonstrates the relevance of dopaminergic- and stress-dependent sex differences to maladaptive decision making.

Learning From One's Mistakes: A Dual Role for the Rostromedial Tegmental Nucleus in the Encoding and Expression of Punished Reward Seeking

BACKGROUND

Psychiatric disorders such as addiction and mania are marked by persistent reward seeking despite highly negative or aversive outcomes, but the neural mechanisms underlying this aberrant decision making are unknown. The recently identified rostromedial tegmental nucleus (RMTg) encodes a wide variety of aversive stimuli and sends robust inhibitory projections to midbrain dopamine neurons, leading to the hypothesis that the RMTg provides a brake to reward signaling in response to aversive costs.

METHODS

To test the role of the RMTg in punished reward seeking, adult male Sprague Dawley rats were tested in several cost-benefit decision tasks after excitotoxic lesions of the RMTg or temporally specific optogenetic inhibition of RMTg efferents in the ventral tegmental area.

RESULTS

RMTg lesions drastically impaired the ability of foot shock to suppress operant responding for food. Optogenetic inhibition showed that this resistance to punishment was due in part to RMTg activity at the precise moment of shock delivery and was mediated by projections to the ventral tegmental area, which is consistent with an aversive "teaching signal" role for the RMTg during encoding of the aversive event. We observed a similar resistance to punishment when the RMTg was selectively inhibited immediately prior to the operant lever press, which is consistent with a second distinct role for the RMTg during action selection. These effects were not attributable to RMTg effects on learning rate, locomotion, shock sensitivity, or perseveration.

CONCLUSIONS

The RMTg has two strong and dissociable roles during both encoding and recall of aversive consequences of behavior.

Drosophila divalent metal ion transporter Malvolio is required in dopaminergic neurons for feeding decisions

Members of the natural resistance-associated macrophage protein (NRAMP) family are evolutionarily conserved metal ion transporters that play an essential role in regulating intracellular divalent cation homeostasis in both prokaryotes and eukaryotes. Malvolio (Mvl), the sole NRAMP family member in insects, plays a role in food choice behaviors in Drosophila and other species. However, the specific physiological and cellular processes that require the action of Mvl for appropriate feeding decisions remain elusive. Here, we show that normal food choice requires Mvl function specifically in the dopaminergic system, and can be rescued by supplementing food with manganese. Collectively, our data indicate that the action of the Mvl transporter affects food choice behavior via the regulation of dopaminergic innervation of the mushroom bodies, a principle brain region associated with decision-making in insects. Our studies suggest that the homeostatic regulation of the intraneuronal levels of divalent cations plays an important role in the development and function of the dopaminergic system and associated behaviors.

Translating the Habenula-From Rodents to Humans

The habenula (Hb) is a central structure connecting forebrain to midbrain regions. This microstructure regulates monoaminergic systems, notably dopamine and serotonin, and integrates cognitive with emotional and sensory processing. Early preclinical data have described Hb as a brain nucleus activated in anticipation of aversive outcomes. Evidence has now accumulated to show that the Hb encodes both rewarding and aversive aspects of external stimuli, thus driving motivated behaviors and decision making. Human Hb research is still nascent but develops rapidly, alongside with the growth of neuroimaging and deep brain stimulation techniques. Not surprisingly, Hb dysfunction has been associated with psychiatric disorders, and studies in patients have established evidence for Hb involvement in major depression, addiction, and schizophrenia, as well as in pain and analgesia. Here, we summarize current knowledge from animal research and overview the existing human literature on anatomy and function of the Hb. We also discuss challenges and future directions in targeting this small brain structure in both rodents and humans. By combining animal data and human experimental studies, this review addresses the translational potential of preclinical Hb research.

The habenula in psychiatric disorders: More than three decades of translational investigation

The habenula is an epithalamic structure located at the center of the dorsal diencephalic conduction system, a pathway involved in linking forebrain to midbrain regions. Composed of a medial and lateral subdivisions, the habenula receives inputs from the limbic system and basal ganglia mainly through the stria medullaris (SM), and projects to midbrain regions through the fasciculus retroflexus (FR). An increasing number of studies have implicated this structure in psychiatric disorders associated with dysregulated reward circuitry function, notably mood disorders, schizophrenia, and substance use disorder. However, despite significant progress in research, the mechanisms underlying the relationship between the habenula and the pathophysiology of psychiatric disorders are far from being fully understood, and still need further investigation. This review provides a closer look at key findings from animal and human studies illustrating the role of the habenula in mood disorders, schizophrenia, and substance use disorder, and discusses the clinical potential of using this structure as a therapeutic target.

Morphometric analysis of the cerebral expression of ATP-binding cassette transporter protein ABCB1 in chronic schizophrenia: Circumscribed deficits in the habenula

There is increasing evidence that microvascular abnormalities and malfunction of the blood-brain barrier (BBB) significantly contribute to schizophrenia pathophysiology. The ATP-binding cassette transporter ABCB1 is an important molecular component of the intact BBB, which has been implicated in a number of neurodegenerative and psychiatric disorders, including schizophrenia. However, the regional and cellular expression of ABCB1 in schizophrenia is yet unexplored. Therefore, we studied ABCB1 protein expression immunohistochemically in twelve human post-mortem brain regions known to play a role in schizophrenia, in 13 patients with schizophrenia and nine controls. In ten out of twelve brain regions under study, no significant differences were found with regard to the numerical density of ABCB1-expressing capillaries between all patients with schizophrenia and control cases. The left and right habenular complex, however, showed significantly reduced capillary densities in schizophrenia patients. In addition, we found a significantly reduced density of ABCB1-expressing neurons in the left habenula. Reduced ABCB1 expression in habenular capillaries might contribute to increased brain levels of proinflammatory cytokines in patients with schizophrenia, while decreased expression of this protein in a subpopulation of medial habenular neurons (which are probably purinergic) might be related to abnormalities of purines and their receptors found in this disease.

Left nucleus accumbens atrophy in deficit schizophrenia: A preliminary study

A question that remains to be answered is whether schizophrenia can be characterized by a single etiopathophysiology or whether separate sub-syndromes should be differentiated to define specific mechanisms for each sub-type. Individuals affected by the deficit subtype of schizophrenia (DSZ) display avolitional/amotivational features that respond poorly to conventional treatments. Characterizing DSZ from a neuroanatomical point of view may help clarify this issue and develop new treatment strategies. To determine if DSZ is associated with structural alterations in specific deep grey matter structures linked to its key clinical features, 22 DSZ patients, 22 non-deficit schizophrenia (NDSZ) patients and 22 healthy controls (HC) were recruited for a case-control cross-sectional study. High-resolution magnetic resonance imaging was performed in all subjects and volumes of deep grey matter structures were measured using FreeSurfer. DSZ patients displayed smaller left accumbens volumes compared to both NDSZ patients and HC. Moreover, age and duration of illness were significantly associated with lower volume of the left accumbens in DSZ but not in NDSZ. Findings indicate that DSZ is associated with lower volume of the nucleus accumbens in the dominant hemisphere. This is consistent with the psychopathological features and functional impairments present in DSZ and thus indicates a potential mechanism.

Neural correlates of reward processing in adults with 22q11 deletion syndrome

BACKGROUND

22q11.2 deletion syndrome (22q11DS) is caused by a microdeletion on chromosome 22q11.2 and associated with an increased risk to develop psychosis. The gene coding for catechol-O-methyl-transferase (COMT) is located at the deleted region, resulting in disrupted dopaminergic neurotransmission in 22q11DS, which may contribute to the increased vulnerability for psychosis. A dysfunctional motivational reward system is considered one of the salient features in psychosis and thought to be related to abnormal dopaminergic neurotransmission. The functional anatomy of the brain reward circuitry has not yet been investigated in 22q11DS.

METHODS

This study aims to investigate neural activity during anticipation of reward and loss in adult patients with 22q11DS. We measured blood-oxygen-level dependent (BOLD) activity in 16 patients with 22q11DS and 12 healthy controls during a monetary incentive delay task using a 3T Philips Intera MRI system. Data were analysed using SPM8.

RESULTS

During anticipation of reward, the 22q11DS group alone displayed significant activation in bilateral middle frontal and temporal brain regions. Compared to healthy controls, significantly less activation in bilateral cingulate gyrus extending to premotor, primary motor and somatosensory areas was found. During anticipation of loss, the 22q11DS group displayed activity in the left middle frontal gyrus and anterior cingulate cortex, and relative to controls, they showed reduced brain activation in bilateral (pre)cuneus and left posterior cingulate. Within the 22q11DS group, COMT Val hemizygotes displayed more activation compared to Met hemizygotes in right posterior cingulate and bilateral parietal regions during anticipation of reward. During anticipation of loss, COMT Met hemizygotes compared to Val hemizygotes showed more activation in bilateral insula, striatum and left anterior cingulate.

CONCLUSIONS

This is the first study to investigate reward processing in 22q11DS. Our preliminary results suggest that people with 22q11DS engage a fronto-temporal neural network. Compared to healthy controls, people with 22q11DS primarily displayed reduced activity in medial frontal regions during reward anticipation. COMT hemizygosity affects responsivity of the reward system in this condition. Alterations in reward processing partly underlain by the dopamine system may play a role in susceptibility for psychosis in 22q11DS.

Modulation of risk/reward decision making by dopaminergic transmission within the basolateral amygdala

RATIONALE

Dopamine (DA) transmission within cortico-limbic-striatal circuitry is integral in modulating decisions involving reward uncertainty. The basolateral amygdala (BLA) also plays a role in these processes, yet how DA transmission within this nucleus regulates cost/benefit decision making is unknown.

OBJECTIVES

We investigated the contribution of DA transmission within the BLA to risk/reward decision making assessed with a probabilistic discounting task.

METHODS

Rats were well-trained to choose between a small/certain reward and a large/risky reward, with the probability of obtaining the larger reward decreasing (100-12.5 %) or increasing (12.5-100 %) over a session. We examined the effects of antagonizing BLA D1 (SCH 23390, 0.1-1 μg) or D2 (eticlopride, 0.1-1 μg) receptors, as well as intra-BLA infusions of agonists for D1 (SKF 81297, 0.1-1 μg) and D2 (quinpirole, 1-10 μg) receptors. We also assessed how DA receptor stimulation may induce differential effects related to baseline levels of risky choice.

RESULTS

BLA D1 receptor antagonism reduced risky choice by decreasing reward sensitivity, whereas D2 antagonism did not affect overall choice patterns. Stimulation of BLA D1 receptors optimized decision making in a baseline-dependent manner: in risk-averse rats, infusions of a lower dose of SKF81297 increased risky choice when reward probabilities were high (50 %), whereas in risk-prone rats, this drug reduced risky choice when probabilities were low (12.5 %). Quinpirole reduced risky choice in risk-prone rats, enhancing lose-shift behavior.

CONCLUSIONS

These data highlight previously uncharacterized roles for BLA DA D1 and D2 receptors in biasing choice during risk/reward decision making through mediation of reward/negative feedback sensitivity.

Dissociable contribution of nucleus accumbens and dorsolateral striatum to the acquisition of risk choice behavior in the rat

While a growing body of research has suggested that the mesocorticolimbic dopamine systems play a key role in decision making under risk, how the nucleus accumbens (NAC) is involved in the acquisition of risk choice behavior remains unclear. This study used a T-maze task to assess risk-based decision making in which the rat was required to assess the risk by choosing to enter either a small and certain reward arm or a large but uncertain reward arm of the maze. The latter option, when chosen, resulted in provision of 2, 4, or 8 sweeten pellets with a probability (p) of 0.5, 0.25, or 0.125, respectively. Thus the latter arm provided three different conditions of reward ratio, compared to the choice of former arm, which always provided 1 pellet with p=1. This risk choice task was then run with the expected value being equality between the binary choice options. The experimental rats first received an excitoneurotoxic lesion affecting either the NAC or the dorsolateral striatum (DLS) and this was followed by post-lesion behavioral examination. The sham lesion control rats acquired a stable risk choice with regard to each reward ratio over a 10-day test. The pattern of choice behavior appeared in risk-seeking when p=0.5 to obtain 2 pellets, and was risk-averse when larger reward resulted in lower p. The NAC lesion significantly disrupted the acquisition of the aforementioned risk choice behavior and apparently shifted the choice into a risk-averse style for all three reward ratios. No such effect was observed in the rats with DLS lesions. Neither the gross motor action nor the discrimination of different reward magnitudes was impaired by the lesions affecting either the NAC or DLS as assessed by an additional experiment. These findings suggest that firstly there is heterogeneity between NAC and DLS with respect to risk-based decision making, and that secondly the NAC is involved and critical to the acquisition of behavioral choice under risk, specially when the expected value of the reward under the two choice options is equal.

Altered basolateral amygdala encoding in an animal model of schizophrenia

It has been proposed that schizophrenia results, in part, from the inappropriate or spurious attribution of salience to cues in the environment. We have recently reported neural correlates of salience in the basolateral amygdala (ABL) of rats during learning in an odor-guided discrimination task. Here we tested whether this dopamine-dependent salience signal is altered in rats with neonatal ventral hippocampal lesions (NVHLs), a rodent model of schizophrenia. We found that ABL signals related to violations in reward prediction were only mildly affected by NVHL; however, neurons in rats with NVHLs showed significantly stronger selectivity during odor sampling, particularly for the more salient large-reward cue. The elevated cue-evoked activity in NVHL rats was correlated with heightened orienting behavior and also with changes in firing to the shifts in reward, suggesting that it reflected abnormal signaling of the large reward-predicting cue's salience. These results are broadly consistent with the proposal that schizophrenics suffer from enhanced signaling of salience.

Risky decision-making and ventral striatal dopamine responses to amphetamine: a positron emission tomography [(11)C]raclopride study in healthy adults

Recent functional magnetic resonance imaging (fMRI) studies have provided compelling evidence that corticolimbic brain regions are integrally involved in human decision-making. Although much less is known about molecular mechanisms, there is growing evidence that the mesolimbic dopamine (DA) neurotransmitter system may be an important neural substrate. Thus far, direct examination of DA signaling in human risk-taking has centered on gambling disorder. Findings from several positron emission tomography (PET) studies suggest that dysfunctions in mesolimbic DA circuits may play an important role in gambling behavior. Nevertheless, interpretation of these findings is currently hampered by a need for better understanding of how individual differences in regional DA function influence normative decision-making in humans. To further our understanding of these processes, we used [(11)C]raclopride PET to examine associations between ventral striatal (VS) DA responses to amphetamine (AMPH) and risky decision-making in a sample of healthy young adults with no history of psychiatric disorder, Forty-five male and female subjects, ages 18-29 years, completed a computerized version of the Iowa Gambling Task. Participants then underwent two 90-minute PET studies with high specific activity [(11)C]raclopride. The first scan was preceded by intravenous saline; the second, by intravenous AMPH (0.3mg/kg). Findings of primary analyses showed that less advantageous decision-making was associated with greater right VS DA release; the relationship did not differ as a function of gender. No associations were observed between risk-taking and left VS DA release or baseline D2/D3 receptor availability in either hemisphere. Overall, the results support notions that variability in striatal DA function may mediate inter-individual differences in risky decision-making in healthy adults, further suggesting that hypersensitive DA circuits may represent a risk pathway in this population.