Orbitofrontal dopamine depletion upregulates caudate dopamine and alters behavior via changes in reinforcement sensitivity

Identification of genes regulated by trait sensitivity to negative feedback and prolonged alcohol consumption in rats

BACKGROUND

The results of our previous studies demonstrated that low sensitivity to negative feedback (NF) is associated with increased vulnerability to the development of compulsive alcohol-seeking in rats. In the present study, we investigated the molecular underpinnings of this relationship.

METHODS

Using TaqMan Gene Expression Array Cards, we analyzed the expression of the genes related to NF sensitivity and alcohol metabolism in three cortical regions (medial prefrontal cortex [mPFC], anterior cingulate cortex [ACC], orbitofrontal cortex [OFC]) and two subcortical regions (nucleus accumbens [Nacc], amygdala [Amy]). Gene expression differences were confirmed at the protein level with Western blot.

RESULTS

Sensitivity to NF was characterized by differences in Gad2, Drd2, and Slc6a4 expression in the ACC, Maoa in the mPFC, and Gria1, Htr3a, and Maoa in the OFC. Chronic alcohol consumption was associated with differences in the expression of Comt and Maoa in the ACC, Comt, Adh1, and Htr2b in the mPFC, Adh1, and Slc6a4 in the Nacc, Gad2, and Htr1a in the OFC, and Drd2 in the Amy. Interactions between the sensitivity to NF and alcohol consumption were observed in the expression of Gabra1, Gabbr2, Grin2a, Grin2b, and Grm3 in the ACC, and Grin2a in the OFC. The observed differences were confirmed at the protein level for MAO-A in the mPFC, and ADH1 in the mPFC and Nacc.

CONCLUSIONS

Our findings contribute to a better understanding of the molecular mechanisms underlying the relationship between trait sensitivity to NF and compulsive alcohol consumption.

Trait sensitivity to positive feedback is a predisposing factor for several aspects of compulsive alcohol drinking in male rats: behavioural, physiological, and molecular correlates

INTRODUCTION

Alcohol use disorder (AUD) is one of the most common psychiatric disorders and a leading cause of mortality worldwide. While the pathophysiology underlying AUD is relatively well known, the cognitive mechanisms of an individual's susceptibility to the development of alcohol dependence remain poorly understood. In this study, we investigated the theoretical claim that sensitivity to positive feedback (PF), as a stable and enduring behavioural trait, can predict individual susceptibility to the acquisition and maintenance of alcohol-seeking behaviour in rats.

METHODS

Trait sensitivity to PF was assessed using a series of probabilistic reversal learning tests. The escalation of alcohol intake in rats was achieved by applying a mix of intermittent free access and instrumental paradigms of alcohol drinking. The next steps included testing the influence of sensitivity to PF on the acquisition of compulsive alcohol-seeking behaviour in the seeking-taking punishment task, measuring motivation to seek alcohol, and comparing the speed of extinction and reinstatement of alcohol-seeking after a period of abstinence between rats expressing trait insensitivity and sensitivity to PF. Finally, trait differences in the level of stress hormones and in the expression of genes and proteins in several brain regions of interest were measured to identify potential physiological and neuromolecular mechanisms of the observed interactions.

RESULTS

We showed that trait sensitivity to PF in rats determines the level of motivation to seek alcohol following the experience of its negative consequences. They also revealed significant differences between animals classified as insensitive and sensitive to PF in their propensity to reinstate alcohol-seeking behaviours after a period of forced abstinence. The abovementioned effects were accompanied by differences in blood levels of stress hormones and differences in the cortical and subcortical expression of genes and proteins related to dopaminergic, serotonergic, and GABAergic neurotransmission.

CONCLUSION

Trait sensitivity to PF can determine the trajectory of alcohol addiction in rats. This effect is, at least partially, mediated via distributed physiological and molecular changes within cortical and subcortical regions of the brain.

Activity in the Dorsomedial Striatum Underlies Serial Reversal Learning Performance Under Probabilistic Uncertainty

Background

Corticostriatal circuits, particularly the dorsomedial striatum (DMS) and lateral orbitofrontal cortex, are critical for navigating reversal learning under probabilistic uncertainty. These same areas are implicated in the reversal learning impairments observed in individuals with psychosis as well as their psychotic symptoms, suggesting that they may share a common neurobiological substrate. To address this question, we used psychostimulant exposure and specific activation of the DMS during reversal learning in mice to assess corticostriatal activity.

Methods

We used amphetamine treatment to induce psychosis-relevant neurobiology in male mice during reversal learning and to examine pathway-specific corticostriatal activation. To determine the causal role of DMS activity, we used chemogenetics to drive midbrain inputs during a range of probabilistic contingencies.

Results

Mice treated with amphetamine showed altered punishment learning, which was associated with decreased shifting after losses and increased perseverative errors after reversals. Reversal learning performance and strategies were dependent on increased activity in lateral orbitofrontal cortex to DMS circuits as well as in the DMS itself. Specific activation of midbrain to DMS circuits also decreased shifting after losses and reversal learning performance. However, these alterations were dependent on the probabilistic contingency.

Conclusions

Our work suggests that the DMS plays a multifaceted role in reversal learning. Increasing DMS activity impairs multiple reversal learning processes dependent on the level of uncertainty, confirming its role in the maintenance and selection of incoming cortical inputs. Together, these outcomes suggest that elevated dopamine levels in the DMS could contribute to decision-making impairments in individuals with psychosis.

Dopaminergic signalling and behavioural alterations by Comt-Dtnbp1 genetic interaction and their clinical relevance

BACKGROUND AND PURPOSE

Cognitive and motor functions are modulated by dopaminergic signalling, which is shaped by several genetic factors. The biological effects of single genetic variants might differ depending on epistatic interactions that can be functionally multi-directional and non-linear.

EXPERIMENTAL APPROACH

We performed behavioural and neurochemical assessments in genetically modified mice and behavioural assessments and genetic screening in human patients with 22q11.2 deletion syndrome (22q11.2DS).

KEY RESULTS

Here, we confirm a genetic interaction between the Comt (catechol-O-methyltransferase, human orthologue: COMT) and Dtnbp1 (dystrobrevin binding protein 1, alias dysbindin, human orthologue: DTNBP1) genes that modulate cortical and striatal dopaminergic signalling in a manner not predictable by the effects of each single gene. In mice, Comt-by-Dtnbp1 concomitant reduction leads to a hypoactive mesocortical and a hyperactive mesostriatal dopamine pathway, associated with specific cognitive abnormalities. Like mice, in subjects with the 22q11.2DS (characterized by COMT hemideletion and dopamine alterations), COMT-by-DTNBP1 concomitant reduction was associated with analogous cognitive disturbances. We then developed an easy and inexpensive colourimetric kit for the genetic screening of common COMT and DTNBP1 functional genetic variants for clinical application.

CONCLUSIONS AND IMPLICATIONS

These findings illustrate an epistatic interaction of two dopamine-related genes and their functional effects, supporting the need to address genetic interaction mechanisms at the base of complex behavioural traits.

Cognitive impairment in schizophrenia: aetiology, pathophysiology, and treatment

Cognitive deficits are a core feature of schizophrenia, account for much of the impaired functioning associated with the disorder and are not responsive to existing treatments. In this review, we first describe the clinical presentation and natural history of these deficits. We then consider aetiological factors, highlighting how a range of similar genetic and environmental factors are associated with both cognitive function and schizophrenia. We then review the pathophysiological mechanisms thought to underlie cognitive symptoms, including the role of dopamine, cholinergic signalling and the balance between GABAergic interneurons and glutamatergic pyramidal cells. Finally, we review the clinical management of cognitive impairments and candidate novel treatments.

The Aversive Lens: Stress effects on the prefrontal-cingulate cortical pathways that regulate emotion

ARNSTEN, A.F.T., M.K.P. Joyce and A.C. Roberts. The Aversive Lens: Stress effects on the prefrontal-cingulate cortical pathways that regulate emotion. NEUROSCI BIOBEHAV REV XXX-XXX, 2022. The symptoms of major-depressive-disorder include psychic pain and anhedonia, i.e. seeing the world through an "aversive lens". The neurobiology underlying this shift in worldview is emerging. Here these data are reviewed, focusing on how activation of subgenual cingulate (BA25) induces an "aversive lens", and how higher prefrontal cortical (PFC) areas (BA46/10/32) provide top-down regulation of BA25 but are weakened by excessive dopamine and norepinephrine release during stress exposure, and dendritic spine loss with chronic stress exposure. These changes may generate an attractor state, which maintains the brain under the control of BA25, requiring medication or neuromodulatory treatments to return connectivity to a more flexible state. In line with this hypothesis, effective anti-depressant treatments reduce the activity of BA25 and restore top-down regulation by higher circuits, e.g. as seen with SSRI medications, ketamine, deep brain stimulation of BA25, or rTMS to strengthen dorsolateral PFC. This research has special relevance in an era of chronic stress caused by the COVID19 pandemic, political unrest and threat of climate change.

Sex-dependent effects of early life stress on reinforcement learning and limbic cortico-striatal functional connectivity

Major depressive disorder (MDD) is a stress-related condition hypothesized to involve aberrant reinforcement learning (RL) with positive and negative stimuli. The present study investigated whether repeated early maternal separation (REMS) stress, a procedure widely recognized to cause depression-like behaviour, affects how subjects learn from positive and negative feedback. The REMS procedure was implemented by separating male and female rats from their dam for 6 h each day from post-natal day 5-19. Control rat offspring were left undisturbed during this period. Rats were tested as adults for behavioral flexibility and feedback sensitivity on a probabilistic reversal learning task. A computational approach based on RL theory was used to derive latent behavioral variables related to reward learning and flexibility. To assess underlying brain substrates, a seed-based functional MRI connectivity analysis was applied both before and after an additional adulthood stressor in control and REMS rats. Female but not male rats exposed to REMS stress showed increased response 'stickiness' (repeated responses regardless of reward outcome). Following repeated adulthood stress, reduced functional connectivity from the basolateral amygdala (BLA) to the dorsolateral striatum (DLS), cingulate cortex (Cg), and anterior insula (AI) cortex was observed in females. By contrast, control male rats exposed to the second stressor showed impaired learning from negative feedback (i.e., non-reward) and reduced functional connectivity from the BLA to the DLS and AI compared to maternally separated males. RL in male rats exposed to REMS was unaffected. The fMRI data further revealed that connectivity between the mOFC and other prefrontal cortical and subcortical structures was positively correlated with response 'stickiness'. These findings reveal differences in how females and males respond to early life adversity and subsequent stress. These effects may be mediated by functional divergence in resting-state connectivity between the basolateral amygdala and fronto-striatal brain regions.

Prefrontal and Striatal Dopamine Release Are Inversely Correlated in Schizophrenia

BACKGROUND

The dopamine (DA) hypothesis postulates hyperactivity of subcortical DA transmission and hypoactivity of cortical DA in schizophrenia (SCH). Positron emission tomography provides the ability to assess this hypothesis in humans. However, no studies have examined the relationship between cortical DA and striatal DA in this illness.

METHODS

D_2/3 receptor radiotracer [¹¹C]FLB457 BP_ND (binding potential relative to nondisplaceable uptake) was measured in 14 off-medication subjects with SCH and 14 healthy control (HC) subjects at baseline and after the administration of 0.5 mg/kg oral d-amphetamine. The amphetamine-induced change in BP_ND (ΔBP_ND) was calculated as the difference between BP_ND in the postamphetamine condition and BP_ND in the baseline condition and expressed as a percentage of BP_ND at baseline. DA release in the striatum using the radiotracer [¹¹C]NPA was also measured in these subjects.

RESULTS

[¹¹C]FLB457 ΔBP_ND was greater in the HC group compared with the SCH group (F_1,26 = 5.7; p = .02) with significant differences in [¹¹C]FLB457 ΔBP_ND seen across cortical brain regions. Only in the SCH group was a significant negative correlation observed between [¹¹C]FLB457 ΔBP_ND in the dorsolateral prefrontal cortex and [¹¹C]NPA ΔBP_ND in the dorsal caudate (r = -0.71, p = .005).

CONCLUSIONS

Subjects with SCH demonstrated deficits of DA release in cortical brain regions relative to HC subjects. Examining both cortical and striatal DA release in the same subjects demonstrated an inverse relationship between cortical DA release and striatal DA release in SCH not present in HC subjects, providing support for the current DA hypothesis of SCH.

Amphetamine-induced dopamine release and impulsivity in Parkinson's disease

Impulsive-compulsive behaviours manifest in a substantial proportion of subjects with Parkinson's disease. Reduced ventral striatum dopamine receptor availability, and increased dopamine release is noted in patients with these symptoms. Prior studies of impulsivity suggest that midbrain D2 autoreceptors regulate striatal dopamine release in a feedback inhibitory manner, and in healthy populations, greater impulsivity is linked to poor proficiency of this inhibition. This has not been assessed in a Parkinson's disease population. Here, we applied 18F-fallypride PET studies to assess striatal and extrastriatal D2-like receptor uptake in a placebo-controlled oral dextroamphetamine sequence. We hypothesized that Parkinson's disease patients with impulsive-compulsive behaviours would have greater ventral striatal dopaminergic response to dextroamphetamine, and that an inability to attenuate ventral striatal dopamine release via midbrain D2 autoreceptors would underlie this response. Twenty patients with Parkinson's disease (mean age = 64.1 ± 5.8 years) both with (n = 10) and without (n = 10) impulsive-compulsive behaviours, participated in a single-blind dextroamphetamine challenge (oral; 0.43 mg/kg) in an OFF dopamine state. All completed PET imaging with 18F-fallypride, a high-affinity D2-like receptor ligand, in the placebo and dextroamphetamine state. Both voxelwise and region of interest analyses revealed dextroamphetamine-induced endogenous dopamine release localized to the ventral striatum, and the caudal-medial orbitofrontal cortex. The endogenous dopamine release observed in the ventral striatum correlated positively with patient-reported participation in reward-based behaviours, as quantified by the self-reported Questionnaire for Impulsivity in Parkinson's disease Rating Scale. In participants without impulsive-compulsive behaviours, baseline midbrain D2 receptor availability negatively correlated with ventral striatal dopamine release; however, this relationship was absent in those with impulsive-compulsive behaviours. These findings emphasize that reward-based behaviours in Parkinson's disease are regulated by ventral striatal dopamine release, and suggest that loss of inhibitory feedback from midbrain autoreceptors may underlie the manifestation of impulsive-compulsive behaviours.

Fast and slow contributions to decision-making in corticostriatal circuits

We make complex decisions using both fast judgments and slower, more deliberative reasoning. For example, during value-based decision-making, animals make rapid value-guided orienting eye movements after stimulus presentation that bias the upcoming decision. The neural mechanisms underlying these processes remain unclear. To address this, we recorded from the caudate nucleus and orbitofrontal cortex while animals made value-guided decisions. Using population-level decoding, we found a rapid, phasic signal in caudate that predicted the choice response and closely aligned with animals' initial orienting eye movements. In contrast, the dynamics in orbitofrontal cortex were more consistent with a deliberative system serially representing the value of each available option. The phasic caudate value signal and the deliberative orbitofrontal value signal were largely independent from each other, consistent with value-guided orienting and value-guided decision-making being independent processes.

Understanding them to understand ourselves: The importance of NHP research for translational neuroscience

Studying higher brain function presents fundamental scientific challenges but has great potential for impactful translation to the clinic, supporting the needs of many patients suffering from conditions that relate to neuronal dysfunction. For many key questions relevant to human neurological conditions and clinical interventions, non-human primates (NHPs) remain the only suitable model organism and the only effective way to study the relationship between brain structure and function with the knowledge and tools currently available. Here we present three exemplary studies of current research yielding important findings that are directly translational to human clinical patients but which would be impossible without NHP studies. Our first example shows how studies of the NHP prefrontal cortex are leading to clinically relevant advances and potential new treatments for human neuropsychiatric disorders such as depression and anxiety. Our second example looks at the relevance of NHP research to our understanding of visual pathways and the visual cortex, leading to visual prostheses that offer treatments for otherwise blind patients. Finally, we consider recent advances in treatments leading to improved recovery of movement and motor control in stroke patients, resulting from our improved understanding of brain stem parallel pathways involved in movement in NHPs. The case for using NHPs in neuroscience research, and the direct benefits to human patients, is strong but has rarely been set out directly. This paper reviews three very different areas of neuroscience research, expressly highlighting the unique insights offered to each by NHP studies and their direct applicability to human clinical conditions.

Prefrontal cortex and depression

The prefrontal cortex (PFC) has emerged as one of the regions most consistently impaired in major depressive disorder (MDD). Although functional and structural PFC abnormalities have been reported in both individuals with current MDD as well as those at increased vulnerability to MDD, this information has not translated into better treatment and prevention strategies. Here, we argue that dissecting depressive phenotypes into biologically more tractable dimensions - negative processing biases, anhedonia, despair-like behavior (learned helplessness) - affords unique opportunities for integrating clinical findings with mechanistic evidence emerging from preclinical models relevant to depression, and thereby promises to improve our understanding of MDD. To this end, we review and integrate clinical and preclinical literature pertinent to these core phenotypes, while emphasizing a systems-level approach, treatment effects, and whether specific PFC abnormalities are causes or consequences of MDD. In addition, we discuss several key issues linked to cross-species translation, including functional brain homology across species, the importance of dissecting neural pathways underlying specific functional domains that can be fruitfully probed across species, and the experimental approaches that best ensure translatability. Future directions and clinical implications of this burgeoning literature are discussed.

Combining brain perturbation and neuroimaging in non-human primates

Brain perturbation studies allow detailed causal inferences of behavioral and neural processes. Because the combination of brain perturbation methods and neural measurement techniques is inherently challenging, research in humans has predominantly focused on non-invasive, indirect brain perturbations, or neurological lesion studies. Non-human primates have been indispensable as a neurobiological system that is highly similar to humans while simultaneously being more experimentally tractable, allowing visualization of the functional and structural impact of systematic brain perturbation. This review considers the state of the art in non-human primate brain perturbation with a focus on approaches that can be combined with neuroimaging. We consider both non-reversible (lesions) and reversible or temporary perturbations such as electrical, pharmacological, optical, optogenetic, chemogenetic, pathway-selective, and ultrasound based interference methods. Method-specific considerations from the research and development community are offered to facilitate research in this field and support further innovations. We conclude by identifying novel avenues for further research and innovation and by highlighting the clinical translational potential of the methods.

Reinforcement-based cognitive biases as vulnerability factors in alcohol addiction: From humans to animal models

Alcohol use disorder (AUD) is one of the most common, but still poorly treated, psychiatric conditions. Developing new treatments requires a better understanding of the aetiology of symptoms and evaluation of novel therapeutic targets in preclinical studies. Recent developments in our understanding of the reinforcement-based cognitive biases (RBCBs) that contribute to the development of AUD and its treatment offer new opportunities for both clinical and preclinical research. In this review, we first briefly describe psychological and cognitive theories that involve various aspects of reinforcement sensitivity in the development, maintenance, and recurrence of alcohol addiction. Furthermore, in separate sections, we describe studies investigating RBCBs and their neural, neurochemical, and pharmacological correlates, and we discuss possible interactions between RBCBs and trajectories of AUD. Finally, we describe how recent translational studies using state-of-the-art animal models can facilitate our understanding of the role of reinforcement sensitivity and RBCBs in various aspects of AUD.

Medial orbitofrontal cortex dopamine D1/D2 receptors differentially modulate distinct forms of probabilistic decision-making

Efficient decision-making involves weighing the costs and benefits associated with different actions and outcomes to maximize long-term utility. The medial orbitofrontal cortex (mOFC) has been implicated in guiding choice in situations involving reward uncertainty, as inactivation in rats alters choice involving probabilistic rewards. The mOFC receives considerable dopaminergic input, yet how dopamine (DA) modulates mOFC function has been virtually unexplored. Here, we assessed how mOFC D₁ and D₂ receptors modulate two forms of reward seeking mediated by this region, probabilistic reversal learning and probabilistic discounting. Separate groups of well-trained rats received intra-mOFC microinfusions of selective D₁ or D₂ antagonists or agonists prior to task performance. mOFC D₁ and D₂ blockade had opposing effects on performance during probabilistic reversal learning and probabilistic discounting. D₁ blockade impaired, while D₂ blockade increased the number of reversals completed, both mediated by changes in errors and negative feedback sensitivity apparent during the initial discrimination of the task, which suggests changes in probabilistic reinforcement learning rather than flexibility. Similarly, D₁ blockade reduced, while D₂ blockade increased preference for larger/risky rewards. Excess D₁ stimulation had no effect on either task, while excessive D₂ stimulation impaired probabilistic reversal performance, and reduced both profitable risky choice and overall task engagement. These findings highlight a previously uncharacterized role for mOFC DA, showing that D₁ and D₂ receptors play dissociable and opposing roles in different forms of reward-related action selection. Elucidating how DA biases behavior in these situations will expand our understanding of the mechanisms regulating optimal and aberrant decision-making.

Phenotypes of reinforcement sensitivity as predictors of the response to acute antidepressant treatment in rats

One of the biggest threats to modern societies is the increasing prevalence of mood disorders. Cognitive deficits associated with depressive and bipolar disorders are a major driver of functional impairment and the ensuing disability of the suffering individuals. Growing evidence has indicated strong inter-individual differences in the vulnerability to development and effectivity of treatment of these psychiatric conditions, linking various levels of reinforcement sensitivity with specific mood conditions. In this study, we took a unique opportunity to investigate how trait sensitivity to reinforcement determines the reactivity of rats to acute antidepressant treatment. For this, using a preclinical version of the probabilistic reversal-learning (PRL) paradigm, we identified 4 phenotypes of sensitivity to negative and positive feedback in rats, which could represent various types of potential vulnerability to affective disorders. Subsequently, using the light/dark box (LDB) and progressive ratio schedule of reinforcement (PRSR) tests, we evaluated inter-phenotypic differences in the effects of acute treatment with 3 different antidepressant drugs (escitalopram, mirtazapine and clomipramine, each in 3 doses) on anxiety and appetitive motivation of experimental animals. We report statistically significant differences between the investigated phenotypes of reinforcement sensitivity in the effects of acute escitalopram treatment on anxiety in the LDB test. We also report phenotype-independent effects of mirtazapine on motivation and anxiety and a lack of effect of clomipramine. These results demonstrate for the first time that trait sensitivity to reinforcement could have important implications for the effectiveness of treatment in affective disorders.

High-frequency neuromodulation improves obsessive-compulsive behavior

Nearly one billion people worldwide suffer from obsessive-compulsive behaviors^1,2, yet our mechanistic understanding of these behaviors is incomplete, and effective therapeutics are unavailable. An emerging perspective characterizes obsessive-compulsive behaviors as maladaptive habit learning^3,4, which may be associated with abnormal beta-gamma neurophysiology of the orbitofrontal-striatal circuitry during reward processing^5,6. We target the orbitofrontal cortex with alternating current, personalized to the intrinsic beta-gamma frequency of the reward network, and show rapid, reversible, frequency-specific modulation of reward- but not punishment-guided choice behavior and learning, driven by increased exploration in the setting of an actor-critic architecture. Next, we demonstrate that chronic application of the procedure over 5 days robustly attenuates obsessive-compulsive behavior in a non-clinical population for 3 months, with the largest benefits for individuals with more severe symptoms. Finally, we show that convergent mechanisms underlie modulation of reward learning and reduction of obsessive-compulsive symptoms. The results contribute to neurophysiological theories of reward, learning and obsessive-compulsive behavior, suggest a unifying functional role of rhythms in the beta-gamma range, and set the groundwork for the development of personalized circuit-based therapeutics for related disorders.

Distinct roles for dopamine clearance mechanisms in regulating behavioral flexibility

Dopamine plays a crucial role in adaptive behavior, and dysfunctional dopamine is implicated in multiple psychiatric conditions characterized by inflexible or inconsistent choices. However, the precise relationship between dopamine and flexible decision making remains unclear. One reason is that, while many studies have focused on the activity of dopamine neurons, efficient dopamine signaling also relies on clearance mechanisms, notably the dopamine transporter (DAT), which predominates in striatum, and catechol-O-methyltransferase (COMT), which predominates in cortex. The exact locus, extent, and timescale of the effects of DAT and COMT are uncertain. Moreover, there is limited data on how acute disruption of either mechanism affects flexible decision making strategies mediated by cortico-striatal networks. To address these issues, we combined pharmacological modulation of DAT and COMT with electrochemistry and behavior in mice. DAT blockade, but not COMT inhibition, regulated sub-second dopamine release in the nucleus accumbens core, but surprisingly neither clearance mechanism affected evoked release in prelimbic cortex. This was not due to a lack of sensitivity, as both amphetamine and atomoxetine changed the kinetics of sub-second release. In a multi-step decision making task where mice had to respond to reversals in either reward probabilities or the choice sequence to reach the goal, DAT blockade selectively impaired, and COMT inhibition improved, performance after reward reversals, but neither manipulation affected the adaptation of choices after action-state transition reversals. Together, our data suggest that DAT and COMT shape specific aspects of behavioral flexibility by regulating different aspects of the kinetics of striatal and cortical dopamine, respectively.

Genetic Contribution of Synapse-Associated Protein 97 to Orbitofrontal-Striatal-Thalamic Circuitry Connectivity Changes in First-Episode Schizophrenia

Functional and structural disturbances in the orbitofrontal-striatal-thalamic circuitry are thought to be associated with mental symptoms and neurocognitive impairments in schizophrenia. This study tested whether synapse-associated protein 97 (SAP97), a reasonable candidate gene for schizophrenia, is related to orbitofrontal-striatal-thalamic connection changes in first-episode schizophrenia (FES) patients and the clinical performance of schizophrenic patients by affecting this integrity. Fifty-two FES patients and 52 matched healthy controls were recruited. All subjects underwent genotyping via the improved multiplex ligation detection reaction technique and scanning with magnetic resonance imaging (MRI) to provide orbitofrontal-striatal-thalamic functional and structural imaging data. A two-way analysis of covariance model was employed to examine abnormal brain connectivities, and Spearman correlations were applied to estimate the relationships between brain connectivity and clinical manifestations. In the FES group, those with the SAP97 rs3915512 TT genotype showed lower structural and functional connectivity than A allele carriers between the orbitofrontal gyrus and striatum/thalamus. In the FES group, negative correlations were found between resting-state functional connectivity (RSFC) in the orbitofrontal gyrus and thalamus, and positive symptoms between structural connections in the orbitofrontal gyrus and striatum and cognitive functions, and positive correlations were suggested between RSFC in the orbitofrontal gyrus and thalamus and negative symptoms. Our findings suggested that the SAP97 rs3915512 polymorphism may be involved in mental symptoms and cognitive dysfunction in FES patients by influencing structural and functional connectivity of the orbitofrontal-striatal and orbitofrontal-thalamic regions.

Is impaired dopaminergic function associated with mobility capacity in older adults?

The capacity to move is essential for independence and declines with age. Slow movement speed, in particular, is strongly associated with negative health outcomes. Prior research on mobility (herein defined as movement slowness) and aging has largely focused on musculoskeletal mechanisms and processes. More recent work has provided growing evidence for a significant role of the nervous system in contributing to reduced mobility in older adults. In this article, we report four pieces of complementary evidence from behavioral, genetic, and neuroimaging experiments that, we believe, provide theoretical support for the assertion that the basal ganglia and its dopaminergic function are responsible, in part, for age-related reductions in mobility. We report four a posteriori findings from an existing dataset: (1) slower central activation of ballistic force development is associated with worse mobility among older adults; (2) older adults with the Val/Met intermediate catecholamine-O-methyl-transferase (COMT) genotype involved in dopamine degradation exhibit greater mobility than their homozygous counterparts; (3) there are moderate relationships between performance times from a series of lower and upper extremity tasks supporting the notion that movement speed in older adults is a trait-like attribute; and (4) there is a relationship of functional connectivity within the medial orbofrontal (mOFC) cortico-striatal network and measures of mobility, suggesting that a potential neural mechanism for impaired mobility with aging is the deterioration of the integrity of key regions within the mOFC cortico-striatal network. These findings align with recent basic and clinical science work suggesting that the basal ganglia and its dopaminergic function are mechanistically linked to age-related reductions in mobility capacity.

A framework for the investigation of rare genetic disorders in neuropsychiatry

De novo and inherited rare genetic disorders (RGDs) are a major cause of human morbidity, frequently involving neuropsychiatric symptoms. Recent advances in genomic technologies and data sharing have revolutionized the identification and diagnosis of RGDs, presenting an opportunity to elucidate the mechanisms underlying neuropsychiatric disorders by investigating the pathophysiology of high-penetrance genetic risk factors. Here we seek out the best path forward for achieving these goals. We think future research will require consistent approaches across multiple RGDs and developmental stages, involving both the characterization of shared neuropsychiatric dimensions in humans and the identification of neurobiological commonalities in model systems. A coordinated and concerted effort across patients, families, researchers, clinicians and institutions, including rapid and broad sharing of data, is now needed to translate these discoveries into urgently needed therapies.

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2/3 receptor agents

RATIONALE

Disorders of compulsivity such as stimulant use disorder (SUD) and obsessive-compulsive disorder (OCD) are characterised by deficits in behavioural flexibility, some of which have been captured using probabilistic reversal learning (PRL) paradigms.

OBJECTIVES

This study used computational modelling to characterise the reinforcement learning processes underlying patterns of PRL behaviour observed in SUD and OCD and to show how the dopamine D2/3 receptor agonist pramipexole and the D2/3 antagonist amisulpride affected these responses.

METHODS

We applied a hierarchical Bayesian method to PRL data across three groups: individuals with SUD, OCD, and healthy controls. Participants completed three sessions where they received placebo, pramipexole, and amisulpride, in a double-blind placebo-controlled, randomised design. We compared seven models using a bridge sampling estimate of the marginal likelihood.

RESULTS

Stimulus-bound perseveration, a measure of the degree to which participants responded to the same stimulus as before irrespective of outcome, was significantly increased in SUD, but decreased in OCD, compared to controls (on placebo). Individuals with SUD also exhibited reduced reward-driven learning, whilst both the SUD and OCD groups showed increased learning from punishment (nonreward). Pramipexole and amisulpride had similar effects on the control and OCD groups; both increased punishment-driven learning. These D2/3-modulating drugs affected the SUD group differently, remediating reward-driven learning and reducing aspects of perseverative behaviour, amongst other effects.

CONCLUSIONS

We provide a parsimonious computational account of how perseverative tendencies and reward- and punishment-driven learning differentially contribute to PRL in SUD and OCD. D2/3 agents modulated these processes and remediated deficits in SUD in particular, which may inform therapeutic effects.

Neural dynamics in co-morbid schizophrenia and OCD: A computational approach

The co-morbidity of obsessive-compulsive disorder (OCD) and schizophrenia is higher than what would be expected by chance and the common underlying neuropathophysiology is not well understood. Repetitive stereotypes and routines can be caused by perseverative thoughts and motor sequences in both of these disorders. We extended a previously published computational model to investigate cortico-striatal network dynamics. Given the considerable overlap in symptom phenomenology and the high degree of co-morbidity between OCD and schizophrenia, we examined the dynamical consequences of functional connectivity variations in the overlapping network. This was achieved by focusing on the emergence of network oscillatory activity and examining parameter sensitivity. Opposing activity levels are present in orbitofrontal cortex (OFC) and anterior cingulate cortex (ACC) in schizophrenia and OCD. We found that with over-compensation of the primary pathology, emergence of the other disorder can occur. The oscillatory behavior is delicately modulated by connections between the OFC/ACC to the ventral and dorsal striatum and by the coupling between the ACC and dorsolateral prefrontal cortex (DLPFC). Modulation on cortical self-inhibition (e.g. serotonin reuptake inhibitor treatment) together with dopaminergic input to the striatum (e.g. anti-dopaminergic medication) has non-trivial complex effects on the network oscillatory behavior, with an optimal modulatory window. Additionally, there are several disruption mechanisms and compensatory processes in the cortico-striato-thalamic network which may contribute to the underlying neuropathophysiology and clinical heterogeneity in schizo-obsessive spectrum disorders. Our mechanistic model predicts that dynamic over-compensation of the primarily occuring neuropathophysiology can lead to the secondary co-morbid disease.

Computational psychopharmacology: a translational and pragmatic approach

RATIONALE

Psychopharmacology needs novel quantitative measures and theoretical approaches based on computational modelling that can be used to help translate behavioural findings from experimental animals to humans, including patients with neuropsychiatric disorders.

OBJECTIVES

This brief review exemplifies this approach when applied to recent published studies of the effects of manipulating central dopaminergic and serotoninergic systems in rodents and marmoset monkeys, and possible comparisons with healthy human volunteers receiving systemic agents or patients with depression and schizophrenia.

METHODS

Behavioural effects of central depletions of dopamine or serotonin in monkeys in probabilistic learning paradigms are characterised further by computational modelling methods and related to rodent and human data.

RESULTS

Several examples are provided of the power of computational modelling to derive new measures and reappraise conventional explanations of regional neurotransmitter depletion and other drug effects, whilst enhancing construct validation in patient groups. Specifically, effects are shown on such parameters as 'stimulus stickiness' and 'side stickiness', which occur over and above effects on standard parameters of reinforcement learning, reminiscent of some early innovations in data analysis in psychopharmacology.

CONCLUSIONS

Computational modelling provides a useful methodology for further detailed analysis of behavioural mechanisms that are affected by pharmacological manipulations across species and will aid the translation of experimental findings to understand the therapeutic effects of medications in neuropsychiatric disorders, as well as facilitating future drug discovery.

Translational tests involving non-reward: methodological considerations

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson's disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Dopamine D2-like receptor stimulation blocks negative feedback in visual and spatial reversal learning in the rat: behavioural and computational evidence

RATIONALE

Dopamine D2-like receptors (D2R) are important drug targets in schizophrenia and Parkinson's disease, but D2R ligands also cause cognitive inflexibility such as poor reversal learning. The specific role of D2R in reversal learning remains unclear.

OBJECTIVES

We tested the hypotheses that D2R agonism impairs reversal learning by blocking negative feedback and that antagonism of D1-like receptors (D1R) impairs learning from positive feedback.

METHODS

Male Lister Hooded rats were trained on a novel visual reversal learning task. Performance on "probe trials", during which the correct or incorrect stimulus was presented with a third, probabilistically rewarded (50% of trials) and therefore intermediate stimulus, revealed individual learning curves for the processes of positive and negative feedback. The effects of D2R and D1R agonists and antagonists were evaluated. A separate cohort was tested on a spatial probabilistic reversal learning (PRL) task after D2R agonism. Computational reinforcement learning modelling was applied to choice data from the PRL task to evaluate the contribution of latent factors.

RESULTS

D2R agonism with quinpirole dose-dependently impaired both visual reversal and PRL. Analysis of the probe trials on the visual task revealed a complete blockade of learning from negative feedback at the 0.25 mg/kg dose, while learning from positive feedback was intact. Estimated parameters from the model that best described the PRL choice data revealed a steep and selective decrease in learning rate from losses. D1R antagonism had a transient effect on the positive probe trials.

CONCLUSIONS

D2R stimulation impairs reversal learning by blocking the impact of negative feedback.

The role of the orbitofrontal cortex in alcohol use, abuse, and dependence

One of the major functions of the orbitofrontal cortex (OFC) is to promote flexible motivated behavior. It is no surprise, therefore, that recent work has demonstrated a prominent impact of chronic drug use on the OFC and a potential role for OFC disruption in drug abuse and addiction. Among drugs of abuse, the use of alcohol is particularly salient with respect to OFC function. Although a number of studies in humans have implicated OFC dysregulation in alcohol use disorders, animal models investigating the association between OFC and alcohol use are only beginning to be developed, and there is still a great deal to be revealed. The goal of this review is to consider what is currently known regarding the role of the OFC in alcohol use and dependence. I will first provide a brief, general overview of current views of OFC function and its contributions to drug seeking and addiction. I will then discuss research to date related to the OFC and alcohol use, both in human clinical populations and in non-human models. Finally I will consider issues and strategies to guide future study that may identify this brain region as a key player in the transition from moderated to problematic alcohol use and dependence.

Impaired Expected Value Computations in Schizophrenia Are Associated With a Reduced Ability to Integrate Reward Probability and Magnitude of Recent Outcomes

BACKGROUND

Motivational deficits in people with schizophrenia (PSZ) are associated with an inability to integrate the magnitude and probability of previous outcomes. The mechanisms that underlie probability-magnitude integration deficits, however, are poorly understood. We hypothesized that increased reliance on "valueless" stimulus-response associations, in lieu of expected value (EV)-based learning, could drive probability-magnitude integration deficits in PSZ with motivational deficits.

METHODS

Healthy volunteers (n = 38) and PSZ (n = 49) completed a learning paradigm consisting of four stimulus pairs. Reward magnitude (3, 2, 1, 0 points) and probability (90%, 80%, 20%, 10%) determined each stimulus's EV. Following a learning phase, new and familiar stimulus pairings were presented. Participants were asked to select stimuli with the highest reward value.

RESULTS

PSZ with high motivational deficits made increasingly less optimal choices as the difference in reward value (probability × magnitude) between two competing stimuli increased. Using a previously validated computational hybrid model, PSZ relied less on EV ("Q-learning") and more on stimulus-response learning ("actor-critic"), which correlated with Scale for the Assessment of Negative Symptoms motivational deficit severity. PSZ specifically failed to represent reward magnitude, consistent with model demonstrations showing that response tendencies in the actor-critic were preferentially driven by reward probability.

CONCLUSIONS

Probability-magnitude deficits in PSZ with motivational deficits arise from underutilization of EV in favor of reliance on valueless stimulus-response associations. Confirmed by our computational hybrid framework, probability-magnitude integration deficits were driven specifically by a failure to represent reward magnitude. This work provides a first mechanistic explanation of complex EV-based learning deficits in PSZ with motivational deficits that arise from an inability to combine information from different reward modalities.

Adolescence as a neurobiological critical period for the development of higher-order cognition

The transition from adolescence to adulthood is characterized by improvements in higher-order cognitive abilities and corresponding refinements of the structure and function of the brain regions that support them. Whereas the neurobiological mechanisms that govern early development of sensory systems are well-understood, the mechanisms that drive developmental plasticity of association cortices, such as prefrontal cortex (PFC), during adolescence remain to be explained. In this review, we synthesize neurodevelopmental findings at the cellular, circuit, and systems levels in PFC and evaluate them through the lens of established critical period (CP) mechanisms that guide early sensory development. We find remarkable correspondence between these neurodevelopmental processes and the mechanisms driving CP plasticity, supporting the hypothesis that adolescent development is driven by CP mechanisms that guide the rapid development of neurobiology and cognitive ability during adolescence and their subsequent stability in adulthood. Critically, understanding adolescence as a CP not only provides a mechanism for normative adolescent development, it provides a framework for understanding the role of experience and neurobiology in the emergence of psychopathology that occurs during this developmental period.

Chronic Social Stress Leads to Reduced Gustatory Reward Salience and Effort Valuation in Mice

Pathology of reward processing is a major clinical feature of stress-related neuropsychiatric disorders including depression. Several dimensions of reward processing can be impacted, including reward valuation/salience, learning, expectancy and effort valuation. To establish the causal relationships between stress, brain changes, and reward processing pathologies, valid animal models are essential. Here, we present mouse experiments investigating behavioral effects of chronic social stress (CSS) in association learning tests of gustatory reward salience and effort valuation. The reward salience test (RST) comprised Pavlovian pairing of a tone with gustatory reward. The effort valuation test (EVT) comprised operant responding for gustatory reinforcement on a progressive ratio schedule (PRS). All testing was conducted with mice at 100% baseline body weight (BBW). In one experiment, mice underwent 15-day CSS or control handling (CON) and testing was conducted using sucrose pellets. In the RST on days 16–17, CSS mice made fewer feeder responses and had a longer tone response latency, than CON mice. In a shallow EVT on days 19–20, CSS mice attained a lower final ratio than CON mice. In a second CSS experiment, mice underwent CSS or CON and testing was conducted with chocolate pellets and in the presence of standard diet (low effort/low reward). In the RST on days 16–18, CSS mice made fewer feeder responses and had a longer tone response latency, than CON mice. In a steep EVT on days 19–20, CSS and CON mice attained less pellets than in the RST, and CSS mice attained a lower final ratio than CON mice. At day 21, blood levels of glucose and the satiety adipokine leptin were similar in CSS and CON mice. Therefore, CSS leads to consistent reductions in reward salience and effort valuation in tests based on association learning. These reward pathology models are being applied to identify the underlying neurobiology and putative molecular targets for therapeutic pharmacology.

Schizophrenia alters intra-network functional connectivity in the caudate for detecting speech under informational speech masking conditions

BACKGROUND

Speech recognition under noisy "cocktail-party" environments involves multiple perceptual/cognitive processes, including target detection, selective attention, irrelevant signal inhibition, sensory/working memory, and speech production. Compared to health listeners, people with schizophrenia are more vulnerable to masking stimuli and perform worse in speech recognition under speech-on-speech masking conditions. Although the schizophrenia-related speech-recognition impairment under "cocktail-party" conditions is associated with deficits of various perceptual/cognitive processes, it is crucial to know whether the brain substrates critically underlying speech detection against informational speech masking are impaired in people with schizophrenia.

METHODS

Using functional magnetic resonance imaging (fMRI), this study investigated differences between people with schizophrenia (n = 19, mean age = 33 ± 10 years) and their matched healthy controls (n = 15, mean age = 30 ± 9 years) in intra-network functional connectivity (FC) specifically associated with target-speech detection under speech-on-speech-masking conditions.

RESULTS

The target-speech detection performance under the speech-on-speech-masking condition in participants with schizophrenia was significantly worse than that in matched healthy participants (healthy controls). Moreover, in healthy controls, but not participants with schizophrenia, the strength of intra-network FC within the bilateral caudate was positively correlated with the speech-detection performance under the speech-masking conditions. Compared to controls, patients showed altered spatial activity pattern and decreased intra-network FC in the caudate.

CONCLUSIONS

In people with schizophrenia, the declined speech-detection performance under speech-on-speech masking conditions is associated with reduced intra-caudate functional connectivity, which normally contributes to detecting target speech against speech masking via its functions of suppressing masking-speech signals.

Influence of ventral tegmental area input on cortico-subcortical networks underlying action control and decision making

It is argued that the mesolimbic system has a more general function in processing all salient events, including and extending beyond rewards. Saliency was defined as an event that is unexpected due to its frequency of occurrence and elicits an attentional-behavioral switch. Using functional magnetic resonance imaging (fMRI), signals were measured in response to the modulation of salience of rewarding and nonrewarding events during a reward-based decision making task, the so called desire-reason dilemma paradigm (DRD). Replicating previous findings, both frequent and infrequent, and therefore salient, reward stimuli elicited reliable activation of the ventral tegmental area (VTA) and ventral striatum (vStr). When immediate reward desiring contradicted the superordinate task-goal, we found an increased activation of the VTA and vStr when the salient reward stimuli were presented compared to the nonsalient reward stimuli, indicating a boosting of activation in these brain regions. Furthermore, we found a significantly increased functional connectivity between the VTA and vStr, confirming the boosting of vStr activation via VTA input. Moreover, saliency per se without a reward association led to an increased activation of brain regions in the mesolimbic reward system as well as the orbitofrontal cortex (OFC), inferior frontal gyrus (IFG), and anterior cingulate cortex (ACC). Finally, findings uncovered multiple increased functional interactions between cortical saliency-processing brain areas and the VTA and vStr underlying detection and processing of salient events and adaptive decision making.

Mapping anhedonia-specific dysfunction in a transdiagnostic approach: an ALE meta-analysis

Anhedonia is a prominent symptom in neuropsychiatric disorders, most markedly in major depressive disorder (MDD) and schizophrenia (SZ). Emerging evidence indicates an overlap in the neural substrates of anhedonia between MDD and SZ, which supported a transdiagnostic approach. Therefore, we used activation likelihood estimation (ALE) meta-analysis of functional magnetic resonance imaging studies in MDD and SZ to examine the neural bases of three subdomains of anhedonia: consummatory anhedonia, anticipatory anhedonia and emotional processing. ALE analysis focused specifically on MDD or SZ was used later to dissociate specific anhedonia-related neurobiological impairments from potential disease general impairments. ALE results revealed that consummatory anhedonia was associated with decreased activation in ventral basal ganglia areas, while anticipatory anhedonia was associated with more substrates in frontal-striatal networks except the ventral striatum, which included the dorsal anterior cingulate, middle frontal gyrus and medial frontal gyrus. MDD and SZ patients showed similar neurobiological impairments in anticipatory and consummatory anhedonia, but differences in the emotional experience task, which may also involve affective/mood general processing. These results support that anhedonia is characterized by alterations in reward processing and relies on frontal-striatal brain circuitry. The transdiagnostic approach is a promising way to reveal the overall neurobiological framework that contributes to anhedonia and could help to improve targeted treatment strategies.

Dopamine Modulates the Functional Organization of the Orbitofrontal Cortex

Neuromodulators such as dopamine can alter the intrinsic firing properties of neurons and may thereby change the configuration of larger functional circuits. The primate orbitofrontal cortex (OFC) receives dopaminergic input from midbrain nuclei, but the role of dopamine in the OFC is still unclear. Here we tested the idea that dopaminergic activity changes the pattern of connectivity between the OFC and the rest of the brain and thereby reconfigures functional networks in the OFC. To this end, we combined double-blind, placebo-controlled pharmacology [D₂ receptor (D2R) antagonist amisulpride] in humans with resting-state functional magnetic resonance imaging and clustering methods. In the placebo group, we replicated previously observed parcellations of the OFC into two and six subregions based on connectivity patterns with the rest of the brain. Most importantly, while the twofold clustering did not differ significantly between groups, blocking D2Rs significantly changed the composition of the sixfold parcellation, suggesting a dopamine-dependent reconfiguration of functional OFC subregions. Moreover, multivariate decoding analyses revealed that amisulpride changed the whole-brain connectivity patterns of individual OFC subregions. In particular, D2R blockade shifted the balance of OFC connectivity from associative areas in the temporal and parietal lobe toward functional connectivity with the frontal cortex. In summary, our results suggest that dopamine alters the composition of functional OFC circuits, possibly indicating a broader role for neuromodulators in the dynamic reconfiguration of functional brain networks.SIGNIFICANCE STATEMENT A key role of any neuromodulator may be the reconfiguration of functional brain circuits. Here we test this idea with regard to dopamine and the organization of functional networks in the orbitofrontal cortex (OFC). We show that blockade of dopamine D₂ receptors has profound effects on the functional connectivity patterns of the OFC, yielding altered connectivity-based subdivisions of this region. Our results suggest that dopamine changes the connectional configuration of the OFC, possibly leading to transitions between different operating modes that favor either sensory input or recurrent processing in the prefrontal cortex. More generally, our findings support a broader role for neuromodulators in the dynamic reconfiguration of functional brain networks and may have clinical implications for understanding the actions of antipsychotic agents.

Distinct roles for primate caudate dopamine D1 and D2 receptors in visual discrimination learning revealed using shRNA knockdown

The striatum plays important motor, associative and cognitive roles in brain functions. However, the rodent dorsolateral (the primate putamen) and dorsomedial (the primate caudate nucleus) striatum are not anatomically separated, making it difficult to distinguish their functions. By contrast, anatomical separation exists between the caudate nucleus and putamen in primates. Here, we successfully decreased dopamine D1 receptor (D1R) or D2R mRNA expression levels selectively in the marmoset caudate using shRNA knockdown techniques, as determined using positron emission tomography imaging with specific D1R and D2R ligands and postmortem in situ hybridization analysis. We then conducted a voxel-based correlation analysis between binding potential values of PET imaging and visual discrimination learning task performance in these genetically modified marmosets to find a critical role for the caudate D2R but no apparent role for the caudate D1R. This latter finding challenges the current understanding of the mechanisms underlying D1R activation in the caudate.

Genetic Disruption of Arc/Arg3.1 in Mice Causes Alterations in Dopamine and Neurobehavioral Phenotypes Related to Schizophrenia

Human genetic studies have recently suggested that the postsynaptic activity-regulated cytoskeleton-associated protein (Arc) complex is a convergence signal for several genes implicated in schizophrenia. However, the functional significance of Arc in schizophrenia-related neurobehavioral phenotypes and brain circuits is unclear. Here, we find that, consistent with schizophrenia-related phenotypes, disruption of Arc in mice produces deficits in sensorimotor gating, cognitive functions, social behaviors, and amphetamine-induced psychomotor responses. Furthermore, genetic disruption of Arc leads to concomitant hypoactive mesocortical and hyperactive mesostriatal dopamine pathways. Application of a D1 agonist to the prefrontal cortex or a D2 antagonist in the ventral striatum rescues Arc-dependent cognitive or psychomotor abnormalities, respectively. Our findings demonstrate a role for Arc in the regulation of dopaminergic neurotransmission and related behaviors. The results also provide initial biological support implicating Arc in dopaminergic and behavioral abnormalities related to schizophrenia.

Dopamine's Actions in Primate Prefrontal Cortex: Challenges for Treating Cognitive Disorders

The prefrontal cortex (PFC) elaborates and differentiates in primates, and there is a corresponding elaboration in cortical dopamine (DA). DA cells that fire to both aversive and rewarding stimuli likely project to the dorsolateral PFC (dlPFC), signaling a salient event. Since 1979, we have known that DA has an essential influence on dlPFC working memory functions. DA has differing effects via D1 (D1R) versus D2 receptor (D2R) families. D1R are concentrated on dendritic spines, and D1/5R stimulation produces an inverted U-shaped dose response on visuospatial working memory performance and Delay cell firing, the neurons that generate representations of visual space. Optimal levels of D1R stimulation gate out "noise," whereas higher levels, e.g., during stress, suppress Delay cell firing. These effects likely involve hyperpolarization-activated cyclic nucleotide-gated channel opening, activation of GABA interneurons, and reduced glutamate release. Dysregulation of D1R has been related to cognitive deficits in schizophrenia, and there is a need for new, lower-affinity D1R agonists that may better mimic endogenous DA to enhance mental representations and improve cognition. In contrast to D1R, D2R are primarily localized on layer V pyramidal cell dendrites, and D2/3R stimulation speeds and magnifies the firing of Response cells, including Response Feedback cells. Altered firing of Feedback neurons may relate to positive symptoms in schizophrenia. Emerging research suggests that DA may have similar effects in the ventrolateral PFC and frontal eye fields. Research on the orbital PFC in monkeys is just beginning and could be a key area for future discoveries.

Frontal D2/3 Receptor Availability in Schizophrenia Patients Before and After Their First Antipsychotic Treatment: Relation to Cognitive Functions and Psychopathology

BACKGROUND

We have previously reported associations between frontal D2/3 receptor binding potential positive symptoms and cognitive deficits in antipsychotic-naïve schizophrenia patients. Here, we examined the effect of dopamine D2/3 receptor blockade on cognition. Additionally, we explored the relation between frontal D2/3 receptor availability and treatment effect on positive symptoms.

METHODS

Twenty-five antipsychotic-naïve first-episode schizophrenia patients were examined with the Positive and Negative Syndrome Scale, tested with the cognitive test battery Cambridge Neuropsychological Test Automated Battery, scanned with single-photon emission computerized tomography using the dopamine D2/3 receptor ligand [(123)I]epidepride, and scanned with MRI. After 3 months of treatment with either risperidone (n=13) or zuclopenthixol (n=9), 22 patients were reexamined.

RESULTS

Blockade of extrastriatal dopamine D2/3 receptors was correlated with decreased attentional focus (r = -0.615, P=.003) and planning time (r = -0.436, P=.048). Moreover, baseline frontal dopamine D2/3 binding potential and positive symptom reduction correlated positively (D2/3 receptor binding potential left frontal cortex rho = 0.56, P=.003; D2/3 receptor binding potential right frontal cortex rho = 0.48, P=.016).

CONCLUSIONS

Our data support the hypothesis of a negative influence of D2/3 receptor blockade on specific cognitive functions in schizophrenia. This is highly clinically relevant given the well-established association between severity of cognitive disturbances and a poor functional outcome in schizophrenia. Additionally, the findings support associations between frontal D2/3 receptor binding potential at baseline and the effect of antipsychotic treatment on positive symptoms.

Mesocorticolimbic dopamine functioning in primary psychopathy: A source of within-group heterogeneity

Despite similar emotional deficiencies, primary psychopathic individuals can be situated on a continuum that spans from controlled to disinhibited. The constructs on which primary psychopaths are found to diverge, such as self-control, cognitive flexibility, and executive functioning, are crucially regulated by dopamine (DA). As such, the goal of this review is to examine which specific alterations in the meso-cortico-limbic DA system and corresponding genes (e.g., TH, DAT, COMT, DRD2, DRD4) might bias development towards a more controlled or disinhibited expression of primary psychopathy. Based on empirical data, it is argued that primary psychopathy is generally related to a higher tonic and population activity of striatal DA neurons and lower levels of D2-type DA receptors in meso-cortico-limbic projections, which may boost motivational drive towards incentive-laden goals, dampen punishment sensitivity, and increase future reward-expectancy. However, increasingly higher levels of DA activity in the striatum (moderate versus pathological elevations), lower levels of DA functionality in the prefrontal cortex, and higher D1-to-D2-type receptor ratios in meso-cortico-limbic projections may lead to increasingly disinhibited and impetuous phenotypes of primary psychopathy. Finally, in order to provide a more coherent view on etiological mechanisms, we discuss interactions between DA and serotonin that are relevant for primary psychopathy.

Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults

The striatum is known to play a key role in reinforcement learning, specifically in the encoding of teaching signals such as reward prediction errors (RPEs). It has been proposed that aberrant salience attribution is associated with impaired coding of RPE and heightened dopamine turnover in the striatum, and might be linked to the development of psychotic symptoms. However, the relationship of aberrant salience attribution, RPE coding, and dopamine synthesis capacity has not been directly investigated. Here we assessed the association between a behavioral measure of aberrant salience attribution, the salience attribution test, to neural correlates of RPEs measured via functional magnetic resonance imaging while healthy participants (n = 58) performed an instrumental learning task. A subset of participants (n = 27) also underwent positron emission tomography with the radiotracer [(18)F]fluoro-l-DOPA to quantify striatal presynaptic dopamine synthesis capacity. Individual variability in aberrant salience measures related negatively to ventral striatal and prefrontal RPE signals and in an exploratory analysis was found to be positively associated with ventral striatal presynaptic dopamine levels. These data provide the first evidence for a specific link between the constructs of aberrant salience attribution, reduced RPE processing, and potentially increased presynaptic dopamine function.

Striatal and extrastriatal dopamine release in the common marmoset brain measured by positron emission tomography and [(18)F]fallypride

Previous studies have demonstrated that patients with schizophrenia show greater sensitivity to psychostimulants than healthy subjects. Sensitization to psychostimulants and resultant alteration of dopaminergic neurotransmission in rodents has been suggested as a useful model of schizophrenia. This study sought to examine the use of methylphenidate as a psychostimulant to induce dopamine release and that of [(18)F]fallypride as a radioligand to quantify the release in a primate model of schizophrenia. Four common marmosets were scanned by positron emission tomography twice, before and after methylphenidate challenge, to evaluate dopamine release. Four other marmosets were sensitized by repeated methamphetamine (MAP) administration. Then, they were scanned twice, before and after methylphenidate challenge, to evaluate whether MAP-sensitization induced greater sensitivity to methylphenidate. We revealed a main effect of the methylphenidate challenge but not the MAP pretreatment on the striatal binding potential. These results suggest that methylphenidate-induced striatal dopamine release in the common marmoset could be evaluated by [(18)F]fallypride.

Dopamine D1/D2 Receptor Activity in the Nucleus Accumbens Core But Not in the Nucleus Accumbens Shell and Orbitofrontal Cortex Modulates Risk-Based Decision Making

BACKGROUND

It is well known that brain dopamine (DA) signals support risk-based decision making; however, the specific terminal regions of midbrain DA neurons through which DA signals mediate risk-based decision making are unknown.

METHODS

Using microinfusions of the D1/D2 receptor antagonist flupenthixol, we sought to explore the role of D1/D2 receptor activity in the rat orbitofrontal cortex (OFC) and core and shell regions of the nucleus accumbens (AcbC and AcbS, respectively) in the regulation of risky choices. A risk-discounting task was used that involves choices between a certain small-reward lever that always delivered 1 pellet or a risky large-reward lever which delivered 4 pellets but had a decreasing probability of receiving the reward across 4 subsequent within-session trial blocks (100%, 50%, 25%, 12.5%). To validate task sensitivity to experimental manipulations of DA activity, we also examined the effects of systemic amphetamine and flupenthixol.

RESULTS

Systemic amphetamine increased while systemic flupenthixol reduced risky choices. Results further demonstrate that rats that received intra-AcbC flupenthixol were able to track increasing risk associated with the risky lever but displayed a generally reduced preference for the risky lever across all trial blocks, including in the initial trial block (large reward at 100%). Microinfusions of flupenthixol into the AcbS or OFC did not alter risk-based decision making.

CONCLUSIONS

Our data suggest that intra-AcbC D1/D2 receptor signaling does not support the ability to track shifts in reward probabilities but does bias risk-based decision making. That is, it increased the rats' preference for the response option known to be associated with higher risk-related costs.

Reversal learning and dopamine: a bayesian perspective

Reversal learning has been studied as the process of learning to inhibit previously rewarded actions. Deficits in reversal learning have been seen after manipulations of dopamine and lesions of the orbitofrontal cortex. However, reversal learning is often studied in animals that have limited experience with reversals. As such, the animals are learning that reversals occur during data collection. We have examined a task regime in which monkeys have extensive experience with reversals and stable behavioral performance on a probabilistic two-arm bandit reversal learning task. We developed a Bayesian analysis approach to examine the effects of manipulations of dopamine on reversal performance in this regime. We find that the analysis can clarify the strategy of the animal. Specifically, at reversal, the monkeys switch quickly from choosing one stimulus to choosing the other, as opposed to gradually transitioning, which might be expected if they were using a naive reinforcement learning (RL) update of value. Furthermore, we found that administration of haloperidol affects the way the animals integrate prior knowledge into their choice behavior. Animals had a stronger prior on where reversals would occur on haloperidol than on levodopa (l-DOPA) or placebo. This strong prior was appropriate, because the animals had extensive experience with reversals occurring in the middle of the block. Overall, we find that Bayesian dissection of the behavior clarifies the strategy of the animals and reveals an effect of haloperidol on integration of prior information with evidence in favor of a choice reversal.

Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds

In this review, we provide a brief overview over the current knowledge about the role of dopamine transmission in the prefrontal cortex during learning and memory. We discuss work in humans, monkeys, rats, and birds in order to provide a basis for comparison across species that might help identify crucial features and constraints of the dopaminergic system in executive function. Computational models of dopamine function are introduced to provide a framework for such a comparison. We also provide a brief evolutionary perspective showing that the dopaminergic system is highly preserved across mammals. Even birds, following a largely independent evolution of higher cognitive abilities, have evolved a comparable dopaminergic system. Finally, we discuss the unique advantages and challenges of using different animal models for advancing our understanding of dopamine function in the healthy and diseased brain.