Impairments of probabilistic response reversal and passive avoidance following catecholamine depletion

Behavioral Response to Catecholamine Depletion in Individuals With Schizophrenia and Healthy Volunteers

Background and Hypothesis

Dysfunction of the dopamine system is the leading neurobiological hypothesis of schizophrenia. In this study, we tested this hypothesis in the context of aberrance salience theory of delusions using catecholamine depletion. We hypothesized that acute dopamine depletion improves both positive symptoms and salience attribution in individuals with schizophrenia.

Study Design

Catecholamine depletion was achieved by oral administration of alpha-methyl-para-tyrosine (AMPT) in 15 individuals with schizophrenia and 15 healthy volunteers. The study design consisted of a randomized, double-blind, placebo-controlled crossover, single-site experimental trial. The main outcome measures were the Scale for the Assessment of Positive Symptoms and the Salience Attribution Test.

Study Results

Catecholamine depletion transiently reduced specific psychotic symptoms in symptomatic individuals with schizophrenia, namely delusions and positive formal thought disorder (interaction treatment-by-timepoint, P = .013 and P = .010, respectively). We also found trends for catecholamine depletion to increase relevant bias and adaptive salience in participants with schizophrenia while decreasing them in healthy controls (interaction group-by-treatment, P = .060 and P = .089, respectively). Exploratory analyses revealed that in participants with schizophrenia, higher relevant bias at 3 hours after the end of AMPT treatment corresponded to lower delusional symptoms (Spearman's rho = -0.761, P = .001).

Conclusions

This study suggests that the relationship between dopamine hyperactivity and delusional symptoms in schizophrenia is mediated by impaired attribution of salience to reward-predicting stimuli.

Anhedonia as a central factor in depression: Neural mechanisms revealed from preclinical to clinical evidence

Anhedonia is one of the core symptoms of major depressive disorder (MDD), which is often inadequately treated by traditional antidepressants. The modern framework of anhedonia extends the definition from impaired consummatory pleasure or interest in rewards to a broad spectrum of deficits that impact functions such as reward anticipation, approach motivation, effort expenditure, reward valuation, expectation, and reward-cue association learning. Substantial preclinical and clinical research has explored the neural basis of reward deficits in the context of depression, and has implicated mesocorticolimbic reward circuitry comprising the nucleus accumbens, ventral pallidum, ventral tegmental area, amygdala, hippocampus, anterior cingulate, insula, orbitofrontal cortex, and other prefrontal cortex regions. Dopamine modulates several reward facets including anticipation, motivation, effort, and learning. As well, serotonin, norepinephrine, opioids, glutamate, Gamma aminobutyric acid (GABA), and acetylcholine are also involved in anhedonia, and medications targeting these systems may also potentially normalize reward processing in depression. Unfortunately, whereas reward anticipation and reward outcome are extensively explored by both preclinical and clinical studies, translational gaps remain in reward motivation, effort, valuation, and learning, where clinical neuroimaging studies are in the early stages. This review aims to synthesize the neurobiological mechanisms underlying anhedonia in MDD uncovered by preclinical and clinical research. The translational difficulties in studying the neural basis of reward are also discussed.

Presentation and Neurobiology of Anhedonia in Mood Disorders: Commonalities and Distinctions

PURPOSE OF REVIEW

To focus on the clinical and behavioral presentation of anhedonia in mood disorders, as well as the differences and commonalities in the underlying neurocircuitry.

RECENT FINDINGS

Evidence suggests that depression is characterized by hypofunction of the reward system, while bipolar disorder manifests dysregulation of the behavioral activation system that increases goal-directed reward behavior. Importantly, strong evidence does not exist to suggest significant differences in anhedonia severity between depressed unipolar and bipolar patients, suggesting that there are more nuanced fluctuations in reward processing deficits in bipolar patients depending on their state. Both euthymic unipolar and bipolar patients frequently report residual reward dysfunction, which highlights the potential of reward processing deficits that give rise to the clinical symptom of anhedonia to be trait factors of mood disorders; however, the possibility that therapies are not adequately treating anhedonia could also explain the presence of residual symptoms. Reward processing represents a potential diagnostic and treatment marker for mood disorders. Further research should systematically explore the facets of reward processing in at-risk, affected, and remitted patients.

Affective Biases in Humans and Animals

Depression is one of the most common but poorly understood psychiatric conditions. Although drug treatments and psychological therapies are effective in some patients, many do not achieve full remission and some patients receive no apparent benefit. Developing new improved treatments requires a better understanding of the aetiology of symptoms and evaluation of novel therapeutic targets in pre-clinical studies. Recent developments in our understanding of the basic cognitive processes that may contribute to the development of depression and its treatment offer new opportunities for both clinical and pre-clinical research. This chapter discusses the clinical evidence supporting a cognitive neuropsychological model of depression and antidepressant efficacy, and how this information may be usefully translated to pre-clinical investigation. Studies using neuropsychological tests in depressed patients and at risk populations have revealed basic negative emotional biases and disrupted reward and punishment processing, which may also impact on non-affective cognition. These affective biases are sensitive to antidepressant treatments with early onset effects observed, suggesting an important role in recovery. This clinical work into affective biases has also facilitated back-translation to animals and the development of assays to study affective biases in rodents. These animal studies suggest that, similar to humans, rodents in putative negative affective states exhibit negative affective biases on decision-making and memory tasks. Antidepressant treatments also induce positive biases in these rodent tasks, supporting the translational validity of this approach. Although still in the early stages of development and validation, affective biases in depression have the potential to offer new insights into the clinical condition, as well as facilitating the development of more translational approaches for pre-clinical studies.

Affective Biases in Humans and Animals

Depression is one of the most common but poorly understood psychiatric conditions. Although drug treatments and psychological therapies are effective in some patients, many do not achieve full remission and some patients receive no apparent benefit. Developing new improved treatments requires a better understanding of the aetiology of symptoms and evaluation of novel therapeutic targets in pre-clinical studies. Recent developments in our understanding of the basic cognitive processes that may contribute to the development of depression and its treatment offer new opportunities for both clinical and pre-clinical research. This chapter discusses the clinical evidence supporting a cognitive neuropsychological model of depression and antidepressant efficacy, and how this information may be usefully translated to pre-clinical investigation. Studies using neuropsychological tests in depressed patients and at risk populations have revealed basic negative emotional biases and disrupted reward and punishment processing, which may also impact on non-affective cognition. These affective biases are sensitive to antidepressant treatments with early onset effects observed, suggesting an important role in recovery. This clinical work into affective biases has also facilitated back-translation to animals and the development of assays to study affective biases in rodents. These animal studies suggest that, similar to humans, rodents in putative negative affective states exhibit negative affective biases on decision-making and memory tasks. Antidepressant treatments also induce positive biases in these rodent tasks, supporting the translational validity of this approach. Although still in the early stages of development and validation, affective biases in depression have the potential to offer new insights into the clinical condition, as well as facilitating the development of more translational approaches for pre-clinical studies.

Assessing anhedonia in depression: Potentials and pitfalls

The resurgence of interest in anhedonia within major depression has been fuelled by clinical trials demonstrating its utility in predicting antidepressant response as well as recent conceptualizations focused on the role and manifestation of anhedonia in depression. Historically, anhedonia has been understood as a "loss of pleasure", yet neuropsychological and neurobiological studies reveal a multifaceted reconceptualization that emphasizes different facets of hedonic function, including desire, effort/motivation, anticipation and consummatory pleasure. To ensure generalizability across studies, evaluation of the available subjective and objective methods to assess anhedonia is necessary. The majority of research regarding anhedonia and its neurobiological underpinnings comes from preclinical research, which uses primary reward (e.g. food) to probe hedonic responding. In contrast, behavioural studies in humans primarily use secondary reward (e.g. money) to measure many aspects of reward responding, including delay discounting, response bias, prediction error, probabilistic reversal learning, effort, anticipation and consummatory pleasure. The development of subjective scales to measure anhedonia has also increased in the last decade. This review will assess the current methodology to measure anhedonia, with a focus on scales and behavioural tasks in humans. Limitations of current work and recommendations for future studies are discussed.

Investigating the underlying mechanisms of aberrant behaviors in bipolar disorder from patients to models: Rodent and human studies

Psychiatric patients with bipolar disorder suffer from states of depression and mania, during which a variety of symptoms are present. Current treatments are limited and neurocognitive deficits in particular often remain untreated. Targeted therapies based on the biological mechanisms of bipolar disorder could fill this gap and benefit patients and their families. Developing targeted therapies would benefit from appropriate animal models which are challenging to establish, but remain a vital tool. In this review, we summarize approaches to create a valid model relevant to bipolar disorder. We focus on studies that use translational tests of multivariate exploratory behavior, sensorimotor gating, decision-making under risk, and attentional functioning to discover profiles that are consistent between patients and rodent models. Using this battery of translational tests, similar behavior profiles in bipolar mania patients and mice with reduced dopamine transporter activity have been identified. Future investigations should combine other animal models that are biologically relevant to the neuropsychiatric disorder with translational behavioral assessment as outlined here. This methodology can be utilized to develop novel targeted therapies that relieve symptoms for more patients without common side effects caused by current treatments.

Age moderates the effect of acute dopamine depletion on passive avoidance learning

Despite extensive links between reinforcement-based learning and dopamine (DA), studies to date have not found consistent effects of acute DA reduction on reinforcement learning in both men and women. Here, we tested the effects of reducing DA on reward- and punishment-based learning using the deterministic passive avoidance learning (PAL) task. We tested 16 (5 female) adults (ages 22-40) in a randomized, cross-over design to determine whether reducing global DA by administering an amino acid beverage deficient in the DA precursors, phenylalanine and tyrosine (P/T[-]), would affect PAL task performance. We found that P/T[-] beverage effects on PAL performance were modulated by age. Specifically, we found that P/T depletion significantly improved learning from punishment with increasing participant age. Participants committed 1.49 fewer passive avoidance errors per additional year of age (95% CI, -0.71 - -2.27, r=-0.74, p=0.001). Moreover, P/T depletion improved learning from punishment in adults (ages 26-40) while it impaired learning from punishment in emerging adults (ages 22-25). We observed similar, but non-significant trends in learning from reward. While there was no overall effect of P/T-depletion on reaction time (RT), there was a relationship between the effect of P/T depletion on PAL performance and RT; those who responded more slowly on the P/T[-] beverage also made more errors on the P/T[-] beverage. When P/T-depletion slowed RT after a correct response, there was a worsening of PAL task performance; there was no similar relationship for the RT after an incorrect response and PAL task performance. Moreover, among emerging adults, changes in mood on the P/T[-] beverage negatively correlated with learning from reward on the P/T[-] beverage. Together, we found that both reward- and punishment-based learning are sensitive to central catecholamine levels, and that these effects of acute DA reduction vary with age.

Dopamine depletion attenuates some behavioral abnormalities in a hyperdopaminergic mouse model of bipolar disorder

BACKGROUND

Patients with BD suffer from multifaceted symptoms, including hyperactive and psychomotor agitated behaviors. Previously, we quantified hyperactivity, increased exploration, and straighter movements of patients with BD mania in the human Behavioral Pattern Monitor (BPM). A similar BPM profile is observed in mice that are hyperdopaminergic due to reduced dopamine transporter (DAT) functioning. We hypothesized that dopamine depletion through alpha-methyl-p-tyrosine (AMPT) administration would attenuate this mania-like profile.

METHODS

Male and female DAT wild-type (WT; n=26) and knockdown (KD; n=28) mice on a C57BL/6 background were repeatedly tested in the BPM to assess profile robustness and stability. The optimal AMPT dose was identified by treating male C57BL/6 mice (n=39) with vehicle or AMPT (10, 30, or 100mg/kg) at 24, 20, and 4h prior to testing in the BPM. Then, male and female DAT WT (n=40) and KD (n=37) mice were tested in the BPM after vehicle or AMPT (30mg/kg) treatment.

RESULTS

Compared to WT littermates, KD mice exhibited increased activity, exploration, straighter movement, and disorganized behavior. AMPT-treatment reduced hyperactivity and increased path organization, but potentiated specific exploration in KD mice without affecting WT mice.

LIMITATIONS

AMPT is not specific to dopamine and also depletes norepinephrine.

CONCLUSIONS

KD mice exhibit abnormal exploration in the BPM similar to patients with BD mania. AMPT-induced dopamine depletion attenuated some, but potentiated other, aspects of this mania-like profile in mice. Future studies should extend these findings into other aspects of mania to determine the suitability of AMPT as a treatment for BD mania.

To treat a psychopath

Some people are now quite optimistic about the possibility of treating psychopathy with drugs that directly modulate brain function. I argue that this optimism is misplaced. Psychopathy is a global disorder in an individual's worldview, including his social and moral outlook. Because of the unity of this Weltanschauung, it is unlikely to be treatable in a piecemeal fashion. Recent neuroscientific methods do not give us much hope that we can replace, in a wholesale manner, problematic views of the world with more socially desirable ones. There are, therefore, principled reasons that psychopathy is so singularly treatment resistant.

Dopaminergic control of cognitive flexibility in humans and animals

Striatal dopamine (DA) is thought to code for learned associations between cues and reinforcers and to mediate approach behavior toward a reward. Less is known about the contribution of DA to cognitive flexibility—the ability to adapt behavior in response to changes in the environment. Altered reward processing and impairments in cognitive flexibility are observed in psychiatric disorders such as obsessive compulsive disorder (OCD). Patients with this disorder show a disruption of functioning in the frontostriatal circuit and alterations in DA signaling. In this review we summarize findings from animal and human studies that have investigated the involvement of striatal DA in cognitive flexibility. These findings may provide a better understanding of the role of dopaminergic dysfunction in cognitive inflexibility in psychiatric disorders, such as OCD.

The neurobiology of psychopathic traits in youths

Conduct disorder is a childhood behaviour disorder that is characterized by persistent aggressive or antisocial behaviour that disrupts the child's environment and impairs his or her functioning. A proportion of children with conduct disorder have psychopathic traits. Psychopathic traits consist of a callous-unemotional component and an impulsive-antisocial component, which are associated with two core impairments. The first is a reduced empathic response to the distress of other individuals, which primarily reflects reduced amygdala responsiveness to distress cues; the second is deficits in decision making and in reinforcement learning, which reflects dysfunction in the ventromedial prefrontal cortex and striatum. Genetic and prenatal factors contribute to the abnormal development of these neural systems, and social-environmental variables that affect motivation influence the probability that antisocial behaviour will be subsequently displayed.

Frontoparietal attentional network activation differs between smokers and nonsmokers during affective cognition

Smoking withdrawal-induced disruption of affect and cognition is associated with dysregulated prefrontal brain function, although little is known regarding the neural foci of smoker-nonsmoker differences during affective cognition. Thus, the current study used functional magnetic resonance imaging (fMRI) to identify smoker-nonsmoker differences in affective cognition. Thirty-four healthy volunteers (17 smokers, 17 nonsmokers) underwent fMRI during an affective Stroop task (aST). The aST includes emotional cue-reactivity trials, and response selection trials that contain either neutral or negative emotional distractors. Smokers had less activation during negative cue-reactivity trials in regions subserving emotional awareness (i.e., posterior cingulate), inhibitory control (i.e., inferior frontal gyrus) and conflict resolution (i.e., anterior cingulate); during response-selection trials with negative emotional distractors, smokers had greater activation in a frontoparietal attentional network (i.e., middle frontal and supramarginal gyri). Exploratory analyses revealed that task accuracy was positively correlated with anterior cingulate cortex and inferior frontal gyrus response on fMRI. These findings suggests that chronic nicotine use may reduce inhibitory control and conflict resolution of emotional distraction, and result in recruiting additional attentional resources during emotional interference on cognition.

Neurocognitive correlates of the effects of yoga meditation practice on emotion and cognition: a pilot study

Mindfulness meditation involves attending to emotions without cognitive fixation of emotional experience. Over time, this practice is held to promote alterations in trait affectivity and attentional control with resultant effects on well-being and cognition. However, relatively little is known regarding the neural substrates of meditation effects on emotion and cognition. The present study investigated the neurocognitive correlates of emotion interference on cognition in Yoga practitioners and a matched control group (CG) underwent fMRI while performing an event-related affective Stroop task. The task includes image viewing trials and Stroop trials bracketed by neutral or negative emotional distractors. During image viewing trials, Yoga practitioners exhibited less reactivity in right dorsolateral prefrontal cortex (dlPFC) to negative as compared to neutral images; whereas the CG had the opposite pattern. A main effect of valence (negative > neutral) was observed in limbic regions (e.g., amygdala), of which the magnitude was inversely related to dlPFC activation. Exploratory analyses revealed that the magnitude of amygdala activation predicted decreased self-reported positive affect in the CG, but not among Yoga practitioners. During Stroop trials, Yoga practitioners had greater activation in ventrolateral prefrontal cortex (vlPFC) during Stroop trials when negative, compared to neutral, emotional distractor were presented; the CG exhibited the opposite pattern. Taken together, these data suggest that though Yoga practitioners exhibit limbic reactivity to negative emotional stimuli, such reactivity does not have downstream effects on later mood state. This uncoupling of viewing negative emotional images and affect among Yoga practitioners may be occasioned by their selective implementation of frontal executive-dependent strategies to reduce emotional interference during competing cognitive demands and not during emotional processing per se.

Nicotine withdrawal modulates frontal brain function during an affective Stroop task

BACKGROUND

Among nicotine-dependent smokers, smoking abstinence disrupts multiple cognitive and affective processes including conflict resolution and emotional information processing (EIP). However, the neurobiological basis of abstinence effects on resolving emotional interference on cognition remains largely uncharacterized. In this study, functional magnetic resonance imaging (fMRI) was used to investigate smoking abstinence effects on emotion-cognition interactions.

METHODS

Smokers (n = 17) underwent fMRI while performing an affective Stroop task (aST) over two sessions: once following 24-h abstinence and once following smoking as usual. The aST includes trials that serially present incongruent or congruent numerical grids bracketed by neutral or negative emotional distractors and view-only emotional image trials. Statistical analyses were conducted using a statistical threshold of p < 0.05 cluster corrected.

RESULTS

Smoking abstinence increased Stroop blood-oxygenation-level-dependent response in the right middle frontal and rostral anterior cingulate gyri. Moreover, withdrawal-induced negative affect was associated with less activation in frontoparietal regions during negative emotional information processing; whereas, during Stroop trials, negative affect predicted greater activation in frontal regions during negative, but not neutral emotional distractor trials.

CONCLUSION

Hyperactivation in the frontal executive control network during smoking abstinence may represent a need to recruit additional executive resources to meet task demands. Moreover, abstinence-induced negative affect may disrupt cognitive control neural circuitry during EIP and place additional demands on frontal executive neural resources during cognitive demands when presented with emotionally distracting stimuli.

Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder

OBJECTIVE

Affective biases may underlie many of the key symptoms of major depressive disorder, from anhedonia to altered cognitive performance. Understanding the cause of these biases is therefore critical in the quest for improved treatments. Depression is associated, for example, with a negative affective bias in reversal learning. However, despite the fact that reversal learning is associated with striatal response in healthy individuals and depressed individuals exhibit attenuated striatal function on multiple tasks, studies to date have not demonstrated striatal involvement in the negative bias in reversal learning in depression. In this study, the authors sought to determine whether this may be because reversal learning tasks conventionally used to study behavior examine reversals only on the basis of unexpected punishment and therefore do not adequately separate reward- and punishment-based behavior.

METHOD

The authors used functional MRI to compare the hemodynamic response to a reversal learning task with mixed reward- and punishment-based reversal stages between individuals with unmedicated major depressive disorder (N=13) and healthy comparison subjects (N=14).

RESULTS

Impaired reward (but not punishment) reversal accuracy was found alongside attenuated anteroventral striatal response to unexpected reward in depression.

CONCLUSIONS

Attenuated neurophysiological response of the anteroventral striatum may reflect dysfunction in circuits involving afferent projections from the orbitofrontal, limbic, and/or mesostriatal dopaminergic pathways, which conceivably may, together with the ventral striatum, underlie anhedonia in depression. Learning to appreciate and enjoy positive life experiences is critical for recovery from depression. This study pinpoints a neural target for such recovery.

Measuring extrastriatal dopamine release during a reward learning task

OBJECTIVES

Reward learning is critical for survival. Animal research emphasizes the role of dopaminergic (DA) mesocorticolimbic pathways in reward learning, but few studies have evaluated extrastriatal DA functioning in humans. The purpose of this study was to examine presynaptic DA release in extrastriatal regions of the reward circuit by measuring displacement of the high affinity D(2) /D(3) radioligand [(18) F]Fallypride during a reward task.

DESIGN

Ten healthy volunteers underwent a [(18) F]Fallypride positron emission tomography protocol while performing a reward task, allowing us to assess participants' ability to modulate behavior as a function of reward. DA receptor ligand displacement was correlated with task performance and self-reported anhedonia.

OBSERVATIONS

Parametric t-maps revealed significant decrease in [(18) F]Fallypride binding in the medial orbitofrontal cortex (mOFC), ventromedial prefrontal cortex (vmPFC), and dorsal anterior cingulate cortex (dACC), indicating endogenous DA release in these regions. Increasing anhedonic symptoms correlated with DA release in the left vmPFC, left dACC, and right dACC emerged (all r's > 0.65, P's < 0.05). Similarly, reduced reward learning correlated with higher DA release in left vmPFC, right vmPFC, and left dACC (all r's < -0.64, P's < 0.05). Left dACC (r = 0.66, P = 0.04) and left vmPFC (r = 0.74, P = 0.01) DA release showed a significant positive correlation with impaired tendency to modulate behavior as a function of prior positive reinforcements.

CONCLUSIONS

These findings support the hypothesis that DA release in mOFC, vmPFC, and dACC regions plays an important role in reinforcement learning in the human brain.

Neuromodulation of reward-based learning and decision making in human aging

In this paper, we review the current literature to highlight relations between age-associated declines in dopaminergic and serotonergic neuromodulation and adult age differences in adaptive goal-directed behavior. Specifically, we focus on evidence suggesting that deficits in neuromodulation contribute to older adults' behavioral disadvantages in learning and decision making. These deficits are particularly pronounced when reward information is uncertain or the task context requires flexible adaptations to changing stimulus-reward contingencies. Moreover, emerging evidence points to age-related differences in the sensitivity to rewarding and aversive outcomes during learning and decision making if the acquisition of behavior critically depends on outcome processing. These age-related asymmetries in outcome valuation may be explained by age differences in the interplay of dopaminergic and serotonergic neuromodulation. This hypothesis is based on recent neurocomputational and psychopharmacological approaches, which suggest that dopamine and serotonin serve opponent roles in regulating the balance between approach behavior and inhibitory control. Studying adaptive regulation of behavior across the adult life span may shed new light on how the aging brain changes functionally in response to its diminishing resources.

Can the neuroeconomics revolution revolutionize psychiatry?

Neuroeconomics is a rapidly growing new research discipline aimed at describing the neural substrate of decision-making using incentivized decisions introduced in experimental economics. The novel combination of economic decision theory and neuroscience has the potential to better examine the interactions of social, psychological and neural factors with regard to motivational forces that may underlie psychiatric problems. Game theory will provide psychiatry with computationally principled measures of cognitive dysfunction. Given the relatively high heritability of these measures, they may contribute to improving phenotypic definitions of psychiatric conditions. The game-theoretical concepts of optimal behavior will allow description of psychopathology as deviation from optimal functioning. Neuroeconomists have successfully used normative or near-normative models to interpret the function of neurotransmitters; these models have the potential to significantly improve neurotransmitter theories of psychiatric disorders. This paper will review recent evidence from neuroeconomics and psychiatry in support of applying economic concepts such as risk/uncertainty preference, time preference and social preference to psychiatric research to improve diagnostic classification, prevention and therapy.