Measuring extrastriatal dopamine release during a reward learning task

Increased cortical structural covariance correlates with anhedonia in schizophrenia

Anhedonia is a common symptom in schizophrenia and is closely related to poor functional outcomes. Several lines of evidence reveal that the orbitofrontal cortex plays an important role in anhedonia. In the present study, we aimed to investigate abnormalities in structural covariance within the orbitofrontal subregions, and to further study their role in anticipatory and consummatory anhedonia in schizophrenia. T1 images of 35 schizophrenia patients and 45 healthy controls were obtained. The cortical thickness of 68 cerebral regions parcellated by the Desikan-Killiany (DK) atlas was calculated. The structural covariance within the orbitofrontal subregions was calculated in both schizophrenia and healthy control groups. Stepwise linear regression was performed to examine the relationship between structural covariance and anhedonia in schizophrenia patients. Patients with schizophrenia exhibited higher structural covariance between the left and right medial orbitofrontal thickness, the left lateral orbitofrontal thickness and left pars orbitalis thickness compared to healthy controls (p < 0.05, FDR corrected). This results imply that the increased structural covariance in orbitofrontal thickness may be involved in the process of developing anhedonia in schizophrenia. The result indicated that the increased structural covariance between the left and right medial orbitofrontal thickness might be a protective factor for anticipatory pleasure (B' = 0.420, p = 0.012).

Emotion Processing Dysfunction in Alzheimer's Disease: An Overview of Behavioral Findings, Systems Neural Correlates, and Underlying Neural Biology

We described behavioral studies to highlight emotional processing deficits in Alzheimer's disease (AD). The findings suggest prominent deficit in recognizing negative emotions, pronounced effect of positive emotion on enhancing memory, and a critical role of cognitive deficits in manifesting emotional processing dysfunction in AD. We reviewed imaging studies to highlight morphometric and functional markers of hippocampal circuit dysfunction in emotional processing deficits. Despite amygdala reactivity to emotional stimuli, hippocampal dysfunction conduces to deficits in emotional memory. Finally, the reviewed studies implicating major neurotransmitter systems in anxiety and depression in AD supported altered cholinergic and noradrenergic signaling in AD emotional disorders. Overall, the studies showed altered emotions early in the course of illness and suggest the need of multimodal imaging for further investigations. Particularly, longitudinal studies with multiple behavioral paradigms translatable between preclinical and clinical models would provide data to elucidate the time course and underlying neurobiology of emotion processing dysfunction in AD.

Reward Responsiveness in Patients with Opioid Use Disorder on Opioid Agonist Treatment: Role of Comorbid Chronic Pain

OBJECTIVE

Evidence suggests that blunted reward responsiveness may account for poor clinical outcomes in both opioid use disorder (OUD) and chronic pain. Understanding how individuals with OUD and comorbid chronic pain (OUD+CP) respond to rewards is, therefore, of clinical interest because it may reveal a potential point of behavioral intervention.

METHODS

Patients with OUD (n = 28) and OUD+CP (n = 19) on opioid agonist treatment were compared on: 1) the Probabilistic Reward Task (an objective behavioral measure of reward response bias) and 2) ecological momentary assessment of affective responses to pleasurable events.

RESULTS

Both the OUD and the OUD+CP groups evidenced an increase in reward response bias in the Probabilistic Reward Task. The rate of change in response bias across blocks was statistically significant in the OUD group (B = 0.06, standard error [SE] = 0.02, t = 3.92, P < 0.001, 95% confidence interval [CI]: 0.03 to 0.09) but not in the OUD+CP group (B = 0.03, SE = 0.02, t = 1.90, P = 0.07, 95% CI: -0.002 to 0.07). However, groups did not significantly differ in the rate of change in response bias across blocks (B = 0.03, SE = 0.02, t = 1.21, P = 0.23, 95% CI: -0.02 to 0.07). Groups did not significantly differ on state measures of reward responsiveness (P's ≥0.50).

CONCLUSIONS

Overall, findings across objective and subjective measures were mixed, necessitating follow-up with a larger sample. The results suggest that although there is a reward response bias in patients with OUD+CP treated with opioid agonist treatment relative to patients with OUD without CP, it is modest and does not appear to translate into patients' responses to rewarding events as they unfold in daily life.

PET Imaging of Dopamine Neurotransmission During EEG Neurofeedback

Neurofeedback (NFB) is a brain-based training method that enables users to control their own cortical oscillations using real-time feedback from the electroencephalogram (EEG). Importantly, no investigations to date have directly explored the potential impact of NFB on the brain's key neuromodulatory systems. Our study's objective was to assess the capacity of NFB to induce dopamine release as revealed by positron emission tomography (PET). Thirty-two healthy volunteers were randomized to either EEG-neurofeedback (NFB) or EEG-electromyography (EMG), and scanned while performing self-regulation during a single session of dynamic PET brain imaging using the high affinity D2/3 receptor radiotracer, [18F]Fallypride. NFB and EMG groups down-regulated cortical alpha power and facial muscle tone, respectively. Task-induced effects on endogenous dopamine release were estimated in the frontal cortex, anterior cingulate cortex, and thalamus, using the linearized simplified reference region model (LSRRM), which accounts for time-dependent changes in radiotracer binding following task initiation. Contrary to our hypothesis of a differential effect for NFB vs. EMG training, significant dopamine release was observed in both training groups in the frontal and anterior cingulate cortex, but not in thalamus. Interestingly, a significant negative correlation was observed between dopamine release in frontal cortex and pre-to-post NFB change in spontaneous alpha power, suggesting that intra-individual changes in brain state (i.e., alpha power) could partly result from changes in neuromodulatory tone. Overall, our findings constitute the first direct investigation of neurofeedback's effect on the endogenous release of a key neuromodulator, demonstrating its feasibility and paving the way for future studies using this methodology.

Selective kappa-opioid antagonism ameliorates anhedonic behavior: evidence from the Fast-fail Trial in Mood and Anxiety Spectrum Disorders (FAST-MAS)

Anhedonia remains a major clinical issue for which there is few effective interventions. Untreated or poorly controlled anhedonia has been linked to worse disease course and increased suicidal behavior across disorders. Taking a proof-of-mechanism approach under the auspices of the National Institute of Mental Health FAST-FAIL initiative, we were the first to show that, in a transdiagnostic sample screened for elevated self-reported anhedonia, 8 weeks of treatment with a kappa-opioid receptor (KOR) antagonist resulted in significantly higher reward-related activation in one of the core hubs of the brain reward system (the ventral striatum), better reward learning in the Probabilistic Reward Task (PRT), and lower anhedonic symptoms, relative to 8 weeks of placebo. Here, we performed secondary analyses of the PRT data to investigate the putative effects of KOR antagonism on anhedonic behavior with more precision by using trial-level model-based Bayesian computational modeling and probability analyses. We found that, relative to placebo, KOR antagonism resulted in significantly higher learning rate (i.e., ability to learn from reward feedback) and a more sustained preference toward the more frequently rewarded stimulus, but unaltered reward sensitivity (i.e., the hedonic response to reward feedback). Collectively, these findings provide novel evidence that in a transdiagnostic sample characterized by elevated anhedonia, KOR antagonism improved the ability to modulate behavior as a function of prior rewards. Together with confirmation of target engagement in the primary report (Krystal et al., Nat Med, 2020), the current findings suggest that further transdiagnostic investigation of KOR antagonism for anhedonia is warranted.

Experimental sleep disruption and reward learning: moderating role of positive affect responses

STUDY OBJECTIVES

Sleep disturbances increase vulnerability for depression, but the mechanisms underlying this relationship are not well known. We investigated the effects of experimental sleep disruption on response bias (RB), a measure of reward learning previously linked to depression, and the moderating role of positive affect responses.

METHODS

Participants (N = 42) were healthy adults enrolled in a within-subject crossover sleep disruption experiment that incorporated one night of uninterrupted sleep (US) and one night of forced awakenings (FA) in random order. On the day following each experimental sleep night, participants completed a probabilistic reward task to assess RB, and the Positive and Negative Affect Schedule-X. Participants were subgrouped according to positive affect responses: Preserved Positive Affect (i.e. positive affect scores maintained or increased; n = 15) or Reduced Positive Affect (i.e. positive affect scores decreased; n = 27) following FA.

RESULTS

Contrary to our hypotheses, across participants, RB did not significantly differ between the US and FA sleep conditions (p = .67). However, the effect of sleep condition on RB was moderated by positive affect response (p = .01); those with preserved positive affect showed heightened RB following FA, whereas those with reduced positive affect showed diminished RB following FA. Changes in negative affect between US and FA did not moderate RB.

CONCLUSION

The inability to preserve positive affect through periods of sleep disruption may be a marker of diminished reward learning capability. Understanding how sleep disruption impacts positive affect responses and reward learning identifies a pathway by which sleep disturbances may confer risk for depression.

Effects of stress-induced inflammation on reward processing in healthy young women

BACKGROUND

Anhedonia, or loss of interest or pleasure, is a feature of depression and transdiagnostic construct in psychopathology. Theory and compelling evidence from preclinical models implicates stress-induced inflammation as a psychobiological pathway to anhedonic behavior; however, this pathway has not been tested in human models. Further, although anhedonia may reflect dysregulation in multiple dimensions of reward, the extent to which stress-induced inflammation alters these dimensions is unclear. Thus, the current experimental study used a standardized laboratory stressor task to elicit an inflammatory response and evaluate effects of stress-induced inflammation on multiple behavioral indices of reward processing.

METHODS

Healthy young women (age 18-25) completed behavioral reward tasks assessing reward learning, motivation, and sensitivity and were randomized to undergo an acute psychosocial stressor (n = 37) or a no-stress active control (n = 17). Tasks were re-administered 90-120 min post-stress to coincide with the peak of the stress-induced inflammatory response. Blood samples were collected for assessment of the pro-inflammatory cytokine interleukin-6 (IL-6) at baseline and 90 and 120 min post stressor.

RESULTS

Stress-induced IL-6 was associated with increased response bias during reward learning and increased motivation when probability of receiving a reward was low. Sensitivity to reward in the context of a motivation task was not altered in association with stress-induced IL-6.

CONCLUSIONS

Contrary to hypotheses, mild increases in IL-6 following acute stress were associated with increased reward responsiveness during reward learning and selective increases in motivation. Results contribute to an emerging and nuanced literature linking inflammation to reward processing, and demonstrate that behavioral effects of stress-induced inflammation may be detected in the laboratory setting.

CLINICAL TRIAL REGISTRATION

NCT03828604.

Frontostriatal and Dopamine Markers of Individual Differences in Reinforcement Learning: A Multi-modal Investigation

Prior studies have shown that dopamine (DA) functioning in frontostriatal circuits supports reinforcement learning (RL), as phasic DA activity in ventral striatum signals unexpected reward and may drive coordinated activity of striatal and orbitofrontal regions that support updating of action plans. However, the nature of DA functioning in RL is complex, in particular regarding the role of DA clearance in RL behavior. Here, in a multi-modal neuroimaging study with healthy adults, we took an individual differences approach to the examination of RL behavior and DA clearance mechanisms in frontostriatal learning networks. We predicted that better RL would be associated with decreased striatal DA transporter (DAT) availability and increased intrinsic functional connectivity among DA-rich frontostriatal regions. In support of these predictions, individual differences in RL behavior were related to DAT binding potential in ventral striatum and resting-state functional connectivity between ventral striatum and orbitofrontal cortex. Critically, DAT binding potential had an indirect effect on reinforcement learning behavior through frontostriatal connectivity, suggesting potential causal relationships across levels of neurocognitive functioning. These data suggest that individual differences in DA clearance and frontostriatal coordination may serve as markers for RL, and suggest directions for research on psychopathologies characterized by altered RL.

Potent Dopamine D2 Antagonists Block the Reward-Enhancing Effects of Nicotine in Smokers With Schizophrenia

Antipsychotics that are potent dopamine (DA) D2 receptor antagonists have been linked to elevated levels of nicotine dependence in smokers with schizophrenia. Because activation of D2 receptors mediates motivation for nicotine, we examined whether potent D2 antagonists would diminish nicotine's ability to stimulate reward processing-a mechanism that may drive compensatory increases in smoking. Smokers with schizophrenia (n = 184) were recruited and stratified into medication groups based on D2 receptor antagonist potency. The effects of smoking on reward function were assessed using a probabilistic reward task (PRT), administered pre- and post-smoking. The PRT used an asymmetrical reinforcement schedule to produce a behavioral response bias, previously found to increase under conditions (including smoking) that enhance mesolimbic DA signaling. Among the 98 participants with valid PRT data and pharmacotherapy that could be stratified into D2 receptor antagonism potency, a medication × smoking × block interaction emerged (P = .005). Post-hoc tests revealed a smoking × block interaction only for those not taking potent D2 antagonists (P = .007). This group exhibited smoking-related increases in response bias (P < .001) that were absent in those taking potent D2 antagonists (P > .05). Our findings suggest that potent D2 antagonists diminish the reward-enhancing effects of nicotine in smokers with schizophrenia. This may be a mechanism implicated in the increased rate of smoking often observed in patients prescribed these medications. These findings have important clinical implications for the treatment of nicotine dependence in schizophrenia.

Depression genetic risk score is associated with anhedonia-related markers across units of analysis

Investigations of pathophysiological mechanisms implicated in vulnerability to depression have been negatively impacted by the significant heterogeneity characteristic of psychiatric syndromes. Such challenges are also reflected in numerous null findings emerging from genome-wide association studies (GWAS) of depression. Bolstered by increasing sample sizes, recent GWAS studies have identified genetics variants linked to MDD. Among them, Okbay and colleagues (Nat. Genet. 2016 Jun;48(6):624-33) identified genetic variants associated with three well-validated depression-related phenotypes: subjective well-being, depressive symptoms, and neuroticism. Despite this progress, little is known about psychopathological and neurobiological mechanisms underlying such risk. To fill this gap, a genetic risk score (GRS) was computed from the Okbay's study for a sample of 88 psychiatrically healthy females. Across two sessions, participants underwent two well-validated psychosocial stressors, and performed two separate tasks probing reward learning both before and after stress. Analyses tested whether GRS scores predicted anhedonia-related phenotypes across three units of analyses: self-report (Snaith Hamilton Pleasure Scale), behavior (stress-induced changes in reward learning), and circuits (stress-induced changes in striatal reward prediction error; striatal volume). GRS scores were negatively associated with anhedonia-related phenotypes across all units of analyses but only circuit-level variables were significant. In addition, the amount of explained variance was systematically larger as variables were putatively closer to the effects of genes (self-report < behavior < neural circuitry). Collectively, findings implicate anhedonia-related phenotypes and neurobiological mechanisms in increased depression vulnerability, and highlight the value of focusing on fundamental dimensions of functioning across different units of analyses.

Dopamine Release in Antidepressant-Naive Major Depressive Disorder: A Multimodal [11C]-(+)-PHNO Positron Emission Tomography and Functional Magnetic Resonance Imaging Study

BACKGROUND

Mesolimbic dopamine system dysfunction is believed to contribute to major depressive disorder (MDD), but molecular neuroimaging of striatal dopamine neurotransmission has yielded mixed results, possibly owing to limited sensitivity of antagonist radioligands used with positron emission tomography to assess dopamine release capacity. This study used an agonist radioligand with agonist challenge to assess dopamine release capacity and D₂/D₃ receptor availability in MDD.

METHODS

Twenty-six treatment-naive adults with MDD and 26 healthy comparison participants underwent functional magnetic resonance imaging during a probabilistic reinforcement task, and positron emission tomography with the D₃-preferring ligand [¹¹C]-(+)-PHNO, before and after oral dextroamphetamine. MDD participants then received pramipexole treatment for 6 weeks.

RESULTS

MDD participants had trend-level greater dopamine release capacity in the ventral striatum, as measured by percent change in baseline binding potential relative to nondisplaceable compartment (ΔBP_ND) (-34% vs. -30%; p = .072, d = 0.58) but no difference in D₂/D₃ receptor availability (BP_ND). Striatal and extrastriatal BP_ND and percent change in baseline BP_ND were not significantly associated with blood oxygen level-dependent response to reward prediction error in the ventral striatum, severity of depression and anhedonia, or antidepressant response to pramipexole (response rate = 72.7%).

CONCLUSIONS

[¹¹C]-(+)-PHNO demonstrated high sensitivity to displacement by amphetamine-induced dopamine release, but dopamine release capacity and D₂/D₃ availability were not associated with ventral striatal activation to reward prediction error or clinical features, in this study powered to detect large effects. While a preponderance of indirect evidence implicates dopaminergic dysfunction in MDD, these findings suggest that presynaptic dopamine dysregulation may not be a feature of MDD or a prerequisite for treatment response to dopamine agonists.

Brain Activity and Functional Connectivity Associated with Hypnosis

Hypnosis has proven clinical utility, yet changes in brain activity underlying the hypnotic state have not yet been fully identified. Previous research suggests that hypnosis is associated with decreased default mode network (DMN) activity and that high hypnotizability is associated with greater functional connectivity between the executive control network (ECN) and the salience network (SN). We used functional magnetic resonance imaging to investigate activity and functional connectivity among these three networks in hypnosis. We selected 57 of 545 healthy subjects with very high or low hypnotizability using two hypnotizability scales. All subjects underwent four conditions in the scanner: rest, memory retrieval, and two different hypnosis experiences guided by standard pre-recorded instructions in counterbalanced order. Seeds for the ECN, SN, and DMN were left and right dorsolateral prefrontal cortex, dorsal anterior cingulate cortex (dACC), and posterior cingulate cortex (PCC), respectively. During hypnosis there was reduced activity in the dACC, increased functional connectivity between the dorsolateral prefrontal cortex (DLPFC;ECN) and the insula in the SN, and reduced connectivity between the ECN (DLPFC) and the DMN (PCC). These changes in neural activity underlie the focused attention, enhanced somatic and emotional control, and lack of self-consciousness that characterizes hypnosis.

Evidence of a diurnal rhythm in implicit reward learning

Many aspects of hedonic behavior, including self-administration of natural and drug rewards, as well as human positive affect, follow a diurnal cycle that peaks during the species-specific active period. This variation has been linked to circadian modulation of the mesolimbic dopamine system, and is hypothesized to serve an adaptive function by driving an organism to engage with the environment during times where the opportunity for obtaining rewards is high. However, relatively little is known about whether more complex facets of hedonic behavior - in particular, reward learning - follow the same diurnal cycle. The current study aimed to address this gap by examining evidence for diurnal variation in reward learning on a well-validated probabilistic reward learning task (PRT). PRT data from a large normative sample (N = 516) of non-clinical individuals, recruited across eight studies, were examined for the current study. The PRT uses an asymmetrical reinforcement ratio to induce a behavioral response bias, and reward learning was operationalized as the strength of this response bias across blocks of the task. Results revealed significant diurnal variation in reward learning, however in contrast to patterns previously observed in other aspects of hedonic behavior, reward learning was lowest in the middle of the day. Although a diurnal pattern was also observed on a measure of more general task performance (discriminability), this did not account for the variation observed in reward learning. Taken together, these findings point to a distinct diurnal pattern in reward learning that differs from that observed in other aspects of hedonic behavior. The results of this study have important implications for our understanding of clinical disorders characterized by both circadian and reward learning disturbances, and future research is needed to confirm whether this diurnal variation has a truly circadian origin.

Neuroclinical Framework for the Role of Stress in Addiction

Addiction has been conceptualized as a three-stage cycle—binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation—that worsens over time and involves allostatic changes in hedonic function via changes in the brain reward and stress systems. Using the withdrawal/negative affect stage and negative reinforcement as an important source of motivation for compulsive drug seeking, we outline the neurobiology of the stress component of the withdrawal/negative affect stage and relate it to a derivative of the Research Domain Criteria research construct for the study of psychiatric disease, known as the Addictions Neuroclinical Assessment. Using the Addictions Neuroclinical Assessment, we outline five subdomains of negative emotional states that can be operationally measured in human laboratory settings and paralleled by animal models. We hypothesize that a focus on negative emotionality and stress is closely related to the acute neurobiological alterations that are experienced in addiction and may serve as a bridge to a reformulation of the addiction nosology to better capture individual differences in patients for whom the withdrawal/negative affect stage drives compulsive drug taking.

Intermittent Theta Burst Stimulation Increases Reward Responsiveness in Individuals with Higher Hedonic Capacity

Background: Repetitive transcranial magnetic stimulation over the left dorsolateral prefrontal cortex (DLPFC) has been documented to influence striatal and orbitofrontal dopaminergic activity implicated in reward processing. However, the exact neuropsychological mechanisms of how DLPFC stimulation may affect the reward system and how trait hedonic capacity may interact with the effects remains to be elucidated.

Objective: In this sham-controlled study in healthy individuals, we investigated the effects of a single session of neuronavigated intermittent theta burst stimulation (iTBS) on reward responsiveness, as well as the influence of trait hedonic capacity.

Methods: We used a randomized crossover single session iTBS design with an interval of 1 week. We assessed reward responsiveness using a rewarded probabilistic learning task and measured individual trait hedonic capacity (the ability to experience pleasure) with the temporal experience of pleasure scale questionnaire.

Results: As expected, the participants developed a response bias toward the most rewarded stimulus (rich stimulus). Reaction time and accuracy for the rich stimulus were respectively shorter and higher as compared to the less rewarded stimulus (lean stimulus). Active or sham stimulation did not seem to influence the outcome. However, when taking into account individual trait hedonic capacity, we found an early significant increase in the response bias only after active iTBS. The higher the individual's trait hedonic capacity, the more the response bias toward the rich stimulus increased after the active stimulation.

Conclusion: When taking into account trait hedonic capacity, one active iTBS session over the left DLPFC improved reward responsiveness in healthy male participants with higher hedonic capacity. This suggests that individual differences in hedonic capacity may influence the effects of iTBS on the reward system.

Assessing anhedonia in depression: Potentials and pitfalls

The resurgence of interest in anhedonia within major depression has been fuelled by clinical trials demonstrating its utility in predicting antidepressant response as well as recent conceptualizations focused on the role and manifestation of anhedonia in depression. Historically, anhedonia has been understood as a "loss of pleasure", yet neuropsychological and neurobiological studies reveal a multifaceted reconceptualization that emphasizes different facets of hedonic function, including desire, effort/motivation, anticipation and consummatory pleasure. To ensure generalizability across studies, evaluation of the available subjective and objective methods to assess anhedonia is necessary. The majority of research regarding anhedonia and its neurobiological underpinnings comes from preclinical research, which uses primary reward (e.g. food) to probe hedonic responding. In contrast, behavioural studies in humans primarily use secondary reward (e.g. money) to measure many aspects of reward responding, including delay discounting, response bias, prediction error, probabilistic reversal learning, effort, anticipation and consummatory pleasure. The development of subjective scales to measure anhedonia has also increased in the last decade. This review will assess the current methodology to measure anhedonia, with a focus on scales and behavioural tasks in humans. Limitations of current work and recommendations for future studies are discussed.

The Neurobiology of Motivational Deficits in Depression--An Update on Candidate Pathomechanisms

Anhedonia has long been recognized as a central feature of major depression, yet its neurobiological underpinnings remain poorly understood. While clinical definitions of anhedonia have historically emphasized reductions in pleasure and positive emotionality, there has been growing evidence that motivation may be substantially impaired as well. Here, we review recent evidence suggesting that motivational deficits may reflect an important dimension of symptomatology that is discrete from traditional definitions of anhedonia in terms of both behavior and pathophysiology. In summarizing this work, we highlight two candidate neurobiological mechanisms--elevated inflammation and reduced synaptic plasticity--that may underlie observed reductions in motivation and reinforcement learning in depression.

Parkinson's Disease, Religion, and Spirituality

BACKGROUND

There has been increasing interest in recent decades in the interactions between disease, religious faith, and spirituality. An issue specific to neurological disorders is to what extent religiousness and spirituality depend upon the integrity of neuronal pathways.

METHODS

We review recent research that investigates the effects of Parkinson's disease (PD) on religious faith and spirituality. Few studies have addressed this issue, but these few illustrate contrasting methodological approaches that yield different conclusions.

FINDINGS

On the one hand, case-control studies have reported an apparent decrease in both religious practice and beliefs in PD with some influence of laterality of disease onset. In contrast, qualitative studies investigating religious and general coping in PD emphasize that religious faith remains important to patients.

CONCLUSIONS

Methodological pitfalls are found in both approaches. We conclude that there is little evidence to support claims of reduced spirituality and religious faith in PD. We recommend approaches to future studies that could enable a more nuanced understanding of spiritual and religious changes that might occur in PD.

The DA antagonist tiapride impairs context-related extinction learning in a novel context without affecting renewal

Renewal describes the recovery of an extinguished response if recall is tested in a context different from the extinction context. Behavioral studies demonstrated that attention to relevant context strengthens renewal. Neurotransmitters mediating attention and learning such as the dopaminergic (DA) system presumably modulate extinction learning and renewal. However, the role of DA for non-fear-based extinction learning and renewal in humans has not yet been investigated. This fMRI study investigated effects of DA-antagonism upon context-related extinction in a predictive learning task in which extinction occurred either in a novel (ABA) or an unchanged (AAA) context. The tiapride-treated group (TIA) showed significantly impaired ABA extinction learning and a significant within-group difference between ABA and AAA extinction, compared to placebo (PLAC). Groups did not differ in their level of ABA renewal. In ABA extinction, TIA showed reduced activation in dlPFC and OFC, hippocampus, and temporal regions. Across groups, activation in PFC and hippocampus correlated negatively with ABA extinction errors. Results suggest that in context-related extinction learning DA in PFC and hippocampus is involved in readjusting the cue-outcome relationship in the presence of a novel context. However, relating context to the appropriate association during recall does not appear to rely exclusively on DA signaling.

Dysfunctional Reward Processing in Depression

Anhedonia - diminished pleasure and/or decreased reactivity to pleasurable stimuli - is a core feature of depression that frequently persists after treatment. As a result, extensive effort has been directed towards characterizing the psychological and biological processes that mediate dysfunctional reward processing in depression. Reward processing can be parsed into sub-components that include motivation, reinforcement learning, and hedonic capacity, which, according to preclinical and neuroimaging evidence, involve partially dissociable brain systems. In line with this, recent findings indicate that behavioral impairments and neural abnormalities in depression vary across distinct reward-related constructs. Ultimately, improved understanding of precise reward-related dysfunctions in depression promises to improve diagnostic and therapeutic efforts in depression.

Translational Assessment of Reward and Motivational Deficits in Psychiatric Disorders

Deficits in reward and motivation are common symptoms characterizing several psychiatric and neurological disorders. Such deficits may include anhedonia, defined as loss of pleasure, as well as impairments in anticipatory pleasure, reward valuation, motivation/effort, and reward learning. This chapter describes recent advances in the development of behavioral tasks used to assess different aspects of reward processing in both humans and non-human animals. While earlier tasks were generally developed independently with limited cross-species correspondence, a newer generation of translational tasks has emerged that are theoretically and procedurally analogous across species and allow parallel testing, data analyses, and interpretation between human and rodent behaviors. Such enhanced conformity between cross-species tasks will facilitate investigation of the neurobiological mechanisms underlying discrete reward and motivated behaviors and is expected to improve our understanding and treatment of neuropsychiatric disorders characterized by reward and motivation deficits.

Voxelwise lp-ntPET for detecting localized, transient dopamine release of unknown timing: sensitivity analysis and application to cigarette smoking in the PET scanner

The “linear parametric neurotransmitter PET” (lp‐ntPET) model estimates time variation in endogenous neurotransmitter levels from dynamic PET data. The pattern of dopamine (DA) change over time may be an important element of the brain's response to addictive substances such as cigarettes or alcohol. We have extended the lp‐ntPET model from the original region of interest (ROI) ‐ based implementation to be able to apply the model at the voxel level. The resulting endpoint is a dynamic image, or movie, of transient neurotransmitter changes. Simulations were performed to select threshold values to reduce the false positive rate when applied to real ¹¹C‐raclopride PET data. We tested the new voxelwise method on simulated data, and finally, we applied it to ¹¹C‐raclopride PET data of subjects smoking cigarettes in the PET scanner. In simulation, the temporal precision of neurotransmitter response was shown to be similar to that of ROI‐based lp‐ntPET (standard deviation ∼ 3 min). False positive rates for the voxelwise method were well controlled by combining a statistical threshold (the F‐test) with a new spatial (cluster‐size) thresholding operation. Sensitivity of detection for the new algorithm was greater than 80% for the case of short‐lived DA changes that occur in subregions of the striatum as might be the case with cigarette smoking. Finally, in ¹¹C‐raclopride PET data, DA movies reveal for the first time that different temporal patterns of the DA response to smoking may exist in different subregions of the striatum. These spatiotemporal patterns of neurotransmitter change created by voxelwise lp‐ntPET may serve as novel biomarkers for addiction and/or treatment efficacy. Hum Brain Mapp 35:4876–4891, 2014. © 2014 The Authors. Human Brain Mapping Published by Wiley Periodicals, Inc.

Peril and pleasure: an rdoc-inspired examination of threat responses and reward processing in anxiety and depression

As a step toward addressing limitations in the current psychiatric diagnostic system, the National Institute of Mental Health recently developed the Research Domain Criteria (RDoC) to stimulate integrative research-spanning self-report, behavior, neural circuitry, and molecular/genetic mechanisms-on core psychological processes implicated in mental illness. Here, we use the RDoC conceptualization to review research on threat responses, reward processing, and their interaction. The first section of the manuscript highlights the pivotal role of exaggerated threat responses-mediated by circuits connecting the frontal cortex, amygdala, and midbrain-in anxiety, and reviews data indicating that genotypic variation in the serotonin system is associated with hyperactivity in this circuitry, which elevates the risk for anxiety and mood disorders. In the second section, we describe mounting evidence linking anhedonic behavior to deficits in psychological functions that rely heavily on dopamine signaling, especially cost/benefit decision making and reward learning. The third section covers recent studies that document negative effects of acute threats and chronic stress on reward responses in humans. The mechanisms underlying such effects are unclear, but the fourth section reviews new optogenetic data in rodents indicating that GABAergic inhibition of midbrain dopamine neurons, driven by activation of the habenula, may play a fundamental role in stress-induced anhedonia. In addition to its basic scientific value, a better understanding of interactions between the neural systems that mediate threat and reward responses may offer relief from the burdensome condition of anxious depression.

Dimensions in major depressive disorder and their relevance for treatment outcome

BACKGROUND

Major depressive disorder (MDD) is a heterogeneous disease. More homogeneous psycho(patho)logical dimensions would facilitate MDD research as well as clinical practice. The first aim of this study was to find potential dimensions within a broad psychopathological assessment in depressed patients. Second, we aimed at examining how these dimensions predicted course in MDD.

METHODS

Ten psychopathological variables were assessed in 75 MDD inpatients. Factor and regression analyses assessed putative relations between psychopathological factors and depression severity and outcome after 8 weeks of treatment.

RESULTS

A 3-factor model (eigenvalue: 54.4%) was found, representing a psychomotor change, anhedonia and negative affect factor. Anhedonia and negative affect predicted depression severity (R(2)=0.37, F=20.86, p<0.0001). Anhedonia predicted non-response (OR 6.00, CI 1.46-24.59) and both negative affect (OR 5.69, CI 1.19-27.20) and anhedonia predicted non-remission (OR 9.28, CI 1.85-46.51).

LIMITATIONS

The sample size of the study was relatively modest, limiting the number of variables included in the analysis.

CONCLUSIONS

Results confirm that psychomotor change, anhedonia and negative affect are key MDD dimensions, two of which are related to treatment outcome.

Familial liability to psychosis is associated with attenuated dopamine stress signaling in ventromedial prefrontal cortex

OBJECTIVE

Patients diagnosed with a psychotic disorder and their first-degree relatives display increased reactivity to stress. Theory predicts that experience of psychosocial stress is associated both with ventromedial prefrontal and mesolimbic dopamine neurotransmission. However, while there is evidence of aberrant striatal dopamine processing in psychotic disorder, the role of the prefrontal cortex remains under-researched. This study aimed at investigating stress-induced in vivo dopamine release in ventromedial prefrontal cortex (vmPFC) of individuals at familial risk for psychosis.

METHOD

Fourteen healthy first-degree relatives of patients with a diagnosis of psychotic disorder and 10 control subjects underwent a single dynamic positron emission tomography (PET) scanning session after intravenous administration of 183.2 (SD = 7.6) MBq [(18)F]fallypride. Psychosocial stress was initiated at 100 min postinjection using a computerized mental arithmetic task with social evaluative threat components. PET data were analyzed using the linearized simplified reference region model. Regression analyses were performed to compare the spatial extent of task-related ligand displacement between control subjects and relatives and to find how it related to self-rated experiences of psychosocial stress and psychosis.

RESULTS

First-degree relatives displayed hyporeactive dopamine signaling in the vmPFC in response to stress. Increased levels of subjectively rated stress were associated with increased intensity of psychotic experiences. This effect was particularly pronounced in first-degree relatives.

CONCLUSION

Although previous studies have hypothesized a role for prefrontal dopamine dysfunction in psychosis, this study, to our knowledge, is the first in vivo human imaging study showing attenuated (ie, hyporeactive) dopamine stress neuromodulation in vmPFC of individuals at familial risk for psychosis.

Co-Occurring Depressive and Substance Use Disorders in Adolescents: An Examination of Reward Responsiveness During Treatment

The goals of the present study were to examine: (a) putative dysfunctions in reward responsiveness in a sample of adolescents (n = 40) with co-occurring depressive and substance use disorders; (b) possible links between reward responsiveness and symptoms of depression, anhedonia, anxiety, and motivation for change in relation to alcohol and drug use; and (c) potential gender differences in findings. Before and after a 2-week residential treatment, adolescents completed self-report assessments of depression, anhedonia, anxiety symptoms, and motivation for change in relation to substance use. In addition, participants completed a computer-based Probabilistic Reward Task (PRT) to examine reward responsiveness (i.e., participants' ability to modulate behavior as a function of reinforcement history). Results indicated that depression and anhedonia symptoms decreased, and motivation for change in relation to drug use increased. Improved reward responsiveness over the course of residential treatment emerged in female, but not male, participants.

Blunted reward responsiveness in remitted depression

Major depressive disorder has been associated with blunted responsiveness to rewards, but inconsistencies exist whether such abnormalities persist after complete remission. To address this issue, across two independent studies, 47 adults with remitted major depressive disorder (rMDD) and 37 healthy controls completed a Probabilistic Reward Task, which used a differential reinforcement schedule of social or monetary feedback to examine reward responsiveness (i.e., ability to modulate behavior as a function of reinforcement history). Relative to controls, adults with rMDD showed blunted reward responsiveness. Importantly, a history of depression predicted reduced reward learning above and beyond residual depressive (including anhedonic) symptoms and perceived stress. Findings indicate that blunted reward responsiveness endures even when adults are in remission and might be a trait-related abnormality in MDD. More research is warranted to investigate if blunted reward responsiveness may predict future depressive episodes and whether targeting reward-related deficits may prevent the re-occurrence of the disorder.

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu) meeting. A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits.

Assessment of reward responsiveness in the response bias probabilistic reward task in rats: implications for cross-species translational research

Mood disorders, such as major depressive disorder, are characterized by abnormal reward responsiveness. The Response Bias Probabilistic Reward Task (hereafter referred to as probabilistic reward task (PRT)) quantifies reward responsiveness in human subjects, and an equivalent animal assessment is needed to facilitate preclinical translational research. Thus, the goals of the present studies were to develop, validate and characterize a rat analog of the PRT. Adult male Wistar and Long-Evans rats were trained in operant testing chambers to discriminate between two tone stimuli that varied in duration (0.5 and 2 s). During a subsequent test session consisting of 100 trials, the two tones were made ambiguous (0.9 and 1.6 s) and correct identification of one tone was reinforced with a food pellet three times more frequently than the other tone. In subsequent experiments, Wistar rats were administered either a low dose of the dopamine D2/D3 receptor agonist pramipexole (0.1 mg kg(-1), subcutaneous) or the psychostimulant amphetamine (0.5 mg kg(-1), intraperitoneal) before the test session. Similar to human subjects, both rat strains developed a response bias toward the more frequently reinforced stimulus, reflecting robust reward responsiveness. Mirroring prior findings in humans, a low dose of pramipexole blunted response bias. Moreover, in rats, amphetamine potentiated response bias. These results indicate that in rats, reward responsiveness can be quantified and bidirectionally modulated by pharmacological manipulations that alter striatal dopamine transmission. Thus, this new procedure in rats, which is conceptually and procedurally analogous to the one used in humans, provides a reverse translational platform to investigate abnormal reward responsiveness across species.

Delta-9-tetrahydrocannabinol-induced dopamine release as a function of psychosis risk: 18F-fallypride positron emission tomography study

Cannabis use is associated with psychosis, particularly in those with expression of, or vulnerability for, psychotic illness. The biological underpinnings of these differential associations, however, remain largely unknown. We used Positron Emission Tomography and (18)F-fallypride to test the hypothesis that genetic risk for psychosis is expressed by differential induction of dopamine release by Δ(9)-THC (delta-9-tetrahydrocannabinol, the main psychoactive ingredient of cannabis). In a single dynamic PET scanning session, striatal dopamine release after pulmonary administration of Δ(9)-THC was measured in 9 healthy cannabis users (average risk psychotic disorder), 8 patients with psychotic disorder (high risk psychotic disorder) and 7 un-related first-degree relatives (intermediate risk psychotic disorder). PET data were analyzed applying the linear extension of the simplified reference region model (LSRRM), which accounts for time-dependent changes in (18)F-fallypride displacement. Voxel-based statistical maps, representing specific D2/3 binding changes, were computed to localize areas with increased ligand displacement after Δ(9)-THC administration, reflecting dopamine release. While Δ(9)-THC was not associated with dopamine release in the control group, significant ligand displacement induced by Δ(9)-THC in striatal subregions, indicative of dopamine release, was detected in both patients and relatives. This was most pronounced in caudate nucleus. This is the first study to demonstrate differential sensitivity to Δ(9)-THC in terms of increased endogenous dopamine release in individuals at risk for psychosis.

COMT Val158Met genotype selectively alters prefrontal [18F]fallypride displacement and subjective feelings of stress in response to a psychosocial stress challenge

Catechol-O-methyltransferase (COMT) plays an essential role in degradation of extracellular dopamine in prefrontal regions of the brain. Although a polymorphism in this gene, COMT Val¹⁵⁸Met, affects human behavior in response to stress little is known about its effect on dopaminergic activity associated with the human stress response, which may be of interest for stress-related psychiatric disorders such as psychosis. We aimed to investigate the effect of variations in COMT genotype on in vivo measures of stress-induced prefrontal cortex (PFC) dopaminergic processing and subjective stress responses. A combined sample of healthy controls and healthy first-degree relatives of psychosis patients (n = 26) were subjected to an [¹⁸F]fallypride Positron Emission Tomography scan. Psychosocial stress during the scan was induced using the Montreal Imaging Stress Task and subjective stress was assessed every 12 minutes. Parametric t-maps, generated using the linear extension of the simplified reference region model, revealed an effect of COMT genotype on the spatial extent of [¹⁸F]fallypride displacement. Detected effects of exposure to psychosocial stress were unilateral and remained restricted to the left superior and right inferior frontal gyrus, with Met-hetero- and homozygotes showing less [¹⁸F]fallypride displacement than Val-homozygotes. Additionally, Met-hetero- and homozygotes experienced larger subjective stress responses than Val-homozygotes. The direction of the effects remained the same when the data was analyzed separately for controls and first-degree relatives. The human stress response may be mediated in part by COMT-dependent dopaminergic PFC activity, providing speculation for the neurobiology underlying COMT-dependent differences in human behaviour following stress. Implications of these results for stress-related psychopathology and models of dopaminergic functioning are discussed.

Reduced reward learning predicts outcome in major depressive disorder

BACKGROUND

Reduced reward learning might contribute to the onset and maintenance of major depressive disorder (MDD). In particular, the inability to utilize rewards to guide behavior is hypothesized to be associated with anhedonia, a core feature and potential trait marker of MDD. Few studies have investigated whether reduced reward learning normalizes with treatment and/or reward learning predicts clinical outcome. Our goal was to test whether MDD is characterized by reduced reward learning, especially in the presence of anhedonic symptoms, and to investigate the relationship between reward learning and MDD diagnosis after 8 weeks of treatment.

METHODS

Seventy-nine inpatients and 63 healthy control subjects performed a probabilistic reward task yielding an objective measure of participants' ability to modulate behavior as a function of reward. We compared reward responsiveness between depressed patients and control subjects, as well as high- versus low-anhedonic MDD patients. We also evaluated whether reward-learning deficits predicted persistence of MDD after 8 weeks of treatment.

RESULTS

Relative to control subjects, MDD patients showed reduced reward learning. Moreover, patients with high anhedonia showed diminished reward learning compared with patients with low anhedonia. Reduced reward learning at study entry increased the odds of a persisting diagnosis of MDD after 8 weeks of treatment (odds ratio 7.84).

CONCLUSIONS

Our findings indicate that depressed patients, especially those with anhedonic features, are characterized by an impaired ability to modulate behavior as a function of reward. Moreover, reduced reward learning increased the odds for the diagnosis of MDD to persist after 8 weeks of treatment.

Prefrontal dopamine signaling and cognitive symptoms of Parkinson's disease

Cognitive dysfunction is a common symptom of Parkinson's disease (PD) that causes significant morbidity and mortality. The severity of these symptoms ranges from minor executive symptoms to frank dementia involving multiple domains. In the present review, we will concentrate on the aspects of cognitive impairment associated with prefrontal dopaminergic dysfunction, seen in non-demented patients with PD. These symptoms include executive dysfunction and disorders of thought, such as hallucinations and psychosis. Such symptoms may go on to predict dementia related to PD, which involves amnestic dysfunction and is typically seen later in the disease. Cognitive symptoms are associated with dysfunction in cholinergic circuits, in addition to the abnormalities in the prefrontal dopaminergic system. These circuits can be carefully studied and evaluated in PD, and could be leveraged to treat difficult clinical problems related to cognitive symptoms of PD.