Motivational Context Modulates Prediction Error Response in Schizophrenia

Prefrontal cortical dopamine deficit may cause impaired glucose metabolism in schizophrenia

The brain neurotramsmitter dopamine may play an important role in modulating systemic glucose homeostasis. In seven hundred and four drug- naïve patients with first-episode schizophrenia, we provide robust evidence of positive associations between negative symptoms of schizophrenia and high fasting blood glucose. We then show that glucose metabolism and negative symptoms are improved when intermittent theta burst stimulation (iTBS) on prefrontal cortex (PFC) is performed in patients with predominantly negative symptoms of schizophrenia. These findings led us to hypothesize that the prefrontal cortical dopamine deficit, which is known to be associated with negative symptoms, may be responsible for abnormal glucose metabolism in schizophrenia. To explore this, we optogenetically and chemogenetically inhibited the ventral tegmental area (VTA)-medial prefrontal cortex (mPFC) dopamine projection in mice and found both procedures caused glucose intolerance. Moreover, microinjection of dopamine two receptor (D2R) neuron antagonists into mPFC in mice significantly impaired glucose tolerance. Finally, a transgenic mouse model of psychosis named Disc1tr exhibited depressive-like symptoms, impaired glucose homeostasis, and compared to wild type littermates reduced D2R expression in prefrontal cortex.

Neural correlates of prediction error in patients with schizophrenia: evidence from an fMRI meta-analysis

Abnormal processes of learning from prediction errors, i.e. the discrepancies between expectations and outcomes, are thought to underlie motivational impairments in schizophrenia. Although dopaminergic abnormalities in the mesocorticolimbic reward circuit have been found in patients with schizophrenia, the pathway through which prediction error signals are processed in schizophrenia has yet to be elucidated. To determine the neural correlates of prediction error processing in schizophrenia, we conducted a meta-analysis of whole-brain neuroimaging studies that investigated prediction error signal processing in schizophrenia patients and healthy controls. A total of 14 studies (324 schizophrenia patients and 348 healthy controls) using the reinforcement learning paradigm were included. Our meta-analysis showed that, relative to healthy controls, schizophrenia patients showed increased activity in the precentral gyrus and middle frontal gyrus and reduced activity in the mesolimbic circuit, including the striatum, thalamus, amygdala, hippocampus, anterior cingulate cortex, insula, superior temporal gyrus, and cerebellum, when processing prediction errors. We also found hyperactivity in frontal areas and hypoactivity in mesolimbic areas when encoding prediction error signals in schizophrenia patients, potentially indicating abnormal dopamine signaling of reward prediction error and suggesting failure to represent the value of alternative responses during prediction error learning and decision making.

Revisiting reward impairments in schizophrenia spectrum disorders: a systematic review and meta-analysis for neuroimaging findings

BACKGROUND

Abnormal reward functioning is central to anhedonia and amotivation symptoms of schizophrenia (SCZ). Reward processing encompasses a series of psychological components. This systematic review and meta-analysis examined the brain dysfunction related to reward processing of individuals with SCZ spectrum disorders and risks, covering multiple reward components.

METHODS

After a systematic literature search, 37 neuroimaging studies were identified and divided into four groups based on their target psychology components (i.e. reward anticipation, reward consumption, reward learning, effort computation). Whole-brain Seed-based d Mapping (SDM) meta-analyses were conducted for all included studies and each component.

RESULTS

The meta-analysis for all reward-related studies revealed reduced functional activation across the SCZ spectrum in the striatum, orbital frontal cortex, cingulate cortex, and cerebellar areas. Meanwhile, distinct abnormal patterns were found for reward anticipation (decreased activation of the cingulate cortex and striatum), reward consumption (decreased activation of cerebellum IV/V areas, insula and inferior frontal gyri), and reward learning processing (decreased activation of the striatum, thalamus, cerebellar Crus I, cingulate cortex, orbitofrontal cortex, and parietal and occipital areas). Lastly, our qualitative review suggested that decreased activation of the ventral striatum and anterior cingulate cortex was also involved in effort computation.

CONCLUSIONS

These results provide deep insights on the component-based neuro-psychopathological mechanisms for anhedonia and amotivation symptoms of the SCZ spectrum.

Repeat investigation during social preference behavior is suppressed in male mice with prefrontal cortex cacna1c (Cav1.2)-deficiency through the dysregulation of neural dynamics

Impairments in social behavior are observed in a range of neuropsychiatric disorders and several lines of evidence have demonstrated that dysfunction of the prefrontal cortex (PFC) plays a central role in social deficits. We have previously shown that loss of neuropsychiatric risk gene Cacna1c that codes for the Cav1.2 isoform of L-type calcium channels (LTCCs) in the PFC result in impaired sociability as tested using the three-chamber social approach test. In this study we aimed to further characterize the nature of the social deficit associated with a reduction in PFC Cav1.2 channels (Cav1.2PFCKO mice) by testing male mice in a range of social and nonsocial tests while examining PFC neural activity using in vivo GCaMP6s fiber photometry. We found that during the first investigation of the social and non-social stimulus in the three-chamber test, both Cav1.2PFCKO male mice and Cav1.2PFCGFP controls spent significantly more time with the social stimulus compared to a non-social object. In contrast, during repeat investigations while Cav1.2PFCWT mice continued to spend more time with the social stimulus, Cav1.2PFCKO mice spent equal amount of time with both social and non-social stimuli. Neural activity recordings paralleled social behavior with increase in PFC population activity in Cav1.2PFCWT mice during first and repeat investigations, which was predictive of social preference behavior. In Cav1.2PFCKO mice, there was an increase in PFC activity during first social investigation but not during repeat investigations. These behavioral and neural differences were not observed during a reciprocal social interaction test nor during a forced alternation novelty test. To evaluate a potential deficit in reward-related processes, we tested mice in a three-chamber test wherein the social stimulus was replaced by food. Behavioral testing revealed that both Cav1.2PFCWT and Cav1.2PFCKO mice showed a preference for food over object with significantly greater preference during repeat investigation. Interestingly, there was no increase in PFC activity when Cav1.2PFCWT or Cav1.2PFCKO first investigated the food however activity significantly increased in Cav1.2PFCWT mice during repeat investigations of the food. This was not observed in Cav1.2PFCKO mice. In summary, a reduction in Cav1.2 channels in the PFC suppresses the development of a sustained social preference in mice that is associated with lack of PFC neuronal population activity that may be related to deficits in social reward.

Belief updating in psychosis, depression and anxiety disorders: A systematic review across computational modelling approaches

Alterations in belief updating are proposed to underpin symptoms of psychiatric illness, including psychosis, depression, and anxiety. Key parameters underlying belief updating can be captured using computational modelling techniques, aiding the identification of unique and shared deficits, and improving diagnosis and treatment. We systematically reviewed research that applied computational modelling to probabilistic tasks measuring belief updating in stable and volatile (changing) environments, across clinical and subclinical psychosis (n = 17), anxiety (n = 9), depression (n = 9) and transdiagnostic samples (n = 9). Depression disorders related to abnormal belief updating in response to the valence of rewards, evidenced in both stable and volatile environments. Whereas psychosis and anxiety disorders were associated with difficulties adapting to changing contingencies specifically, indicating an inflexibility and/or insensitivity to environmental volatility. Higher-order learning models revealed additional difficulties in the estimation of overall environmental volatility across psychosis disorders, showing increased updating to irrelevant information. These findings stress the importance of investigating belief updating in transdiagnostic samples, using homogeneous experimental and computational modelling approaches.

Both unmedicated and medicated individuals with schizophrenia show impairments across a wide array of cognitive and reinforcement learning tasks

BACKGROUND

Schizophrenia is a disorder characterized by pervasive deficits in cognitive functioning. However, few well-powered studies have examined the degree to which cognitive performance is impaired even among individuals with schizophrenia not currently on antipsychotic medications using a wide range of cognitive and reinforcement learning measures derived from cognitive neuroscience. Such research is particularly needed in the domain of reinforcement learning, given the central role of dopamine in reinforcement learning, and the potential impact of antipsychotic medications on dopamine function.

METHODS

The present study sought to fill this gap by examining healthy controls (N = 75), unmedicated (N = 48) and medicated (N = 148) individuals with schizophrenia. Participants were recruited across five sites as part of the CNTRaCS Consortium to complete tasks assessing processing speed, cognitive control, working memory, verbal learning, relational encoding and retrieval, visual integration and reinforcement learning.

RESULTS

Individuals with schizophrenia who were not taking antipsychotic medications, as well as those taking antipsychotic medications, showed pervasive deficits across cognitive domains including reinforcement learning, processing speed, cognitive control, working memory, verbal learning and relational encoding and retrieval. Further, we found that chlorpromazine equivalency rates were significantly related to processing speed and working memory, while there were no significant relationships between anticholinergic load and performance on other tasks.

CONCLUSIONS

These findings add to a body of literature suggesting that cognitive deficits are an enduring aspect of schizophrenia, present in those off antipsychotic medications as well as those taking antipsychotic medications.

Reduced learning bias towards the reward context in medication-naive first-episode schizophrenia patients

BACKGROUND

Reinforcement learning has been proposed to contribute to the development of amotivation in individuals with schizophrenia (SZ). Accumulating evidence suggests dysfunctional learning in individuals with SZ in Go/NoGo learning and expected value representation. However, previous findings might have been confounded by the effects of antipsychotic exposure. Moreover, reinforcement learning also rely on the learning context. Few studies have examined the learning performance in reward and loss-avoidance context separately in medication-naïve individuals with first-episode SZ. This study aimed to explore the behaviour profile of reinforcement learning performance in medication-naïve individuals with first-episode SZ, including the contextual performance, the Go/NoGo learning and the expected value representation performance.

METHODS

Twenty-nine medication-naïve individuals with first-episode SZ and 40 healthy controls (HCs) who have no significant difference in age and gender, completed the Gain and Loss Avoidance Task, a reinforcement learning task involving stimulus pairs presented in both the reward and loss-avoidance context. We assessed the group difference in accuracy in the reward and loss-avoidance context, the Go/NoGo learning and the expected value representation. The correlations between learning performance and the negative symptom severity were examined.

RESULTS

Individuals with SZ showed significantly lower accuracy when learning under the reward than the loss-avoidance context as compared to HCs. The accuracies under the reward context (90%win- 10%win) in the Acquisition phase was significantly and negatively correlated with the Scale for the Assessment of Negative Symptoms (SANS) avolition scores in individuals with SZ. On the other hand, individuals with SZ showed spared ability of Go/NoGo learning and expected value representation.

CONCLUSIONS

Despite our small sample size and relatively modest findings, our results suggest possible reduced learning bias towards reward context among medication-naïve individuals with first-episode SZ. The reward learning performance was correlated with amotivation symptoms. This finding may facilitate our understanding of the underlying mechanism of negative symptoms. Reinforcement learning performance under the reward context may be important to better predict and prevent the development of schizophrenia patients' negative symptom, especially amotivation.

Anhedonia in Schizophrenia

Anhedonia has long been considered a cardinal symptom of schizophrenia. This symptom is strongly associated with poor functional outcome, and limited treatment options are available. While originally conceptualized as an inability to experience pleasure, recent work has consistently shown that individuals with schizophrenia have an intact capacity to experience pleasure in-the-moment. Adjacent work in basic affective neuroscience has broadened the conceptualization of anhedonia to include not only the capacity to experience pleasure but highlights important temporal affective dynamics and decision-making processes that go awry in schizophrenia. Here we detail these mechanisms for emotional and motivational impairment in people with schizophrenia including: (1) initial response to reward; (2) reward anticipation; (3) reward learning; (4) effort-cost decision-making; (5) working memory and cognitive control. We will review studies that utilized various types of rewards (e.g., monetary, social), in order to draw conclusions regarding whether findings vary by reward type. We will then discuss how modern assessment methods may best incorporate each of the mechanisms, to provide a more fine-grained understanding of anhedonia in individuals with schizophrenia. We will close by providing a discussion of relevant future directions.

Differential reinforcement learning responses to positive and negative information in unmedicated individuals with depression

Major depressive disorder (MDD) is characterized by behavioral and neural abnormalities in processing both rewarding and aversive stimuli, which may impact motivational and affective symptoms. Learning paradigms have been used to assess reinforcement encoding abnormalities in MDD and their association with dysfunctional incentive-based behavior, but how the valence and context of information modulate this learning is not well understood. To address these gaps, we examined responses to positive and negative reinforcement across multiple temporal phases of information processing. While undergoing functional magnetic resonance imaging (fMRI), 47 participants (23 unmedicated, predominantly medication-naïve participants with MDD and 24 demographically-matched HC participants) completed a probabilistic, feedback-based reinforcement learning task that allowed us to separate neural activation during motor response (choice) from reinforcement feedback and monetary outcome across two independent conditions: pursuing gains and avoiding losses. In the gain condition, MDD participants showed overall blunted learning responses (prediction error) in the dorsal striatum when receiving monetary outcome, and reduced responses in ventral striatum for positive, but not negative, prediction error. The MDD group showed enhanced sensitivity to negative information, and symptom severity was associated with better behavioral performance in the loss condition. These findings suggest that striatal responses during learning are abnormal in individuals with MDD but vary with the valence of information.

Psychiatric symptoms influence reward-seeking and loss-avoidance decision-making through common and distinct computational processes

AIM

Psychiatric symptoms are often accompanied by impairments in decision-making to attain rewards and avoid losses. However, due to the complex nature of mental disorders (e.g., high comorbidity), symptoms that are specifically associated with deficits in decision-making remain unidentified. Furthermore, the influence of psychiatric symptoms on computations underpinning reward-seeking and loss-avoidance decision-making remains elusive. Here, we aim to address these issues by leveraging a large-scale online experiment and computational modeling.

METHODS

In the online experiment, we recruited 1900 non-diagnostic participants from the general population. They performed either a reward-seeking or loss-avoidance decision-making task, and subsequently completed questionnaires about psychiatric symptoms.

RESULTS

We found that one trans-diagnostic dimension of psychiatric symptoms related to compulsive behavior and intrusive thought (CIT) was negatively correlated with overall decision-making performance in both the reward-seeking and loss-avoidance tasks. A deeper analysis further revealed that, in both tasks, the CIT psychiatric dimension was associated with lower preference for the options that recently led to better outcomes (i.e. reward or no-loss). On the other hand, in the reward-seeking task only, the CIT dimension was associated with lower preference for recently unchosen options.

CONCLUSION

These findings suggest that psychiatric symptoms influence the two types of decision-making, reward-seeking and loss-avoidance, through both common and distinct computational processes.

Reinforcement learning abnormalities in the attenuated psychosis syndrome and first episode psychosis

Prior studies indicate that chronic schizophrenia (SZ) is associated with a specific profile of reinforcement learning abnormalities. These impairments are characterized by: 1) reductions in learning rate, and 2) impaired Go learning and intact NoGo learning. Furthermore, each of these deficits are associated with greater severity of negative symptoms, consistent with theoretical perspectives positing that avolition and anhedonia are associated with impaired value representation. However, it is unclear whether these deficits extend to earlier phases of psychotic illness and when individuals are unmedicated. Two studies were conducted to examine reinforcement learning deficits in earlier phases of psychosis and in high risk patients. In study 1, participants included 35 participants with first episode psychosis (FEP) with limited antipsychotic medication exposure and 25 healthy controls (HC). Study 2 included 17 antipsychotic naïve individuals who were at clinical high-risk for psychosis (CHR) (i.e., attenuated psychosis syndrome) and 18 matched healthy controls (HC). In both studies, participants completed the Temporal Utility Integration Task, a measure of probabilistic reinforcement learning that contained Go and NoGo learning blocks. FEP displayed impaired Go and NoGo learning. In contrast, CHR did not display impairments in Go or NoGo learning. Impaired Go learning was not significantly associated with clinical outcomes in the CHR or FEP samples. Findings provide new evidence for areas of spared and impaired reinforcement learning in early phases of psychosis.

Abnormal prediction error processing in schizophrenia and depression

To make adaptive decisions under uncertainty, individuals need to actively monitor the discrepancy between expected outcomes and actual outcomes, known as prediction errors. Reward‐based learning deficits have been shown in both depression and schizophrenia patients. For this study, we compiled studies that investigated prediction error processing in depression and schizophrenia patients and performed a series of meta‐analyses. In both groups, positive t‐maps of prediction error tend to yield striatum activity across studies. The analysis of negative t‐maps of prediction error revealed two large clusters within the right superior and inferior frontal lobes in schizophrenia and the medial prefrontal cortex and bilateral insula in depression. The concordant posterior cingulate activity was observed in both patient groups, more prominent in the depression group and absent in the healthy control group. These findings suggest a possible role in dopamine‐rich areas associated with the encoding of prediction errors in depression and schizophrenia.

Reliability and Replicability of Implicit and Explicit Reinforcement Learning Paradigms in People With Psychotic Disorders

BACKGROUND

Motivational deficits in people with psychosis may be a result of impairments in reinforcement learning (RL). Therefore, behavioral paradigms that can accurately measure these impairments and their change over time are essential.

METHODS

We examined the reliability and replicability of 2 RL paradigms (1 implicit and 1 explicit, each with positive and negative reinforcement components) given at 2 time points to healthy controls (n = 75), and people with bipolar disorder (n = 62), schizoaffective disorder (n = 60), and schizophrenia (n = 68).

RESULTS

Internal consistency was acceptable (mean α = 0.78 ± 0.15), but test-retest reliability was fair to low (mean intraclass correlation = 0.33 ± 0.25) for both implicit and explicit RL. There were no clear effects of practice for these tasks. Largely, performance on these tasks shows intact implicit and impaired explicit RL in psychosis. Symptom presentation did not relate to performance in any robust way.

CONCLUSIONS

Our findings replicate previous literature showing spared implicit RL and impaired explicit reinforcement in psychosis. This suggests typical basal ganglia dopamine release, but atypical recruitment of the orbitofrontal and dorsolateral prefrontal cortices. However, we found that these tasks have only fair to low test-retest reliability and thus may not be useful for assessing change over time in clinical trials.

Cingulum and abnormal psychological stress response in schizophrenia

Stress is implicated in many aspects of schizophrenia, including heightened distress intolerance. We examined how affect and microstructure of major brain tracts involved in regulating affect may contribute to distress intolerance in schizophrenia. Patients with schizophrenia spectrum disorders (n = 78) and community controls (n = 95) completed diffusion weighted imaging and performed psychological stress tasks. Subjective affect was collected pre and post stressors. Individuals who did not persist during one or both stress tasks were considered distress intolerant (DI), and otherwise distress tolerant (DT). Fractional anisotropy (FA) of the dorsal cingulum showed a significant diagnosis x DT/DI phenotype interaction (p = 0.003). Post-hoc tests showed dorsal cingulum FA was significantly lower in DI patients compared with DI controls (p < 0.001), but not different between DT groups (p = 0.27). Regarding affect responses to stress, irritability showed the largest stress-related change (p < 0.001), but irritability changes were significantly reduced in DI patients compared to DI controls (p = 0.006). The relationship between irritability change and performance errors also differed among patients (ρ = -0.29, p = 0.011) and controls (ρ = 0.21, p = 0.042). Further modeling highlighted the explanatory power of dorsal cingulum for predicting DI even after performance and irritability were taken into account. Distress intolerance during psychological stress exposure is related to microstructural properties of the dorsal cingulum, a key structure for cognitive control and emotion regulation. In schizophrenia, the affective response to psychological stressors is abnormal, and distress intolerant patients had significantly reduced dorsal cingulum FA compared to distress intolerant controls. The findings provide new insight regarding distress intolerance in schizophrenia.

Striatal Dopamine and Reward Prediction Error Signaling in Unmedicated Schizophrenia Patients

Increased striatal dopamine synthesis capacity has consistently been reported in patients with schizophrenia. However, the mechanism translating this into behavior and symptoms remains unclear. It has been proposed that heightened striatal dopamine may blunt dopaminergic reward prediction error signaling during reinforcement learning. In this study, we investigated striatal dopamine synthesis capacity, reward prediction errors, and their association in unmedicated schizophrenia patients (n = 19) and healthy controls (n = 23). They took part in FDOPA-PET and underwent functional magnetic resonance imaging (fMRI) scanning, where they performed a reversal-learning paradigm. The groups were compared regarding dopamine synthesis capacity (Kicer), fMRI neural prediction error signals, and the correlation of both. Patients did not differ from controls with respect to striatal Kicer. Taking into account, comorbid alcohol abuse revealed that patients without such abuse showed elevated Kicer in the associative striatum, while those with abuse did not differ from controls. Comparing all patients to controls, patients performed worse during reversal learning and displayed reduced prediction error signaling in the ventral striatum. In controls, Kicer in the limbic striatum correlated with higher reward prediction error signaling, while there was no significant association in patients. Kicer in the associative striatum correlated with higher positive symptoms and blunted reward prediction error signaling was associated with negative symptoms. Our results suggest a dissociation between striatal subregions and symptom domains, with elevated dopamine synthesis capacity in the associative striatum contributing to positive symptoms while blunted prediction error signaling in the ventral striatum related to negative symptoms.

Motivational deficits in schizophrenia relate to abnormalities in cortical learning rate signals

Individuals from across the psychosis spectrum display impairments in reinforcement learning. In some individuals, these deficits may result from aberrations in reward prediction error (RPE) signaling, conveyed by dopaminergic projections to the ventral striatum (VS). However, there is mounting evidence that VS RPE signals are relatively intact in medicated people with schizophrenia (PSZ). We hypothesized that, in PSZ, reinforcement learning deficits often are not related to RPE signaling per se but rather their impact on learning and behavior (i.e., learning rate modulation), due to dysfunction in anterior cingulate and dorsomedial prefrontal cortex (dmPFC). Twenty-six PSZ and 23 healthy volunteers completed a probabilistic reinforcement learning paradigm with occasional, sudden, shifts in contingencies. Using computational modeling, we found evidence of an impairment in trial-wise learning rate modulation (α) in PSZ before and after a reinforcement contingency shift, expressed most in PSZ with more severe motivational deficits. In a subsample of 22 PSZ and 22 healthy volunteers, we found little evidence for between-group differences in VS RPE and dmPFC learning rate signals, as measured with fMRI. However, a follow-up psychophysiological interaction analysis revealed decreased dmPFC-VS connectivity concurrent with learning rate modulation, most prominently in individuals with the most severe motivational deficits. These findings point to an impairment in learning rate modulation in PSZ, leading to a reduced ability to adjust task behavior in response to unexpected outcomes. At the level of the brain, learning rate modulation deficits may be associated with decreased involvement of the dmPFC within a greater RL network.

Striatum-related functional activation during reward- versus punishment-based learning in psychosis risk

Psychosis is strongly related to increased striatal dopamine. However, the neural consequences of increased striatal dopamine in psychosis risk are still not fully understood. Consistent with an increase in striatal dopamine, in previous research, psychosis risk has been associated with neural EEG evidence of a greater response to unexpected reward than unexpected punishment feedback on a reversal-learning task. However, previous research has not directly examined whether psychosis risk is associated with altered striatal activation when receiving unexpected feedback on this task. There were two groups of participants: an antipsychotic medication-naive psychosis risk group (n = 21) who had both (a) extreme levels of self-reported psychotic-like beliefs and experiences and (b) interview-rated current-attenuated psychotic symptoms; and a comparison group (n = 20) who had average levels of self-reported psychotic-like beliefs and experiences. Participants completed a reversal-leaning task during fMRI scanning. As expected, in both ROI and whole-brain analyses, the psychosis risk group exhibited greater striatal activation (for whole-brain analyses, the peak was located in the right caudate) to unexpected reward than unexpected punishment feedback relative to the comparison group. These results indicate that psychosis risk is associated with a relatively increased neural sensitivity to unexpected reward than unexpected punishment outcomes and appears consistent with increased striatal dopamine. The results may help us better understand and detect striatal dysfunction in psychosis risk.

From neuroimaging to daily functioning: A multimethod analysis of reward anticipation in people with schizophrenia

Negative symptoms are a core clinical feature of schizophrenia that are only marginally responsive to current treatments. Recent work suggests that deficits in reinforcement learning and anticipatory responses to reward may be two mechanisms that help explain impairments in motivation in those with schizophrenia. The present study utilized a reinforcement-learning paradigm, which allowed us to examine both reward anticipation and reinforcement learning. Twenty-eight people with schizophrenia and 30 healthy controls completed a reinforcement-learning task while undergoing functional MRI. Participants with schizophrenia also completed a weeklong ecological momentary assessment protocol reporting anticipated motivation and pleasure in their daily activities. Unexpectedly, we found no significant group differences in performance or neural response in reinforcement learning. However, we found that poorer reward learning was associated with greater clinician ratings of negative symptoms and daily reports of anticipatory motivation and pleasure negative symptoms. In regards to anticipatory responses, we found that people with schizophrenia showed blunted activation in the anterior cingulate, insula, caudate, and putamen while anticipating reward. Further, blood oxygen level-dependent (BOLD) response in reward related regions during anticipation of reward was significantly related to both clinician-rated motivation and pleasure deficits as well as daily reports of motivation and pleasure. Our results provide further evidence of deficits during reward anticipation in individuals with schizophrenia, particularly for those with severe negative symptoms, and some evidence for worse reward learning among those with greater negative symptoms. Moreover, our findings suggest that these deficits show important relationships with emotional and motivational functioning in everyday life. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Reduced Neural Sensitivity to Social vs Nonsocial Reward in Schizophrenia

BACKGROUND

Human beings find social stimuli rewarding, which is thought to facilitate efficient social functioning. Although reward processing has been extensively studied in schizophrenia, a few studies have examined neural processes specifically involved in social reward processing. This study examined neural sensitivity to social and nonsocial rewards in schizophrenia.

METHODS

Twenty-seven patients with schizophrenia and 25 community controls completed a One-Armed Bandit Task, an implicit reinforcement learning task, in the scanner. There were 2 conditions with an identical trial structure, one with social rewards and the other with nonsocial rewards. The data were analyzed using a region of interest (ROI) approach, focusing on the ventral striatum, ventromedial prefrontal cortex, and anterior cingulate cortex.

RESULTS

Across all 3 ROIs, patients showed reduced activation for social rewards compared to controls. However, the 2 groups showed comparable levels of activation for nonsocial rewards. Within the patient group, levels of neural activation in these ROIs during the social reward condition were associated with better performance.

CONCLUSIONS

This study found reduced neural sensitivity in patients with schizophrenia in key reward-processing regions for social but not for nonsocial rewards. These findings suggest a relatively specific social reward-processing deficit in schizophrenia during an implicit reinforcement learning task.

Dopamine Release in Antidepressant-Naive Major Depressive Disorder: A Multimodal [11C]-(+)-PHNO Positron Emission Tomography and Functional Magnetic Resonance Imaging Study

BACKGROUND

Mesolimbic dopamine system dysfunction is believed to contribute to major depressive disorder (MDD), but molecular neuroimaging of striatal dopamine neurotransmission has yielded mixed results, possibly owing to limited sensitivity of antagonist radioligands used with positron emission tomography to assess dopamine release capacity. This study used an agonist radioligand with agonist challenge to assess dopamine release capacity and D₂/D₃ receptor availability in MDD.

METHODS

Twenty-six treatment-naive adults with MDD and 26 healthy comparison participants underwent functional magnetic resonance imaging during a probabilistic reinforcement task, and positron emission tomography with the D₃-preferring ligand [¹¹C]-(+)-PHNO, before and after oral dextroamphetamine. MDD participants then received pramipexole treatment for 6 weeks.

RESULTS

MDD participants had trend-level greater dopamine release capacity in the ventral striatum, as measured by percent change in baseline binding potential relative to nondisplaceable compartment (ΔBP_ND) (-34% vs. -30%; p = .072, d = 0.58) but no difference in D₂/D₃ receptor availability (BP_ND). Striatal and extrastriatal BP_ND and percent change in baseline BP_ND were not significantly associated with blood oxygen level-dependent response to reward prediction error in the ventral striatum, severity of depression and anhedonia, or antidepressant response to pramipexole (response rate = 72.7%).

CONCLUSIONS

[¹¹C]-(+)-PHNO demonstrated high sensitivity to displacement by amphetamine-induced dopamine release, but dopamine release capacity and D₂/D₃ availability were not associated with ventral striatal activation to reward prediction error or clinical features, in this study powered to detect large effects. While a preponderance of indirect evidence implicates dopaminergic dysfunction in MDD, these findings suggest that presynaptic dopamine dysregulation may not be a feature of MDD or a prerequisite for treatment response to dopamine agonists.

Differential neural reward mechanisms in treatment-responsive and treatment-resistant schizophrenia

BACKGROUND

The significant proportion of schizophrenia patients refractory to treatment, primarily directed at the dopamine system, suggests that multiple mechanisms may underlie psychotic symptoms. Reinforcement learning tasks have been employed in schizophrenia to assess dopaminergic functioning and reward processing, but these have not directly compared groups of treatment-refractory and non-refractory patients.

METHODS

In the current functional magnetic resonance imaging study, 21 patients with treatment-resistant schizophrenia (TRS), 21 patients with non-treatment-resistant schizophrenia (NTR), and 24 healthy controls (HC) performed a probabilistic reinforcement learning task, utilizing emotionally valenced face stimuli which elicit a social bias toward happy faces. Behavior was characterized with a reinforcement learning model. Trial-wise reward prediction error (RPE)-related neural activation and the differential impact of emotional bias on these reward signals were compared between groups.

RESULTS

Patients showed impaired reinforcement learning relative to controls, while all groups demonstrated an emotional bias favoring happy faces. The pattern of RPE signaling was similar in the HC and TRS groups, whereas NTR patients showed significant attenuation of RPE-related activation in striatal, thalamic, precentral, parietal, and cerebellar regions. TRS patients, but not NTR patients, showed a positive relationship between emotional bias and RPE signal during negative feedback in bilateral thalamus and caudate.

CONCLUSION

TRS can be dissociated from NTR on the basis of a different neural mechanism underlying reinforcement learning. The data support the hypothesis that a favorable response to antipsychotic treatment is contingent on dopaminergic dysfunction, characterized by aberrant RPE signaling, whereas treatment resistance may be characterized by an abnormality of a non-dopaminergic mechanism - a glutamatergic mechanism would be a possible candidate.

Abnormal reward prediction-error signalling in antipsychotic naive individuals with first-episode psychosis or clinical risk for psychosis

Ongoing research suggests preliminary, though not entirely consistent, evidence of neural abnormalities in signalling prediction errors in schizophrenia. Supporting theories suggest mechanistic links between the disruption of these processes and the generation of psychotic symptoms. However, it is unknown at what stage in the pathogenesis of psychosis these impairments in prediction-error signalling develop. One major confound in prior studies is the use of medicated patients with strongly varying disease durations. Our study aims to investigate the involvement of the meso-cortico-striatal circuitry during reward prediction-error signalling in earliest stages of psychosis. We studied patients with first-episode psychosis (FEP) and help-seeking individuals at-risk for psychosis due to sub-threshold prodromal psychotic symptoms. Patients with either FEP (n = 14), or at-risk for developing psychosis (n = 30), and healthy volunteers (n = 39) performed a reinforcement learning task during fMRI scanning. ANOVA revealed significant (p < 0.05 family-wise error corrected) prediction-error signalling differences between groups in the dopaminergic midbrain and right middle frontal gyrus (dorsolateral prefrontal cortex, DLPFC). FEP patients showed disrupted reward prediction-error signalling compared to controls in both regions. At-risk patients showed intermediate activation in the midbrain that significantly differed from controls and from FEP patients, but DLPFC activation that did not differ from controls. Our study confirms that FEP patients have abnormal meso-cortical signalling of reward-prediction errors, whereas reward-prediction-error dysfunction in the at-risk patients appears to show a more nuanced pattern of activation with a degree of midbrain impairment but preserved cortical function.

Impaired Expected Value Computations Coupled With Overreliance on Stimulus-Response Learning in Schizophrenia

BACKGROUND

While many have emphasized impaired reward prediction error signaling in schizophrenia, multiple studies suggest that some decision-making deficits may arise from overreliance on stimulus-response systems together with a compromised ability to represent expected value. Guided by computational frameworks, we formulated and tested two scenarios in which maladaptive representations of expected value should be most evident, thereby delineating conditions that may evoke decision-making impairments in schizophrenia.

METHODS

In a modified reinforcement learning paradigm, 42 medicated people with schizophrenia and 36 healthy volunteers learned to select the most frequently rewarded option in a 75-25 pair: once when presented with a more deterministic (90-10) pair and once when presented with a more probabilistic (60-40) pair. Novel and old combinations of choice options were presented in a subsequent transfer phase. Computational modeling was employed to elucidate contributions from stimulus-response systems (actor-critic) and expected value (Q-learning).

RESULTS

People with schizophrenia showed robust performance impairments with increasing value difference between two competing options, which strongly correlated with decreased contributions from expected value-based learning (Q-learning). Moreover, a subtle yet consistent contextual choice bias for the probabilistic 75 option was present in people with schizophrenia, which could be accounted for by a context-dependent reward prediction error in the actor-critic.

CONCLUSIONS

We provide evidence that decision-making impairments in schizophrenia increase monotonically with demands placed on expected value computations. A contextual choice bias is consistent with overreliance on stimulus-response learning, which may signify a deficit secondary to the maladaptive representation of expected value. These results shed new light on conditions under which decision-making impairments may arise.

Meta-analytic evidence for altered mesolimbic responses to reward in schizophrenia

Dysfunction of reward-related neural circuitry in schizophrenia (SCZ) has been widely reported, and may provide insight into the motivational and cognitive disturbances that characterize the disorder. Although previous meta-analyses of reward learning paradigms in SCZ have been performed, a meta-analysis of whole-brain coordinate maps in SCZ alone has not been conducted. In this study, we performed an activation likelihood estimate (ALE) meta-analysis, and performed a follow-up analysis of functional connectivity and functional decoding of identified regions. We report several salient findings that extend prior work in this area. First, an alteration in reward-related activation was observed in the right ventral striatum, but this was not solely driven by hypoactivation in the SCZ group compared to healthy controls. Second, the region was characterized by functional connectivity primarily with the lateral prefrontal cortex and pre-supplementary motor area (preSMA), as well as subcortical regions such as the thalamus which show structural deficits in SCZ. Finally, although the meta-analysis showed no regions outside the ventral striatum to be significantly altered, regions with higher functional connectivity with the ventral striatum showed a greater number of subthreshold foci. Together, these findings confirm the alteration of ventral striatal function in SCZ, but suggest that a network-based approach may assist future analysis of the functional underpinnings of the disorder.

Evidence of absence: no relationship between behaviourally measured prediction error response and schizotypy

INTRODUCTION

The predictive processing framework has attracted much interest in the field of schizophrenia research in recent years, with an increasing number of studies also carried out in healthy individuals with nonclinical psychosis-like experiences. The current research adopted a continuum approach to psychosis and aimed to investigate different types of prediction error responses in relation to psychometrically defined schizotypy.

METHODS

One hundred and two healthy volunteers underwent a battery of behavioural tasks including (a) a force-matching task, (b) a Kamin blocking task, and (c) a reversal learning task together with three questionnaires measuring domains of schizotypy from different approaches.

RESULTS

Neither frequentist nor Bayesian statistical methods supported the notion that alterations in prediction error responses were related to schizotypal traits in any of the three tasks.

CONCLUSIONS

These null results suggest that deficits in predictive processing associated with clinical states of psychosis are not always present in healthy individuals with schizotypal traits.

Motivational Deficits in Schizophrenia Are Associated With Reduced Differentiation Between Gain and Loss-Avoidance Feedback in the Striatum

BACKGROUND

The current study was designed to test the hypothesis that motivational deficits in schizophrenia (SZ) are tied to a reduced ability to differentially signal gains and instances of loss-avoidance in the brain, leading to reduced ability to form adaptive representations of expected value.

METHODS

We administered a reinforcement learning paradigm to 27 medicated SZ patients and 27 control subjects in which participants learned three probabilistic discriminations. In regions of interest in reward networks identified a priori, we examined contrasts between trial types with different expected values (e.g., expected gain-nonmonetary) and between outcomes with the same prediction error valence but different experienced values (e.g., gain-loss-avoidance outcome, miss-loss outcome).

RESULTS

Both whole-brain and region of interest analyses revealed that SZ patients showed reduced differentiation between gain and loss-avoidance outcomes in the dorsal anterior cingulate cortex and bilateral anterior insula. That is, SZ patients showed reduced contrasts between positive prediction errors of different objective values in these areas. In addition, we observed significant correlations between gain-loss-avoidance outcome contrasts in the ventral striatum and ratings for avolition/anhedonia and between expected gain-nonmonetary contrasts in the ventral striatum and ventromedial prefrontal cortex.

CONCLUSIONS

These results provide further evidence for intact prediction error signaling in medicated SZ patients, especially with regard to loss-avoidance. By contrast, components of frontostriatal circuits appear to show reduced sensitivity to the absolute valence of expected and experienced outcomes, suggesting a mechanism by which motivational deficits may emerge.

Intact Ventral Striatal Prediction Error Signaling in Medicated Schizophrenia Patients

BACKGROUND

Midbrain dopaminergic neurons code a computational quantity, reward prediction error (RPE), which has been causally related to learning. Recently, this insight has been leveraged to link phenomenological and biological levels of understanding in psychiatric disorders, such as schizophrenia. However, results have been mixed, possibly due to small sample sizes. Here we present results from two studies with relatively large Ns to assess VS RPE in schizophrenia.

METHODS

In the current study we analyzed data from two independent studies, involving a total of 87 chronic medicated schizophrenia patients and 61 controls. Subjects completed a probabilistic reinforcement-learning task in conjunction with fMRI scanning. We fit each participant's choice behavior to a Q-learning model and derived trial-wise RPEs. We then modeled BOLD signal data with parametric regressor functions using these values to determine whether patient and control groups differed in prediction-error-related BOLD signal modulations.

RESULTS

Both groups demonstrated robust VS RPE BOLD activations. Interestingly, these BOLD activation patterns did not differ between groups in either study. This was true when we included all participants in the analysis, as well as when we excluded participants whose data was not sufficiently fit by the models.

CONCLUSIONS

These data demonstrate the utility of computational methods in isolating/testing underlying mechanisms of interest in psychiatric disorders. Importantly, similar VS RPE signal encoding across groups suggests that this mechanism does not drive task deficits in these patients. Deficits may instead stem from aberrant prefrontal/parietal circuits associated with maintenance and selection of goal-relevant information.