Mild Reinforcement Learning Deficits in Patients With First-Episode Psychosis

Associative learning and facial expression recognition in schizophrenic patients: Effects of social presence

Schizophrenia (SCZ) is a psychiatric disorder that alters both general and social cognition. However, the exact mechanisms that are altered remain to be elucidated. In this study, we investigated associative learning (AL) and facial expression recognition (FER) in the same patients, using emotional expressions and abstract images. Our main aim was to investigate how these cognitive abilities are affected by SCZ and to assess the role of mere social presence, a factor that has not been considered before. The study compared the behavioral performance of 60 treated outpatients with SCZ and 103 demographically matched healthy volunteers. In the AL task, participants had to associate abstract images or facial expressions with key presses, guided by feedback on each trial. In the FER task, they had to report whether two successively presented facial expressions were the same or different. All participants performed the two tasks under two social context conditions: alone or in the presence of a passive but attentive audience. The results showed a severe learning impairment in patients compared to controls, with a slight advantage for facial expressions compared to abstract images, and a gender-dependent effect of social presence. In contrast, facial expression recognition was partially spared in patients and facilitated by social presence. We conclude that cognitive abilities are impaired in patients with SCZ, but their investigation needs to take into account the social context in which they are assessed.

Reversal learning in those with early psychosis features contingency-dependent changes in loss response and learning

INTRODUCTION

People with psychotic disorders commonly feature broad decision-making impairments that impact their functional outcomes. Specific associative/reinforcement learning problems have been demonstrated in persistent psychosis. But these phenotypes may differ in early psychosis, suggesting that aspects of cognition decline over time.

METHODS

The present proof-of-concept study examined goal-directed action and reversal learning in controls and those with early psychosis.

RESULTS

Equivalent performance was observed between groups during outcome-specific devaluation, and reversal learning at an 80:20 contingency (reward probability for high:low targets). But when the low target reward probability was increased (80:40) those with early psychosis altered their response to loss, whereas controls did not. Computational modelling confirmed that in early psychosis there was a change in punishment learning that increased the chance of staying with the same stimulus after a loss, multiple trials into the future. In early psychosis, the magnitude of this response was greatest in those with higher IQ and lower clinical severity scores.

CONCLUSIONS

We show preliminary evidence that those with early psychosis present with a phenotype that includes altered responding to loss and hyper-adaptability in response to outcome changes. This may reflect a compensatory response to overcome the milieu of corticostriatal changes associated with psychotic disorders.

Emotion-behaviour decoupling and experiential pleasure deficits predict negative symptoms and functional outcome in first-episode schizophrenia patients

BACKGROUND

Emotion-behaviour decoupling refers to the failure to translate emotion into motivated behaviour, and is a putative marker for schizophrenia. The heterogeneity of experiential pleasure and emotion expressivity deficits has been reported in schizophrenia patients. These three constructs are believed to contribute to negative symptoms, but very few studies have examined their predictive ability for clinical and functional outcome of schizophrenia. This study aimed to clarify whether these three constructs influence clinical and functional outcome of schizophrenia.

METHOD

At baseline, 127 first-episode schizophrenia patients completed a behavioural paradigm for emotion-behaviour decoupling, and self-report scales for experiential pleasure and emotion expressivity deficits. Cluster-analysis was applied to characterize schizophrenia subgroups based on these three constructs. At end-point (mean follow-up = 5.37 years, SD = 1.03 years), 85 schizophrenia patients were reassessed using the Clinical Assessment Interview for Negative Symptoms (CAINS) and a clinician-rated social functioning scale.

RESULTS

Cluster 1 (n = 74) did not show emotion-behaviour decoupling, and had intact experiential pleasure and emotion expressivity. Cluster 2 (n = 29) showed emotion-behaviour decoupling and experiential pleasure deficits. Cluster 3 (n = 24) showed emotion expressivity deficits. At endpoint, the three clusters differed significantly in CAINS MAP factor (p = 0.016) and social functioning (p = 0.019), but not CAINS EXP factor. Specifically, Cluster 2 (n = 18) showed more severe negative symptoms of CAINS MAP factor (p = 0.046) and poorer social functioning (p = 0.022) than Cluster 1 (n = 49). Cluster 3 (n = 18) did not differ from Cluster 1 and Cluster 2 in negative symptoms and social functioning.

DISCUSSION

Emotion-behaviour decoupling and experiential pleasure deficits predicted clinical and functional outcome of schizophrenia.

Reinforcement learning deficits exhibited by postnatal PCP-treated rats enable deep neural network classification

The ability to appropriately update the value of a given action is a critical component of flexible decision making. Several psychiatric disorders, including schizophrenia, are associated with impairments in flexible decision making that can be evaluated using the probabilistic reversal learning (PRL) task. The PRL task has been reverse-translated for use in rodents. Disrupting glutamate neurotransmission during early postnatal neurodevelopment in rodents has induced behavioral, cognitive, and neuropathophysiological abnormalities relevant to schizophrenia. Here, we tested the hypothesis that using the NMDA receptor antagonist phencyclidine (PCP) to disrupt postnatal glutamatergic transmission in rats would lead to impaired decision making in the PRL. Consistent with this hypothesis, compared to controls the postnatal PCP-treated rats completed fewer reversals and exhibited disruptions in reward and punishment sensitivity (i.e., win-stay and lose-shift responding, respectively). Moreover, computational analysis of behavior revealed that postnatal PCP-treatment resulted in a pronounced impairment in the learning rate throughout PRL testing. Finally, a deep neural network (DNN) trained on the rodent behavior could accurately predict the treatment group of subjects. These data demonstrate that disrupting early postnatal glutamatergic neurotransmission impairs flexible decision making and provides evidence that DNNs can be trained on behavioral datasets to accurately predict the treatment group of new subjects, highlighting the potential for DNNs to aid in the diagnosis of schizophrenia.

Neural substrates of reward anticipation and outcome in schizophrenia: a meta-analysis of fMRI findings in the monetary incentive delay task

Dysfunction of the mesocorticolimbic dopaminergic reward system is a core feature of schizophrenia (SZ), yet its precise contributions to different stages of reward processing and their relevance to disease symptomology are not fully understood. We performed a coordinate-based meta-analysis, using the monetary incentive delay task, to identify which brain regions are implicated in different reward phases in functional magnetic resonance imaging in SZ. A total of 17 studies (368 SZ and 428 controls) were included in the reward anticipation, and 10 studies (229 SZ and 281 controls) were included in the reward outcome. Our meta-analysis revealed that during anticipation, patients showed hypoactivation in the striatum, anterior cingulate cortex, median cingulate cortex (MCC), amygdala, precentral gyrus, and superior temporal gyrus compared with controls. Striatum hypoactivation was negatively associated with negative symptoms and positively associated with the proportion of second-generation antipsychotic users (percentage of SGA users). During outcome, patients displayed hyperactivation in the striatum, insula, amygdala, hippocampus, parahippocampal gyrus, cerebellum, postcentral gyrus, and MCC, and hypoactivation in the dorsolateral prefrontal cortex (DLPFC) and medial prefrontal cortex (mPFC). Hypoactivity of mPFC during outcome was negatively associated with positive symptoms. Moderator analysis showed that the percentage of SGA users was a significant moderator of the association between symptom severity and brain activity in both the anticipation and outcome stages. Our findings identified the neural substrates for different reward phases in SZ and may help explain the neuropathological mechanisms underlying reward processing deficits in the disorder.

Impaired Effort Allocation in Patients with Recent-Onset Schizophrenia and Its Relevance to Negative Symptoms Assessments and Persistent Negative Symptoms

(1) Background: Our aims in this study were (i) to compare effort allocation capacity measured between patients with recent-onset schizophrenia (SCZ) and healthy controls (HCs), (ii) within the SCZ, to investigate the association of effort allocation capacity with negative symptoms (NS), and (iii) to compare this association with the type of NS scale used. (2) Methods: Thirty-one patients with SCZ and 30 HCs participated in the study. The NS was examined using an older-generation (Scale for the Assessment of Negative Symptoms, SANS), a newer-generation (Brief Negative Symptoms Scale, BNSS), and a self-rated (Self-evaluation of Negative Symptoms Scale, SNS) negative symptom scale, as well as longitudinally by using persistent NS (PNS) distinction. (3) Results: The SCZ group was less willing to expend effort in high/moderate-probability and -magnitude conditions but more in low-probability and -magnitude conditions. A general reduction in effort allocation capacity was also present. Patients with PNS were less likely to choose hard tasks than non-PNS patients. Clinician-rated scales correlated with 50% probability and moderate-reward-magnitude conditions. Correlations with the SNS were minimal. (4) Conclusions: Our findings suggest that patients with SCZ may show a general reduction in effort allocation capacity and make inefficient choices, although they are not totally reward-insensitive. The effects of NS on effort expenditure can be more pronounced when the rewarding stimulus is vague.

Both unmedicated and medicated individuals with schizophrenia show impairments across a wide array of cognitive and reinforcement learning tasks

BACKGROUND

Schizophrenia is a disorder characterized by pervasive deficits in cognitive functioning. However, few well-powered studies have examined the degree to which cognitive performance is impaired even among individuals with schizophrenia not currently on antipsychotic medications using a wide range of cognitive and reinforcement learning measures derived from cognitive neuroscience. Such research is particularly needed in the domain of reinforcement learning, given the central role of dopamine in reinforcement learning, and the potential impact of antipsychotic medications on dopamine function.

METHODS

The present study sought to fill this gap by examining healthy controls (N = 75), unmedicated (N = 48) and medicated (N = 148) individuals with schizophrenia. Participants were recruited across five sites as part of the CNTRaCS Consortium to complete tasks assessing processing speed, cognitive control, working memory, verbal learning, relational encoding and retrieval, visual integration and reinforcement learning.

RESULTS

Individuals with schizophrenia who were not taking antipsychotic medications, as well as those taking antipsychotic medications, showed pervasive deficits across cognitive domains including reinforcement learning, processing speed, cognitive control, working memory, verbal learning and relational encoding and retrieval. Further, we found that chlorpromazine equivalency rates were significantly related to processing speed and working memory, while there were no significant relationships between anticholinergic load and performance on other tasks.

CONCLUSIONS

These findings add to a body of literature suggesting that cognitive deficits are an enduring aspect of schizophrenia, present in those off antipsychotic medications as well as those taking antipsychotic medications.

Reduced learning bias towards the reward context in medication-naive first-episode schizophrenia patients

BACKGROUND

Reinforcement learning has been proposed to contribute to the development of amotivation in individuals with schizophrenia (SZ). Accumulating evidence suggests dysfunctional learning in individuals with SZ in Go/NoGo learning and expected value representation. However, previous findings might have been confounded by the effects of antipsychotic exposure. Moreover, reinforcement learning also rely on the learning context. Few studies have examined the learning performance in reward and loss-avoidance context separately in medication-naïve individuals with first-episode SZ. This study aimed to explore the behaviour profile of reinforcement learning performance in medication-naïve individuals with first-episode SZ, including the contextual performance, the Go/NoGo learning and the expected value representation performance.

METHODS

Twenty-nine medication-naïve individuals with first-episode SZ and 40 healthy controls (HCs) who have no significant difference in age and gender, completed the Gain and Loss Avoidance Task, a reinforcement learning task involving stimulus pairs presented in both the reward and loss-avoidance context. We assessed the group difference in accuracy in the reward and loss-avoidance context, the Go/NoGo learning and the expected value representation. The correlations between learning performance and the negative symptom severity were examined.

RESULTS

Individuals with SZ showed significantly lower accuracy when learning under the reward than the loss-avoidance context as compared to HCs. The accuracies under the reward context (90%win- 10%win) in the Acquisition phase was significantly and negatively correlated with the Scale for the Assessment of Negative Symptoms (SANS) avolition scores in individuals with SZ. On the other hand, individuals with SZ showed spared ability of Go/NoGo learning and expected value representation.

CONCLUSIONS

Despite our small sample size and relatively modest findings, our results suggest possible reduced learning bias towards reward context among medication-naïve individuals with first-episode SZ. The reward learning performance was correlated with amotivation symptoms. This finding may facilitate our understanding of the underlying mechanism of negative symptoms. Reinforcement learning performance under the reward context may be important to better predict and prevent the development of schizophrenia patients' negative symptom, especially amotivation.

Mechanisms Underlying Motivational Dysfunction in Schizophrenia

Negative symptoms are a debilitating feature of schizophrenia which are often resistant to pharmacological intervention. The mechanisms underlying them remain poorly understood, and diagnostic methods rely on phenotyping through validated questionnaires. Deeper endo-phenotyping is likely to be necessary in order to improve current understanding. In the last decade, valuable behavioural insights have been gained through the use of effort-based decision making (EBDM) tasks. These have highlighted impairments in reward-related processing in schizophrenia, particularly associated with negative symptom severity. Neuroimaging investigations have related these changes to dysfunction within specific brain networks including the ventral striatum (VS) and frontal brain regions. Here, we review the behavioural and neural evidence associated with negative symptoms, shedding light on potential underlying mechanisms and future therapeutic possibilities. Findings in the literature suggest that schizophrenia is characterised by impaired reward based learning and action selection, despite preserved hedonic responses. Associations between amotivation and reward-processing deficits have not always been clear, and may be mediated by factors including cognitive dysfunction or dysfunctional or self-defeatist beliefs. Successful endo-phenotyping of negative symptoms as a function of objective behavioural and neural measurements is crucial in advancing our understanding of this complex syndrome. Additionally, transdiagnostic research–leveraging findings from other brain disorders, including neurological ones–can shed valuable light on the possible common origins of motivation disorders across diseases and has important implications for future treatment development.

Altered risky decision making in patients with early non-affective psychosis

Abnormal risky decision making may represent an important factor contributing to functional impairment in psychotic disorders. Previous research revealed impaired decision making under risk in patients with chronic schizophrenia. However, risky decision making is under-studied in the early course of illness. We examined risky decision making in 33 patients with early non-affective psychosis and 32 demographically matched controls, using two well-validated experimental paradigms, balloon analogue risk task (BART) and Risky-Gains task (RGT), which modeled and assessed actual risk-taking behaviors in deliberative and time-pressured decision-making situations, respectively. Our results showed that patients exhibited suboptimal decision making on the BART and were more risk averse than controls by having fewer average balloon pumps in non-burst trials, lower explosion rate and lower total points gained. On the RGT, patients also behaved more conservatively than controls, with lower overall rate in choosing the risky option. Intriguingly, patients performed comparably to controls in adjusting risk-taking pattern following punished trials, suggesting relatively preserved sensitivity to punishment in early psychosis. Risk-taking measures showed no significant correlations with any symptom dimensions, impulsivity traits, cognitive functions or antipsychotic treatment after correcting for multiple comparisons. This study is the first to investigate risk-taking propensity in early psychosis based on BART/RGT performance, and consistently indicate that patients with early psychosis displayed altered risky decision making with increased risk aversion relative to healthy participants. Further investigation is warranted to clarify the longitudinal course of aberrant risky decision making and its relationship with functional outcome in early psychosis.

Decision making under ambiguity and risk in adolescent-onset schizophrenia

OBJECTIVE

Numerous studies have identified impaired decision making (DM) under both ambiguity and risk in adult patients with schizophrenia. However, the assessment of DM in patients with adolescent-onset schizophrenia (AOS) has been challenging as a result of the instability and heterogeneity of manifestations. The Iowa Gambling Task (IGT) and Game of Dice Task (GDT), which are frequently used to evaluate DM respectively under ambiguity and risk, are sensitive to adolescents and neuropsychiatric patients. Our research intended to examine the performance of DM in a relatively large sample of patients with AOS using the above-mentioned two tasks. We also aimed to take a closer look at the relationship between DM and symptom severity of schizophrenia.

METHODS

We compared the performance of DM in 71 patients with AOS and 53 well-matched healthy controls using IGT for DM under ambiguity and GDT for DM under risk through net scores, total scores and feedback ration. Neuropsychological tests were conducted in all participants. Clinical symptoms were evaluated by using Positive and Negative Syndrome Scale (PANSS) in 71 patients with AOS. Pearson's correlation revealed the relationship among total score of DM and clinical and neuropsychological data.

RESULTS

Compared to healthy controls, patients with AOS failed to show learning effect and had a significant difference on the 5th block in IGT and conducted more disadvantageous choices as well as exhibited worse negative feedback rate in GDT. Apart from DM impairment under risk, diminished DM abilities under ambiguity were found related to poor executive function in AOS in the present study.

CONCLUSIONS

Our findings unveiled the abnormal pattern of DM in AOS, mainly reflected under the risky condition, extending the knowledge on the performance of DM under ambiguity and risk in AOS. Inefficient DM under risk may account for the lagging impulse control and the combined effects of developmental disease. In addition, our study demonstrated that the performance on IGT was related to executive function in AOS.

Reliability and Replicability of Implicit and Explicit Reinforcement Learning Paradigms in People With Psychotic Disorders

BACKGROUND

Motivational deficits in people with psychosis may be a result of impairments in reinforcement learning (RL). Therefore, behavioral paradigms that can accurately measure these impairments and their change over time are essential.

METHODS

We examined the reliability and replicability of 2 RL paradigms (1 implicit and 1 explicit, each with positive and negative reinforcement components) given at 2 time points to healthy controls (n = 75), and people with bipolar disorder (n = 62), schizoaffective disorder (n = 60), and schizophrenia (n = 68).

RESULTS

Internal consistency was acceptable (mean α = 0.78 ± 0.15), but test-retest reliability was fair to low (mean intraclass correlation = 0.33 ± 0.25) for both implicit and explicit RL. There were no clear effects of practice for these tasks. Largely, performance on these tasks shows intact implicit and impaired explicit RL in psychosis. Symptom presentation did not relate to performance in any robust way.

CONCLUSIONS

Our findings replicate previous literature showing spared implicit RL and impaired explicit reinforcement in psychosis. This suggests typical basal ganglia dopamine release, but atypical recruitment of the orbitofrontal and dorsolateral prefrontal cortices. However, we found that these tasks have only fair to low test-retest reliability and thus may not be useful for assessing change over time in clinical trials.

Neural Abnormalities in Fear Generalization in Schizophrenia and Associations With Negative Symptoms

BACKGROUND

Associative learning and memory processes, including the generalization of previously learned associations, may be altered in schizophrenia. Deficits in schizophrenia in stimulus generalization, one of the simplest forms of memory, could interfere with the ability to efficiently categorize related, similar information, potentially leading to impairments in daily functioning.

METHODS

To measure generalization in schizophrenia, 37 individuals with a nonaffective psychotic disorder and 32 demographically matched healthy control subjects underwent a Pavlovian fear conditioning and generalization procedure, which accounted for variation in perceptual ability across participants, while undergoing functional magnetic resonance imaging. Skin conductance and neural responses to conditioned (CS+), neutral (CS-), and generalization stimuli were measured. Explicit memory ratings reflecting successful generalization were also collected after the scanning, as well as measures of symptom severity.

RESULTS

Compared with healthy control subjects, individuals with nonaffective psychotic disorders showed significant deficits in fear generalization across multiple measurements, with impairments in memory ratings and reductions in activation and deactivation of the salience and default networks, respectively, during fear generalization. Moreover, in the psychotic disorder group, greater behavioral and neural abnormalities in generalization were associated with higher levels of negative symptoms.

CONCLUSIONS

Fear generalization is impaired in psychotic illness. Given that successful generalization relies on a dynamic balance between excitatory and inhibitory neurotransmission, these results reveal a potentially quantifiable mechanism linked to negative symptoms that can be investigated further in future human and experimental animal studies.

Inter-relationships among psychopathology, premorbid adjustment, cognition and psychosocial functioning in first-episode psychosis: a network analysis approach

BACKGROUND

Better understanding of interplay among symptoms, cognition and functioning in first-episode psychosis (FEP) is crucial to promoting functional recovery. Network analysis is a promising data-driven approach to elucidating complex interactions among psychopathological variables in psychosis, but has not been applied in FEP.

METHOD

This study employed network analysis to examine inter-relationships among a wide array of variables encompassing psychopathology, premorbid and onset characteristics, cognition, subjective quality-of-life and psychosocial functioning in 323 adult FEP patients in Hong Kong. Graphical Least Absolute Shrinkage and Selection Operator (LASSO) combined with extended Bayesian information criterion (BIC) model selection was used for network construction. Importance of individual nodes in a generated network was quantified by centrality analyses.

RESULTS

Our results showed that amotivation played the most central role and had the strongest associations with other variables in the network, as indexed by node strength. Amotivation and diminished expression displayed differential relationships with other nodes, supporting the validity of two-factor negative symptom structure. Psychosocial functioning was most strongly connected with amotivation and was weakly linked to several other variables. Within cognitive domain, digit span demonstrated the highest centrality and was connected with most of the other cognitive variables. Exploratory analysis revealed no significant gender differences in network structure and global strength.

CONCLUSION

Our results suggest the pivotal role of amotivation in psychopathology network of FEP and indicate its critical association with psychosocial functioning. Further research is required to verify the clinical significance of diminished motivation on functional outcome in the early course of psychotic illness.

Reinforcement learning as an intermediate phenotype in psychosis? Deficits sensitive to illness stage but not associated with polygenic risk of schizophrenia in the general population

BACKGROUND

Schizophrenia is a complex disorder in which the causal relations between risk genes and observed clinical symptoms are not well understood and the explanatory gap is too wide to be clarified without considering an intermediary level. Thus, we aimed to test the hypothesis of a pathway from molecular polygenic influence to clinical presentation occurring via deficits in reinforcement learning.

METHODS

We administered a reinforcement learning task (Go/NoGo) that measures reinforcement learning and the effect of Pavlovian bias on decision making. We modelled the behavioural data with a hierarchical Bayesian approach (hBayesDM) to decompose task performance into its underlying learning mechanisms. Study 1 included controls (n = 29, F|M = 0.81), At Risk Mental State for psychosis (ARMS, n = 23, F|M = 0.35) and FEP (First-episode psychosis, n = 26, F|M = 0.18). Study 2 included healthy adolescents (n = 735, F|M = 1.06), 390 of whom had their polygenic risk scores for schizophrenia (PRSs) calculated.

RESULTS

Patients with FEP showed significant impairments in overriding Pavlovian conflict, a lower learning rate and a lower sensitivity to both reward and punishment. Less widespread deficits were observed in ARMS. PRSs did not significantly predict performance on the task in the general population, which only partially correlated with measures of psychopathology.

CONCLUSIONS

Reinforcement learning deficits are observed in first episode psychosis and, to some extent, in those at clinical risk for psychosis, and were not predicted by molecular genetic risk for schizophrenia in healthy individuals. The study does not support the role of reinforcement learning as an intermediate phenotype in psychosis.

Revisiting anticipatory hedonic processing in patients with schizophrenia: An examination between representation activation and maintenance

BACKGROUND

Anticipatory anhedonia is one of the key deficits found in patients with schizophrenia (SCZ). However, the underlying mechanism of this deficit remains unclear. The present study examined whether representation activation and maintenance capacity influenced anticipatory experiences in SCZ patients.

METHODS

We recruited 46 SCZ patients (26 males) and 45 matched healthy controls (24 males). The Reward Representation Activation and Maintenance (RRAM) Task was administrated to assess anticipatory experience and representation activation and maintenance capacity.

RESULTS

SCZ patients exhibited lower subjective arousal than controls in anticipation of rewards with high probability when representation activation and maintenance were difficult to accomplish. SCZ patients also tended to reduce their button presses more than HC when they were required to maintain reward representation.

CONCLUSIONS

Our findings suggest that representation activation and maintenance may partially account for anticipatory anhedonia observed in SCZ patients.

Effort-based decision-making impairment in patients with clinically-stabilized first-episode psychosis and its relationship with amotivation and psychosocial functioning

Effort-based decision-making has recently been proposed as a potential mechanism contributing to motivational deficits (amotivation) in psychotic disorder. Previous research has identified altered effort allocation in chronic schizophrenia, but produced mixed results regarding its relationship with amotivation. No study has investigated effort allocation in first-episode psychosis (FEP). We examined effort-based decision-making in 45 clinically-stabilized FEP patients and 45 demographically-matched controls, using Effort-Expenditure for Reward Task (EEfRT) which measures allocation of physical effort for monetary reward at varying magnitude and probability levels. Our results showed that FEP patients did not demonstrate overall reduction in effort expenditure but displayed reduced willingness to expend effort for high-value/high-probability reward as compared to controls. In particular, such selective effort-related impairment was most pronounced in patients with high levels of amotivation. Furthermore, reduced allocation of greater effort for higher probability reward was related to poorer psychosocial functioning. Decreased effort exertion was generally unrelated to other symptom dimensions, self-report anhedonia, antipsychotic dose and cognitive deficits. This study thus provides the first evidence of effort-based decision-making impairment in FEP, and indicates that first-episode patients were not generally effort-averse but exhibited inefficient effort allocation by failing to make high-effort choices to maximize reward receipt. Our findings affirm the critical role of amotivation on aberrant effort allocation, and support the link between laboratory-based effort-cost measures and real-world psychosocial functioning in medicated FEP. Further longitudinal research is required to clarify trajectory of suboptimal effort allocation and its potential utility in predicting amotivation and functional outcomes in the early course of illness.

Reward-driven decision-making impairments in schizophrenia

The ability to use feedback to guide optimal decision-making is essential for goal-directed behaviour. While impairments in feedback-driven decision-making have been associated with schizophrenia and depression, this has been examined primarily in the context of binary probabilistic choice paradigms. In real-world decision-making, however, individuals must make choices when there are more than two competing options that vary in the frequency and magnitude of potential rewards and losses. Thus, the current study examined win-stay/lose-shift (WSLS) behaviour on the Iowa Gambling Task (IGT) in order to evaluate the influence of immediate rewards and losses in guiding real-world decision-making in patients with schizophrenia and major depressive disorder. Fifty-one patients with schizophrenia, 43 patients with major depressive disorder, and 51 healthy controls completed the IGT, as well as a series of clinical and cognitive measures. WSLS was assessed by quantifying trial-by-trial behaviour following rewards and losses on the IGT. Multivariate analyses of variance revealed that patients with schizophrenia demonstrated intact lose-shift behaviour, but significantly reduced win-stay rates compared to healthy controls. In contrast, no WSLS impairments emerged in the depressed group. Win-stay impairments in the schizophrenia group were significantly related to deficits in motivation and cognition. Patients with schizophrenia exhibit impaired reward-driven decision-making in the context of multiple choices with concurrent rewards and losses, and this appears to be driven by a reduced propensity for advantageous win-stay behaviour. With the importance of reward learning and decision-making in generating goal-directed behaviour, these findings suggest a potential mechanism contributing to the motivation deficits seen in schizophrenia.

Differential neural reward mechanisms in treatment-responsive and treatment-resistant schizophrenia

BACKGROUND

The significant proportion of schizophrenia patients refractory to treatment, primarily directed at the dopamine system, suggests that multiple mechanisms may underlie psychotic symptoms. Reinforcement learning tasks have been employed in schizophrenia to assess dopaminergic functioning and reward processing, but these have not directly compared groups of treatment-refractory and non-refractory patients.

METHODS

In the current functional magnetic resonance imaging study, 21 patients with treatment-resistant schizophrenia (TRS), 21 patients with non-treatment-resistant schizophrenia (NTR), and 24 healthy controls (HC) performed a probabilistic reinforcement learning task, utilizing emotionally valenced face stimuli which elicit a social bias toward happy faces. Behavior was characterized with a reinforcement learning model. Trial-wise reward prediction error (RPE)-related neural activation and the differential impact of emotional bias on these reward signals were compared between groups.

RESULTS

Patients showed impaired reinforcement learning relative to controls, while all groups demonstrated an emotional bias favoring happy faces. The pattern of RPE signaling was similar in the HC and TRS groups, whereas NTR patients showed significant attenuation of RPE-related activation in striatal, thalamic, precentral, parietal, and cerebellar regions. TRS patients, but not NTR patients, showed a positive relationship between emotional bias and RPE signal during negative feedback in bilateral thalamus and caudate.

CONCLUSION

TRS can be dissociated from NTR on the basis of a different neural mechanism underlying reinforcement learning. The data support the hypothesis that a favorable response to antipsychotic treatment is contingent on dopaminergic dysfunction, characterized by aberrant RPE signaling, whereas treatment resistance may be characterized by an abnormality of a non-dopaminergic mechanism - a glutamatergic mechanism would be a possible candidate.

Impaired Expected Value Computations Coupled With Overreliance on Stimulus-Response Learning in Schizophrenia

BACKGROUND

While many have emphasized impaired reward prediction error signaling in schizophrenia, multiple studies suggest that some decision-making deficits may arise from overreliance on stimulus-response systems together with a compromised ability to represent expected value. Guided by computational frameworks, we formulated and tested two scenarios in which maladaptive representations of expected value should be most evident, thereby delineating conditions that may evoke decision-making impairments in schizophrenia.

METHODS

In a modified reinforcement learning paradigm, 42 medicated people with schizophrenia and 36 healthy volunteers learned to select the most frequently rewarded option in a 75-25 pair: once when presented with a more deterministic (90-10) pair and once when presented with a more probabilistic (60-40) pair. Novel and old combinations of choice options were presented in a subsequent transfer phase. Computational modeling was employed to elucidate contributions from stimulus-response systems (actor-critic) and expected value (Q-learning).

RESULTS

People with schizophrenia showed robust performance impairments with increasing value difference between two competing options, which strongly correlated with decreased contributions from expected value-based learning (Q-learning). Moreover, a subtle yet consistent contextual choice bias for the probabilistic 75 option was present in people with schizophrenia, which could be accounted for by a context-dependent reward prediction error in the actor-critic.

CONCLUSIONS

We provide evidence that decision-making impairments in schizophrenia increase monotonically with demands placed on expected value computations. A contextual choice bias is consistent with overreliance on stimulus-response learning, which may signify a deficit secondary to the maladaptive representation of expected value. These results shed new light on conditions under which decision-making impairments may arise.

Social motivation in people with recent-onset schizophrenia spectrum disorders

People with schizophrenia-spectrum disorders (SSD) often experience impairments in non-social motivation. In this study, we extended this line of investigation by examining specific components of social motivation and the extent to which these components work together in people with and without a recent-onset SSD. Sixty-four people with a recent-onset SSD and 26 controls completed a task that allowed us to examine changes in anticipated pleasure, decisions to trust, and effort expenditure over the course of repeated interactions with positive or negative outcomes. Compared to controls, we found that people in the SSD group placed less trust, tended to anticipate less pleasure, and expended less effort to increase the likelihood of future interactions with positive outcomes. Further, in the SSD group, effort expenditure was not associated with either anticipated pleasure or decisions to trust. While there were no group differences in anticipated pleasure or trust placed during interactions with negative outcomes, people in the SSD group expended less effort to decrease to the likelihood of future interactions. Taken together, our findings suggest that people with a recent-onset SSD may experience both impairment and disconnection between various components of social motivation for interactions with positive outcomes. Implications for interventions for social engagement in people with SSD are discussed.

A Transdiagnostic Review of Negative Symptom Phenomenology and Etiology

In the DSM5, negative symptoms are 1 of the 5 core dimensions of psychopathology evaluated for schizophrenia. However, negative symptoms are not pathognomonic-they are also part of the diagnostic criteria for other schizophrenia-spectrum disorders, disorders that sometimes have comorbid psychosis, diagnoses not in the schizophrenia-spectrum, and the general "nonclinical" population. Although etiological models of negative symptoms have been developed for chronic schizophrenia, there has been little attention given to whether these models have transdiagnostic applicability. In the current review, we examine areas of commonality and divergence in the clinical presentation and etiology of negative symptoms across diagnostic categories. It was concluded that negative symptoms are relatively frequent across diagnostic categories, but individual disorders may differ in whether their negative symptoms are persistent/transient or primary/secondary. Evidence for separate dimensions of volitional and expressive symptoms exists, and there may be multiple mechanistic pathways to the same symptom phenomenon among DSM-5 disorders within and outside the schizophrenia-spectrum (ie, equifinality). Evidence for a novel transdiagnostic etiological model is presented based on the Research Domain Criteria (RDoC) constructs, which proposes the existence of 2 such pathways-a hedonic pathway and a cognitive pathway-that can both lead to expressive or volitional symptoms. To facilitate treatment breakthroughs, future transdiagnostic studies on negative symptoms are warranted that explore mechanisms underlying volitional and expressive pathology.

Relationship of amotivation to neurocognition, self-efficacy and functioning in first-episode psychosis: a structural equation modeling approach

BACKGROUND

Better understanding of the complex interplay among key determinants of functional outcome is crucial to promoting recovery in psychotic disorders. However, this is understudied in the early course of illness. We aimed to examine the relationships among negative symptoms, neurocognition, general self-efficacy and global functioning in first-episode psychosis (FEP) patients using structural equation modeling (SEM).

METHOD

Three hundred and twenty-one Chinese patients aged 26-55 years presenting with FEP to an early intervention program in Hong Kong were recruited. Assessments encompassing symptom profiles, functioning, perceived general self-efficacy and a battery of neurocognitive tests were conducted. Negative symptom measurement was subdivided into amotivation and diminished expression (DE) domain scores based on the ratings in the Scale for the Assessment of Negative Symptoms.

RESULTS

An initial SEM model showed no significant association between functioning and DE which was removed from further analysis. A final trimmed model yielded very good model fit (χ2 = 15.48, p = 0.63; comparative fit index = 1.00; root mean square error of approximation <0.001) and demonstrated that amotivation, neurocognition and general self-efficacy had a direct effect on global functioning. Amotivation was also found to mediate a significant indirect effect of neurocognition and general self-efficacy on functioning. Neurocognition was not significantly related to general self-efficacy.

CONCLUSION

Our results indicate a critical intermediary role of amotivation in linking neurocognitive impairment to functioning in FEP. General self-efficacy may represent a promising treatment target for improvement of motivational deficits and functional outcome in the early illness stage.

Deficits in reinforcement learning but no link to apathy in patients with schizophrenia

Negative symptoms in schizophrenia have been linked to selective reinforcement learning deficits in the context of gains combined with intact loss-avoidance learning. Fundamental mechanisms of reinforcement learning and choice are prediction error signaling and the precise representation of reward value for future decisions. It is unclear which of these mechanisms contribute to the impairments in learning from positive outcomes observed in schizophrenia. A recent study suggested that patients with severe apathy symptoms show deficits in the representation of expected value. Considering the fundamental relevance for the understanding of these symptoms, we aimed to assess the stability of these findings across studies. Sixty-four patients with schizophrenia and 19 healthy control participants performed a probabilistic reward learning task. They had to associate stimuli with gain or loss-avoidance. In a transfer phase participants indicated valuation of the previously learned stimuli by choosing among them. Patients demonstrated an overall impairment in learning compared to healthy controls. No effects of apathy symptoms on task indices were observed. However, patients with schizophrenia learned better in the context of loss-avoidance than in the context of gain. Earlier findings were thus partially replicated. Further studies are needed to clarify the mechanistic link between negative symptoms and reinforcement learning.