Probabilistic reinforcement learning abnormalities and their correlates in adolescent bipolar disorders

Mapping punishment avoidance learning deficits in non-suicidal self-injury in young adults with and without borderline personality disorder: An fMRI study

INTRODUCTION

Non-suicidal self-injury (NSSI) is a growing public health concern among young adults in both clinical and non-clinical settings. Despite evidence linking NSSI to alterations in learning from reward and punishment, this area remains understudied, especially in non-clinical populations without borderline personality disorder (BPD).

METHODS

We employed a modified version of the Probabilistic Stimulus Selection (PSS) task in two groups of young adults with recurrent NSSI, with (NSSI+BPD) and without BPD (NSSI), and an additional group of healthy controls (HC). While undergoing functional magnetic resonance imaging (fMRI), participants were asked to choose between pairs of stimuli with different reward probabilities. In the training phase, they received probabilistic feedback and learned to identify the most rewarding option within fixed pairs. In the test phase, these learned stimuli were recombined into novel pairs, where participants' accuracy in selecting the most rewarding and avoiding the most punishing options reflected their ability to learn from reward and punishment, respectively.

RESULTS

Compared to HC, participants in the NSSI and NSSI+BPD groups were less accurate at avoiding the most punishing options than at choosing the most rewarding options, and showed reduced activity in the nucleus accumbens (NAcc) during punishment avoidance relative to reward selection.

LIMITATIONS

The modest sample size, descriptive rather than modeling approach, and absence of ecological momentary assessments may limit the results.

CONCLUSION

Findings suggest that reduced activation of the NAcc when avoiding loss may underlie difficulties in learning to avoid punishment in young adults with NSSI, regardless of the presence of BPD.

How to study psychological mechanisms of mania? A systematic review on the methodology of experimental studies on manic mood dysregulation of leading theories on bipolar disorder

INTRODUCTION

Although there are several psychological theories on bipolar disorders (BD), the empirical evidence on these theories through experimental studies is still limited. The current study systematically reviews experimental methods used in studies on the main theories of BD: Reward Hypersensitivity Theory (RST) or Behavioral Activation System (BAS), Integrative Cognitive Model (ICM), Positive Emotion Persistence (PEP), Manic Defense theory (MD), and Mental Imagery (MI). The primary aim is to provide an overview of the used methods and to identify limitations and suggest areas of improvement.

METHODS

A systematic search of six databases until October 2023 was conducted. Study selection involved two independent reviewers extracting data on experimental study design and methodology.

RESULTS

A total of 84 experimental studies were reviewed. BAS and RST were the most frequently studied theories. The majority of these experimental studies focus on mechanisms of reward sensitivity. Other important elements of the reviewed theories, such as goal setting and-attainment, situation selection (avoidance or approach), activation, affective/emotional reactivity, and regulatory strategies, are understudied. Self-report and neuropsychological tasks are most often used, while mood induction and physiological measures are rarely used.

CONCLUSION

There is a need for more consensus on the operationalization of psychological theories of mania. Standardization of test batteries could improve comparability among studies and foster a more systematic approach to experimental research. Research on affective (activated) states is still underrepresented in comparison with studies on trait vulnerabilities.

Global reward processing deficits predict negative symptoms transdiagnostically and transphasically in a severe mental illness-spectrum sample

Reward processing impairments are a key factor associated with negative symptoms in those with severe mental illnesses. However, past findings are inconsistent regarding which reward processing components are impaired and most strongly linked to negative symptoms. The current study examined the hypothesis that these mixed findings may be the result of multiple reward processing pathways (i.e., equifinality) to negative symptoms that cut across diagnostic boundaries and phases of illness. Participants included healthy controls (n = 100) who served as a reference sample and a severe mental illness-spectrum sample (n = 92) that included psychotic-like experiences, clinical high-risk for psychosis, bipolar disorder, and schizophrenia participants. All participants completed tasks measuring four RDoC Positive Valence System constructs: value representation, reinforcement learning, effort-cost computation, and hedonic reactivity. A k-means cluster analysis of the severe mental illness-spectrum samples identified three clusters with differential reward processing profiles that were characterized by: (1) global reward processing deficits (22.8%), (2) selective impairments in hedonic reactivity alone (40.2%), and (3) preserved reward processing (37%). Elevated negative symptoms were only observed in the global reward processing cluster. All clusters contained participants from each clinical group, and the distribution of these groups did not significantly differ among the clusters. Findings identified one pathway contributing to negative symptoms that was transdiagnostic and transphasic. Future work further characterizing divergent pathways to negative symptoms may help to improve symptom trajectories and personalized treatments.

Misperceiving Momentum: Computational Mechanisms of Biased Striatal Reward Prediction Errors in Bipolar Disorder

Background

Dysregulated reward processing and mood instability are core features of bipolar disorder that have largely been considered separately, with contradictory findings. We sought to test a mechanistic account that emphasizes an excessive tendency in bipolar disorder to enter recursive cycles in which reward perception is biased by signals that the environment may be changing for the better or worse.

Methods

Participants completed a probabilistic reward task with functional magnetic resonance imaging. Using an influential computational model, we ascertained whether participants with bipolar disorder (n = 21) showed greater striatal tracking of momentum-biased reward prediction errors (RPEs) than matched control participants (n = 21). We conducted psychophysiological interaction analyses to quantify the degree to which each group modulated functional connectivity between the ventral striatum and left anterior insula in response to fluctuations in momentum.

Results

In participants with bipolar disorder, but not control participants, the momentum-biased RPE model accounted for significant additional variance in striatal activity beyond a standard model of veridical RPEs. Compared with control participants, participants with bipolar disorder exhibited lower insular-striatal functional connectivity modulated by momentum-biased RPEs, an effect that was more pronounced as a function of current manic symptoms.

Conclusions

Consistent with existing theory, we found evidence that bipolar disorder is associated with a tendency for momentum to excessively bias striatal tracking of RPEs. We identified impaired insular-striatal connectivity as a possible locus for this propensity. We argue that computational psychiatric approaches that examine momentary shifts in reward and mood dynamics have strong potential for yielding new mechanistic insights and intervention targets.

Neural response to monetary and social rewards and familial risk for psychopathology in adolescent females

BACKGROUND

Adolescence is a key developmental period for the emergence of psychopathology. Reward-related brain activity increases across adolescence and has been identified as a potential neurobiological mechanism of risk for different forms of psychopathology. The reward positivity (RewP) is an event-related potential component that indexes reward system activation and has been associated with both concurrent and family history of psychopathology. However, it is unclear whether the RewP is also associated with higher-order psychopathology subfactors and whether this relationship is present across different types of reward.

METHODS

In a sample of 193 adolescent females and a biological parent, the present study examined the association between adolescent and parental psychopathology subfactors and adolescent RewP to monetary and social reward.

RESULTS

Results indicated that the adolescent and parental distress subfactors were negatively associated with the adolescent domain-general RewP. The adolescent and parental positive mood subfactors were negatively associated with the adolescent domain-general and domain-specific monetary RewP, respectively. Conversely, the adolescent and parental fear/obsessions subfactors were positively associated with the adolescent domain-general RewP. The associations between parental and adolescent psychopathology subfactors and the adolescent RewP were independent of each other.

CONCLUSIONS

The RewP in adolescent females is associated with both concurrent and parental psychopathology symptoms, suggesting that it indexes both severity and risk for higher-order subfactors.

Learning bias predicts fear acquisition under stress but not cognitive flexibility

Individuals differ in their ability to learn from reinforcement and in avoiding punishment, which can be measured by the Probabilistic Selection Task (PST). Recently, some studies have demonstrated that this learning bias is regulated by the dopaminergic system, and that stress can differentially affect the use of positive (i.e., reinforcement) and negative (i.e., avoiding punishment) feedback. The current two studies examined whether performance on the PST can predict measures of goal-directed behaviour as assessed by a cognitive flexibility task (Wisconsin Card Sorting Test) and the acquisition of fear responses, when individuals are exposed to a stressor (Socially Evaluated Cold Pressor Test). A total of 26 and 59 healthy participants completed Experiments I and II, respectively. In those who were best at learning from reinforcement, stress increased the processing (i.e., higher skin conductance responses) of non-threatening stimuli during fear acquisition compared to the non-stressful condition, which was not recapitulated in those who were best at avoiding punishment. Additionally, PST performance did not interact with stress to modulate cognitive flexibility, although stress negatively impaired this domain, consistent with previous findings. Furthermore, independent of stress, both positive and negative learning biases were correlated with cognitive flexibility errors. Our results demonstrate that the PST has predictive value for better understanding the determinants of reinforcement and avoidance learning.

Neural abnormalities of reward processing in adolescents with bipolar disorders: An ERP study

Adolescent onset is common in bipolar disorders (BDs) and is associated with a worse illness course in adulthood. A model of BDs suggests that a dysregulated behavioral approach system (BAS), a neural system that mobilizes reward-seeking behavior, is at the root of BDs. Normative adolescence is often accompanied by dynamic changes to neural structures underlying the BAS and related cognitive processes. It is possible that adolescent-onset BDs is associated with abnormal BAS neurodevelopment. Consistently, the present study is the first to compare specific BAS-relevant anticipatory and consummatory reward processes as indexed by event-related potentials (ERPs) in adolescents with BDs and typically developing peers. Using a sample of 43 adolescents with BDs and 56 without psychopathology, we analyzed N1 and P3 responses to anticipatory cues and feedback-related negativity (FRN) and P3 responses to feedback stimuli during a monetary incentive delay (MID) task. Hierarchical linear models examined relationships between ERP amplitudes and diagnostic group, MID condition, sex, and age. During anticipation phase, adolescent boys with BDs exhibited significantly larger N1 amplitudes in loss than even or gain trials. During feedback phase, compared to their healthy peers, adolescents with BDs had smaller FRN amplitudes across all conditions. Additional effects involving age, sex and trial type were observed. The findings indicate subtle, non-ubiquitous BAS-relevant neural abnormalities involving early attentional processes during reward anticipation and reward learning following feedback in adolescents with BDs. Adolescents with BDs did not show overall hypersensitive neural responses to monetary reward anticipation or feedback observed in adults with BDs.

Neural reward circuit dysfunction as a risk factor for bipolar spectrum disorders and substance use disorders: A review and integration

Bipolar spectrum disorders (BSDs) and substance use disorders (SUDs) are associated with neural reward dysfunction. However, it is unclear what pattern of neural reward function underlies pre-existing vulnerability to BSDs and SUDs, or whether neural reward function explains their high co-occurrence. The current paper provides an overview of the separate literatures on neural reward sensitivity in BSDs and SUDs. We provide a systematic review of 35 studies relevant to identifying neural reward function vulnerability to BSDs and SUDs. These studies include those examining neural reward processing on a monetary reward task with prospective designs predicting initial onset of SUDs, familial risk studies that examine unaffected offspring or first-degree relatives of family members with BSDs or SUDs, and studies that examine individuals with BSDs or SUDs who are not currently in an episode of the disorder. Findings from the review highlight that aberrant responding and connectivity across neural regions associated with reward and cognitive control confers risk for the development of BSDs and SUDs. Discussion focuses on limitations of the extant literature. We conclude with an integration and theoretical model for understanding how aberrant neural reward responding may constitute a vulnerability to the development of both BSDs and SUDs.

What is bipolar disorder? A disease model of dysregulated energy expenditure

Advances in the understanding and management of bipolar disorder (BD) have been slow to emerge. Despite notable recent developments in neurosciences, our conceptualization of the nature of this mental disorder has not meaningfully progressed. One of the key reasons for this scenario is the continuing lack of a comprehensive disease model. Within the increasing complexity of modern research methods, there is a clear need for an overarching theoretical framework, in which findings are assimilated and predictions are generated. In this review and hypothesis article, we propose such a framework, one in which dysregulated energy expenditure is a primary, sufficient cause for BD. Our proposed model is centered on the disruption of the molecular and cellular network regulating energy production and expenditure, as well its potential secondary adaptations and compensatory mechanisms. We also focus on the putative longitudinal progression of this pathological process, considering its most likely periods for onset, such as critical periods that challenges energy homeostasis (e.g. neurodevelopment, social isolation), and the resulting short and long-term phenotypical manifestations.

Reward and punishment learning in schizophrenia and bipolar disorder

Prior studies on reward learning deficits in psychiatric disorders have used probabilistic learning tasks, making it unclear whether impairment is due to the probabilistic nature of the task rather than reward processing. In this study, we tested probabilistic vs. deterministic reward and punishment learning in healthy controls and three patient groups: schizophrenia (SZ), psychotic bipolar disorder (BD), and nonpsychotic BD. Experimental results show that reward learning was impaired in patients with SZ and patients with psychotic BD in the probabilistic learning task compared to patients with nonpsychotic BD and healthy controls. In contrast, punishment learning in the probabilistic task was impaired in patients with nonpsychotic BD compared to the other patient groups and healthy controls. There were no significant differences among all groups in the deterministic learning task scores. We also found that Hamilton Depression Scale scores negatively correlated with probabilistic learning performance. Our data may suggest that reward learning impairment may be due to the nature of the task as well as subtype of BD.