Probabilistic Reversal Learning in Schizophrenia: Stability of Deficits and Potential Causal Mechanisms

Dynamic brain entropy predicts risky decision-making across transdiagnostic dimensions of psychopathology

OBJECTIVES

Maladaptive risky decision-making is a common pathological behavior among patients with various psychiatric disorders. Brain entropy, which measures the complexity of brain time series signals, provides a novel approach to assessing brain health. Despite its potential, the dynamics of brain entropy have seldom been explored. This study aimed to construct a dynamic model of brain entropy and examine its predictive value for risky decision-making in patients with mental disorders, utilizing resting-state functional magnetic resonance imaging (rs-fMRI).

METHODS

This study analyzed the rs-fMRI data from a total of 198 subjects, including 48 patients with bipolar disorder (BD), 47 patients with schizophrenia (SZ), 40 patients with adult attention deficit hyperactivity disorder (ADHD), as well as 63 healthy controls (HC). Time series signals were extracted from 264 brain regions based on rs-fMRI. The traditional static entropy and dynamic entropy (coefficient of variation, CV; rate of change, Rate) were constructed, respectively. Support vector regression was employed to predict risky decision-making utilizing leave-one-out cross-validation within each group.

RESULTS

Our findings showed that CV achieved the best performances in HC and BD groups (r = -0.58, MAE = 6.43, R2 = 0.32; r = -0.78, MAE = 12.10, R2 = 0.61), while the Rate achieved the best in SZ and ADHD groups (r = -0.69, MAE = 10.20, R2 = 0.47; r = -0.78, MAE = 7.63, R2 = 0.60). For the dynamic entropy, the feature selection threshold rather than the time window length and overlapping ratio influenced predictive performance.

CONCLUSIONS

These results suggest that dynamic brain entropy could be a more effective predictor of risky decision-making than traditional static brain entropy. Our findings offer a novel perspective on exploring brain signal complexity and can serve as a reference for interventions targeting risky decision-making behaviors, particularly in individuals with psychiatric diagnoses.

Cross-species translational paradigms for assessing positive valence system as defined by the RDoC matrix

Functions associated with processing reward-related information are fundamental drivers of motivation, learning, and goal-directed behavior. Such functions have been classified as the positive valence system under the Research Domain and Criteria (RDoC) criteria and are negatively impacted across a range of psychiatric disorders and mental illnesses. The positive valence system is composed of three comprehensive categories containing related but dissociable functions that are organized into either Reward Responsiveness, Reward Learning, or Reward Valuation. The presence of overlapping behavioral dysfunction across diagnostic mental disorders is in-part what motivated the RDoC initiative, which emphasized that the study of mental illness focus on investigating relevant behavior and cognitive functions and their underlying mechanisms, rather than separating efforts on diagnostic categories (i.e., transdiagnostic). Moreover, the RDoC approach is well-suited for preclinical neuroscience research, as the rise in genetic toolboxes and associated neurotechnologies enables researchers to probe specific cellular targets with high specificity. Thus, there is an opportunity to dissect whether behaviors and cognitive functions are supported by shared or distinct neural mechanisms. For preclinical research to effectively inform our understandings of human behavior however, the cognitive and behavioral paradigms should have predictive, neurobiological, and pharmacological predictive validity to the human test. Touchscreen-based testing systems provide a further advantage for this endeavor enabling tasks to be presented to animals using the same media and task design as in humans. Here, we outline the primary categories of the positive valence system and review the work that has been done cross-species to investigate the neurobiology and neurochemistry underlying reward-related functioning. Additionally, we provide clinical tasks outlined by RDoC, along with validity and/or need for further validation for analogous rodent paradigms with a focus on implementing the touchscreen-based cognitive testing systems.

Reviewing explore/exploit decision-making as a transdiagnostic target for psychosis, depression, and anxiety

In many everyday decisions, individuals choose between trialling something novel or something they know well. Deciding when to try a new option or stick with an option that is already known to you, known as the "explore/exploit" dilemma, is an important feature of cognition that characterises a range of decision-making contexts encountered by humans. Recent evidence has suggested preferences in explore/exploit biases are associated with psychopathology, although this has typically been examined within individual disorders. The current review examined whether explore/exploit decision-making represents a promising transdiagnostic target for psychosis, depression, and anxiety. A systematic search of academic databases was conducted, yielding a total of 29 studies. Studies examining psychosis were mostly consistent in showing that individuals with psychosis explored more compared with individuals without psychosis. The literature on anxiety and depression was more heterogenous; some studies found that anxiety and depression were associated with more exploration, whereas other studies demonstrated reduced exploration in anxiety and depression. However, examining a subset of studies that employed case-control methods, there was some evidence that both anxiety and depression also were associated with increased exploration. Due to the heterogeneity across the literature, we suggest that there is insufficient evidence to conclude whether explore/exploit decision-making is a transdiagnostic target for psychosis, depression, and anxiety. However, alongside our advisory groups of lived experience advisors, we suggest that this context of decision-making is a promising candidate that merits further investigation using well-powered, longitudinal designs. Such work also should examine whether biases in explore/exploit choices are amenable to intervention.

Maternal choline supplementation modulates cognition and induces anti-inflammatory signaling in the prefrontal cortices of adolescent rats exposed to maternal immune activation

Maternal infection has long been described as a risk factor for neurodevelopmental disorders, especially autism spectrum disorders (ASD) and schizophrenia. Although many pathogens do not cross the placenta and infect the developing fetus directly, the maternal immune response to them is sufficient to alter fetal neurodevelopment, a phenomenon termed maternal immune activation (MIA). Low maternal choline is also a risk factor for neurodevelopmental disorders, and most pregnant people do not receive enough of it. In addition to its role in neurodevelopment, choline is capable of inducing anti-inflammatory signaling through a nicotinic pathway. Therefore, it was hypothesized that maternal choline supplementation would blunt the neurodevelopmental impact of MIA in offspring through long-term instigation of cholinergic anti-inflammatory signaling. To model MIA in rats, the viral mimetic polyinosinic:polycytidylic acid (poly(I:C)) was used to elicit a maternal antiviral innate immune response in dams both with and without choline supplementation. Offspring were reared to both early and late adolescent stages (postnatal days 28 and 50, respectively), where anxiety-related behaviors and cognition were examined. After behavioral testing, animals were euthanized, and their prefrontal cortices (PFCs) were collected for analysis. MIA offspring demonstrated sex-specific patterns of altered cognition and repetitive behaviors, which were modulated by maternal choline supplementation. Choline supplementation also bolstered anti-inflammatory signaling in the PFCs of MIA animals at both early and late adolescent stages. These findings suggest that maternal choline supplementation may be sufficient to blunt some of the behavioral and neurobiological impacts of inflammatory exposures in utero, indicating that it may be a cheap, safe, and effective intervention for neurodevelopmental disorders.

The Impact of Cannabis Use on Cognition in People with HIV: Evidence of Function-Dependent Effects and Mechanisms from Clinical and Preclinical Studies

PURPOSE OF REVIEW

Cannabis may have beneficial anti-inflammatory effects in people with HIV (PWH); however, given this population's high burden of persisting neurocognitive impairment (NCI), clinicians are concerned they may be particularly vulnerable to the deleterious effects of cannabis on cognition. Here, we present a systematic scoping review of clinical and preclinical studies evaluating the effects of cannabinoid exposure on cognition in HIV.

RECENT FINDINGS

Results revealed little evidence to support a harmful impact of cannabis use on cognition in HIV, with few eligible preclinical data existing. Furthermore, the beneficial/harmful effects of cannabis use observed on cognition were function-dependent and confounded by several factors (e.g., age, frequency of use). Results are discussed alongside potential mechanisms of cannabis effects on cognition in HIV (e.g., anti-inflammatory), and considerations are outlined for screening PWH that may benefit from cannabis interventions. We further highlight the value of accelerating research discoveries in this area by utilizing translatable cross-species tasks to facilitate comparisons across human and animal work.

Amphetamine increases motivation of humans and mice as measured by breakpoint, but does not affect an Electroencephalographic biomarker

Translation of drug targets from preclinical studies to clinical trials has been aided by cross-species behavioral tasks, but evidence for brain-based engagement during task performance is still required. Cross-species progressive ratio breakpoint tasks (PRBTs) measure motivation-related behavior and are pharmacologically and clinically sensitive. We recently advanced elevated parietal alpha power as a cross-species electroencephalographic (EEG) biomarker of PRBT engagement. Given that amphetamine increases breakpoint in mice, we tested its effects on breakpoint and parietal alpha power in both humans and mice. Twenty-three healthy participants performed the PRBT with EEG after amphetamine or placebo in a double-blind design. C57BL/6J mice were trained on PRBT with EEG (n = 24) and were treated with amphetamine or vehicle. A second cohort of mice was trained on PRBT without EEG (n = 40) and was treated with amphetamine or vehicle. In humans, amphetamine increased breakpoint. In mice, during concomitant EEG, 1 mg/kg of amphetamine significantly decreased breakpoint. In cohort 2, however, 0.3 mg/kg of amphetamine increased breakpoint consistent with human findings. Increased alpha power was observed in both species as they reached breakpoint, replicating previous findings. Amphetamine did not affect alpha power in either species. Amphetamine increased effort in humans and mice. Consistent with previous reports, elevated parietal alpha power was observed in humans and mice as they performed the PRBT. Amphetamine did not affect this EEG biomarker of effort. Hence, these findings support the pharmacological predictive validity of the PRBT to measure effort in humans and mice and suggest that this EEG biomarker is not directly reflective of amphetamine-induced changes in effort.

Maternal selenium dietary supplementation alters sociability and reinforcement learning deficits induced by in utero exposure to maternal immune activation in mice

Maternal immune activation (MIA) during pregnancy increases the risk for the unborn foetus to develop neurodevelopmental conditions such as autism spectrum disorder and schizophrenia later in life. MIA mouse models recapitulate behavioural and biological phenotypes relevant to both conditions, and are valuable models to test novel treatment approaches. Selenium (Se) has potent anti-inflammatory properties suggesting it may be an effective prophylactic treatment against MIA. The aim of this study was to determine if Se supplementation during pregnancy can prevent adverse effects of MIA on offspring brain and behaviour in a mouse model. Selenium was administered via drinking water (1.5 ppm) to pregnant dams from gestational day (GD) 9 to birth, and MIA was induced at GD17 using polyinosinic:polycytidylic acid (poly-I:C, 20 mg/kg via intraperitoneal injection). Foetal placenta and brain cytokine levels were assessed using a Luminex assay and brain elemental nutrients assessed using inductively coupled plasma- mass spectrometry. Adult offspring were behaviourally assessed using a reinforcement learning paradigm, the three-chamber sociability test and the open field test. MIA elevated placental IL-1β and IL-17, and Se supplementation successfully prevented this elevation. MIA caused an increase in foetal brain calcium, which was prevented by Se supplement. MIA caused in offspring a female-specific reduction in sociability, which was recovered by Se, and a male-specific reduction in social memory, which was not recovered by Se. Exposure to poly-I:C or selenium, but not both, reduced performance in the reinforcement learning task. Computational modelling indicated that this was predominantly due to increased exploratory behaviour, rather than reduced rate of learning the location of the food reward. This study demonstrates that while Se may be beneficial in ameliorating sociability deficits caused by MIA, it may have negative effects in other behavioural domains. Caution in the use of Se supplementation during pregnancy is therefore warranted.

Flexibility Retained: Unimpaired Updating of Expectations in Schizophrenia

Flexibly and actively updating expectations based on feedback is crucial for navigating daily life. Previous research has shown that people with schizophrenia (PSZ) have difficulty adjusting their expectations. However, there are studies suggesting otherwise. To explore this further, we used a novel trial-based expectation updating paradigm called attribute amnesia. In the task, the participants needed to report the location of a target stimulus among distractors in pre-surprise trials. In the surprise trial, they were unexpectedly asked to report the identity of the target before reporting its location. Afterward, control trials were conducted whereby the participants were asked the same questions as in the surprise trial. Notably, the surprise trial and control trials were nearly identical, except that the participants expected to be asked about identity information in the control trials but not in the surprise trial. Thus, an improvement in identity reporting accuracy in the control trials in comparison with the surprise trial indicated active updating of expectations. In the current study, a total of 63 PSZ and 60 healthy control subjects (HCS) were enrolled. We found that both the PSZ and the HCS were unable to report information that they had fully attended to (i.e., identity) in the surprise trial. However, both groups showed a significant improvement in reporting identity information even in the first control trial. Critically, there was no significant difference in the magnitude of improvement between the two groups. The current findings indicate that PSZ have the ability to update their expectations as quickly and flexibly as HCS, at least in the context of the current task. The possible factors that might contribute to the discrepancy regarding expectation updating are discussed.

Transdiagnostic inflexible learning dynamics explain deficits in depression and schizophrenia

Deficits in reward learning are core symptoms across many mental disorders. Recent work suggests that such learning impairments arise by a diminished ability to use reward history to guide behaviour, but the neuro-computational mechanisms through which these impairments emerge remain unclear. Moreover, limited work has taken a transdiagnostic approach to investigate whether the psychological and neural mechanisms that give rise to learning deficits are shared across forms of psychopathology. To provide insight into this issue, we explored probabilistic reward learning in patients diagnosed with major depressive disorder (n = 33) or schizophrenia (n = 24) and 33 matched healthy controls by combining computational modelling and single-trial EEG regression. In our task, participants had to integrate the reward history of a stimulus to decide whether it is worthwhile to gamble on it. Adaptive learning in this task is achieved through dynamic learning rates that are maximal on the first encounters with a given stimulus and decay with increasing stimulus repetitions. Hence, over the course of learning, choice preferences would ideally stabilize and be less susceptible to misleading information. We show evidence of reduced learning dynamics, whereby both patient groups demonstrated hypersensitive learning (i.e. less decaying learning rates), rendering their choices more susceptible to misleading feedback. Moreover, there was a schizophrenia-specific approach bias and a depression-specific heightened sensitivity to disconfirmational feedback (factual losses and counterfactual wins). The inflexible learning in both patient groups was accompanied by altered neural processing, including no tracking of expected values in either patient group. Taken together, our results thus provide evidence that reduced trial-by-trial learning dynamics reflect a convergent deficit across depression and schizophrenia. Moreover, we identified disorder distinct learning deficits.

Postnatal Phencyclidine-Induced Deficits in Decision Making Are Ameliorated by Optogenetic Inhibition of Ventromedial Orbitofrontal Cortical Glutamate Neurons

Background

The orbitofrontal cortex (OFC) is essential for decision making, and functional disruptions within the OFC are evident in schizophrenia. Postnatal phencyclidine (PCP) administration in rats is a neurodevelopmental manipulation that induces schizophrenia-relevant cognitive impairments. We aimed to determine whether manipulating OFC glutamate cell activity could ameliorate postnatal PCP-induced deficits in decision making.

Methods

Male and female Wistar rats (n = 110) were administered saline or PCP on postnatal days 7, 9, and 11. In adulthood, we expressed YFP (yellow fluorescent protein) (control), ChR2 (channelrhodopsin-2) (activation), or eNpHR 3.0 (enhanced halorhodopsin) (inhibition) in glutamate neurons within the ventromedial OFC (vmOFC). Rats were tested on the probabilistic reversal learning task once daily for 20 days while we manipulated the activity of vmOFC glutamate cells. Behavioral performance was analyzed using a Q-learning computational model of reinforcement learning.

Results

Compared with saline-treated rats expressing YFP, PCP-treated rats expressing YFP completed fewer reversals, made fewer win-stay responses, and had lower learning rates. We induced similar performance impairments in saline-treated rats by activating vmOFC glutamate cells (ChR2). Strikingly, PCP-induced performance deficits were ameliorated when the activity of vmOFC glutamate cells was inhibited (halorhodopsin).

Conclusions

Postnatal PCP-induced deficits in decision making are associated with hyperactivity of vmOFC glutamate cells. Thus, normalizing vmOFC activity may represent a potential therapeutic target for decision-making deficits in patients with schizophrenia.

A mild impairment in reversal learning in a bowl-digging substrate deterministic task but not other cognitive tests in the Dlg2+/- rat model of genetic risk for psychiatric disorder

Variations in the Dlg2 gene have been linked to increased risk for psychiatric disorders, including schizophrenia, autism spectrum disorders, intellectual disability, bipolar disorder, attention deficit hyperactivity disorder, and pubertal disorders. Recent studies have reported disrupted brain circuit function and behaviour in models of Dlg2 knockout and haploinsufficiency. Specifically, deficits in hippocampal synaptic plasticity were found in heterozygous Dlg2+/- rats suggesting impacts on hippocampal dependent learning and cognitive flexibility. Here, we tested these predicted effects with a behavioural characterisation of the heterozygous Dlg2+/- rat model. Dlg2+/- rats exhibited a specific, mild impairment in reversal learning in a substrate deterministic bowl-digging reversal learning task. The performance of Dlg2+/- rats in other bowl digging task, visual discrimination and reversal, novel object preference, novel location preference, spontaneous alternation, modified progressive ratio, and novelty-suppressed feeding test were not impaired. These findings suggest that despite altered brain circuit function, behaviour across different domains is relatively intact in Dlg2+/- rats, with the deficits being specific to only one test of cognitive flexibility. The specific behavioural phenotype seen in this Dlg2+/- model may capture features of the clinical presentation associated with variation in the Dlg2 gene.

Reversal learning in those with early psychosis features contingency-dependent changes in loss response and learning

INTRODUCTION

People with psychotic disorders commonly feature broad decision-making impairments that impact their functional outcomes. Specific associative/reinforcement learning problems have been demonstrated in persistent psychosis. But these phenotypes may differ in early psychosis, suggesting that aspects of cognition decline over time.

METHODS

The present proof-of-concept study examined goal-directed action and reversal learning in controls and those with early psychosis.

RESULTS

Equivalent performance was observed between groups during outcome-specific devaluation, and reversal learning at an 80:20 contingency (reward probability for high:low targets). But when the low target reward probability was increased (80:40) those with early psychosis altered their response to loss, whereas controls did not. Computational modelling confirmed that in early psychosis there was a change in punishment learning that increased the chance of staying with the same stimulus after a loss, multiple trials into the future. In early psychosis, the magnitude of this response was greatest in those with higher IQ and lower clinical severity scores.

CONCLUSIONS

We show preliminary evidence that those with early psychosis present with a phenotype that includes altered responding to loss and hyper-adaptability in response to outcome changes. This may reflect a compensatory response to overcome the milieu of corticostriatal changes associated with psychotic disorders.

Reinforcement learning deficits exhibited by postnatal PCP-treated rats enable deep neural network classification

The ability to appropriately update the value of a given action is a critical component of flexible decision making. Several psychiatric disorders, including schizophrenia, are associated with impairments in flexible decision making that can be evaluated using the probabilistic reversal learning (PRL) task. The PRL task has been reverse-translated for use in rodents. Disrupting glutamate neurotransmission during early postnatal neurodevelopment in rodents has induced behavioral, cognitive, and neuropathophysiological abnormalities relevant to schizophrenia. Here, we tested the hypothesis that using the NMDA receptor antagonist phencyclidine (PCP) to disrupt postnatal glutamatergic transmission in rats would lead to impaired decision making in the PRL. Consistent with this hypothesis, compared to controls the postnatal PCP-treated rats completed fewer reversals and exhibited disruptions in reward and punishment sensitivity (i.e., win-stay and lose-shift responding, respectively). Moreover, computational analysis of behavior revealed that postnatal PCP-treatment resulted in a pronounced impairment in the learning rate throughout PRL testing. Finally, a deep neural network (DNN) trained on the rodent behavior could accurately predict the treatment group of subjects. These data demonstrate that disrupting early postnatal glutamatergic neurotransmission impairs flexible decision making and provides evidence that DNNs can be trained on behavioral datasets to accurately predict the treatment group of new subjects, highlighting the potential for DNNs to aid in the diagnosis of schizophrenia.

Modulation of ventromedial orbitofrontal cortical glutamatergic activity affects the explore-exploit balance and influences value-based decision-making

The balance between exploration and exploitation is essential for decision-making. The present study investigated the role of ventromedial orbitofrontal cortex (vmOFC) glutamate neurons in mediating value-based decision-making by first using optogenetics to manipulate vmOFC glutamate activity in rats during a probabilistic reversal learning (PRL) task. Rats that received vmOFC activation during informative feedback completed fewer reversals and exhibited reduced reward sensitivity relative to rats. Analysis with a Q-learning computational model revealed that increased vmOFC activity did not affect the learning rate but instead promoted maladaptive exploration. By contrast, vmOFC inhibition increased the number of completed reversals and increased exploitative behavior. In a separate group of animals, calcium activity of vmOFC glutamate neurons was recorded using fiber photometry. Complementing our results above, we found that suppression of vmOFC activity during the latter part of rewarded trials was associated with improved PRL performance, greater win-stay responding and selecting the correct choice on the next trial. These data demonstrate that excessive vmOFC activity during reward feedback disrupted value-based decision-making by increasing the maladaptive exploration of lower-valued options. Our findings support the premise that pharmacological interventions that normalize aberrant vmOFC glutamate activity during reward feedback processing may attenuate deficits in value-based decision-making.

Computational mechanisms of belief updating in relation to psychotic-like experiences

Introduction

Psychotic-like experiences (PLEs) may occur due to changes in weighting prior beliefs and new evidence in the belief updating process. It is still unclear whether the acquisition or integration of stable beliefs is altered, and whether such alteration depends on the level of environmental and belief precision, which reflects the associated uncertainty. This motivated us to investigate uncertainty-related dynamics of belief updating in relation to PLEs using an online study design.

Methods

We selected a sample (n = 300) of participants who performed a belief updating task with sudden change points and provided self-report questionnaires for PLEs. The task required participants to observe bags dropping from a hidden helicopter, infer its position, and dynamically update their belief about the helicopter's position. Participants could optimize performance by adjusting learning rates according to inferred belief uncertainty (inverse prior precision) and the probability of environmental change points. We used a normative learning model to examine the relationship between adherence to specific model parameters and PLEs.

Results

PLEs were linked to lower accuracy in tracking the outcome (helicopter location) (β = 0.26 ± 0.11, p = 0.018) and to a smaller increase of belief precision across observations after a change point (β = -0.003 ± 0.0007, p < 0.001). PLEs were related to slower belief updating when participants encountered large prediction errors (β = -0.03 ± 0.009, p = 0.001). Computational modeling suggested that PLEs were associated with reduced overall belief updating in response to prediction errors (βPE = -1.00 ± 0.45, p = 0.028) and reduced modulation of updating at inferred environmental change points (βCPP = -0.84 ± 0.38, p = 0.023).

Discussion

We conclude that PLEs are associated with altered dynamics of belief updating. These findings support the idea that the process of balancing prior belief and new evidence, as a function of environmental uncertainty, is altered in PLEs, which may contribute to the development of delusions. Specifically, slower learning after large prediction errors in people with high PLEs may result in rigid beliefs. Disregarding environmental change points may limit the flexibility to establish new beliefs in the face of contradictory evidence. The present study fosters a deeper understanding of inferential belief updating mechanisms underlying PLEs.

Aberrant adapting of beliefs under stress: a mechanism relevant to the formation of paranoia?

BACKGROUND

Difficulties in the ability to adapt beliefs in the face of new information are associated with psychosis and its central symptom - paranoia. As cognitive processes and psychotic symptoms are both known to be sensitive to stress, the present study investigated the exact associations between stress, adapting of beliefs [reversal learning (RL), bias against disconfirmatory evidence (BADE), and jumping to conclusions (JTC)] and paranoia. We hypothesized that paranoia would increase under stress and that difficulties in adapting of beliefs would mediate or moderate the link between stress and paranoia. Furthermore, we hypothesized that the investigated effects would be strongest in the group of individuals diagnosed with a psychotic disorder.

METHODS

We exposed 155 participants (38 diagnosed with a psychotic disorder, 40 individuals with attenuated psychotic symptoms, 39 clinical controls diagnosed with an obsessive-compulsive disorder, and 38 healthy controls) to a control condition and a stress condition, in which we assessed their levels of paranoia and their ability to adapt beliefs. We applied multilevel models to analyze the data.

RESULTS

Paranoia was higher in the stress condition than in the control condition, b = 1.142, s.e. = 0.338, t(150) = 3.381, p < 0.001. RL, BADE, and JTC did not differ between conditions and did not mediate or moderate the association between stress and paranoia (all p_s > 0.05).

CONCLUSIONS

The results support the assumption that stress triggers paranoia. However, the link between stress and paranoia does not seem to be affected by the ability to adapt beliefs.

Development of cross-species translational paradigms for psychiatric research in the Research Domain Criteria era

The past 30 years of IBNS has included research attempting to treat the cognitive and behavioral deficits observed in people with psychiatric conditions. Early work utilized drugs identified from tests thought to be cognition-relevant, however the high failure rate crossing the translational-species barrier led to focus on developing valid cross-species translational tests. The face, predictive, and neurobiological validities used to assess animal models of psychiatry can be used to validate these tests. Clinical sensitivity is another important aspect however, for if the clinical population targeted for treatment does not exhibit task deficits, then why develop treatments? This review covers some work validating cross-species translational tests and suggests future directions. Also covered is the contribution IBNS made to fostering such research and my role in IBNS, making it more available to all including fostering mentor/mentee programs plus spearheading diversity and inclusivity initiatives. All science needs support and IBNS has supported research recreating the behavioral abnormalities that define psychiatric conditions with the aim to improve the lives of people with such conditions.

Maladaptive explore/exploit trade-offs in schizophrenia

Schizophrenia is a complex disorder that remains poorly understood, particularly at the systems level. In this opinion article we argue that the explore/exploit trade-off concept provides a holistic and ecologically valid framework to resolve some of the apparent paradoxes that have emerged within schizophrenia research. We review recent evidence suggesting that fundamental explore/exploit behaviors may be maladaptive in schizophrenia during physical, visual, and cognitive foraging. We also describe how theories from the broader optimal foraging literature, such as the marginal value theorem (MVT), could provide valuable insight into how aberrant processing of reward, context, and cost/effort evaluations interact to produce maladaptive responses.

Assessing cognitive flexibility in humans and rhesus macaques with visual motion and neutral distractors

Introduction

Cognitive flexibility is the ability of an individual to make behavioral adjustments in response to internal and/or external changes. While it has been reported in a wide variety of species, established paradigms to assess cognitive flexibility vary between humans and non-human animals, making systematic comparisons difficult to interpret.

Methods

We developed a computer-based paradigm to assess cognitive flexibility in humans and non-human primates. Our paradigm (1) uses a classical reversal learning structure in combination with a set-shifting approach (4 stimuli and 3 rules) to assess flexibility at various levels; (2) it employs the use of motion as one of three possible contextual rules; (3) it comprises elements that allow a foraging-like and random interaction, i.e., instances where the animals operate the task without following a strategy, to potentially minimize frustration in favor of a more positive engagement.

Results and Discussion

We show that motion can be used as a feature dimension (in addition to commonly used shape and color) to assess cognitive flexibility. Due to the way motion is processed in the primate brain, we argue that this dimension is an ideal candidate in situations where a non-binary rule set is needed and where participants might not be able to fully grasp other visual information of the stimulus (e.g., quantity in Wisconsin Card Sorting Test). All participants in our experiment flexibly shifted to and from motion-based rules as well as color- and shape-based rules, but did so with different proficiencies. Overall, we believe that with such approach it is possible to better characterize the evolution of cognitive flexibility in primates, as well as to develop more efficient tools to diagnose and treat various executive function deficits.

Impairments in goal-directed action and reversal learning in a proportion of individuals with psychosis

Cognitive impairment in psychosis is one of the strongest predictors of functional decline. Problems with decision-making processes, such as goal-directed action and reversal learning, can reflect cortico-striatal dysfunction. The heterogenous symptoms and neurobiology observed in those with psychosis suggests that specific cognitive phenotypes may reflect differing causative mechanisms. As such, decision-making performance could identify subgroups of individuals with more severe cortico-striatal dysfunction and help to predict their functional decline. The present work evaluated the relationship between goal-directed action, reversal learning, and symptom profiles in those with psychosis. We assessed decision-making processes in healthy controls (N = 34) and those with persistent psychosis (N = 45), subclassifying subjects based on intact/impaired goal-directed action. Compared with healthy controls (<20%), a large proportion (58%) of those with persistent psychosis displayed impaired goal-directed action, predicting poor serial reversal learning performance. Computational approaches indicated that those with impaired goal-directed action had a decreased capacity to rapidly update their prior beliefs in the face of changing contingencies. Impaired decision-making also was associated with reduced levels of grandiosity and increased problems with abstract thinking. These findings suggest that prominent decision-making deficits, indicative of cortico-striatal dysfunction, are present in a large proportion of people with persistent psychosis. Moreover, these impairments would have significant functional implications in terms of planning and abstract thinking.

Belief Updating and Paranoia in Individuals With Schizophrenia

BACKGROUND

Persecutory delusions are among the most common delusions in schizophrenia and represent the extreme end of the paranoia continuum. Paranoia is accompanied by significant worry and distress. Identifying cognitive mechanisms underlying paranoia is critical for advancing treatment. We hypothesized that aberrant belief updating, which is related to paranoia in human and animal models, would also contribute to persecutory beliefs in individuals with schizophrenia.

METHODS

Belief updating was assessed in 42 participants with schizophrenia and 44 healthy control participants using a 3-option probabilistic reversal learning task. Hierarchical Gaussian Filter was used to estimate computational parameters of belief updating. Paranoia was measured using the Positive and Negative Syndrome Scale and the revised Green et al. Paranoid Thoughts Scale. Unusual thought content was measured with the Psychosis Symptom Rating Scale and the Peters et al. Delusions Inventory. Worry was measured using the Dunn Worry Questionnaire.

RESULTS

Paranoia was significantly associated with elevated win-switch rate and prior beliefs about volatility both in schizophrenia and across the whole sample. These relationships were specific to paranoia and did not extend to unusual thought content or measures of anxiety. We observed a significant indirect effect of paranoia on the relationship between prior beliefs about volatility and worry.

CONCLUSIONS

This work provides evidence that relationships between belief updating parameters and paranoia extend to schizophrenia, may be specific to persecutory beliefs, and contribute to theoretical models implicating worry in the maintenance of persecutory delusions.

The relationship between negative symptoms, social cognition, and social functioning in patients with first episode psychosis

INTRODUCTION

Social functioning is severely affected in psychotic disorders. Negative symptoms and social cognition seem to play an important role in social functioning, although the preponderance and relationship between these three domains is not clear. In this study, we sought to assess the interrelation between social cognition, social functioning, and the expressiveness and experiential factors of negative symptoms in first-episode psychosis (FEP).

SAMPLE AND METHODS

216 patients, participants in a multicentre study (AGES-CM), comprised our study sample. The WHO Disability Assessment Schedule (WHODAS 2.0) was used to assess functioning, whereas the Positive and Negative Schizophrenia Syndrome Scale (PANSS) was used to measure the severity of negative symptoms, and the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) was applied to assess the emotional processing component of social cognition. Network analyses were conducted with the aim of analysing the patterns of relationships between social cognition, social functioning, and the expressiveness and experiential factors of negative symptoms.

RESULTS

Our findings suggest that there is a direct relationship between social cognition and social functioning (weight = -.077), but also an indirect connection between them, mediated by the experiential (but not the expressiveness) factor of negative symptoms (weight = 0.300).

DISCUSSION

The importance of the affectation of subdomains of social cognition, as well as the role of negative symptoms, specifically the experiential factor, in the functioning of patients with FEP seems to be relevant. The inclusion of these factors in prevention and treatment programs would thus allow us to reduce their impact on the social functioning of these patients.

Using Computational Modeling to Capture Schizophrenia-Specific Reinforcement Learning Differences and Their Implications on Patient Classification

BACKGROUND

Psychiatric diagnosis and treatment have historically taken a symptom-based approach, with less attention on identifying underlying symptom-producing mechanisms. Recent efforts have illuminated the extent to which different underlying circuitry can produce phenotypically similar symptomatology (e.g., psychosis in bipolar disorder vs. schizophrenia). Computational modeling makes it possible to identify and mathematically differentiate behaviorally unobservable, specific reinforcement learning differences in patients with schizophrenia versus other disorders, likely owing to a higher reliance on prediction error-driven learning associated with basal ganglia and underreliance on explicit value representations associated with orbitofrontal cortex.

METHODS

We used a well-established probabilistic reinforcement learning task to replicate those findings in individuals with schizophrenia both on (n = 120) and off (n = 44) antipsychotic medications and included a patient comparison group of bipolar patients with psychosis (n = 60) and healthy control subjects (n = 72).

RESULTS

Using accuracy, there was a main effect of group (F3,279 = 7.87, p < .001), such that all patient groups were less accurate than control subjects. Using computationally derived parameters, both medicated and unmediated individuals with schizophrenia, but not patients with bipolar disorder, demonstrated a reduced mixing parameter (F3,295 = 13.91, p < .001), indicating less dependence on learning explicit value representations as well as greater learning decay between training and test (F1,289 = 12.81, p < .001). Unmedicated patients with schizophrenia also showed greater decision noise (F3,295 = 2.67, p = .04).

CONCLUSIONS

Both medicated and unmedicated patients showed overreliance on prediction error-driven learning as well as significantly higher noise and value-related memory decay, compared with the healthy control subjects and the patients with bipolar disorder. Additionally, the computational model parameters capturing these processes can significantly improve patient/control classification, potentially providing useful diagnosis insight.

Spared performance but increased uncertainty in schizophrenia: Evidence from a probabilistic decision-making task

Aberrant attribution of salience to in fact little informative events might explain the emergence of positive symptoms in schizophrenia and has been linked to belief uncertainty. Uncertainty is thought to be encoded by neuromodulators, including norepinephrine. However, norepinephrinergic encoding of uncertainty, measured as task-related pupil dilation, has rarely been explored in schizophrenia. Here, we addressed this question by comparing individuals with a disorder from the schizophrenia spectrum to a non-psychiatric control group on behavioral and pupillometric measures in a probabilistic prediction task, where different levels of uncertainty were introduced. Behaviorally, patients performed similar to controls, but their belief uncertainty was higher, particularly when instability of the task environment was high, suggesting an increased sensitivity to this instability. Furthermore, while pupil dilation scaled positively with uncertainty, this was less the case for patients, suggesting aberrant neuromodulatory regulation of neural gain, which may hinder the reduction of uncertainty in the long run. Together, the findings point to abnormal uncertainty processing and norepinephrinergic signaling in schizophrenia, potentially informing future development of both psychopharmacological therapies and psychotherapeutic approaches that deal with the processing of uncertain information.

Altered medial prefrontal cortex and dorsal raphé activity predict genotype and correlate with abnormal learning behavior in a mouse model of autism-associated 2p16.3 deletion

2p16.3 deletion, involving NEUREXIN1 (NRXN1) heterozygous deletion, substantially increases the risk of developing autism and other neurodevelopmental disorders. We have a poor understanding of how NRXN1 heterozygosity impacts on brain function and cognition to increase the risk of developing the disorder. Here we characterize the impact of Nrxn1α heterozygosity on cerebral metabolism, in mice, using ¹⁴C‐2‐deoxyglucose imaging. We also assess performance in an olfactory‐based discrimination and reversal learning (OB‐DaRL) task and locomotor activity. We use decision tree classifiers to test the predictive relationship between cerebral metabolism and Nrxn1α genotype. Our data show that Nrxn1α heterozygosity induces prefrontal cortex (medial prelimbic cortex, mPrL) hypometabolism and a contrasting dorsal raphé nucleus (DRN) hypermetabolism. Metabolism in these regions allows for the predictive classification of Nrxn1α genotype. Consistent with reduced mPrL glucose utilization, prefrontal cortex insulin receptor signaling is decreased in Nrxn1α^+/− mice. Behaviorally, Nrxn1α^+/− mice show enhanced learning of a novel discrimination, impaired reversal learning and an increased latency to make correct choices. In addition, male Nrxn1α^+/− mice show hyperlocomotor activity. Correlative analysis suggests that mPrL hypometabolism contributes to the enhanced novel odor discrimination seen in Nrxn1α^+/− mice, while DRN hypermetabolism contributes to their increased latency in making correct choices. The data show that Nrxn1α heterozygosity impacts on prefrontal cortex and serotonin system function, which contribute to the cognitive alterations seen in these animals. The data suggest that Nrxn1α^+/− mice provide a translational model for the cognitive and behavioral alterations seen in autism and other neurodevelopmental disorders associated with 2p16.3 deletion.

Timing of maternal immune activation and sex influence schizophrenia-relevant cognitive constructs and neuregulin and GABAergic pathways

Maternal immune activation (MIA) during pregnancy is an established environmental risk factor for schizophrenia. Timing of immune activation exposure as well as sex of the exposed offspring are critical factors in defining the effects of MIA. However, the specificity of MIA on the component structure of schizophrenia, especially cognition, has been difficult to assess due to a lack of translational validity of maze-like testing paradigms. We aimed to assess cognitive domains relevant to schizophrenia using highly translational touchscreen-based tasks in male and female mice exposed to the viral mimetic, poly(I:C) (5 mg/k, i.p.), during early (gestational day (GD) 9-11) and late (GD13-15) gestational time points. Gene expression of schizophrenia candidate pathways were assessed in fetal brain immediately following poly(I:C) exposure and in adulthood to identify its influence on neurodevelopmental processes. Sex and window specific alterations in cognitive performance were found with the early window of MIA exposure causing female-specific disruptions to working memory and reduced perseverative behaviour, while late MIA exposure caused male-specific changes to working memory and deficits in reversal learning. GABAergic specification marker, Nkx2.1 gene expression was reduced in fetal brains and reelin expression was reduced in adult hippocampus of both early and late poly(I:C) exposed mice. Neuregulin and EGF signalling were initially upregulated in the fetal brain, but were reduced in the adult hippocampus, with male mice exposed in the late window showing reduced Nrg3 expression. Serine racemase was reduced in both fetal and adult brain, but again, adult reductions were specific to male mice exposed at the late time point. Overall, we show that cognitive constructs relevant to schizophrenia are altered by in utero exposure to maternal immune activation, but are highly dependent on the timing of infection and the sex of the offspring. Glutamatergic and epidermal growth factor pathways were similarly altered by MIA in a timing and sex dependent manner, while MIA-induced GABAergic deficits were independent of timing or sex.

A review of risky decision-making in psychosis-spectrum disorders

The investigation of risky decision-making has a prominent place in clinical science, with sundry behavioral tasks aimed at empirically quantifying the psychological construct of risk-taking. However, use of differing behavioral tasks has resulted in lack of agreement on risky decision-making within psychosis-spectrum disorders, as findings fail to converge upon the typical, binary conceptualization of increased risk-seeking or risk-aversion. The current review synthesizes the behavioral, risky decision-making literature to elucidate how specific task parameters may contribute to differences in task performance, and their associations with psychosis symptomatology and cognitive functioning. A paring of the literature suggests that: 1) Explicit risk-taking may be characterized by risk imperception, evidenced by less discrimination between choices of varying degrees of risk, potentially secondary to cognitive deficits. 2) Ambiguous risk-taking findings are inconclusive with few published studies. 3) Uncertain risk-taking findings, consistently interpreted as more risk-averse, have not parsed risk attitudes from confounding processes that may impact decision-making (e.g. risk imperception, reward processing, motivation). Thus, overgeneralized interpretations of task-specific risk-seeking/aversion should be curtailed, as they may fail to appropriately characterize decision-making phenomena. Future research in psychosis-spectrum disorders would benefit from empirically isolating contributions of specific processes during risky decision-making, including the newly hypothesized risk imperception.

Neural Circuitry of Salience and Reward Processing in Psychosis

The processing of salient and rewarding stimuli is integral to engaging our attention, stimulating anticipation for future events, and driving goal-directed behaviors. Widespread impairments in these processes are observed in psychosis, which may be associated with worse functional outcomes or mechanistically linked to the development of symptoms. Here, we summarize the current knowledge of behavioral and functional neuroimaging in salience, prediction error, and reward. Although each is a specific process, they are situated in multiple feedback and feedforward systems integral to decision making and cognition more generally. We argue that the origin of salience and reward processing dysfunctions may be centered in the subcortex during the earliest stages of psychosis, with cortical abnormalities being initially more spared but becoming more prominent in established psychotic illness/schizophrenia. The neural circuits underpinning salience and reward processing may provide targets for delaying or preventing progressive behavioral and neurobiological decline.

Electrophysiological biomarkers of behavioral dimensions from cross-species paradigms

There has been a fundamental failure to translate preclinically supported research into clinically efficacious treatments for psychiatric disorders. One of the greatest impediments toward improving this species gap has been the difficulty of identifying translatable neurophysiological signals that are related to specific behavioral constructs. Here, we present evidence from three paradigms that were completed by humans and mice using analogous procedures, with each task eliciting candidate a priori defined electrophysiological signals underlying effortful motivation, reinforcement learning, and cognitive control. The effortful motivation was assessed using a progressive ratio breakpoint task, yielding a similar decrease in alpha-band activity over time in both species. Reinforcement learning was assessed via feedback in a probabilistic learning task with delta power significantly modulated by reward surprise in both species. Additionally, cognitive control was assessed in the five-choice continuous performance task, yielding response-locked theta power seen across species, and modulated by difficulty in humans. Together, these successes, and also the teachings from these failures, provide a roadmap towards the use of electrophysiology as a method for translating findings from the preclinical assays to the clinical settings.

Preliminary evidence for the phosphodiesterase type-4 inhibitor, roflumilast, in ameliorating cognitive flexibility deficits in patients with schizophrenia

BACKGROUND

Cognitive flexibility deficits are present in patients with schizophrenia and are strong predictors of functional outcome but, as yet, have no pharmacological treatments.

AIMS

The purpose of this study was to investigate whether the phosphodiesterase type-4 inhibitor, roflumilast, can improve cognitive flexibility performance and functional brain activity in patients with schizophrenia.

METHODS

This was a within-subject, randomised, double-blind, placebo-controlled, three-period crossover study using a version of the Intradimensional/Extradimensional (ID/ED) task, optimised for functional magnetic resonance imaging (fMRI), in 10 patients with schizophrenia who were scanned after receiving placebo, 100 µg or 250 µg roflumilast for 8 consecutive days. Data from an additional fMRI ID/ED study of 18 healthy participants on placebo was included to contextualise the schizophrenia-related performance and activations. The fMRI analyses included a priori driven region of interest (ROI) analysis of the dorsal frontoparietal attention network.

RESULTS

Patients on placebo demonstrated broad deficits in task performance compared to the healthy comparison group, accompanied by preserved network activity for solution search, but reduced activity in left ventrolateral prefrontal cortex (VLPFC) and posterior parietal cortex for attentional set-shifting and reduced activity in left dorsolateral prefrontal cortex (DLPFC) for reversal learning. These ROI deficits were ameliorated by 250 µg roflumilast, whereas during solution search 100 µg roflumilast reduced activity in the left orbitofrontal cortex, right DLPFC and bilateral PPC, which was associated with an improvement in formation of attentional sets.

CONCLUSIONS

The results suggest roflumilast has dose-dependent cognitive enhancing effects on the ID/ED task in patients with schizophrenia, and provides sufficient support for larger studies to test roflumilast's role in improving cognitive flexibility deficits in this clinical population.

All or nothing belief updating in patients with schizophrenia reduces precision and flexibility of beliefs

Schizophrenia is characterized by abnormal perceptions and beliefs, but the computational mechanisms through which these abnormalities emerge remain unclear. One prominent hypothesis asserts that such abnormalities result from overly precise representations of prior knowledge, which in turn lead beliefs to become insensitive to feedback. In contrast, another prominent hypothesis asserts that such abnormalities result from a tendency to interpret prediction errors as indicating meaningful change, leading to the assignment of aberrant salience to noisy or misleading information. Here we examine behaviour of patients and control subjects in a behavioural paradigm capable of adjudicating between these competing hypotheses and characterizing belief updates directly on individual trials. We show that patients are more prone to completely ignoring new information and perseverating on previous responses, but when they do update, tend to do so completely. This updating strategy limits the integration of information over time, reducing both the flexibility and precision of beliefs and provides a potential explanation for how patients could simultaneously show over-sensitivity and under-sensitivity to feedback in different paradigms.

The role of oxytocin in delay of gratification and flexibility in non-social decision making

Oxytocin is well-known for its impact on social cognition. This specificity for the social domain, however, has been challenged by findings suggesting a domain-general allostatic function for oxytocin by promoting future-oriented and flexible behavior. In this pre-registered study, we tested the hypothesized domain-general function of oxytocin by assessing the impact of intranasal oxytocin (24 IU) on core aspects of human social (inequity aversion) and non-social decision making (delay of gratification and cognitive flexibility) in 49 healthy volunteers (within-subject design). In intertemporal choice, patience was higher under oxytocin than under placebo, although this difference was evident only when restricting the analysis to the first experimental session (between-group comparison) due to carry-over effects. Further, oxytocin increased cognitive flexibility in reversal learning as well as generosity under conditions of advantageous but not disadvantageous inequity. Our findings show that oxytocin affects both social and non-social decision making, supporting theoretical accounts of domain-general functions of oxytocin.

Increased random exploration in schizophrenia is associated with inflammation

One aspect of goal-directed behavior, which is known to be impaired in patients with schizophrenia (SZ), is balancing between exploiting a familiar choice with known reward value and exploring a lesser known, but potentially more rewarding option. Despite its relevance to several symptom domains of SZ, this has received little attention in SZ research. In addition, while there is increasing evidence that SZ is associated with chronic low-grade inflammation, few studies have investigated how this relates to specific behaviors, such as balancing exploration and exploitation. We therefore assessed behaviors underlying the exploration-exploitation trade-off using a three-armed bandit task in 45 patients with SZ and 19 healthy controls (HC). This task allowed us to dissociate goal-unrelated (random) from goal-related (directed) exploration and correlate them with psychopathological symptoms. Moreover, we assessed a broad range of inflammatory proteins in the blood and related them to bandit task behavior. We found that, compared to HC, patients with SZ showed reduced task performance. This impairment was due to a shift from exploitation to random exploration, which was associated with symptoms of disorganization. Relative to HC, patients with SZ showed a pro-inflammatory blood profile. Furthermore, high-sensitivity C-reactive protein (hsCRP) positively correlated with random exploration, but not with directed exploration or exploitation. In conclusion, we show that low-grade inflammation in patients with SZ is associated with random exploration, which can be considered a behavioral marker for disorganization. hsCRP may constitute a marker for severity of, and a potential treatment target for maladaptive exploratory behaviors.

Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach

Cognitive flexibility helps us to navigate through our ever-changing environment and has often been examined by reversal learning paradigms. Performance in reversal learning can be modeled using computational modeling which allows for the specification of biologically plausible models to infer psychological mechanisms. Although such models are increasingly used in cognitive neuroscience, developmental approaches are still scarce. Additionally, though most reversal learning paradigms have a comparable design regarding timing and feedback contingencies, the type of feedback differs substantially between studies. The present study used hierarchical Gaussian filter modeling to investigate cognitive flexibility in reversal learning in children and adolescents and the effect of various feedback types. The results demonstrate that children make more overall errors and regressive errors (when a previously learned response rule is chosen instead of the new correct response after the initial shift to the new correct target), but less perseverative errors (when a previously learned response set continues to be used despite a reversal) adolescents. Analyses of the extracted model parameters of the winning model revealed that children seem to use new and conflicting information less readily than adolescents to update their stimulus-reward associations. Furthermore, more subclinical rigidity in everyday life (parent-ratings) is related to less explorative choice behavior during the probabilistic reversal learning task. Taken together, this study provides first-time data on the development of the underlying processes of cognitive flexibility using computational modeling.

A psychiatric disease-related circular RNA controls synaptic gene expression and cognition

Although circular RNAs (circRNAs) are enriched in the mammalian brain, very little is known about their potential involvement in brain function and psychiatric disease. Here, we show that circHomer1a, a neuronal-enriched circRNA abundantly expressed in the frontal cortex, derived from Homer protein homolog 1 (HOMER1), is significantly reduced in both the prefrontal cortex (PFC) and induced pluripotent stem cell-derived neuronal cultures from patients with schizophrenia (SCZ) and bipolar disorder (BD). Moreover, alterations in circHomer1a were positively associated with the age of onset of SCZ in both the dorsolateral prefrontal cortex (DLPFC) and orbitofrontal cortex (OFC). No correlations between the age of onset of SCZ and linear HOMER1 mRNA were observed, whose expression was mostly unaltered in BD and SCZ postmortem brain. Using in vivo circRNA-specific knockdown of circHomer1a in mouse PFC, we show that it modulates the expression of numerous alternative mRNA transcripts from genes involved in synaptic plasticity and psychiatric disease. Intriguingly, in vivo circHomer1a knockdown in mouse OFC resulted in specific deficits in OFC-mediated cognitive flexibility. Lastly, we demonstrate that the neuronal RNA-binding protein HuD binds to circHomer1a and can influence its synaptic expression in the frontal cortex. Collectively, our data uncover a novel psychiatric disease-associated circRNA that regulates synaptic gene expression and cognitive flexibility.

Reinforcement Learning during Adolescence in Rats

The most dynamic period of postnatal brain development occurs during adolescence, the period between childhood and adulthood. Neuroimaging studies have observed morphologic and functional changes during adolescence, and it is believed that these changes serve to improve the functions of circuits that underlie decision-making. Direct evidence in support of this hypothesis, however, has been limited because most preclinical decision-making paradigms are not readily translated to humans. Here, we developed a reversal-learning protocol for the rapid assessment of adaptive choice behavior in dynamic environments in rats as young as postnatal day 30. A computational framework was used to elucidate the reinforcement-learning mechanisms that change in adolescence and into adulthood. Using a cross-sectional and longitudinal design, we provide the first evidence that value-based choice behavior in a reversal-learning task improves during adolescence in male and female Long-Evans rats and demonstrate that the increase in reversal performance is due to alterations in value updating for positive outcomes. Furthermore, we report that reversal-learning trajectories in adolescence reliably predicted reversal performance in adulthood. This novel behavioral protocol provides a unique platform for conducting biological and systems-level analyses of the neurodevelopmental mechanisms of decision-making.SIGNIFICANCE STATEMENT The neurodevelopmental adaptations that occur during adolescence are hypothesized to underlie age-related improvements in decision-making, but evidence to support this hypothesis has been limited. Here, we describe a novel behavioral protocol for rapidly assessing adaptive choice behavior in adolescent rats with a reversal-learning paradigm. Using a computational approach, we demonstrate that age-related changes in reversal-learning performance in male and female Long-Evans rats are linked to specific reinforcement-learning mechanisms and are predictive of reversal-learning performance in adulthood. Our behavioral protocol provides a unique platform for elucidating key components of adolescent brain function.

Short-active photoperiod gestation induces psychiatry-relevant behavior in healthy mice but a resiliency to such effects are seen in mice with reduced dopamine transporter expression

A higher incidence of multiple psychiatric disorders occurs in people born in late winter/early spring. Reduced light exposure/activity level impacts adult rodent behavior and neural mechanisms, yet few studies have investigated such light exposure on gestating fetuses. A dysfunctional dopamine system is implicated in most psychiatric disorders, and genetic polymorphisms reducing expression of the dopamine transporter (DAT) are associated with some conditions. Furthermore, adult mice with reduced DAT expression (DAT-HT) were hypersensitive to short active (SA; 19:5 L:D) photoperiod exposure versus their wildtype (WT) littermates. Effects of SA photoperiod exposure during gestation in these mice have not been examined. We confirmed adult females exhibit a heightened corticosterone response when in SA photoperiod. We then tested DAT-HT mice and WT littermates in psychiatry-relevant behavioral tests after SA or normal active (NA; 12:12 L:D) photoperiod exposure during gestation and early life. SA-born WT mice exhibited sensorimotor gating deficits (males), increased reward preference, less immobility, open arm avoidance (females), less motivation to obtain a reward, and reversal learning deficits, vs. NA-born WT mice. DAT-HT mice were largely resilient to these effects, however. Future studies will determine the mechanism(s) by which SA photoperiod exposure influences brain development to predispose toward emergence of psychiatry-relevant behaviors.

Subcortical Dopamine and Cognition in Schizophrenia: Looking Beyond Psychosis in Preclinical Models

Schizophrenia is characterized by positive, negative and cognitive symptoms. All current antipsychotic treatments feature dopamine-receptor antagonism that is relatively effective at addressing the psychotic (positive) symptoms of schizophrenia. However, there is no clear evidence that these medications improve the negative or cognitive symptoms, which are the greatest predictors of functional outcomes. One of the most robust pathophysiological observations in patients with schizophrenia is increased subcortical dopamine neurotransmission, primarily in the associative striatum. This brain area has an important role in a range of cognitive processes. Dopamine is also known to play a major part in regulating a number of cognitive functions impaired in schizophrenia but much of this research has been focused on cortical dopamine. Emerging research highlights the strong influence subcortical dopamine has on a range of cognitive domains, including attention, reward learning, goal-directed action and decision-making. Nonetheless, the precise role of the associative striatum in the cognitive impairments observed in schizophrenia remains poorly understood, presenting an opportunity to revisit its contribution to schizophrenia. Without a better understanding of the mechanisms underlying cognitive dysfunction, treatment development remains at a standstill. For this reason, improved preclinical animal models are needed if we are to understand the complex relationship between subcortical dopamine and cognition. A range of new techniques are facillitating the discrete manipulation of dopaminergic neurotransmission and measurements of cognitive performance, which can be investigated using a variety of sensitive translatable tasks. This has the potential to aid the successful incorporation of recent clinical research to address the lack of treatment strategies for cognitive symptoms in schizophrenia. This review will give an overview on the current state of research focused on subcortical dopamine and cognition in the context of schizophrenia research. We also discuss future strategies and approaches aimed at improving the translational outcomes for the treatment of cognitive deficits in schizophrenia.

Interneuron hypomyelination is associated with cognitive inflexibility in a rat model of schizophrenia

Impaired cognitive functioning is a core feature of schizophrenia, and is hypothesized to be due to myelination as well as interneuron defects during adolescent prefrontal cortex (PFC) development. Here we report that in the apomorphine-susceptible (APO-SUS) rat model, which has schizophrenia-like features, a myelination defect occurred specifically in parvalbumin interneurons. The adult rats displayed medial PFC (mPFC)-dependent cognitive inflexibility, and a reduced number of mature oligodendrocytes and myelinated parvalbumin inhibitory axons in the mPFC. In the developing mPFC, we observed decreased myelin-related gene expression that persisted into adulthood. Environmental enrichment applied during adolescence restored parvalbumin interneuron hypomyelination as well as cognitive inflexibility. Collectively, these findings highlight that impairment of parvalbumin interneuron myelination is related to schizophrenia-relevant cognitive deficits.

Dysfunction of GABAergic neurons in the prefrontal cortex has been reported in schizophrenia. Here, the authors use the apomorphine-susceptible rat, which displays some schizophrenia-like behaviors, and show that interneurons in the medial prefrontal cortex are hypomyelinated, which may contribute to this behavioral phenotype.

Activation of D1 receptors affects human reactivity and flexibility to valued cues

Reward-predicting cues motivate goal-directed behavior, but in unstable environments humans must also be able to flexibly update cue-reward associations. While the capacity of reward cues to trigger motivation ('reactivity') as well as flexibility in cue-reward associations have been linked to the neurotransmitter dopamine in humans, the specific contribution of the dopamine D1 receptor family to these behaviors remained elusive. To fill this gap, we conducted a randomized, placebo-controlled, double-blind pharmacological study testing the impact of three different doses of a novel D1 agonist (relative to placebo) on reactivity to reward-predicting cues (Pavlovian-to-instrumental transfer) and flexibility of cue-outcome associations (reversal learning). We observed that the impact of the D1 agonist crucially depended on baseline working memory functioning, which has been identified as a proxy for baseline dopamine synthesis capacity. Specifically, increasing D1 receptor stimulation strengthened Pavlovian-to-instrumental transfer in individuals with high baseline working memory capacity. In contrast, higher doses of the D1 agonist improved reversal learning only in individuals with low baseline working memory functioning. Our findings suggest a crucial and baseline-dependent role of D1 receptor activation in controlling both cue reactivity and the flexibility of cue-reward associations.

Reward processing in certain versus uncertain contexts in schizophrenia: An event-related potential (ERP) study

Disturbances in motivation are prominent in the clinical presentation of people with schizophrenia and might reflect a disturbance in reward processing. Recent advances in affective neuroscience have subdivided reward processing into distinct components, but there are two limitations of the prior work in schizophrenia. First, studies typically focus on only one component rather than on the unfolding of reward processing across multiple stages. Second, studies have not considered the impact of certainty effects, which represent an important contextual factor that impacts processing. We examined whether individuals with schizophrenia show the typical certainty effects across three phases of reward processing: cue evaluation, feedback anticipation, and feedback receipt. Electroencephalography from 74 healthy controls and 92 people with schizophrenia was recorded during a cued gambling task under conditions in which cues indicated forthcoming reward outcomes that were certain or uncertain. Controls demonstrated the expected certainty effects across each stage. Initial cue evaluation (cue P300) was intact in the schizophrenia group, but people with schizophrenia showed diminished certainty effects during feedback anticipation (stimulus-preceding negativity [SPN]) and receipt (feedback reward positivity [fRewP] and feedback P300). During feedback receipt, event-related potentials in people with schizophrenia were similar to controls for the uncertain context but larger than controls for the certain context. Essentially, people with schizophrenia appeared to process certain feedback as though it were uncertain. These findings show, for the first time, that the fundamental distinction between certain and uncertain contexts is altered in schizophrenia at a neural level. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Motivational deficits in schizophrenia relate to abnormalities in cortical learning rate signals

Individuals from across the psychosis spectrum display impairments in reinforcement learning. In some individuals, these deficits may result from aberrations in reward prediction error (RPE) signaling, conveyed by dopaminergic projections to the ventral striatum (VS). However, there is mounting evidence that VS RPE signals are relatively intact in medicated people with schizophrenia (PSZ). We hypothesized that, in PSZ, reinforcement learning deficits often are not related to RPE signaling per se but rather their impact on learning and behavior (i.e., learning rate modulation), due to dysfunction in anterior cingulate and dorsomedial prefrontal cortex (dmPFC). Twenty-six PSZ and 23 healthy volunteers completed a probabilistic reinforcement learning paradigm with occasional, sudden, shifts in contingencies. Using computational modeling, we found evidence of an impairment in trial-wise learning rate modulation (α) in PSZ before and after a reinforcement contingency shift, expressed most in PSZ with more severe motivational deficits. In a subsample of 22 PSZ and 22 healthy volunteers, we found little evidence for between-group differences in VS RPE and dmPFC learning rate signals, as measured with fMRI. However, a follow-up psychophysiological interaction analysis revealed decreased dmPFC-VS connectivity concurrent with learning rate modulation, most prominently in individuals with the most severe motivational deficits. These findings point to an impairment in learning rate modulation in PSZ, leading to a reduced ability to adjust task behavior in response to unexpected outcomes. At the level of the brain, learning rate modulation deficits may be associated with decreased involvement of the dmPFC within a greater RL network.

Towards a Unifying Cognitive, Neurophysiological, and Computational Neuroscience Account of Schizophrenia

Psychotic experiences may be understood as altered information processing due to aberrant neural computations. A prominent example of such neural computations is the computation of prediction errors (PEs), which signal the difference between expected and experienced events. Among other areas showing PE coding, hippocampal-prefrontal-striatal neurocircuits play a prominent role in information processing. Dysregulation of dopaminergic signaling, often secondary to psychosocial stress, is thought to interfere with the processing of biologically important events (such as reward prediction errors) and result in the aberrant attribution of salience to irrelevant sensory stimuli and internal representations. Bayesian hierarchical predictive coding offers a promising framework for the identification of dysfunctional neurocomputational processes and the development of a mechanistic understanding of psychotic experience. According to this framework, mismatches between prior beliefs encoded at higher levels of the cortical hierarchy and lower-level (sensory) information can also be thought of as PEs, with important consequences for belief updating. Low levels of precision in the representation of prior beliefs relative to sensory data, as well as dysfunctional interactions between prior beliefs and sensory data in an ever-changing environment, have been suggested as a general mechanism underlying psychotic experiences. Translating the promise of the Bayesian hierarchical predictive coding into patient benefit will come from integrating this framework with existing knowledge of the etiology and pathophysiology of psychosis, especially regarding hippocampal-prefrontal-striatal network function and neural mechanisms of information processing and belief updating.

Cyfip1 haploinsufficient rats show white matter changes, myelin thinning, abnormal oligodendrocytes and behavioural inflexibility

The biological basis of the increased risk for psychiatric disorders seen in 15q11.2 copy number deletion is unknown. Previous work has shown disturbances in white matter tracts in human carriers of the deletion. Here, in a novel rat model, we recapitulated low dosage of the candidate risk gene CYFIP1 present within the 15q11.2 interval. Using diffusion tensor imaging, we first showed extensive white matter changes in Cyfip1 mutant rats, which were most pronounced in the corpus callosum and external capsule. Transmission electron microscopy showed that these changes were associated with thinning of the myelin sheath in the corpus callosum. Myelin thinning was independent of changes in axon number or diameter but was associated with effects on mature oligodendrocytes, including aberrant intracellular distribution of myelin basic protein. Finally, we demonstrated effects on cognitive phenotypes sensitive to both disruptions in myelin and callosal circuitry.

People with a genetic deletion of the 15q11.2 locus are at increased risk for psychiatric disorders and white matter disturbances, but the gene(s) responsible are unclear. Here, the authors show that low dosage of CYFIP1, present in the human 15q11.2 region, alters white matter structure and cognition in rats.

Nonsocial and social cognition in schizophrenia: current evidence and future directions

Cognitive impairment in schizophrenia involves a broad array of nonsocial and social cognitive domains. It is a core feature of the illness, and one with substantial implications for treatment and prognosis. Our understanding of the causes, consequences and interventions for cognitive impairment in schizophrenia has grown substantially in recent years. Here we review a range of topics, including: a) the types of nonsocial cognitive, social cognitive, and perceptual deficits in schizophrenia; b) how deficits in schizophrenia are similar or different from those in other disorders; c) cognitive impairments in the prodromal period and over the lifespan in schizophrenia; d) neuroimaging of the neural substrates of nonsocial and social cognition, and e) relationships of nonsocial and social cognition to functional outcome. The paper also reviews the considerable efforts that have been directed to improve cognitive impairments in schizophrenia through novel psychopharmacology, cognitive remediation, social cognitive training, and alternative approaches. In the final section, we consider areas that are emerging and have the potential to provide future insights, including the interface of motivation and cognition, the influence of childhood adversity, metacognition, the role of neuroinflammation, computational modelling, the application of remote digital technology, and novel methods to evaluate brain network organization. The study of cognitive impairment has provided a way to approach, examine and comprehend a wide range of features of schizophrenia, and it may ultimately affect how we define and diagnose this complex disorder.

A distinct inferential mechanism for delusions in schizophrenia

Delusions, a core symptom of psychosis, are false beliefs that are rigidly held with strong conviction despite contradictory evidence. Alterations in inferential processes have long been proposed to underlie delusional pathology, but previous attempts to show this have failed to yield compelling evidence for a specific relationship between inferential abnormalities and delusional severity in schizophrenia. Using a novel, incentivized information-sampling task (a modified version of the beads task), alongside well-characterized decision-making tasks, we sought a mechanistic understanding of delusions in a sample of medicated and unmedicated patients with schizophrenia who exhibited a wide range of delusion severity. In this novel task, participants chose whether to draw beads from one of two hidden jars or to guess the identity of the hidden jar, in order to minimize financial loss from a monetary endowment, and concurrently reported their probability estimates for the hidden jar. We found that patients with higher delusion severity exhibited increased information seeking (i.e. increased draws-to-decision behaviour). This increase was highly specific to delusion severity as compared to the severity of other psychotic symptoms, working-memory capacity, and other clinical and socio-demographic characteristics. Delusion-related increases in information seeking were present in unmedicated patients, indicating that they were unlikely due to antipsychotic medication. In addition, after adjusting for delusion severity, patients as a whole exhibited decreased information seeking relative to healthy individuals, a decrease that correlated with lower socioeconomic status. Computational analyses of reported probability estimates further showed that more delusional patients exhibited abnormal belief updating characterized by stronger reliance on prior beliefs formed early in the inferential process, a feature that correlated with increased information seeking in patients. Other decision-making parameters that could have theoretically explained the delusion effects, such as those related to subjective valuation, were uncorrelated with both delusional severity and information seeking among the patients. In turn, we found some preliminary evidence that subjective valuation (rather than belief updating) may explain group differences in information seeking unrelated to delusions. Together, these results suggest that abnormalities in belief updating, characterized by stronger reliance on prior beliefs formed by incorporating information presented earlier in the inferential process, may be a core computational mechanism of delusional ideation in psychosis. Our results thus provide direct empirical support for an inferential mechanism that naturally captures the characteristic rigidity associated with delusional beliefs.

Hop-Derived Iso-α-Acids in Beer Improve Visual Discrimination and Reversal Learning in Mice as Assessed by a Touch Panel Operant System

Dementia and cognitive decline have become worldwide health problems due to rapid growth of the aged population in many countries. We previously demonstrated that single or short-term administration of iso-α-acids, hop-derived bitter acids in beer, improves the spatial memory of scopolamine-induced amnesia model mice in the Y-maze and enhances novel object recognition in normal mice via activation of the vagus nerve and hippocampal dopaminergic system. However, these behavioral tests do not replicate the stimulus conditions or response requirements of human memory tests, and so may have poor translational validity. In this report, we investigated the effects of iso-α-acids on visual discrimination (VD) and reversal discrimination (RD) using a touch panel-based operant system similar to that used for human working memory tests. In the VD task, scopolamine treatment reduced correct response rate and prolonged response latency in mice, deficits reversed by prior oral administration of iso-α-acids. In the RD task, administration of iso-α-acids significantly increased correct response rate compared to vehicle administration. Previous studies have reported that dopamine signaling is involved in both VD and RD learning, suggesting that enhancement of dopamine release contributes to improved memory performance in mice treated with iso-α-acids. Taken together, iso-α-acids improve VD and RD learning, which are considered high-order cognitive functions. Given the translational advantages of the touch panel-based operant system, the present study suggests that iso-α-acids could be effective for improvement of working memory in human dementia patients.