Reward learning as a potential target for pharmacological augmentation of cognitive remediation for schizophrenia: a roadmap for preclinical development

Galvanic Skin Response Features in Psychiatry and Mental Disorders: A Narrative Review

This narrative review is aimed at presenting the galvanic skin response (GSR) Biofeedback method and possibilities for its application in persons with mental disorders as a modern form of neurorehabilitation. In the treatment of mental disorders of various backgrounds and courses, attention is focused on methods that would combine pharmacological treatment with therapies improving functioning. Currently, the focus is on neuronal mechanisms which, being physiological markers, offer opportunities for correction of existing deficits. One such indicator is electrodermal activity (EDA), providing information about emotions, cognitive processes, and behavior, and thus, about the function of various brain regions. Measurement of the galvanic skin response (GSR), both skin conductance level (SCL) and skin conductance responses (SCR), is used in diagnostics and treatment of mental disorders, and the training method itself, based on GSR Biofeedback, allows for modulation of the emotional state depending on needs occurring. Summary: It is relatively probable that neurorehabilitation based on GSR-BF is a method worth noticing, which-in the future-can represent an interesting area of rehabilitation supplementing a comprehensive treatment for people with mental disorders.

Neural Circuitry of Salience and Reward Processing in Psychosis

The processing of salient and rewarding stimuli is integral to engaging our attention, stimulating anticipation for future events, and driving goal-directed behaviors. Widespread impairments in these processes are observed in psychosis, which may be associated with worse functional outcomes or mechanistically linked to the development of symptoms. Here, we summarize the current knowledge of behavioral and functional neuroimaging in salience, prediction error, and reward. Although each is a specific process, they are situated in multiple feedback and feedforward systems integral to decision making and cognition more generally. We argue that the origin of salience and reward processing dysfunctions may be centered in the subcortex during the earliest stages of psychosis, with cortical abnormalities being initially more spared but becoming more prominent in established psychotic illness/schizophrenia. The neural circuits underpinning salience and reward processing may provide targets for delaying or preventing progressive behavioral and neurobiological decline.

Genomic and Non-genomic Action of Neurosteroids in the Peripheral Nervous System

Since the former evidence of biologic actions of neurosteroids in the central nervous system, also the peripheral nervous system (PNS) was reported as a structure affected by these substances. Indeed, neurosteroids are synthesized and active in the PNS, exerting many important actions on the different cell types of this system. PNS is a target for neurosteroids, in their native form or as metabolites. In particular, old and recent evidence indicates that the progesterone metabolite allopregnanolone possesses important functions in the PNS, thus contributing to its physiologic processes. In this review, we will survey the more recent findings on the genomic and non-genomic actions of neurosteroids in nerves, ganglia, and cells forming the PNS, focusing on the mechanisms regulating the peripheral neuron-glial crosstalk. Then, we will refer to the physiopathological significance of the neurosteroid signaling disturbances in the PNS, in to identify new molecular targets for promising pharmacotherapeutic approaches.

Oxytocin improves probabilistic reversal learning but not effortful motivation in Brown Norway rats

Deficits in cognition and motivation are common and debilitating aspects of psychiatric disorders, yet still go largely untreated. The neuropeptide oxytocin (OT) is a potential novel therapeutic for deficits in social cognition and motivation in psychiatric patients. However, the effects of OT on clinically relevant domains of non-social cognition and motivation remain under studied. The present study investigated the effects of acute and chronic (21-day) administration of subcutaneous OT (0.04, 0.2, and 1 mg/kg) in cross-species translatable operant paradigms of reward learning and effortful motivation in male and female Brown Norway (BN) rats (n = 8-10/group). Reward learning was assessed using the probabilistic reversal learning task (PRLT) and effortful motivation was measured using the progressive ratio breakpoint task (PRBT). As predicted, BN rats exhibited baseline deficits in the detection of reversals of reward contingency in the PRLT relative to Long Evans (LE) rats. The two strains performed equally in the PRBT. Thirty minutes after a single OT injection (1 mg/kg), measures of both initial probabilistic learning (trials to first criterion) and subsequent reversal learning (contingency switches) were significantly improved to levels comparable with LE rats. The OT effect on switches persisted in male, but not female, BN rats 30 min, 24 h, and 6 days after long-term OT administration, suggesting the induction of neuroplastic changes. OT did not affect effortful motivation at any time-point. The beneficial effects of OT on reward learning in the absence of increased effortful motivation support the development of OT as a novel therapeutic to improve cognitive functioning.

Nicotine improves probabilistic reward learning in wildtype but not alpha7 nAChR null mutants, yet alpha7 nAChR agonists do not improve probabilistic learning

Cognitive impairments, e.g., reward learning, are present in various psychiatric disorders and warrant treatment. Improving reward-related learning could synergistically enhance psychosocial treatments and cognition generally. A critical first step is to understand the mechanisms underlying reward learning. The dopamine system has been implicated in such learning, but less known is how indirect activation of this system may affect reward learning. We determined the role of alpha7 nicotinic acetylcholine receptors (nAChR) on a probabilistic reversal learning task (PRLT) in mice that includes reward and punishment. Male alpha7 knockout (KO), heterozygous (HT), and wildtype (WT) littermate mice (n = 84) were treated with vehicle, 0.03, or 0.3 mg/kg nicotine. Two cohorts of C57BL/6NJ male mice were treated with various alpha7 nAChR ligands, including the full agonists PNU282877 and AR-R-17779, the positive allosteric modulator CCMI, the partial agonist SSR180711, and the antagonist methyllycaconitine. All mice were then tested in the PRLT. Nicotine (0.3 mg/kg) significantly improved initial reward learning in alpha7 WT and HT mice but did not improve learning in KO mice, suggesting an involvement of the alpha7 nAChR in the pro-learning effects of nicotine. Neither alpha7 nAChR treatments (PNU282987, AR-R-17779, CCMI, SSR180711, nor methyllycaconitine) affected mouse PRLT performance however. Nicotine improved reward learning via a mechanism that may include alpha7 nAChRs. This improvement unlikely relied solely on alpha7 nAChRs however, since no alpha7 nAChR ligand improved reward learning in normal mice. Future assessments of the effects of other nAChR subtypes on reward learning are needed.

The effects of early life stress on reward processing

Early life stress (ELS), in the form of childhood maltreatment, abuse, or neglect, increases the risk for psychiatric sequelae later in life. The neurobiology of response to early stress and of reward processing overlap substantially, leading to the prediction that reward processing may be a primary mediator of the effects of early life stress. We describe a growing body of literature investigating the effects of early life stressors on reward processing in animals and humans. Despite variation in the reviewed studies, an emerging pattern of results indicates that ELS results in deficits of ventral striatum-related functions of reward responsiveness and approach motivation, especially when the stressor is experienced in early in development. For stressors experienced later in the juvenile period and adolescence, the animal literature suggests an opposite effect, in which ELS results in increased hedonic drive. Future research in this area will help elucidate the transdiagnostic impact of early life stress, and therefore potentially identify and intervene with at-risk youth, prior to the emergence of clinical psychopathology.

Relationship between effortful motivation and neurocognition in schizophrenia

Effortful motivation and reward valuation learning deficits are associated with negative symptoms and impaired cognition in schizophrenia (SZ) patients. Whereas clinical assessments of motivation and reward value typically rely upon clinician ratings or self-report scales, behavioral measures often confound these constructs. Simple reverse-translated behavioral tasks that independently quantify motivation and reward valuation-which could then be linked to cognition-may facilitate the development of pro-cognitive therapeutics by bridging the "preclinical-to-clinical" gap. This study determined whether novel behavioral measures of effortful motivation and reward valuation are associated with impaired cognition in SZ patients (n=36). Patients completed the Progressive Ratio Breakpoint task (PRBT; physical effort motivation) and the Probabilistic Learning Task (PLT; reward learning/valuation) in conjunction with the MATRICS Consensus Cognitive Battery (MCCB). SZ patients exhibited statistically significant deficits in global cognition and all individual MCCB subdomains. Significant correlations were observed between PRBT and MCCB global cognition (r=0.52), speed of processing (r=0.56) and attention vigilance (r=0.48) subdomains, but not with PLT or clinical symptoms. Results indicate that effort and reward learning deficits are dissociable targets that can improve our understanding of cognitive impairments associated among patients with SZ. More importantly, the results support the long-standing notion that the measurement of cognitive impairments in SZ is highly linked to a willingness to expend effort. The availability of a PRBT designed for use in both rodents and humans could improve our understanding of the nature of cognitive impairments in neuropsychiatric disorders and accelerate the development of novel pro-cognitive therapeutics.

Phencyclidine increased while isolation rearing did not affect progressive ratio responding in rats: Investigating potential models of amotivation in schizophrenia

BACKGROUND

Schizophrenia is a debilitating neurodevelopmental disorder affecting 1% of the global population with heterogeneous symptoms including positive, negative, and cognitive. While treatment for positive symptoms exists, none have been developed to treat negative symptoms. Animal models of schizophrenia are required to test targeted treatments and since patients exhibit reduced effort (breakpoints) for reward in a progressive ratio (PR) task, we examined the PR breakpoints of rats treated with the NMDA receptor antagonist phencyclidine or those reared in isolation - two common manipulations used to induce schizophrenia-relevant behaviors in rodents.

METHODS

In two cohorts, the PR breakpoint for a palatable food reward was examined in Long Evans rats after: 1) a repeated phencyclidine regimen; 2) A subchronic phencyclidine regimen followed by drug washout; and 3) post-weaning social isolation.

RESULTS

Rats treated with repeated phencyclidine and those following washout from phencyclidine exhibited higher PR breakpoints than vehicle-treated rats. The breakpoint of isolation reared rats did not differ from those socially reared, despite abnormalities of these rats in other schizophrenia-relevant behaviors.

CONCLUSION

Despite their common use for modeling other schizophrenia-relevant behaviors neither phencyclidine treatment nor isolation rearing recreated the motivational deficits observed in patients with schizophrenia, as measured by PR breakpoint. Other manipulations, and negative symptom-relevant behaviors, require investigation prior to testing putative therapeutics.

Blockade of dopamine D1-family receptors attenuates the mania-like hyperactive, risk-preferring, and high motivation behavioral profile of mice with low dopamine transporter levels

BACKGROUND

Patients with bipolar disorder mania exhibit poor cognition, impulsivity, risk-taking, and goal-directed activity that negatively impact their quality of life. To date, existing treatments for bipolar disorder do not adequately remediate cognitive dysfunction. Reducing dopamine transporter expression recreates many bipolar disorder mania-relevant behaviors (i.e. hyperactivity and risk-taking). The current study investigated whether dopamine D1-family receptor blockade would attenuate the risk-taking, hypermotivation, and hyperactivity of dopamine transporter knockdown mice.

METHODS

Dopamine transporter knockdown and wild-type littermate mice were tested in mouse versions of the Iowa Gambling Task (risk-taking), Progressive Ratio Breakpoint Test (effortful motivation), and Behavioral Pattern Monitor (activity). Prior to testing, the mice were treated with the dopamine D1-family receptor antagonist SCH 23390 hydrochloride (0.03, 0.1, or 0.3 mg/kg), or vehicle.

RESULTS

Dopamine transporter knockdown mice exhibited hyperactivity and hyperexploration, hypermotivation, and risk-taking preference compared with wild-type littermates. SCH 23390 hydrochloride treatment decreased premature responding in dopamine transporter knockdown mice and attenuated their hypermotivation. SCH 23390 hydrochloride flattened the safe/risk preference, while reducing activity and exploratory levels of both genotypes similarly.

CONCLUSIONS

Dopamine transporter knockdown mice exhibited mania-relevant behavior compared to wild-type mice. Systemic dopamine D1-family receptor antagonism attenuated these behaviors in dopamine transporter knockdown, but not all effects were specific to only the knockdown mice. The normalization of behavior via blockade of dopamine D1-family receptors supports the hypothesis that D1 and/or D5 receptors could contribute to the mania-relevant behaviors of dopamine transporter knockdown mice.

Electroacupuncture attenuates learning and memory impairment via activation of α7nAChR-mediated anti-inflammatory activity in focal cerebral ischemia/reperfusion injured rats

Studies have reported that electroacupuncture (EA) may reduce learning and memory impairment following cerebral ischemic injury. However, the precise mechanism of action remains unclear. In the present study, the attenuation of focal cerebral ischemia/reperfusion injury by EA in rats was investigated. EA at the Baihui (DU 20) and Shenting (DU 24) acupoints was demonstrated to significantly improve performance in the Morris water maze task, with shortened latency time and increased frequency of passing the platform. Molecular analysis revealed that EA activated the expression of α7 nicotinic acetylcholine receptors (α7nAChR) in the hippocampus. In addition, EA led to a decreased expression of the microglia/macrophage marker Iba1 and the astrocyte marker glial fibrillary acidic protein in the hippocampus. EA treatment also led to decreased production of the inflammatory cytokines tumor necrosis factor-α and interleukin-1β. Treatment with methyllycaconitine, an α7nAChR antagonist, attenuated the improvement of learning and memory following EA treatment and the inhibitory effects of EA on glial cell activation and inflammatory cytokine production. In conclusion, the findings of the present study demonstrate that EA is able to improve learning and memory function following cerebral ischemic injury via activation of α7nAChR, which significantly decreases the neuroinflammatory response.

Striatal dopamine D1 receptor suppression impairs reward-associative learning

Dopamine (DA) is required for reinforcement learning. Hence, disruptions in DA signaling may contribute to the learning deficits associated with psychiatric disorders. The DA D1 receptor (D1R) has been linked to learning and is a target for cognitive/motivational enhancement in patients with schizophrenia. Separating the striatal D1R contribution to learning vs. motivation, however, has been challenging. We suppressed striatal D1R expression in mice using a D1R-targeting short hairpin RNA (shRNA), delivered locally to the striatum via an adeno-associated virus (AAV). We then assessed reward- and punishment-associative learning using a probabilistic learning task and motivation using a progressive-ratio breakpoint procedure. We confirmed suppression of striatal D1Rs immunohistochemically and by testing locomotor activity after the administration of (+)-doxanthrine, a full D1R agonist, in control mice and those treated with the D1RshRNA. D1RshRNA-treated mice exhibited impaired reward-associative learning, while punishment-associative learning was spared. This deficit was unrelated to general learning impairments or amotivation, because the D1shRNA-treated mice exhibited normal Barnes maze learning and normal motivation in the progressive-ratio breakpoint procedure. Suppression of striatal D1Rs selectively impaired reward-associative learning whereas punishment-associative learning, aversion-motivated learning, and appetitive motivation were spared. Because patients with schizophrenia exhibit similar reward-associative learning deficits, D1R-targeted treatments should be investigated to improve reward learning in these patients.

The effects of reduced dopamine transporter function and chronic lithium on motivation, probabilistic learning, and neurochemistry in mice: Modeling bipolar mania

BACKGROUND

Bipolar disorder (BD) mania patients exhibit poor cognition and reward-seeking/hypermotivation, negatively impacting a patient's quality of life. Current treatments (e.g., lithium), do not treat such deficits. Treatment development has been limited due to a poor understanding of the neural mechanisms underlying these behaviors. Here, we investigated putative mechanisms underlying cognition and reward-seeking/motivational changes relevant to BD mania patients using two validated mouse models and neurochemical analyses.

METHODS

The effects of reducing dopamine transporter (DAT) functioning via genetic (knockdown vs. wild-type littermates), or pharmacological (GBR12909- vs. vehicle-treated C57BL/6J mice) means were assessed in the probabilistic reversal learning task (PRLT), and progressive ratio breakpoint (PRB) test, during either water or chronic lithium treatment. These tasks quantify reward learning and effortful motivation, respectively. Neurochemistry was performed on brain samples of DAT mutants ± chronic lithium using high performance liquid chromatography.

RESULTS

Reduced DAT functioning increased reversals in the PRLT, an effect partially attenuated by chronic lithium. Chronic lithium alone slowed PRLT acquisition. Reduced DAT functioning increased motivation (PRB), an effect attenuated by lithium in GBR12909-treated mice. Neurochemical analyses revealed that DAT knockdown mice exhibited elevated homovanillic acid levels, but that lithium had no effect on these elevated levels.

CONCLUSIONS

Reducing DAT functioning recreates many aspects of BD mania including hypermotivation and improved reversal learning (switching), as well as elevated homovanillic acid levels. Chronic lithium only exerted main effects, impairing learning and elevating norepinephrine and serotonin levels of mice, not specifically treating the underlying mechanisms identified in these models.

GlyT-1 Inhibition Attenuates Attentional But Not Learning or Motivational Deficits of the Sp4 Hypomorphic Mouse Model Relevant to Psychiatric Disorders

Serious mental illness occurs in 25% of the general population, with many disorders being neurodevelopmental, lifelong, and debilitating. The wide variation and overlap in symptoms across disorders increases the difficulty of research and treatment development. The NIMH Research Domain of Criteria initiative aims to improve our understanding of the molecular and behavioral consequences of specific neurodevelopmental mechanisms across disorders, enabling targeted treatment development. The transcription factor Specificity Protein 4 (SP4) is important for neurodevelopment and is genetically associated with both schizophrenia and bipolar disorder. Reduced Sp4 expression in mice (hypomorphic) reproduces several characteristics of psychiatric disorders. We further tested the utility of Sp4 hypomorphic mice as a model organism relevant to psychiatric disorders by assessing cognitive control plus effort and decision-making aspects of approach motivation using cross-species-relevant tests. Sp4 hypomorphic mice exhibited impaired attention as measured by the 5-Choice Continuous Performance Test, an effect that was attenuated by glycine type-1 transporter (GlyT-1) inhibition. Hypomorphic mice also exhibited reduced motivation to work for a reward and impaired probabilistic learning. These deficits may stem from affected anticipatory reward, analogous to anhedonia in patients with schizophrenia and other psychiatric disorders. Neither positive valence deficit was attenuated by GlyT-1 treatment, suggesting that these and the attentional deficits stem from different underlying mechanisms. Given the association of SP4 gene with schizophrenia and bipolar disorder, the present studies provide support that personalized GlyT-1 inhibition may treat attentional deficits in neuropsychiatric patients with low SP4 levels.

Dopamine physiology in the basal ganglia of male zebra finches during social stimulation

Accumulating evidence suggests that dopamine (DA) is involved in altering neural activity and gene expression in a zebra finch cortical–basal ganglia circuit specialized for singing, upon the shift between solitary singing and singing as a part of courtship. Our objective here was to sample changes in the extracellular concentrations of DA in Area X of adult and juvenile birds, to test the hypothesis that DA levels would change similarly during presentation of a socially salient stimulus in both age groups. We used microdialysis to sample the extracellular milieu of Area X in awake, behaving adult and juvenile male zebra finches, and analysed the dialysate using high-performance liquid chromatography coupled with electrochemical detection. The extracellular levels of DA in Area X increased significantly during both female presentation to adult males and tutor presentation to juvenile males. DA levels were not correlated with the time spent singing. We also reverse-dialysed Area X with pharmacologic agents that act either on DA systems directly or on norepinephrine, and found that all of these agents significantly increased DA levels (3- to 10-fold) in Area X. These findings suggest that changes in extracellular DA levels can be stimulated similarly by very different social contexts (courtship and interaction with tutor), and influenced potently by dopaminergic and noradrenergic drugs. These results raise the possibility that the arousal level or attentional state of the subject (rather than singing behavior) is the common feature eliciting changes in extracellular DA concentration.

Developing treatments for cognitive deficits in schizophrenia: the challenge of translation

Schizophrenia is a life-long debilitating mental disorder affecting tens of millions of people worldwide. The serendipitous discovery of antipsychotics focused pharmaceutical research on developing a better antipsychotic. Our understanding of the disorder has advanced however, with the knowledge that cognitive enhancers are required for patients in order to improve their everyday lives. While antipsychotics treat psychosis, they do not enhance cognition and hence are not antischizophrenics. Developing pro-cognitive therapeutics has been extremely difficult, however, especially when no approved treatment exists. In lieu of stumbling on an efficacious treatment, developing targeted compounds can be facilitated by understanding the neural mechanisms underlying altered cognitive functioning in patients. Equally importantly, these cognitive domains will need to be measured similarly in animals and humans so that novel targets can be tested prior to conducting expensive clinical trials. To date, the limited similarity of testing across species has resulted in a translational bottleneck. In this review, we emphasize that schizophrenia is a disorder characterized by abnormal cognitive behavior. Quantifying these abnormalities using tasks having cross-species validity would enable the quantification of comparable processes in rodents. This approach would increase the likelihood that the neural substrates underlying relevant behaviors will be conserved across species. Hence, we detail cross-species tasks which can be used to test the effects of manipulations relevant to schizophrenia and putative therapeutics. Such tasks offer the hope of providing a bridge between non-clinical and clinical testing that will eventually lead to treatments developed specifically for patients with deficient cognition.

Identifying cognitive remediation change through computational modelling--effects on reinforcement learning in schizophrenia

OBJECTIVE

Converging research suggests that individuals with schizophrenia show a marked impairment in reinforcement learning, particularly in tasks requiring flexibility and adaptation. The problem has been associated with dopamine reward systems. This study explores, for the first time, the characteristics of this impairment and how it is affected by a behavioral intervention-cognitive remediation.

METHOD

Using computational modelling, 3 reinforcement learning parameters based on the Wisconsin Card Sorting Test (WCST) trial-by-trial performance were estimated: R (reward sensitivity), P (punishment sensitivity), and D (choice consistency). In Study 1 the parameters were compared between a group of individuals with schizophrenia (n = 100) and a healthy control group (n = 50). In Study 2 the effect of cognitive remediation therapy (CRT) on these parameters was assessed in 2 groups of individuals with schizophrenia, one receiving CRT (n = 37) and the other receiving treatment as usual (TAU, n = 34).

RESULTS

In Study 1 individuals with schizophrenia showed impairment in the R and P parameters compared with healthy controls. Study 2 demonstrated that sensitivity to negative feedback (P) and reward (R) improved in the CRT group after therapy compared with the TAU group. R and P parameter change correlated with WCST outputs. Improvements in R and P after CRT were associated with working memory gains and reduction of negative symptoms, respectively.

CONCLUSION

Schizophrenia reinforcement learning difficulties negatively influence performance in shift learning tasks. CRT can improve sensitivity to reward and punishment. Identifying parameters that show change may be useful in experimental medicine studies to identify cognitive domains susceptible to improvement.

Cognitive training in mental disorders: update and future directions

OBJECTIVE

This article reviews the conceptual basis, definitions, and evolution of cognitive training approaches for the treatment of mental disorders.

METHOD

The authors review the current state of the knowledge on cognitive training in psychiatric illnesses, and its neural and behavioral targets, and summarize the factors that appear to relate to a successful response, including learner characteristics that influence clinical outcome. They also discuss methodological issues relevant to the development and testing of cognitive training approaches, with the goal of creating maximally efficient and effective approaches to training. Finally, they identify gaps in existing knowledge and outline key research directions for the future.

RESULTS

While much of the early research has been conducted in schizophrenia, cognitive training has more recently been applied to a widening range of neuropsychiatric illnesses, including attention deficit hyperactivity disorder, mood disorders, and substance use disorders. Cognitive training harnesses the inherent neuroplastic capacities of the brain, targeting neural system function across psychiatric disorders, thus improving the cognitive processes that play a role in emotion regulation, clinical symptoms, and adaptive community functioning.

CONCLUSIONS

Cognitive training offers considerable promise, especially given the limited efficacy of pharmacological interventions in ameliorating cognitive deficits. However, more research is needed to understand the mechanisms underlying cognitive training, predictors of response, generalization and real-world applicability, and approaches to dissemination in practice settings.