Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

GlyT-1 Inhibition Attenuates Attentional But Not Learning or Motivational Deficits of the Sp4 Hypomorphic Mouse Model Relevant to Psychiatric Disorders

Serious mental illness occurs in 25% of the general population, with many disorders being neurodevelopmental, lifelong, and debilitating. The wide variation and overlap in symptoms across disorders increases the difficulty of research and treatment development. The NIMH Research Domain of Criteria initiative aims to improve our understanding of the molecular and behavioral consequences of specific neurodevelopmental mechanisms across disorders, enabling targeted treatment development. The transcription factor Specificity Protein 4 (SP4) is important for neurodevelopment and is genetically associated with both schizophrenia and bipolar disorder. Reduced Sp4 expression in mice (hypomorphic) reproduces several characteristics of psychiatric disorders. We further tested the utility of Sp4 hypomorphic mice as a model organism relevant to psychiatric disorders by assessing cognitive control plus effort and decision-making aspects of approach motivation using cross-species-relevant tests. Sp4 hypomorphic mice exhibited impaired attention as measured by the 5-Choice Continuous Performance Test, an effect that was attenuated by glycine type-1 transporter (GlyT-1) inhibition. Hypomorphic mice also exhibited reduced motivation to work for a reward and impaired probabilistic learning. These deficits may stem from affected anticipatory reward, analogous to anhedonia in patients with schizophrenia and other psychiatric disorders. Neither positive valence deficit was attenuated by GlyT-1 treatment, suggesting that these and the attentional deficits stem from different underlying mechanisms. Given the association of SP4 gene with schizophrenia and bipolar disorder, the present studies provide support that personalized GlyT-1 inhibition may treat attentional deficits in neuropsychiatric patients with low SP4 levels.

The translational study of apathy-an ecological approach

Apathy, a quantitative reduction in goal-directed behavior, is a prevalent symptom dimension with a negative impact on functional outcome in various neuropsychiatric disorders including schizophrenia and depression. The aim of this review is to show that interview-based assessment of apathy in humans and observation of spontaneous rodent behavior in an ecological setting can serve as an important complementary approach to already existing task-based assessment, to study and understand the neurobiological bases of apathy. We first discuss the paucity of current translational approaches regarding animal equivalents of psychopathological assessment of apathy. We then present the existing evaluation scales for the assessment of apathy in humans and propose five sub-domains of apathy, namely self-care, social interaction, exploration, work/education and recreation. Each of the items in apathy evaluation scales can be assigned to one of these sub-domains. We then show that corresponding, well-validated behavioral readouts exist for rodents and that, indeed, three of the five human apathy sub-domains have a rodent equivalent. In conclusion, the translational ecological study of apathy in humans and rodents is possible and will constitute an important approach to increase the understanding of the neurobiological bases of apathy and the development of novel treatments.

Translational Rodent Paradigms to Investigate Neuromechanisms Underlying Behaviors Relevant to Amotivation and Altered Reward Processing in Schizophrenia

Amotivation and reward-processing deficits have long been described in patients with schizophrenia and considered large contributors to patients' inability to integrate well in society. No effective treatments exist for these symptoms, partly because the neuromechanisms mediating such symptoms are poorly understood. Here, we propose a translational neuroscientific approach that can be used to assess reward/motivational deficits related to the negative symptoms of schizophrenia using behavioral paradigms that can also be conducted in experimental animals. By designing and using objective laboratory behavioral tools that are parallel in their parameters in rodents and humans, the neuromechanisms underlying behaviors with relevance to these symptoms of schizophrenia can be investigated. We describe tasks that measure the motivation of rodents to expend physical and cognitive effort to gain rewards, as well as probabilistic learning tasks that assess both reward learning and feedback-based decision making. The latter tasks are relevant because of demonstrated links of performance deficits correlating with negative symptoms in patients with schizophrenia. These tasks utilize operant techniques in order to investigate neural circuits targeting a specific domain across species. These tasks therefore enable the development of insights into altered mechanisms leading to negative symptom-relevant behaviors in patients with schizophrenia. Such findings will then enable the development of targeted treatments for these altered neuromechanisms and behaviors seen in schizophrenia.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms

Impairments in willingness to exert effort contribute to the motivational deficits characteristic of the negative symptoms of schizophrenia. The current study evaluated the psychometric properties of 5 new or adapted paradigms to determine their suitability for use in clinical trials of schizophrenia. This study included 94 clinically stable participants with schizophrenia and 40 healthy controls. The effort-based decision-making battery was administered twice to the schizophrenia group (baseline, 4-week retest) and once to the control group. The 5 paradigms included 1 that assesses cognitive effort, 1 perceptual effort, and 3 that assess physical effort. Each paradigm was evaluated on (1) patient vs healthy control group differences, (2) test-retest reliability, (3) utility as a repeated measure (ie, practice effects), and (4) tolerability. The 5 paradigms showed varying psychometric strengths and weaknesses. The Effort Expenditure for Rewards Task showed the best reliability and utility as a repeated measure, while the Grip Effort Task had significant patient-control group differences, and superior tolerability and administration duration. The other paradigms showed weaker psychometric characteristics in their current forms. These findings highlight challenges in adapting effort and motivation paradigms for use in clinical trials.

Developmental and familial predictors of adult cognitive traits in the European starling

In birds, there is evidence that adult cognitive traits can both run in families and be affected by early developmental influences. However, different studies use different cognitive tasks, which may not be measuring the same traits, and also focus on different developmental factors. We report results from a study in which we administered multiple cognitive tasks (autoshaping, discrimination learning, reversal learning, progressive ratio schedule, extinction learning and impulsivity) to a cohort of 34 European starlings, Sturnus vulgaris, for which several early developmental measures were available. The cohort consisted of siblings raised either apart or together, whose position in the size hierarchy of the rearing brood had been experimentally manipulated. We examined how the different cognitive measures covaried, the extent to which they ran in families, and which of the developmental factors predicted which of the cognitive outcomes. We found that discrimination and reversal learning speeds were positively correlated, as were breakpoint on the progressive ratio schedule and resistance to extinction. Otherwise, the cognitive measures were uncorrelated, suggesting that they reflected different underlying traits. All traits except discrimination and reversal learning speed ran in families to a substantial extent. Using a model selection approach, we found evidence that natal brood size and developmental telomere attrition (the extent to which the birds' erythrocyte telomeres shortened in early life, an integrative measure of developmental stress) were related to several adult cognitive measures. Results are discussed with respect to the best way of measuring avian cognitive abilities, and the utility of developmental telomere attrition as a predictor of adult outcomes.

•

Cognition in birds may be influenced by familial and developmental factors.

•

We administered cognitive tasks to 34 cross-fostered starlings from eight families.

•

Tasks were uncorrelated, except for two measures of learning and two of persistence.

•

Performance on most tasks ran in families.

•

Natal brood size and early life telomere loss were associated with cognition.

Improving temporal cognition by enhancing motivation

Increasing motivation can positively impact cognitive performance. Here we employed a cognitive timing task that allows us to detect changes in cognitive performance that are not influenced by general activity or arousal factors such as the speed or persistence of responding. This approach allowed us to manipulate motivation using three different methods; molecular/genetic, behavioral and pharmacological. Increased striatal D2Rs resulted in deficits in temporal discrimination. Switching off the transgene improved motivation in earlier studies, and here partially rescued the temporal discrimination deficit. To manipulate motivation behaviorally, we altered reward magnitude and found that increasing reward magnitude improved timing in control mice and partially rescued timing in the transgenic mice. Lastly, we manipulated motivation pharmacologically using a functionally selective 5-HT2C receptor ligand, SB242084, which we previously found to increase incentive motivation. SB242084 improved temporal discrimination in both control and transgenic mice. Thus, while there is a general intuitive belief that motivation can affect cognition, we here provide a direct demonstration that enhancing motivation, in a variety of ways, can be an effective strategy for enhancing temporal cognition. Understanding the interaction of motivation and cognition is of clinical significance since many psychiatric disorders are characterized by deficits in both domains.

Neurobiological basis of motivational deficits in psychopathology

In recent years, there has been increasing emphasis on the importance of motivational symptoms in depression, schizophrenia and other disorders. The present review discusses the conceptual background related to the construct of motivation, and provides a framework that for research on both physiological and pathological aspects of motivation. Particular emphasis is placed on what is known about the neurobiological basis of activational aspects of motivation, including studies from animal models. The role of limbic/prefrontal/striatal circuitry in behavioral activation and effort-related functions is examined, and the utility of behavioral tasks of effort-based decision making as models of motivational symptoms is discussed. We also review the neurobiology of motivational symptoms in relation to psychopathology, and issues related to the language used to characterize motivational dysfunctions are considered. The literature suggests that research on the neurobiology of motivational dysfunction in psychopathology, at both clinical and preclinical levels, could inform the development of novel and more effective treatments for a range of CNS disorders.

Serotonin, neural markers, and memory

Diverse neuropsychiatric disorders present dysfunctional memory and no effective treatment exits for them; likely as result of the absence of neural markers associated to memory. Neurotransmitter systems and signaling pathways have been implicated in memory and dysfunctional memory; however, their role is poorly understood. Hence, neural markers and cerebral functions and dysfunctions are revised. To our knowledge no previous systematic works have been published addressing these issues. The interactions among behavioral tasks, control groups and molecular changes and/or pharmacological effects are mentioned. Neurotransmitter receptors and signaling pathways, during normal and abnormally functioning memory with an emphasis on the behavioral aspects of memory are revised. With focus on serotonin, since as it is a well characterized neurotransmitter, with multiple pharmacological tools, and well characterized downstream signaling in mammals' species. 5-HT_1A, 5-HT₄, 5-HT₅, 5-HT₆, and 5-HT₇ receptors as well as SERT (serotonin transporter) seem to be useful neural markers and/or therapeutic targets. Certainly, if the mentioned evidence is replicated, then the translatability from preclinical and clinical studies to neural changes might be confirmed. Hypothesis and theories might provide appropriate limits and perspectives of evidence.

Selection of sucrose concentration depends on the effort required to obtain it: studies using tetrabenazine, D1, D2, and D3 receptor antagonists

RATIONALE

Low doses of dopamine (DA) antagonists and accumbens DA depletions reduce food-reinforced instrumental behavior but do not impair primary food motivation, causing animals to reallocate behavior away from food-reinforced tasks with high response requirements and select less effortful alternatives. However, it is uncertain if this same pattern of effects would occur if sucrose was used as the reinforcer.

OBJECTIVES

These experiments studied the impact of DA depletion and antagonism on performance of an effort-related choice task using sucrose as the reinforcer, as well as sucrose consumption, preference, and taste reactivity tests.

METHODS

The effects of DA manipulations were assessed using a task in which rats chose between lever pressing on a fixed ratio 7 schedule for 5.0 % sucrose versus freely consuming a less concentrated solution (0.3 %).

RESULTS

The DA depleting agent tetrabenazine shifted effort-related choice, decreasing lever pressing for 5.0 % sucrose but increasing intake of the concurrently available 0.3 % sucrose. Tetrabenazine did not affect sucrose appetitive taste reactivity, or sucrose consumption or preference, in free consumption tests. The D1 antagonist ecopipam and the D2 antagonist haloperidol also shifted choice behavior at doses that did not alter sucrose consumption or preference. In contrast, sucrose pre-exposure reduced consumption across all conditions. D3 antagonism had no effects.

CONCLUSIONS

D1 and D2 receptor blockade and DA depletion reduce the tendency to work for sucrose under conditions that leave fundamental aspects of sucrose motivation (intake, preference, hedonic reactivity) intact. These findings have implications for studies employing sucrose intake or preference in animal models of depression.

Reinforcement learning in depression: A review of computational research

Despite being considered primarily a mood disorder, major depressive disorder (MDD) is characterized by cognitive and decision making deficits. Recent research has employed computational models of reinforcement learning (RL) to address these deficits. The computational approach has the advantage in making explicit predictions about learning and behavior, specifying the process parameters of RL, differentiating between model-free and model-based RL, and the computational model-based functional magnetic resonance imaging and electroencephalography. With these merits there has been an emerging field of computational psychiatry and here we review specific studies that focused on MDD. Considerable evidence suggests that MDD is associated with impaired brain signals of reward prediction error and expected value ('wanting'), decreased reward sensitivity ('liking') and/or learning (be it model-free or model-based), etc., although the causality remains unclear. These parameters may serve as valuable intermediate phenotypes of MDD, linking general clinical symptoms to underlying molecular dysfunctions. We believe future computational research at clinical, systems, and cellular/molecular/genetic levels will propel us toward a better understanding of the disease.

The VMAT-2 inhibitor tetrabenazine alters effort-related decision making as measured by the T-maze barrier choice task: reversal with the adenosine A2A antagonist MSX-3 and the catecholamine uptake blocker bupropion

RATIONALE

Depressed people show effort-related motivational symptoms, such as anergia, retardation, lassitude, and fatigue. Animal tests can model these motivational symptoms, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, at low doses, preferentially depletes dopamine.

OBJECTIVES

The current studies investigated the effects of tetrabenazine on effort-based decision making using the T-maze barrier task.

METHODS

Rats were tested in a T-maze in which the choice arms of the maze contain different reinforcement densities, and under some conditions, a vertical barrier was placed in the high-density arm to provide an effort-related challenge. The first experiment assessed the effects of tetrabenazine under different maze conditions: a barrier in the arm with 4 food pellets and 2 pellets in the no barrier arm (4-2 barrier), 4 pellets in one arm and 2 pellets in the other with no barrier in either arm (no barrier), and 4 pellets in the barrier arm with no pellets in the other (4-0 barrier).

RESULTS

Tetrabenazine (0.25-0.75 mg/kg IP) decreased selection of the high cost/high reward arm when the barrier was present, but had no effect on choice under the no barrier and 4-0 barrier conditions. The effects of tetrabenazine on barrier climbing in the 4-2 condition were reversed by the adenosine A2A antagonist MSX-3 and the catecholamine uptake inhibitor and antidepressant bupropion.

CONCLUSIONS

These studies have implications for the development of animal models of the motivational symptoms of depression and other disorders.

Apathy but not diminished expression in schizophrenia is associated with discounting of monetary rewards by physical effort

Negative symptoms in schizophrenia have been grouped into the 2 factors of apathy and diminished expression, which might be caused by separable pathophysiological mechanisms. Recently, it has been proposed that apathy could be due to dysfunctional integration of reward and effort during decision making. We asked whether apathy in particular is associated with stronger devaluation ("discounting") of monetary rewards that require physical effort. Thirty-one patients with schizophrenia and 20 healthy control participants performed a computerized effort discounting task in which they could choose to exert physical effort on a handgrip to obtain monetary rewards. This procedure yields an individual measure for the strength of effort discounting. The degree of effort discounting was strongly correlated with apathy, but not with diminished expression. Importantly, the association between apathy and effort discounting was not driven by cognitive ability, antipsychotic medication, or other clinical and demographic variables. This study provides the first evidence for a highly specific association of apathy with effort-based decision making in patients with schizophrenia. Within a translational framework, the present effort discounting task could provide a bridge between apathy as a psychopathological phenomenon and established behavioral tasks to address similar states in animals.

5-HT7 receptor activation: procognitive and antiamnesic effects

RATIONALE

The serotonin (5-hydroxytryptamine (5-HT)) 5-HT7 receptor is localized in brain areas mediating memory; however, the role of this receptor on memory remains little explored.

OBJECTIVE

First, demonstrating the associative nature of Pavlovian/instrumental autoshaping (P/I-A) task, rats were exposed (three sessions) to CS-US (Pavlovian autoshaping), truly random control, free operant, and presentations of US or CS, and they were compared with rats trained-tested for one session to the P/I-A procedure. Also, effects of the 5-HT7 receptor agonist LP-211 administered intraperitoneally after training was determined on short- (1.5 h) and long-term memory 24 and 48 h) and on scopolamine-induced memory impairment and cAMP production.

METHODS

Autoshaping and its behavioral controls were studied. Other animals were subjected to an autoshaping training session and immediately afterwards were given (intraperitoneal) vehicle or LP-211 (0.1-10 mg/kg) and/or scopolamine (0.2 mg/kg) and tested for short-term memory (STM) and long-term memory (LTM); their brains were extracted for the cAMP ELISA immunoassay.

RESULTS

P/I-A group produced the higher %CR. LP-211 did not affect STM; nonetheless, at 0.5 and 1.0 mg/kg, it improved LTM. The 5-HT7 receptor antagonist SB-269970 (SB; 10.0 mg/kg) alone had no effect; nevertheless, the LP-211 (1.0 mg/kg) LTM facilitation was reversed by SB. The scopolamine (0.2 mg/kg) induced-decrement in CR was accompanied by significant increased cAMP production. The scopolamine-induced decrement in CR and increments in cAMP were significantly attenuated by LP-211.

CONCLUSIONS

Autoshaping is a reliable associative learning task whose consolidation is facilitated by the 5-HT7 receptor agonist LP-211.

Dissecting negative symptoms in schizophrenia: opportunities for translation into new treatments

Among the constellation of symptoms that characterize schizophrenia, negative symptoms have emerged as a critical feature linked to the functional impairment experienced by affected individuals. Despite advances in our understanding of the role of negative symptoms in the illness, effective treatments for these debilitating symptoms have remained elusive. In this review we explore the contemporary conceptualization of negative symptoms in schizophrenia, including the identification of two key subdomains of diminished expression and amotivation, and clarifications around hedonic capacity. We then explore strategies for clinical assessments of negative symptoms, followed by findings using objective paradigms for evaluating discrete aspects of these negative symptoms in clinical populations and animal models, both for symptoms of diminished expression and within the multifaceted motivation system. We conclude with a consideration of current strategies for drug development for these negative symptoms, the role of heterogeneity in the clinical presentation of symptoms in schizophrenia and opportunities for personalized assessment and treatment approaches, as well as a commentary on current clinical drug trial design and the role of environmental opportunities for novel treatments to effect change and improve outcomes for affected individuals.

Developing treatments for cognitive deficits in schizophrenia: the challenge of translation

Schizophrenia is a life-long debilitating mental disorder affecting tens of millions of people worldwide. The serendipitous discovery of antipsychotics focused pharmaceutical research on developing a better antipsychotic. Our understanding of the disorder has advanced however, with the knowledge that cognitive enhancers are required for patients in order to improve their everyday lives. While antipsychotics treat psychosis, they do not enhance cognition and hence are not antischizophrenics. Developing pro-cognitive therapeutics has been extremely difficult, however, especially when no approved treatment exists. In lieu of stumbling on an efficacious treatment, developing targeted compounds can be facilitated by understanding the neural mechanisms underlying altered cognitive functioning in patients. Equally importantly, these cognitive domains will need to be measured similarly in animals and humans so that novel targets can be tested prior to conducting expensive clinical trials. To date, the limited similarity of testing across species has resulted in a translational bottleneck. In this review, we emphasize that schizophrenia is a disorder characterized by abnormal cognitive behavior. Quantifying these abnormalities using tasks having cross-species validity would enable the quantification of comparable processes in rodents. This approach would increase the likelihood that the neural substrates underlying relevant behaviors will be conserved across species. Hence, we detail cross-species tasks which can be used to test the effects of manipulations relevant to schizophrenia and putative therapeutics. Such tasks offer the hope of providing a bridge between non-clinical and clinical testing that will eventually lead to treatments developed specifically for patients with deficient cognition.

Bupropion increases selection of high effort activity in rats tested on a progressive ratio/chow feeding choice procedure: implications for treatment of effort-related motivational symptoms

BACKGROUND

Depression and related disorders are characterized by deficits in behavioral activation, exertion of effort, and other psychomotor/motivational dysfunctions. Depressed patients show alterations in effort-related decision making and a bias towards selection of low effort activities. It has been suggested that animal tests of effort-related decision making could be useful as models of motivational dysfunctions seen in psychopathology.

METHODS

Because clinical studies have suggested that inhibition of catecholamine uptake may be a useful strategy for treatment of effort-related motivational symptoms, the present research assessed the ability of bupropion to increase work output in rats responding on a test of effort-related decision-making (ie, a progressive ratio/chow feeding choice task). With this task, rats can choose between working for a preferred food (high-carbohydrate pellets) by lever pressing on a progressive ratio schedule vs obtaining a less preferred laboratory chow that is freely available in the chamber.

RESULTS

Bupropion (10.0-40.0 mg/kg intraperitoneal) significantly increased all measures of progressive ratio lever pressing, but decreased chow intake. These effects were greatest in animals with low baseline levels of work output on the progressive ratio schedule. Because accumbens dopamine is implicated in effort-related processes, the effects of bupropion on markers of accumbens dopamine transmission were examined. Bupropion elevated extracellular dopamine levels in accumbens core as measured by microdialysis and increased phosphorylated dopamine and cyclic-AMP related phosphoprotein 32 kDaltons (pDARPP-32) immunoreactivity in a manner consistent with D1 and D2 receptor stimulation.

CONCLUSION

The ability of bupropion to increase exertion of effort in instrumental behavior may have implications for the pathophysiology and treatment of effort-related motivational symptoms in humans.

Attention and the Cholinergic System: Relevance to Schizophrenia

Traditional methods of drug discovery often rely on a unidirectional, "bottom-up" approach: A search for molecular compounds that target a particular neurobiological substrate (e.g., a receptor type), the refinement of those compounds, testing in animal models using high-throughput behavioral screening methods, and then human testing for safety and effectiveness. Many attempts have found the "effectiveness" criterion to be a major stumbling block, and we and others have suggested that success may be improved by an alternative approach that considers the neural circuits mediating the effects of genetic and molecular manipulations on behavior and cognition. We describe our efforts to understand the cholinergic system's role in attention using parallel approaches to test main hypotheses in both rodents and humans as well as generating converging evidence using methods and levels of analysis tailored to each species. The close back-and-forth between these methods has enhanced our understanding of the cholinergic system's role in attention both "bottom-up" and "top-down"-that is, the basic neuroscience identifies potential neuronal circuit-based mechanisms of clinical symptoms, and the patient and genetic populations serve as natural experiments to test and refine hypotheses about its contribution to specific processes. Together, these studies have identified (at least) two major and potentially independent contributions of the cholinergic system to attention: a neuromodulatory component that influences cognitive control in response to challenges from distractors that either make detection more difficult or draw attention away from the distractor, and a phasic or transient cholinergic signal that instigates a shift from ongoing behavior and the activation of cue-associated response. Right prefrontal cortex appears to play a particularly important role in the neuromodulatory component integrating motivational and cognitive influences for top-down control across populations, whereas the transient cholinergic signal involves orbitofrontal regions associated with shifts between internal and external attention. Understanding how these two modes of cholinergic function interact and are perturbed in schizophrenia will be an important prerequisite for developing effective treatments.

Mesolimbic Dopamine and the Regulation of Motivated Behavior

It has been known for some time that nucleus accumbens dopamine (DA) is involved in aspects of motivation , but theoretical approaches to understanding the functions of DA have continued to evolve based upon emerging data and novel concepts. Although it has become traditional to label DA neurons as "reward" neurons, the actual findings are more complicated than that, because they indicate that DA neurons can respond to a variety of motivationally significant stimuli. Moreover, it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. Studies that involve nucleus accumbens DA antagonism or depletion indicate that accumbens DA does not mediate primary food motivation or appetite. Nevertheless, DA is involved in appetitive and aversive motivational processes including behavioral activation , exertion of effort, sustained task engagement, and Pavlovian-to-instrumental transfer. Interference with accumbens DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task and also shifts effort-related choice behavior, biasing animals toward low-effort alternatives. Dysfunctions of mesolimbic DA may contribute to motivational symptoms seen in various psychopathologies, including depression , schizophrenia, parkinsonism, and other disorders.

Translational Assessment of Reward and Motivational Deficits in Psychiatric Disorders

Deficits in reward and motivation are common symptoms characterizing several psychiatric and neurological disorders. Such deficits may include anhedonia, defined as loss of pleasure, as well as impairments in anticipatory pleasure, reward valuation, motivation/effort, and reward learning. This chapter describes recent advances in the development of behavioral tasks used to assess different aspects of reward processing in both humans and non-human animals. While earlier tasks were generally developed independently with limited cross-species correspondence, a newer generation of translational tasks has emerged that are theoretically and procedurally analogous across species and allow parallel testing, data analyses, and interpretation between human and rodent behaviors. Such enhanced conformity between cross-species tasks will facilitate investigation of the neurobiological mechanisms underlying discrete reward and motivated behaviors and is expected to improve our understanding and treatment of neuropsychiatric disorders characterized by reward and motivation deficits.

Motivational assessment of mice using the touchscreen operant testing system: effects of dopaminergic drugs

RATIONALE

Touchscreens are widely used to examine rodent cognition. Current paradigms require animals to view stimuli and nose poke at an appropriate touchscreen location. After responding, there is little screen interaction and, as infra-red touchscreens eliminate the need for physical contact, minimal somatosensory feedback. It is therefore unclear if touchscreens can support the vigorous, repetitive responding required in paradigms like progressive ratio (PR) for assessing motivation and effort-related choice (ERC) for assessing decision-making.

OBJECTIVES

This study aims to adapt and validate PR and ERC for the rodent touchscreen.

METHODS

Male C57Bl/6 mice were trained until responding on PR stabilised. Amphetamine, sulpiride and raclopride were administered via the intraperitoneal route to modify performance. Mice were transferred to ERC and paradigm parameters adjusted to demonstrate behavioural modification. ERC reward preference was assessed by home cage choice analysis.

RESULTS

PR performance stabilised within seven sessions. Amphetamine (1 mg/kg) increased and raclopride (0.3 mg/kg) decreased performance by 63 and 28 %, respectively, with a 20-min injection-test interval. Sulpiride (50 mg/kg) decreased performance by 19 % following a 40-min injection-test interval. Increasing ERC operant requirements shifted responding from the operant response-dependent preferred reward towards the freely available alternative.

CONCLUSIONS

Vigorous, repetitive responding is sustainable in touchscreen PR and ERC and task validation mirrors non-touchscreen versions. Thus, motivation and reward-related decision-making can be measured directly with touchscreens and can be evaluated prior to cognitive testing in the same apparatus to avoid confounding by motivational factors.

Methodological approaches and magnitude of the clinical unmet need associated with amotivation in mood disorders

BACKGROUND

There is growing research interest in studying motivational deficits in different neuropsychiatric disorders because these symptoms appear to be more common than originally reported and negatively impact long-term functional outcomes. However, there is considerable ambiguity in the terminology used to describe motivational deficits in the scientific literature. For the purposes of this manuscript, the term "amotivation" will be utilised in the context of mood disorders, since this is considered a more inclusive/appropriate term for this patient population. Other challenges impacting the study of amotivation in mood disorders, include: appropriate patient population selection; managing or controlling for potential confounding factors; the lack of gold-standard diagnostic criteria and assessment scales; and determination of the most appropriate study duration.

METHODS

This paper summarises the search for a consensus by a group of experts in the optimal approach to studying amotivation in mood disorders.

RESULTS

The consensus of this group is that amotivation in mood disorders is a legitimate therapeutic target, given the magnitude of the associated unmet needs, and that proof-of-concept studies should be conducted in order to facilitate subsequent larger investigations. The focus of this manuscript is to consider the study of amotivation, as a residual symptom of major depressive disorder (MDD) or bipolar depression (BD), following adequate treatment with a typical antidepressant or mood stabiliser/antipsychotic, respectively.

DISCUSSION

There is a paucity of data studying amotivation in mood disorders. This manuscript provides general guidance on the most appropriate study design(s) and methodology to assess potential therapeutic options for the management of residual amotivation in mood disorders.

Effort, symptom validity testing, performance validity testing and traumatic brain injury

BACKGROUND

To understand the neurocognitive effects of brain injury, valid neuropsychological test findings are paramount.

REVIEW

This review examines the research on what has been referred to a symptom validity testing (SVT). Above a designated cut-score signifies a 'passing' SVT performance which is likely the best indicator of valid neuropsychological test findings. Likewise, substantially below cut-point performance that nears chance or is at chance signifies invalid test performance. Significantly below chance is the sine qua non neuropsychological indicator for malingering. However, the interpretative problems with SVT performance below the cut-point yet far above chance are substantial, as pointed out in this review. This intermediate, border-zone performance on SVT measures is where substantial interpretative challenges exist. Case studies are used to highlight the many areas where additional research is needed. Historical perspectives are reviewed along with the neurobiology of effort. Reasons why performance validity testing (PVT) may be better than the SVT term are reviewed.

CONCLUSIONS

Advances in neuroimaging techniques may be key in better understanding the meaning of border zone SVT failure. The review demonstrates the problems with rigidity in interpretation with established cut-scores. A better understanding of how certain types of neurological, neuropsychiatric and/or even test conditions may affect SVT performance is needed.

The VMAT-2 inhibitor tetrabenazine affects effort-related decision making in a progressive ratio/chow feeding choice task: reversal with antidepressant drugs

Behavioral activation is a fundamental feature of motivation, and organisms frequently make effort-related decisions based upon evaluations of reinforcement value and response costs. Furthermore, people with major depression and other disorders often show anergia, psychomotor retardation, fatigue, and alterations in effort-related decision making. Tasks measuring effort-based decision making can be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine induces depressive symptoms in humans, and also preferentially depletes dopamine (DA). Rats were assessed using a concurrent progressive ratio (PROG)/chow feeding task, in which they can either lever press on a PROG schedule for preferred high-carbohydrate food, or approach and consume a less-preferred lab chow that is freely available in the chamber. Previous work has shown that the DA antagonist haloperidol reduced PROG work output on this task, but did not reduce chow intake, effects that differed substantially from those of reinforcer devaluation or appetite suppressant drugs. The present work demonstrated that tetrabenazine produced an effort-related shift in responding on the PROG/chow procedure, reducing lever presses, highest ratio achieved and time spent responding, but not reducing chow intake. Similar effects were produced by administration of the subtype selective DA antagonists ecopipam (D1) and eticlopride (D2), but not by the cannabinoid CB1 receptor neutral antagonist and putative appetite suppressant AM 4413, which suppressed both lever pressing and chow intake. The adenosine A_2A antagonist MSX-3, the antidepressant and catecholamine uptake inhibitor bupropion, and the MAO-B inhibitor deprenyl, all reversed the impairments induced by tetrabenazine. This work demonstrates the potential utility of the PROG/chow procedure as a rodent model of the effort-related deficits observed in depressed patients.

Negative symptoms of schizophrenia: clinical characteristics, pathophysiological substrates, experimental models and prospects for improved treatment

Schizophrenia is a complex and multifactorial disorder generally diagnosed in young adults at the time of the first psychotic episode of delusions and hallucinations. These positive symptoms can be controlled in most patients by currently-available antipsychotics. Conversely, they are poorly effective against concomitant neurocognitive dysfunction, deficits in social cognition and negative symptoms (NS), which strongly contribute to poor functional outcome. The precise notion of NS has evolved over the past century, with recent studies - underpinned by novel rating methods - suggesting two major sub-domains: "decreased emotional expression", incorporating blunted affect and poverty of speech, and "avolition", which embraces amotivation, asociality and "anhedonia" (inability to anticipate pleasure). Recent studies implicate a dysfunction of frontocortico-temporal networks in the aetiology of NS, together with a disruption of cortico-striatal circuits, though other structures are also involved, like the insular and parietal cortices, amygdala and thalamus. At the cellular level, a disruption of GABAergic-glutamatergic balance, dopaminergic signalling and, possibly, oxytocinergic and cannibinoidergic transmission may be involved. Several agents are currently under clinical investigation for the potentially improved control of NS, including oxytocin itself, N-Methyl-d-Aspartate receptor modulators and minocycline. Further, magnetic-electrical "stimulation" strategies to recruit cortical circuits and "cognitive-behavioural-psychosocial" therapies likewise hold promise. To acquire novel insights into the causes and treatment of NS, experimental study is crucial, and opportunities are emerging for improved genetic, pharmacological and developmental modelling, together with more refined readouts related to deficits in reward, sociality and "expression". The present article comprises an integrative overview of the above issues as a platform for this Special Issue of European Neuropsychopharmacology in which five clinical and five preclinical articles treat individual themes in greater detail. This Volume provides, then, a framework for progress in the understanding - and ultimately control - of the debilitating NS of schizophrenia.

Evaluating negative-symptom-like behavioural changes in developmental models of schizophrenia

Many lines of evidence suggest that schizophrenia has a major developmental component and that environmental factors that disrupt key stages of development, such as maternal stress during pregnancy as a result of infection or malnutrition, can increase the risk of developing schizophrenia in later life. This review examines how non-clinical neurodevelopmental models pertinent to schizophrenia have been evaluated for their ability to reproduce behavioural deficits related to the negative symptoms of schizophrenia. The more frequently used are the prenatal application of the mitotoxic agent methylazoxymethanol, prenatal immune challenge and the neonatal ventral hippocampus lesion model. In general they have been extensively evaluated in models considered relevant to positive symptoms of schizophrenia. In contrast, very few studies have examined tests related to negative symptoms and, when they have, it has almost exclusively been a social interaction model. Other aspects related to negative symptoms such as anhedonia, affective flattening and avolition have almost never been studied. Further studies examining other components of negative symptomatology are needed to more clearly associate these deficits with a schizophrenia-like profile as social withdrawal is a hallmark of many disorders. Although there are no truly effective treatments for negative symptoms, better characterisation with a broader range of drugs used in schizophrenia will be necessary to better evaluate the utility of these models. In summary, developmental models of schizophrenia have been extensively studied as models of positive symptoms but, given the unmet need in the clinic, the same effort now needs to be made with regard to negative symptoms.