Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

Amphetamine increases motivation of humans and mice as measured by breakpoint, but does not affect an Electroencephalographic biomarker

Translation of drug targets from preclinical studies to clinical trials has been aided by cross-species behavioral tasks, but evidence for brain-based engagement during task performance is still required. Cross-species progressive ratio breakpoint tasks (PRBTs) measure motivation-related behavior and are pharmacologically and clinically sensitive. We recently advanced elevated parietal alpha power as a cross-species electroencephalographic (EEG) biomarker of PRBT engagement. Given that amphetamine increases breakpoint in mice, we tested its effects on breakpoint and parietal alpha power in both humans and mice. Twenty-three healthy participants performed the PRBT with EEG after amphetamine or placebo in a double-blind design. C57BL/6J mice were trained on PRBT with EEG (n = 24) and were treated with amphetamine or vehicle. A second cohort of mice was trained on PRBT without EEG (n = 40) and was treated with amphetamine or vehicle. In humans, amphetamine increased breakpoint. In mice, during concomitant EEG, 1 mg/kg of amphetamine significantly decreased breakpoint. In cohort 2, however, 0.3 mg/kg of amphetamine increased breakpoint consistent with human findings. Increased alpha power was observed in both species as they reached breakpoint, replicating previous findings. Amphetamine did not affect alpha power in either species. Amphetamine increased effort in humans and mice. Consistent with previous reports, elevated parietal alpha power was observed in humans and mice as they performed the PRBT. Amphetamine did not affect this EEG biomarker of effort. Hence, these findings support the pharmacological predictive validity of the PRBT to measure effort in humans and mice and suggest that this EEG biomarker is not directly reflective of amphetamine-induced changes in effort.

Cognitive Performance during the Development of Diabetes in the Zucker Diabetic Fatty Rat

Increased insulin levels may support the development of neural circuits involved in cognition, while chronic mild inflammation may also result in cognitive impairment. This study aimed to gain more insight into whether cognition is already impacted during adolescence in a genetic rat model for obesity and type 2 diabetes. Visual discrimination learning throughout adolescence and the level of motivation during early adulthood were investigated in Zucker Diabetic Fatty (ZDF) obese and ZDF lean rats using operant touchscreens. Blood glucose, insulin, and lipids were longitudinally analyzed. Histological analyses were performed in the liver, white adipose tissues, and the prefrontal cortex. Prior to the experiments with the genetic ZDF research model, all experimental assays were performed in two groups of outbred Long Evans rats to investigate the effect of different feeding circumstances. Adolescent ZDF obese rats outperformed ZDF lean rats on visual discrimination performance. During the longitudinal cognitive testing period, insulin levels sharply increased over weeks in ZDF obese rats and were significantly enhanced from 6 weeks of age onwards. Early signs of liver steatosis and enlarged adipocytes in white adipose tissue were observed in early adult ZDF obese rats. Histological analyses in early adulthood showed no group differences in the number of prefrontal cortex neurons and microglia, nor PSD95 and SIRT1 mRNA expression levels. Together, our data show that adolescent ZDF obese rats even display enhanced cognition despite their early diabetic profile.

Pharmacological activation of the amygdala, but not single prolonged footshock-induced acute stress, interferes with cue-induced motivation toward food rewards in rats

In the face of threats, animals adapt their behaviors to cope with the situation. Under such circumstances, irrelevant behaviors are usually suppressed. In this study, we examined whether food-seeking motivation would decrease under activation of the amygdala, an important nucleus in the regulation of stress response in the central nervous system, or after a physical acute stress session. In Experiment 1, we pharmacologically activated the basolateral nucleus (BLA) or the central nucleus of the amygdala (CeA) before a cue-induced reinstatement test in rats. Our results showed that activation of the BLA or the CeA abolished cue-induced motivation toward food rewards, while locomotor activity and free food intake were not affected. In Experiments 2 and 3, we further assessed anxiety and despair levels, as well as cue-induced reinstatement, after a single prolonged footshock-induced acute stress in rats. Behaviorally, acute stress did not affect anxiety level, despair level, or cue-induced motivation toward food rewards. Physiologically, there was no difference in cellular activities of the amygdala immediately after acute stress. To conclude, our results suggested that pharmacological activation of the amygdala decreased cue-induced motivation toward food reward. However, physiological acute stress did not immediately interfere with the negative emotions, motivation, or amygdala activities of the animals.

Something to Snack on: Can Dietary Modulators Boost Mind and Body?

The last decades have shown that maintaining a healthy and balanced diet can support brain integrity and functionality, while an inadequate diet can compromise it. However, still little is known about the effects and utility of so-called healthy snacks or drinks and their immediate short-term effects on cognition and physical performance. Here, we prepared dietary modulators comprising the essential macronutrients at different ratios and a controlled balanced dietary modulator. We assessed, in healthy adult mice, the short-term effects of these modulators when consumed shortly prior to tests with different cognitive and physical demands. A high-fat dietary modulator sustained increased motivation compared to a carbohydrate-rich dietary modulator (p = 0.041) which had a diminishing effect on motivation (p = 0.018). In contrast, a high-carbohydrate modulator had an initial beneficial effect on cognitive flexibility (p = 0.031). No apparent effects of any of the dietary modulators were observed on physical exercise. There is increasing public demand for acute cognitive and motor function enhancers that can improve mental and intellectual performance in daily life, such as in the workplace, studies, or sports activities. Our findings suggest such enhancers should be tailored to the cognitive demand of the task undertaken, as different dietary modulators will have distinct effects when consumed shortly prior to the task.

Impaired Effort Allocation in Patients with Recent-Onset Schizophrenia and Its Relevance to Negative Symptoms Assessments and Persistent Negative Symptoms

(1) Background: Our aims in this study were (i) to compare effort allocation capacity measured between patients with recent-onset schizophrenia (SCZ) and healthy controls (HCs), (ii) within the SCZ, to investigate the association of effort allocation capacity with negative symptoms (NS), and (iii) to compare this association with the type of NS scale used. (2) Methods: Thirty-one patients with SCZ and 30 HCs participated in the study. The NS was examined using an older-generation (Scale for the Assessment of Negative Symptoms, SANS), a newer-generation (Brief Negative Symptoms Scale, BNSS), and a self-rated (Self-evaluation of Negative Symptoms Scale, SNS) negative symptom scale, as well as longitudinally by using persistent NS (PNS) distinction. (3) Results: The SCZ group was less willing to expend effort in high/moderate-probability and -magnitude conditions but more in low-probability and -magnitude conditions. A general reduction in effort allocation capacity was also present. Patients with PNS were less likely to choose hard tasks than non-PNS patients. Clinician-rated scales correlated with 50% probability and moderate-reward-magnitude conditions. Correlations with the SNS were minimal. (4) Conclusions: Our findings suggest that patients with SCZ may show a general reduction in effort allocation capacity and make inefficient choices, although they are not totally reward-insensitive. The effects of NS on effort expenditure can be more pronounced when the rewarding stimulus is vague.

Motivational disturbances in rodent models of neuropsychiatric disorders

Motivated behavior is integral to the survival of individuals, continuously directing actions toward rewards or away from punishments. The orchestration of motivated behavior depends on interactions among different brain circuits, primarily within the dopaminergic system, that subserve the analysis of factors such as the effort necessary for obtaining the reward and the desirability of the reward. Impairments in motivated behavior accompany a wide range of neuropsychiatric disorders, decreasing the patients’ quality of life. Despite its importance, motivation is often overlooked as a parameter in neuropsychiatric disorders. Here, we review motivational impairments in rodent models of schizophrenia, depression, and Parkinson’s disease, focusing on studies investigating effort-related behavior in operant conditioning tasks and on pharmacological interventions targeting the dopaminergic system. Similar motivational disturbances accompany these conditions, suggesting that treatments aimed at ameliorating motivation levels may be beneficial for various neuropsychiatric disorders.

MDMA for the Treatment of Negative Symptoms in Schizophrenia

The profound economic burden of schizophrenia is due, in part, to the negative symptoms of the disease, which can severely limit daily functioning. There is much debate in the field regarding their measurement and classification and there are no FDA-approved treatments for negative symptoms despite an abundance of research. 3,4-Methylenedioxy methamphetamine (MDMA) is a schedule I substance that has emerged as a novel therapeutic given its ability to enhance social interactions, generate empathy, and induce a state of metaplasticity in the brain. This review provides a rationale for the use of MDMA in the treatment of negative symptoms by reviewing the literature on negative symptoms, their treatment, MDMA, and MDMA-assisted therapy. It reviews recent evidence that supports the safe and potentially effective use of MDMA to treat negative symptoms and concludes with considerations regarding safety and possible mechanisms of action.

Value-based cognition and drug dependency

Value-based decision-making is thought to play an important role in drug dependency. Achieving elevated levels of euphoria or ameliorating dysphoria/pain may motivate goal-directed drug consumption in both drug-naïve and long-time users. In other words, drugs become viewed as the preferred means of attaining a desired internal state. The bias towards choosing drugs may affect one's cognition. Observed biases in learning, attention and memory systems within the brain gradually focus one's cognitive functions towards drugs and related cues to the exclusion of other stimuli. In this narrative review, the effects of drug use on learning, attention and memory are discussed with a particular focus on changes across brain-wide functional networks and the subsequent impact on behaviour. These cognitive changes are then incorporated into the cycle of addiction, an established model outlining the transition from casual drug use to chronic dependency. If drug use results in the elevated salience of drugs and their cues, the studies highlighted in this review strongly suggest that this salience biases cognitive systems towards the motivated pursuit of addictive drugs. This bias is observed throughout the cycle of addiction, possibly contributing to the persistent hold that addictive drugs have over the dependent. Taken together, the excessive valuation of drugs as the preferred means of achieving a desired internal state affects more than just decision-making, but also learning, attentional and mnemonic systems. This eventually narrows the focus of one's thoughts towards the pursuit and consumption of addictive drugs.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Exploring the Effects of an Acute Dose of Antipsychotic Medication on Motivation-mediated BOLD Activity Using fMRI and a Perceptual Decision-making Task

The left inferior frontal gyrus and the bilateral ventral striatum are thought to be involved in motivation-mediated decision-making. Antipsychotics may influence this relationship, and atypical antipsychotics improve secondary negative symptoms in schizophrenia, such as loss of motivation, although the acute effects of pharmacological medication on motivation are not fully understood. In this single-blinded, randomized controlled trial, 49 healthy volunteers were randomized into three groups to receive a single dose of haloperidol, aripiprazole or placebo. Between 4.0 and 5.6 h later, participant's brain blood-oxygen-level dependent (BOLD) activity was recorded using functional magnetic resonance imaging (fMRI) while completing a perceptual decision-making fMRI task consisting of one neutral and one motivated condition. Response bias, reflecting the participant's willingness to say that the target stimulus is present, was calculated using signal detection theory. Concurrent with widespread changes in BOLD signal in the motivated vs. neutral condition, a less conservative, mathematically optimal response bias was observed in the motivated condition across the whole sample. Within-group differences in BOLD signal in the left inferior frontal gyrus and bilateral ventral striatum were observed between conditions in the aripiprazole and haloperidol groups, but not in the placebo group. No robust between-group differences in brain activity in the left inferior frontal gyrus or the bilateral ventral striatum were found. Overall, we found no robust evidence for an effect of either aripiprazole or haloperidol on motivationally mediated behavior. An interesting pattern of correlations possibly related to pharmacologically induced alterations in the dopamine system was observed, although findings remain inconclusive and must be replicated in larger samples.

Effort-related decision making in humanized COMT mice: Effects of Val158Met polymorphisms and possible implications for negative symptoms in humans

Catechol-o-methyltransferase (COMT) is an enzyme that metabolizes catecholamines, and is crucial for clearance of dopamine (DA) in prefrontal cortex. Val¹⁵⁸Met polymorphism, which causes a valine (Val) to methionine (Met) substitution at codon 158, is reported to be associated with human psychopathologies in some studies. The Val/Val variant of the enzyme results in higher dopamine metabolism, which results in reduced dopamine transmission. Thus, it is important to investigate the relation between Val¹⁵⁸Met polymorphisms using rodent models of psychiatric symptoms, including negative symptoms such as motivational dysfunction. In the present study, humanized COMT transgenic mice with two genotype groups (Val/Val (Val) and Met/Met (Met) homozygotes) and wild-type (WT) mice from the S129 background were tested using a touchscreen effort-based choice paradigm. Mice were trained to choose between delivery of a preferred liquid diet that reinforced panel pressing on various fixed ratio (FR) schedules (high-effort alternative), vs. intake of pellets concurrently available in the chamber (low-effort alternative). Panel pressing requirements were controlled by varying the FR levels (FR1, 2, 4, 8, 16) in ascending and descending sequences across weeks of testing. All mice were able to acquire the initial touchscreen operant training, and there was an inverse relationship between the number of reinforcers delivered by panel pressing and pellet intake across different FR levels. There was a significant group x FR level interaction in the ascending limb, with panel presses in the Val group being significantly lower than the WT group in FR1-8, and lower than Met in FR4. These findings indicate that the humanized Val allele in mice modulates FR/pellet-choice performance, as marked by lower levels of panel pressing in the Val group when the ratio requirement was moderately high. These studies may contribute to the understanding of the role of COMT polymorphisms in negative symptoms such as motivational dysfunctions in schizophrenic patients.

Subcortical Dopamine and Cognition in Schizophrenia: Looking Beyond Psychosis in Preclinical Models

Schizophrenia is characterized by positive, negative and cognitive symptoms. All current antipsychotic treatments feature dopamine-receptor antagonism that is relatively effective at addressing the psychotic (positive) symptoms of schizophrenia. However, there is no clear evidence that these medications improve the negative or cognitive symptoms, which are the greatest predictors of functional outcomes. One of the most robust pathophysiological observations in patients with schizophrenia is increased subcortical dopamine neurotransmission, primarily in the associative striatum. This brain area has an important role in a range of cognitive processes. Dopamine is also known to play a major part in regulating a number of cognitive functions impaired in schizophrenia but much of this research has been focused on cortical dopamine. Emerging research highlights the strong influence subcortical dopamine has on a range of cognitive domains, including attention, reward learning, goal-directed action and decision-making. Nonetheless, the precise role of the associative striatum in the cognitive impairments observed in schizophrenia remains poorly understood, presenting an opportunity to revisit its contribution to schizophrenia. Without a better understanding of the mechanisms underlying cognitive dysfunction, treatment development remains at a standstill. For this reason, improved preclinical animal models are needed if we are to understand the complex relationship between subcortical dopamine and cognition. A range of new techniques are facillitating the discrete manipulation of dopaminergic neurotransmission and measurements of cognitive performance, which can be investigated using a variety of sensitive translatable tasks. This has the potential to aid the successful incorporation of recent clinical research to address the lack of treatment strategies for cognitive symptoms in schizophrenia. This review will give an overview on the current state of research focused on subcortical dopamine and cognition in the context of schizophrenia research. We also discuss future strategies and approaches aimed at improving the translational outcomes for the treatment of cognitive deficits in schizophrenia.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

The cognitive, affective motivational and clinical longitudinal determinants of apathy in schizophrenia

Apathy is a frequent and debilitating condition with few treatment options available in schizophrenia patients. Despite evidence of its multidimensional structure, most of past studies have explored apathy through a categorical approach. The main objective of this study was to identify the cognitive, emotional, motivational, and clinical factors at baseline that best predicted the three subtypes of apathy dimensions at follow-up. In a longitudinal study, 137 participants diagnosed with schizophrenia underwent different assessments including clinical, motivational, affective and cognitive measurements, at 1-month (referred to as baseline) and 12-month follow-ups. Data were analyzed using partial least squares variance-based structural equation modeling. Three latent variables representing the three previously described domains of apathy reaching consensus in the literature were extracted from the Lille Apathy Rating Scale. Results showed that in addition to baseline apathy, positive symptoms, anticipatory pleasure and sensibility to punishment at baseline predicted cognitive apathy at follow-up. Likewise, both baseline apathy and sensibility to punishment predicted emotional apathy at follow-up. Finally, baseline anhedonia and episodic memory were the main variables the predicted behavioral apathy at follow-up. This is the first study to show specific associations between apathy subtypes and clinical and cognitive motivational dysfunction in individual with schizophrenia, indicating possible distinct underlying mechanisms to these demotivational symptoms. Treatment for apathy should address both types of processes. Importantly, our results demonstrate the interest of multidimensional approaches in the understanding of apathy in schizophrenia.

A comparison of implicit and explicit reward learning in low risk alcohol users versus people who binge drink and people with alcohol dependence

Chronic alcohol use leads to specific neurobiological alterations in the dopaminergic brain reward system, which probably are leading to a reward deficiency syndrome in alcohol dependence. The purpose of our study was to examine the effects of such hypothesized neurobiological alterations on the behavioral level, and more precisely on the implicit and explicit reward learning. Alcohol users were classified as dependent drinkers (using the DSM-IV criteria), binge drinkers (using criteria of the USA National Institute on Alcohol Abuse and Alcoholism) or low-risk drinkers (following recommendations of the Scientific board of trustees of the German Health Ministry). The final sample (n = 94) consisted of 36 low-risk alcohol users, 37 binge drinkers and 21 abstinent alcohol dependent patients. Participants were administered a probabilistic implicit reward learning task and an explicit reward- and punishment-based trial-and-error-learning task. Alcohol dependent patients showed a lower performance in implicit and explicit reward learning than low risk drinkers. Binge drinkers learned less than low-risk drinkers in the implicit learning task. The results support the assumption that binge drinking and alcohol dependence are related to a chronic reward deficit. Binge drinking accompanied by implicit reward learning deficits could increase the risk for the development of an alcohol dependence.

•

Alcohol dependent patients were impaired in implicit and explicit reward learning.

•

Alcohol dependence may lead to implicit and explicit reward learning deficits.

•

Binge drinkers learned less than low-risk drinkers in the implicit learning task.

•

Binge drinking is related to implicit reward learning deficits.

Clarifying the overlap between motivation and negative symptom measures in schizophrenia research: A meta-analysis

Motivation and negative symptom research has recently been hampered by a series of inconsistent findings, leading to calls for a greater consensus on the type of measures used across studies. To inform this issue, we conducted a meta-analysis that quantified the association between motivation measures (self-report, performance-based) and clinician-rated negative symptom measures as well as a series of moderator analyses to develop a greater understanding of the measurement factors impacting this relationship. Forty-seven eligible studies with people with schizophrenia-spectrum disorders were included. Using a random-effects meta-analytic model, a small but significant overall effect size emerged between motivation and clinician-rated negative symptoms (r = -0.18). Several significant moderators were identified, including the generation of negative symptom measures such that there was a significantly stronger relationship between motivation and second-generation (r = -0.38) than first-generation negative symptom measures (r = -0.17). Further, the type of performance-based measure used moderated the relationship, with effort discounting tasks most strongly related to negative symptoms (r = -0.44). The domain of motivation assessed (intrinsic, extrinsic, amotivation) also moderated the relationship. These findings help to identify sources of inconsistencies observed in prior studies and point to both second-generation and effort discounting tasks as the most promising types of measures, particularly for those interested in validating motivation measures or assessing the effectiveness of motivation treatments. Although additional research is needed, our results suggest that using these measures may help to reduce inconsistencies across studies and move the field forward.

Oxytocin improves probabilistic reversal learning but not effortful motivation in Brown Norway rats

Deficits in cognition and motivation are common and debilitating aspects of psychiatric disorders, yet still go largely untreated. The neuropeptide oxytocin (OT) is a potential novel therapeutic for deficits in social cognition and motivation in psychiatric patients. However, the effects of OT on clinically relevant domains of non-social cognition and motivation remain under studied. The present study investigated the effects of acute and chronic (21-day) administration of subcutaneous OT (0.04, 0.2, and 1 mg/kg) in cross-species translatable operant paradigms of reward learning and effortful motivation in male and female Brown Norway (BN) rats (n = 8-10/group). Reward learning was assessed using the probabilistic reversal learning task (PRLT) and effortful motivation was measured using the progressive ratio breakpoint task (PRBT). As predicted, BN rats exhibited baseline deficits in the detection of reversals of reward contingency in the PRLT relative to Long Evans (LE) rats. The two strains performed equally in the PRBT. Thirty minutes after a single OT injection (1 mg/kg), measures of both initial probabilistic learning (trials to first criterion) and subsequent reversal learning (contingency switches) were significantly improved to levels comparable with LE rats. The OT effect on switches persisted in male, but not female, BN rats 30 min, 24 h, and 6 days after long-term OT administration, suggesting the induction of neuroplastic changes. OT did not affect effortful motivation at any time-point. The beneficial effects of OT on reward learning in the absence of increased effortful motivation support the development of OT as a novel therapeutic to improve cognitive functioning.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Pick Your Model Wisely: Understanding the Negative Symptoms of Schizophrenia in Rodent Models

While the negative symptoms comprise one of the cardinal symptom domains of schizophrenia, there are numerous deficits that are included in this category of symptoms. Therefore, when modeling negative symptoms preclinically, it is important to consider which symptom is being modeled by a specific assay and to try to gain an understanding of the translational value of the findings. It is hoped that enhancing the translational value of animal models will allow for better treatment outcomes for the negative symptoms of schizophrenia in the future.

Dopamine D2-like receptor stimulation blocks negative feedback in visual and spatial reversal learning in the rat: behavioural and computational evidence

RATIONALE

Dopamine D2-like receptors (D2R) are important drug targets in schizophrenia and Parkinson's disease, but D2R ligands also cause cognitive inflexibility such as poor reversal learning. The specific role of D2R in reversal learning remains unclear.

OBJECTIVES

We tested the hypotheses that D2R agonism impairs reversal learning by blocking negative feedback and that antagonism of D1-like receptors (D1R) impairs learning from positive feedback.

METHODS

Male Lister Hooded rats were trained on a novel visual reversal learning task. Performance on "probe trials", during which the correct or incorrect stimulus was presented with a third, probabilistically rewarded (50% of trials) and therefore intermediate stimulus, revealed individual learning curves for the processes of positive and negative feedback. The effects of D2R and D1R agonists and antagonists were evaluated. A separate cohort was tested on a spatial probabilistic reversal learning (PRL) task after D2R agonism. Computational reinforcement learning modelling was applied to choice data from the PRL task to evaluate the contribution of latent factors.

RESULTS

D2R agonism with quinpirole dose-dependently impaired both visual reversal and PRL. Analysis of the probe trials on the visual task revealed a complete blockade of learning from negative feedback at the 0.25 mg/kg dose, while learning from positive feedback was intact. Estimated parameters from the model that best described the PRL choice data revealed a steep and selective decrease in learning rate from losses. D1R antagonism had a transient effect on the positive probe trials.

CONCLUSIONS

D2R stimulation impairs reversal learning by blocking the impact of negative feedback.

Impaired Performance of the Q175 Mouse Model of Huntington's Disease in the Touch Screen Paired Associates Learning Task

Cognitive disturbances often predate characteristic motor dysfunction in individuals with Huntington’s disease (HD) and place an increasing burden on the HD patients and caregivers with the progression of the disorder. Therefore, application of maximally translational cognitive tests to animal models of HD is imperative for the development of treatments that could alleviate cognitive decline in human patients. Here, we examined the performance of the Q175 mouse knock-in model of HD in the touch screen version of the paired associates learning (PAL) task. We found that 10–11-month-old heterozygous Q175 mice had severely attenuated learning curve in the PAL task, which was conceptually similar to previously documented impaired performance of individuals with HD in the PAL task of the Cambridge Neuropsychological Test Automated Battery (CANTAB). Besides high rate of errors in PAL task, Q175 mice exhibited considerably lower responding rate than age-matched wild-type (WT) animals. Our examination of effortful operant responding during fixed ratio (FR) and progressive ratio (PR) reinforcement schedules in a separate cohort of similar age confirmed slower and unselective performance of mutant animals, as observed during PAL task, but suggested that motivation to work for nutritional reward in the touch screen setting was similar in Q175 and WT mice. We also demonstrated that pronounced sensorimotor disturbances in Q175 mice can be detected at early touch screen testing stages, (e.g., during “Punish Incorrect” phase of operant pretraining), so we propose that shorter test routines may be utilised for more expedient studies of treatments aimed at the rescue of HD-related phenotype.

Oxygen responses within the nucleus accumbens are associated with individual differences in effort exertion in rats

Goal‐directed motivated behaviour is crucial for everyday life. Such behaviour is often measured, in rodents, under a progressive ratio (PR) schedule of reinforcement. Previous studies have identified a few brain structures critical for supporting PR performance. However, the association between neural activity within these regions and individual differences in effort‐related behaviour is not known. Presently, we used constant potential in vivo oxygen amperometry, a surrogate for functional resonance imaging in rodents, to assess changes in tissue oxygen levels within the nucleus accumbens (NAc) and orbitofrontal cortex (OFC) in male Wistar rats performing a PR task. Within both regions, oxygen responses to rewards increased as the effort exerted to obtain the rewards was larger. Furthermore, higher individual breakpoints were associated with greater magnitude NAc oxygen responses. This association could not be explained by temporal confounds and remained significant when controlling for the different number of completed trials. Animals with higher breakpoints also showed greater magnitude NAc oxygen responses to rewards delivered independently of any behaviour. In contrast, OFC oxygen responses were not associated with individual differences in behavioural performance. The present results suggest that greater NAc oxygen responses following rewards, through a process of incentive motivation, may allow organisms to remain on task for longer and to overcome greater effort costs.

Optimisation of cognitive performance in rodent operant (touchscreen) testing: Evaluation and effects of reinforcer strength

Operant testing is a widely used and highly effective method of studying cognition in rodents. Performance on such tasks is sensitive to reinforcer strength. It is therefore advantageous to select effective reinforcers to minimize training times and maximize experimental throughput. To quantitatively investigate the control of behavior by different reinforcers, performance of mice was tested with either strawberry milkshake or a known powerful reinforcer, super saccharin (1.5% or 2% (w/v) saccharin/1.5% (w/v) glucose/water mixture). Mice were tested on fixed (FR)- and progressive-ratio (PR) schedules in the touchscreen-operant testing system. Under an FR schedule, both the rate of responding and number of trials completed were higher in animals responding for strawberry milkshake versus super saccharin. Under a PR schedule, mice were willing to emit similar numbers of responses for strawberry milkshake and super saccharin; however, analysis of the rate of responding revealed a significantly higher rate of responding by animals reinforced with milkshake versus super saccharin. To determine the impact of reinforcer strength on cognitive performance, strawberry milkshake and super saccharin-reinforced animals were compared on a touchscreen visual discrimination task. Animals reinforced by strawberry milkshake were significantly faster to acquire the discrimination than animals reinforced by super saccharin. Taken together, these results suggest that strawberry milkshake is superior to super saccharin for operant behavioral testing and further confirms that the application of response rate analysis to multiple ratio tasks is a highly sensitive method for the detection of behavioral differences relevant to learning and motivation.

Caffeine and Selective Adenosine Receptor Antagonists as New Therapeutic Tools for the Motivational Symptoms of Depression

Major depressive disorder is one of the most common and debilitating psychiatric disorders. Some of the motivational symptoms of depression, such anergia (lack of self-reported energy) and fatigue are relatively resistant to traditional treatments such as serotonin uptake inhibitors. Thus, new pharmacological targets are being investigated. Epidemiological data suggest that caffeine consumption can have an impact on aspects of depressive symptomatology. Caffeine is a non-selective adenosine antagonist for A1/A2A receptors, and has been demonstrated to modulate behavior in classical animal models of depression. Moreover, selective adenosine receptor antagonists are being assessed for their antidepressant effects in animal studies. This review focuses on how caffeine and selective adenosine antagonists can improve different aspects of depression in humans, as well as in animal models. The effects on motivational symptoms of depression such as anergia, fatigue, and psychomotor slowing receive particular attention. Thus, the ability of adenosine receptor antagonists to reverse the anergia induced by dopamine antagonism or depletion is of special interest. In conclusion, although further studies are needed, it appears that caffeine and selective adenosine receptor antagonists could be therapeutic agents for the treatment of motivational dysfunction in depression.

A marker of biological ageing predicts adult risk preference in European starlings, Sturnus vulgaris

Why are some individuals more prone to gamble than others? Animals often show preferences between 2 foraging options with the same mean reward but different degrees of variability in the reward, and such risk preferences vary between individuals. Previous attempts to explain variation in risk preference have focused on energy budgets, but with limited empirical support. Here, we consider whether biological ageing, which affects mortality and residual reproductive value, predicts risk preference. We studied a cohort of European starlings (Sturnus vulgaris) in which we had previously measured developmental erythrocyte telomere attrition, an established integrative biomarker of biological ageing. We measured the adult birds' preferences when choosing between a fixed amount of food and a variable amount with an equal mean. After controlling for change in body weight during the experiment (a proxy for energy budget), we found that birds that had undergone greater developmental telomere attrition were more risk averse as adults than were those whose telomeres had shortened less as nestlings. Developmental telomere attrition was a better predictor of adult risk preference than either juvenile telomere length or early-life food supply and begging effort. Our longitudinal study thus demonstrates that biological ageing, as measured via developmental telomere attrition, is an important source of lasting differences in adult risk preferences.

A meta-analytic review of self-reported, clinician-rated, and performance-based motivation measures in schizophrenia: Are we measuring the same "stuff"?

An array of self-reported, clinician-rated, and performance-based measures has been used to assess motivation in schizophrenia; however, the convergent validity evidence for these motivation assessment methods is mixed. The current study is a series of meta-analyses that summarize the relationships between methods of motivation measurement in 45 studies of people with schizophrenia. The overall mean effect size between self-reported and clinician-rated motivation measures (r = 0.27, k = 33) was significant, positive, and approaching medium in magnitude, and the overall effect size between performance-based and clinician-rated motivation measures (r = 0.21, k = 11) was positive, significant, and small in magnitude. The overall mean effect size between self-reported and performance-based motivation measures was negligible and non-significant (r = -0.001, k = 2), but this meta-analysis was underpowered. Findings suggest modest convergent validity between clinician-rated and both self-reported and performance-based motivation measures, but additional work is needed to clarify the convergent validity between self-reported and performance-based measures. Further, there is likely more variability than similarity in the underlying construct that is being assessed across the three methods, particularly between the performance-based and other motivation measurement types. These motivation assessment methods should not be used interchangeably, and measures should be more precisely described as the specific motivational construct or domain they are capturing.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

Relationship between effortful motivation and neurocognition in schizophrenia

Effortful motivation and reward valuation learning deficits are associated with negative symptoms and impaired cognition in schizophrenia (SZ) patients. Whereas clinical assessments of motivation and reward value typically rely upon clinician ratings or self-report scales, behavioral measures often confound these constructs. Simple reverse-translated behavioral tasks that independently quantify motivation and reward valuation-which could then be linked to cognition-may facilitate the development of pro-cognitive therapeutics by bridging the "preclinical-to-clinical" gap. This study determined whether novel behavioral measures of effortful motivation and reward valuation are associated with impaired cognition in SZ patients (n=36). Patients completed the Progressive Ratio Breakpoint task (PRBT; physical effort motivation) and the Probabilistic Learning Task (PLT; reward learning/valuation) in conjunction with the MATRICS Consensus Cognitive Battery (MCCB). SZ patients exhibited statistically significant deficits in global cognition and all individual MCCB subdomains. Significant correlations were observed between PRBT and MCCB global cognition (r=0.52), speed of processing (r=0.56) and attention vigilance (r=0.48) subdomains, but not with PLT or clinical symptoms. Results indicate that effort and reward learning deficits are dissociable targets that can improve our understanding of cognitive impairments associated among patients with SZ. More importantly, the results support the long-standing notion that the measurement of cognitive impairments in SZ is highly linked to a willingness to expend effort. The availability of a PRBT designed for use in both rodents and humans could improve our understanding of the nature of cognitive impairments in neuropsychiatric disorders and accelerate the development of novel pro-cognitive therapeutics.

Selective effects of 5-HT2C receptor modulation on performance of a novel valence-probe visual discrimination task and probabilistic reversal learning in mice

RATIONALE

Dysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning.

METHODS

We used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks.

RESULTS

Specifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback.

CONCLUSIONS

These results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

Phencyclidine increased while isolation rearing did not affect progressive ratio responding in rats: Investigating potential models of amotivation in schizophrenia

BACKGROUND

Schizophrenia is a debilitating neurodevelopmental disorder affecting 1% of the global population with heterogeneous symptoms including positive, negative, and cognitive. While treatment for positive symptoms exists, none have been developed to treat negative symptoms. Animal models of schizophrenia are required to test targeted treatments and since patients exhibit reduced effort (breakpoints) for reward in a progressive ratio (PR) task, we examined the PR breakpoints of rats treated with the NMDA receptor antagonist phencyclidine or those reared in isolation - two common manipulations used to induce schizophrenia-relevant behaviors in rodents.

METHODS

In two cohorts, the PR breakpoint for a palatable food reward was examined in Long Evans rats after: 1) a repeated phencyclidine regimen; 2) A subchronic phencyclidine regimen followed by drug washout; and 3) post-weaning social isolation.

RESULTS

Rats treated with repeated phencyclidine and those following washout from phencyclidine exhibited higher PR breakpoints than vehicle-treated rats. The breakpoint of isolation reared rats did not differ from those socially reared, despite abnormalities of these rats in other schizophrenia-relevant behaviors.

CONCLUSION

Despite their common use for modeling other schizophrenia-relevant behaviors neither phencyclidine treatment nor isolation rearing recreated the motivational deficits observed in patients with schizophrenia, as measured by PR breakpoint. Other manipulations, and negative symptom-relevant behaviors, require investigation prior to testing putative therapeutics.

Frameworking memory and serotonergic markers

The evidence for neural markers and memory is continuously being revised, and as evidence continues to accumulate, herein, we frame earlier and new evidence. Hence, in this work, the aim is to provide an appropriate conceptual framework of serotonergic markers associated with neural activity and memory. Serotonin (5-hydroxytryptamine [5-HT]) has multiple pharmacological tools, well-characterized downstream signaling in mammals’ species, and established 5-HT neural markers showing new insights about memory functions and dysfunctions, including receptors (5-HT1A/1B/1D, 5-HT2A/2B/2C, and 5-HT3-7), transporter (serotonin transporter [SERT]) and volume transmission present in brain areas involved in memory. Bidirectional influence occurs between 5-HT markers and memory/amnesia. A growing number of researchers report that memory, amnesia, or forgetting modifies neural markers. Diverse approaches support the translatability of using neural markers and cerebral functions/dysfunctions, including memory formation and amnesia. At least, 5-HT1A, 5-HT4, 5-HT6, and 5-HT7receptors and SERT seem to be useful neural markers and therapeutic targets. Hence, several mechanisms cooperate to achieve synaptic plasticity or memory, including changes in the expression of neurotransmitter receptors and transporters.

Assessment of a glycine uptake inhibitor in animal models of effort-related choice behavior: implications for motivational dysfunctions

RATIONALE

Motivated behavior can be characterized by a substantial exertion of effort, and organisms often make effort-related decisions based upon analyses of work-related response costs and reinforcement preference. Moreover, alterations in effort-based choice can be seen in people with major depression and schizophrenia. Effort-related decision making is studied using tasks offering choices between high effort options leading to highly valued reinforces vs low effort/low reward options. Interference with dopamine (DA) transmission by administration of the DA D2 family antagonist haloperidol biases behavior towards the lower effort option that can be obtained with minimal work, and previous research has shown that DA interacts with other transmitters, including adenosine and GABA, to regulate effort-based choice.

OBJECTIVES

The present studies focused upon the ability of the glycine transport inhibitor bitopertin to attenuate haloperidol-induced shifts in effort-related choice behavior.

METHODS

Effort-based choice in rats was assessed using the concurrent fixed ratio (FR) 5/chow feeding choice task and the T-maze barrier choice procedure.

RESULTS

Haloperidol shifted effort-based choice, biasing animals towards the low effort option in each task. Co-administration of bitopertin (1.0-10.0 mg/kg) significantly attenuated haloperidol-induced shifts in choice behavior, but the same doses of bitopertin had no effect when administered alone.

CONCLUSIONS

These results indicated that elevation of extracellular glycine via inhibition of glycine uptake was able to reverse the effects of D2 antagonism. Increases in extracellular glycine, possibly through actions on the glycine allosteric site on the NMDA receptor, may be a useful strategy for treating motivational dysfunctions in humans.

Modelling depression in animals: at the interface of reward and stress pathways

RATIONALE

Despite substantial research efforts the aetiology of major depressive disorder (MDD) remains poorly understood, which is due in part to the heterogeneity of the disorder and the complexity of designing appropriate animal models. However, in the last few decades, a focus on the development of novel stress-based paradigms and a focus on using hedonic/anhedonic behaviour have led to renewed optimism in the use of animal models to assess aspects of MDD.

OBJECTIVES

Therefore, in this review article, dedicated to Athina Markou, we summarise the use of stress-based animal models for studying MDD in rodents and how reward-related readouts can be used to validate/assess the model and/or treatment.

RESULTS

We reveal the use and limitations of chronic stress paradigms, which we split into non-social (i.e. chronic mild stress), social (i.e. chronic social defeat) and drug-withdrawal paradigms for studying MDD and detail numerous reward-related readouts that are employed in preclinical research. Finally, we finish with a section regarding important factors to consider when using animal models.

CONCLUSIONS

One of the most consistent findings following chronic stress exposure in rodents is a disruption of the brain reward system, which can be easily assessed using sucrose, social interaction, food, drug of abuse or intracranial self-stimulation as a readout. Probing the underlying causes of such alterations is providing a greater understanding of the potential systems and processes that are disrupted in MDD.

Mice heterozygous for an inactivated allele of the schizophrenia associated Brd1 gene display selective cognitive deficits with translational relevance to schizophrenia

Schizophrenia is a debilitating brain disorder characterized by disturbances of emotion, perception and cognition. Cognitive impairments predict functional outcome in schizophrenia and are detectable even in the prodromal stage of the disorder. However, our understanding of the underlying neurobiology is limited and procognitive treatments remain elusive. We recently demonstrated that mice heterozygous for an inactivated allele of the schizophrenia-associated Brd1 gene (Brd1^+/- mice) display behaviors reminiscent of schizophrenia, including impaired social cognition and long-term memory. Here, we further characterize performance of these mice by following the preclinical guidelines recommended by the 'Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS)' and 'Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS)' initiatives to maximize translational value. Brd1^+/- mice exhibit relational encoding deficits, compromised working and long term memory, as well as impaired executive cognitive functioning with cognitive behaviors relying on medial prefrontal cortex being particularly affected. Akin to patients with schizophrenia, the cognitive deficits displayed by Brd1^+/- mice are not global, but selective. Our results underline the value of Brd1^+/- mice as a promising tool for studying the neurobiology of cognitive deficits in schizophrenia.

Transient inhibition and long-term facilitation of locomotion by phasic optogenetic activation of serotonin neurons

Serotonin (5-HT) is associated with mood and motivation but the function of endogenous 5-HT remains controversial. Here, we studied the impact of phasic optogenetic activation of 5-HT neurons in mice over time scales from seconds to weeks. We found that activating dorsal raphe nucleus (DRN) 5-HT neurons induced a strong suppression of spontaneous locomotor behavior in the open field with rapid kinetics (onset ≤1 s). Inhibition of locomotion was independent of measures of anxiety or motor impairment and could be overcome by strong motivational drive. Repetitive place-contingent pairing of activation caused neither place preference nor aversion. However, repeated 15 min daily stimulation caused a persistent increase in spontaneous locomotion to emerge over three weeks. These results show that 5-HT transients have strong and opposing short and long-term effects on motor behavior that appear to arise from effects on the underlying factors that motivate actions.

DOI:http://dx.doi.org/10.7554/eLife.20975.001

The brain controls sleep, movement and the other behaviors that an animal needs to survive. A chemical called serotonin plays an important role in controlling these behaviors as it regulates the activity of nerve cells (known as neurons) throughout the brain. Serotonin is produced by a specific group of neurons found in an area at the base of the brain called the raphe nuclei. From there, serotonin is released into other parts of the brain to influence different behaviors. Although drugs that target serotonin are widely used as antidepressants, how this chemical signal acts in the brain remains a mystery. This is due, in part, to it being technically challenging to carry out experiments on the serotonin-producing neurons.

A technique called optogenetics uses light to selectively activate or inhibit individual cells in live animals. Here, Correia, Lottem et al. use optogenetics to activate serotonin-producing neurons in the dorsal raphe nucleus of mice. The experiments show that triggering serotonin production for a few seconds causes the mice to move around more slowly as they explore their surroundings. This short-term release of serotonin only slows the mice down if they are not already occupied with other activities, such as finding water or balancing on a moving object. These experiments suggest that serotonin decreases an individual’s motivation to move but that this can be overcome by sufficiently powerful goals. In contrast, repeatedly activating the serotonin neurons over a period of several weeks led to long-term changes of the opposite kind – the mice begin to move around more quickly.

The findings of Correia, Lottem et al. have possible implications for the use of drugs that target serotonin to treat mental disorders as it suggests important links between serotonin, movement, and the ability of the brain to change how it responds to certain situations. The next steps will be to investigate how the two different effects of serotonin are connected, which areas in the brain are involved and how best to apply these findings to clinical studies.

DOI:http://dx.doi.org/10.7554/eLife.20975.002

Modeling neurodevelopmental cognitive deficits in tasks with cross-species translational validity

Numerous psychiatric disorders whose cognitive dysfunction links to functional outcome have neurodevelopmental origins including schizophrenia, autism and bipolar disorder. Treatments are needed for these cognitive deficits, which require development using animal models. Models of neurodevelopmental disorders are as varied and diverse as the disorders themselves, recreating some but not all aspects of the disorder. This variety may in part underlie why purported procognitive treatments translated from these models have failed to restore functioning in the targeted patient populations. Further complications arise from environmental factors used in these models that can contribute to numerous disorders, perhaps only impacting specific domains, while diagnostic boundaries define individual disorders, limiting translational efficacy. The Research Domain Criteria project seeks to 'develop new ways to classify mental disorders based on behavioral dimensions and neurobiological measures' in hopes of facilitating translational research by remaining agnostic toward diagnostic borders derived from clinical presentation in humans. Models could therefore recreate biosignatures of cognitive dysfunction irrespective of disease state. This review highlights work within the field of neurodevelopmental models of psychiatric disorders tested in cross-species translational cognitive paradigms that directly inform this newly developing research strategy. By expounding on this approach, the hopes are that a fuller understanding of each model may be attainable in terms of the cognitive profile elicited by each manipulation. Hence, conclusions may begin to be drawn on the nature of cognitive neuropathology on neurodevelopmental and other disorders, increasing the chances of procognitive treatment development for individuals affected in specific cognitive domains.

Quantifying motivation with effort-based decision-making paradigms in health and disease

Motivation can be characterized as a series of cost-benefit valuations, in which we weigh the amount of effort we are willing to expend (the cost of an action) in return for particular rewards (its benefits). Human motivation has traditionally been measured with self-report and questionnaire-based tools, but an inherent limitation of these methods is that they are unable to provide a mechanistic explanation of the processes underlying motivated behavior. A major goal of current research is to quantify motivation objectively with effort-based decision-making paradigms, by drawing on a rich literature from nonhuman animals. Here, we review this approach by considering the development of these paradigms in the laboratory setting over the last three decades, and their more recent translation to understanding choice behavior in humans. A strength of this effort-based approach to motivation is that it is capable of capturing the wide range of individual differences, and offers the potential to dissect motivation into its component elements, thus providing the basis for more accurate taxonomic classifications. Clinically, modeling approaches might provide greater sensitivity and specificity to diagnosing disorders of motivation, for example, in being able to detect subclinical disorders of motivation, or distinguish a disorder of motivation from related but separate syndromes, such as depression. Despite the great potential in applying effort-based paradigms to index human motivation, we discuss several caveats to interpreting current and future studies, and the challenges in translating these approaches to the clinical setting.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

The effects of pharmacological modulation of the serotonin 2C receptor on goal-directed behavior in mice

RATIONALE

Impaired goal-directed motivation represents a debilitating class of symptoms common to psychological disorders including schizophrenia and some affective disorders. Despite the known negative impact of impaired motivation, there are currently no effective pharmacological interventions to treat these symptoms.

OBJECTIVES

Here, we evaluate the effectiveness of the serotonin 2C (5-HT2C) receptor selective ligand, SB242084, as a potential pharmacological intervention for enhancing goal-directed motivation in mice. The studies were designed to identify not only efficacy but also the specific motivational processes that were affected by the drug treatment.

METHODS

We tested subjects following treatment with SB242084 (0.75 mg/kg) in several operant lever pressing assays including the following: a progressive ratio (PR) schedule of reinforcement, an effort-based choice task, a progressive hold down task (PHD), and various food intake tests.

RESULTS

Acute SB242084 treatment leads to an increase in instrumental behavior. Using a battery of behavioral tasks, we demonstrate that the major effect of SB242084 is an increase in the amount of responses and duration of effort that subjects will make for food rewards. This enhancement of behavior is not the result of non-specific hyperactivity or arousal nor is it due to changes in food consumption.

CONCLUSIONS

Because of this specificity of action, we suggest that the 5-HT2C receptor warrants further attention as a novel therapeutic target for treating pathological impairments in goal-directed motivation.

The NEWMEDS rodent touchscreen test battery for cognition relevant to schizophrenia

RATIONALE

The NEWMEDS initiative (Novel Methods leading to New Medications in Depression and Schizophrenia, http://www.newmeds-europe.com ) is a large industrial-academic collaborative project aimed at developing new methods for drug discovery for schizophrenia. As part of this project, Work package 2 (WP02) has developed and validated a comprehensive battery of novel touchscreen tasks for rats and mice for assessing cognitive domains relevant to schizophrenia.

OBJECTIVES

This article provides a review of the touchscreen battery of tasks for rats and mice for assessing cognitive domains relevant to schizophrenia and highlights validation data presented in several primary articles in this issue and elsewhere.

METHODS

The battery consists of the five-choice serial reaction time task and a novel rodent continuous performance task for measuring attention, a three-stimulus visual reversal and the serial visual reversal task for measuring cognitive flexibility, novel non-matching to sample-based tasks for measuring spatial working memory and paired-associates learning for measuring long-term memory.

RESULTS

The rodent (i.e. both rats and mice) touchscreen operant chamber and battery has high translational value across species due to its emphasis on construct as well as face validity. In addition, it offers cognitive profiling of models of diseases with cognitive symptoms (not limited to schizophrenia) through a battery approach, whereby multiple cognitive constructs can be measured using the same apparatus, enabling comparisons of performance across tasks.

CONCLUSION

This battery of tests constitutes an extensive tool package for both model characterisation and pre-clinical drug discovery.