Comparison of conventional and rapid-acting antidepressants in a rodent probabilistic reversal learning task

Cross-species translational paradigms for assessing positive valence system as defined by the RDoC matrix

Functions associated with processing reward-related information are fundamental drivers of motivation, learning, and goal-directed behavior. Such functions have been classified as the positive valence system under the Research Domain and Criteria (RDoC) criteria and are negatively impacted across a range of psychiatric disorders and mental illnesses. The positive valence system is composed of three comprehensive categories containing related but dissociable functions that are organized into either Reward Responsiveness, Reward Learning, or Reward Valuation. The presence of overlapping behavioral dysfunction across diagnostic mental disorders is in-part what motivated the RDoC initiative, which emphasized that the study of mental illness focus on investigating relevant behavior and cognitive functions and their underlying mechanisms, rather than separating efforts on diagnostic categories (i.e., transdiagnostic). Moreover, the RDoC approach is well-suited for preclinical neuroscience research, as the rise in genetic toolboxes and associated neurotechnologies enables researchers to probe specific cellular targets with high specificity. Thus, there is an opportunity to dissect whether behaviors and cognitive functions are supported by shared or distinct neural mechanisms. For preclinical research to effectively inform our understandings of human behavior however, the cognitive and behavioral paradigms should have predictive, neurobiological, and pharmacological predictive validity to the human test. Touchscreen-based testing systems provide a further advantage for this endeavor enabling tasks to be presented to animals using the same media and task design as in humans. Here, we outline the primary categories of the positive valence system and review the work that has been done cross-species to investigate the neurobiology and neurochemistry underlying reward-related functioning. Additionally, we provide clinical tasks outlined by RDoC, along with validity and/or need for further validation for analogous rodent paradigms with a focus on implementing the touchscreen-based cognitive testing systems.

Preclinical models for evaluating psychedelics in the treatment of major depressive disorder

Psychedelic drugs have seen a resurgence in interest as a next generation of psychiatric medicines with potential as rapid-acting antidepressants (RAADs). Despite promising early clinical trials, the mechanisms which underlie the effects of psychedelics are poorly understood. For example, key questions such as whether antidepressant and psychedelic effects involve related or independent mechanisms are unresolved. Preclinical studies in relevant animal models are key to understanding the pharmacology of psychedelics and translating these findings to explain efficacy and safety in patients. Understanding the mechanisms of action associated with the behavioural effects of psychedelic drugs can also support the identification of novel drug targets and more effective treatments. Here we review the behavioural approaches currently used to quantify the psychedelic and antidepressant effects of psychedelic drugs. We discuss conceptual and methodological issues, the importance of using clinically relevant doses and the need to consider possible sex differences in preclinical psychedelic studies.

The dynamic strategy shifting task: Optimisation of an operant task for assessing cognitive flexibility in rats

Introduction

Although schizophrenia is associated with a broad range of symptoms including hallucinations, delusions, and reduced motivation, measures of cognitive dysfunction, including cognitive flexibility and executive function, are the strongest predictors of functional outcomes. Antipsychotic medications are useful for reducing psychotic symptoms, but they are ineffective at improving cognitive deficits. Despite extensive investment by industry, the transition from preclinical to clinical trials has not been successful for developing precognitive medications for individuals with schizophrenia. Here, we describe the optimisation of a novel dynamic strategy shifting task (DSST) using standard operant chambers to investigate the optimal stimuli required to limit the extensive training times required in previous tasks.

Methods

We determined that optimal learning by male and female Sprague Dawley rats for the flexibility task incorporated dynamic strategy shifts between spatial rules, such as following a visual cue or responding at one location, and non-spatial rules, such as responding to a central visual or auditory cue. A minimum of 6 correct consecutive responses were required to make a within-session change in the behavioural strategies. As a proof of concept, we trained and tested 84 Sprague Dawley rats on the DSST, and then assessed their cognitive flexibility using a within-subject design after an acute dose of ketamine (0, 3, 10 mg/kg). Rats made fewer premature and more perseverant responses to initiate a trial following ketamine. The effects of ketamine on trials to criterion was dependent on the rule.

Results

Ketamine induced a significant improvement on the reversal of a non-spatial visual discrimination rule. There was no significant effect of ketamine on the spatial visual or response discrimination rules.

Discussion

The DSST is a novel assay for studying distinct forms of cognitive flexibility and offers a rapid and adaptable means of assessing the ability to shift between increasingly challenging rule conditions. The DSST has potential utility in advancing our understanding of cognitive processes and the underlying neurobiological mechanisms related to flexibility in neuropsychiatric and neurological conditions where executive dysfunctions occur.>.

Characterisation of behaviours relevant to apathy syndrome in the aged male rat

Apathy is a complex psychiatric syndrome characterised by motivational deficit, emotional blunting and cognitive changes. It occurs alongside a broad range of neurological disorders, but also occurs in otherwise healthy ageing. Despite its clinical prevalence, apathy does not yet have a designated treatment strategy. Generation of a translational animal model of apathy syndrome would facilitate the development of novel treatments. Given the multidimensional nature of apathy, a model cannot be achieved with a single behavioural test. Using a battery of behavioural tests we investigated whether aged rats exhibit behavioural deficits across different domains relevant to apathy. Using the effort for reward and progressive ratio tasks we found that aged male rats (21-27 months) show intact reward motivation. Using the novelty supressed feeding test and position-based object exploration we found aged rats showed increased anxiety-like behaviour inconsistent with emotional blunting. The sucrose preference test and reward learning assay showed intact reward sensitivity and reward-related cognition in aged rats. However, using a bowl-digging version of the probabilistic reversal learning task, we found a deficit in cognitive flexibility in aged rats that did not translate across to a touchscreen version of the task. While these data reveal important changes in cognitive flexibility and anxiety associated with ageing, aged rats do not show deficits across other behavioural domains relevant to apathy. This suggests that aged rats are not a suitable model for age-related apathy syndrome. These findings contrast with previous work in mice, revealing important species differences in behaviours relevant to apathy syndrome in ageing.

Ketamine produces no detectable long-term positive or negative effects on cognitive flexibility or reinforcement learning of male rats

RATIONALE

Patients with major depressive disorder (MDD) often experience abnormalities in behavioral adaptation following environmental changes (i.e., cognitive flexibility) and tend to undervalue positive outcomes but overvalue negative outcomes. The probabilistic reversal learning task (PRL) is used to study these deficits across species and to explore drugs that may have therapeutic value. Selective serotonin-reuptake inhibitors (SSRIs) have limited effectiveness in treating MDD and produce inconsistent effects in non-human versions of the PRL. As such, ketamine, a novel and potentially rapid-acting therapeutic, has begun to be examined using the PRL. Two previous studies examining the effects of ketamine in the PRL have shown conflicting results and only examined short-term effects of ketamine.

OBJECTIVE

This experiment examined PRL performance across a 2-week period following a single exposure to a ketamine dose that varied across groups.

METHODS

After five sessions of PRL training, groups of rats received an injection of either 0, 10, 20 or 30 mg/kg ketamine. One-hour post-injection, rats engaged in the PRL, and subsequently sessions continued daily for 2 weeks. Traditional behavioral and computational reinforcement learning-derived measures were examined.

RESULTS

Results showed that ketamine had acute effects 1-h post-injection, including a significant decrease in the value of the punishment learning rate. Beyond 1 h, ketamine produced no detectable improvements nor decrements in performance across 2 weeks.

CONCLUSION

Overall, the present results suggest that the range of ketamine doses examined do not have long-term positive or negative effects on cognitive flexibility or reward processing in healthy rats as measured by the PRL.

Rodent tests of depression and anxiety: Construct validity and translational relevance

Behavioral testing constitutes the primary method to measure the emotional states of nonhuman animals in preclinical research. Emerging as the characteristic tool of the behaviorist school of psychology, behavioral testing of animals, particularly rodents, is employed to understand the complex cognitive and affective symptoms of neuropsychiatric disorders. Following the symptom-based diagnosis model of the DSM, rodent models and tests of depression and anxiety focus on behavioral patterns that resemble the superficial symptoms of these disorders. While these practices provided researchers with a platform to screen novel antidepressant and anxiolytic drug candidates, their construct validity-involving relevant underlying mechanisms-has been questioned. In this review, we present the laboratory procedures used to assess depressive- and anxiety-like behaviors in rats and mice. These include constructs that rely on stress-triggered responses, such as behavioral despair, and those that emerge with nonaversive training, such as cognitive bias. We describe the specific behavioral tests that are used to assess these constructs and discuss the criticisms on their theoretical background. We review specific concerns about the construct validity and translational relevance of individual behavioral tests, outline the limitations of the traditional, symptom-based interpretation, and introduce novel, ethologically relevant frameworks that emphasize simple behavioral patterns. Finally, we explore behavioral monitoring and morphological analysis methods that can be integrated into behavioral testing and discuss how they can enhance the construct validity of these tests.

Neuropsychological Effects of Antidepressants: Translational Studies

Pharmacological treatments that improve mood were first identified serendipitously, but more than half a century later, how these drugs induce their antidepressant effects remains largely unknown. With the help of animal models, a detailed understanding of their pharmacological targets and acute and chronic effects on brain chemistry and neuronal function has been achieved, but it remains to be elucidated how these effects translate to clinical efficacy. Whilst the field has been dominated by the monoamine and neurotrophic hypotheses, the idea that the maladaptive cognitive process plays a critical role in the development and perpetuation of mood disorders has been discussed since the 1950s. Recently, studies using objective methods to quantify changes in emotional processing found acute effects with conventional antidepressants in both healthy volunteers and patients. These positive effects on emotional processing and cognition occur without a change in the subjective ratings of mood. Building from these studies, behavioural methods for animals that quantify similar cognitive affective processes have been developed. Integrating these behavioural approaches with pharmacology and targeted brain manipulations, a picture is beginning to emerge of the underlying mechanisms that may link the pharmacology of antidepressants, these neuropsychological constructs and clinical efficacy. In this chapter, we discuss findings from animal studies, experimental medicine and patients investigating the neuropsychological effects of antidepressant drugs. We discuss the possible neural circuits that contribute to these effects and discuss whether a neuropsychological model of antidepressant effects could explain the temporal differences in clinical benefits observed with conventional delayed-onset antidepressants versus rapid-acting antidepressants.

A mild impairment in reversal learning in a bowl-digging substrate deterministic task but not other cognitive tests in the Dlg2+/- rat model of genetic risk for psychiatric disorder

Variations in the Dlg2 gene have been linked to increased risk for psychiatric disorders, including schizophrenia, autism spectrum disorders, intellectual disability, bipolar disorder, attention deficit hyperactivity disorder, and pubertal disorders. Recent studies have reported disrupted brain circuit function and behaviour in models of Dlg2 knockout and haploinsufficiency. Specifically, deficits in hippocampal synaptic plasticity were found in heterozygous Dlg2+/- rats suggesting impacts on hippocampal dependent learning and cognitive flexibility. Here, we tested these predicted effects with a behavioural characterisation of the heterozygous Dlg2+/- rat model. Dlg2+/- rats exhibited a specific, mild impairment in reversal learning in a substrate deterministic bowl-digging reversal learning task. The performance of Dlg2+/- rats in other bowl digging task, visual discrimination and reversal, novel object preference, novel location preference, spontaneous alternation, modified progressive ratio, and novelty-suppressed feeding test were not impaired. These findings suggest that despite altered brain circuit function, behaviour across different domains is relatively intact in Dlg2+/- rats, with the deficits being specific to only one test of cognitive flexibility. The specific behavioural phenotype seen in this Dlg2+/- model may capture features of the clinical presentation associated with variation in the Dlg2 gene.

Parallel learning and cognitive flexibility impairments between Fmr1 knockout mice and individuals with fragile X syndrome

Introduction

Fragile X Syndrome (FXS) is a monogenic condition that leads to intellectual disability along with behavioral and learning difficulties. Among behavioral and learning difficulties, cognitive flexibility impairments are among the most commonly reported in FXS, which significantly impacts daily living. Despite the extensive use of the Fmr1 knockout (KO) mouse to understand molecular, synaptic and behavioral alterations related to FXS, there has been limited development of translational paradigms to understand cognitive flexibility that can be employed in both animal models and individuals with FXS to facilitate treatment development.

Methods

To begin addressing this limitation, a parallel set of studies were carried out that investigated probabilistic reversal learning along with other behavioral and cognitive tests in individuals with FXS and Fmr1 KO mice. Fifty-five adolescents and adults with FXS (67% male) and 34 age- and sex-matched typically developing controls (62% male) completed an initial probabilistic learning training task and a probabilistic reversal learning task.

Results

In males with FXS, both initial probabilistic learning and reversal learning deficits were found. However, in females with FXS, we only observed reversal learning deficits. Reversal learning deficits related to more severe psychiatric features in females with FXS, whereas increased sensitivity to negative feedback (lose:shift errors) unexpectedly appear to be adaptive in males with FXS. Male Fmr1 KO mice exhibited both an initial probabilistic learning and reversal learning deficit compared to that of wildtype (WT) mice. Female Fmr1 KO mice were selectively impaired on probabilistic reversal learning. In a prepotent response inhibition test, both male and female Fmr1 KO mice were impaired in learning to choose a non-preferred spatial location to receive a food reward compared to that of WT mice. Neither male nor female Fmr1 KO mice exhibited a change in anxiety compared to that of WT mice.

Discussion

Together, our findings demonstrate strikingly similar sex-dependent learning disturbances across individuals with FXS and Fmr1 KO mice. This suggests the promise of using analogous paradigms of cognitive flexibility across species that may speed treatment development to improve lives of individuals with FXS.

Investigation of reward learning and feedback sensitivity in non-clinical participants with a history of early life stress

Early life stress (ELS) is an important risk factor for the development of depression. Impairments in reward learning and feedback sensitivity are suggested to be an intermediate phenotype in depression aetiology therefore we hypothesised that healthy adults with a history of ELS would exhibit reward processing deficits independent of any current depressive symptoms. We recruited 64 adults with high levels of ELS and no diagnosis of a current mental health disorder and 65 controls. Participants completed the probabilistic reversal learning task and probabilistic reward task followed by depression, anhedonia, social status, and stress scales. Participants with high levels of ELS showed decreased positive feedback sensitivity in the probabilistic reversal learning task compared to controls. High ELS participants also trended towards possessing a decreased model-free learning rate. This was coupled with a decreased learning ability in the acquisition phase of block 1 following the practice session. Neither group showed a reward induced response bias in the probabilistic reward task however high ELS participants exhibited decreased stimuli discrimination. Overall, these data suggest that healthy participants without a current mental health diagnosis but with high levels of ELS show deficits in positive feedback sensitivity and reward learning in the probabilistic reversal learning task that are distinct from depressed patients. These deficits may be relevant to increased depression vulnerability.

Examining the effects of psychoactive drugs on complex behavioral processes in laboratory animals

Behavioral pharmacology has been aided significantly by the development of innovative cognitive tasks designed to examine complex behavioral processes in laboratory animals. Performance outcomes under these conditions have provided key metrics of drug action which serve to supplement traditional in vivo assays of physiologic and behavioral effects of psychoactive drugs. This chapter provides a primer of cognitive tasks designed to assay different aspects of complex behavior, including learning, cognitive flexibility, memory, attention, motivation, and impulsivity. Both capstone studies and recent publications are highlighted throughout to illustrate task value for two distinct but often interconnected translational strategies. First, task performance in laboratory animals can be utilized to elucidate how drugs of abuse affect complex behavioral processes. Here, the expectation is that adverse effects on such processes will have predictive relevance to consequences that will be experienced by humans. Second, these same task outcomes can be used to evaluate candidate therapeutics. In this case, the extent to which drug doses with medicinal value perturb task performance can contribute critical information for a more complete safety profile appraisal and advance the process of medications development. Methodological and theoretical considerations are discussed and include an emphasis on determining selectivity in drug action on complex behavioral processes.

Reinforcement-based cognitive biases as vulnerability factors in alcohol addiction: From humans to animal models

Alcohol use disorder (AUD) is one of the most common, but still poorly treated, psychiatric conditions. Developing new treatments requires a better understanding of the aetiology of symptoms and evaluation of novel therapeutic targets in preclinical studies. Recent developments in our understanding of the reinforcement-based cognitive biases (RBCBs) that contribute to the development of AUD and its treatment offer new opportunities for both clinical and preclinical research. In this review, we first briefly describe psychological and cognitive theories that involve various aspects of reinforcement sensitivity in the development, maintenance, and recurrence of alcohol addiction. Furthermore, in separate sections, we describe studies investigating RBCBs and their neural, neurochemical, and pharmacological correlates, and we discuss possible interactions between RBCBs and trajectories of AUD. Finally, we describe how recent translational studies using state-of-the-art animal models can facilitate our understanding of the role of reinforcement sensitivity and RBCBs in various aspects of AUD.

Using touchscreen-delivered cognitive assessments to address the principles of the 3Rs in behavioral sciences

Despite considerable advances in both in silico and in vitro approaches, in vivo studies that involve animal model systems remain necessary in many research disciplines. Neuroscience is one such area, with studies often requiring access to a complete nervous system capable of dynamically selecting between and then executing a full range of cognitive and behavioral outputs in response to a given stimulus or other manipulation. The involvement of animals in research studies is an issue of active public debate and concern and is therefore carefully regulated. Such regulations are based on the principles of the 3Rs of Replacement, Reduction and Refinement. In the sub-specialty of behavioral neuroscience, Full/Absolute Replacement remains a major challenge, as the complete ex vivo recapitulation of a system as complex and dynamic as the nervous system has yet to be achieved. However, a number of very positive developments have occurred in this area with respect to Relative Replacement and to both Refinement and Reduction. In this review, we discuss the Refinement- and Reduction-related benefits yielded by the introduction of touchscreen-based behavioral assessment apparatus. We also discuss how data generated by a specific panel of behavioral tasks developed for this platform might substantially enhance monitoring of laboratory animal welfare and provide robust, quantitative comparisons of husbandry techniques to define and ensure maintenance of best practice.

Applying Reinforcement Learning to Rodent Stress Research

Rodent models are an invaluable tool for studying the pathophysiological mechanisms underlying stress and depressive disorders. However, the widely used behavioral assays to measure depressive-like states in rodents have serious limitations. In this commentary, we suggest that learning tasks, particularly those that can be analyzed with the framework of reinforcement learning, are ideal for assaying reward processing deficits relevant to depression. The key advantages of these tasks are their repeatable, quantifiable nature and the link to clinical studies. By optimizing the behavioral readout of stress-induced phenotypes in rodents, a reinforcement learning-based approach may help bridge the translational gap and advance antidepressant discovery.

New frontiers in translational research: Touchscreens, open science, and the mouse translational research accelerator platform

Many neurodegenerative and neuropsychiatric diseases and other brain disorders are accompanied by impairments in high-level cognitive functions including memory, attention, motivation, and decision-making. Despite several decades of extensive research, neuroscience is little closer to discovering new treatments. Key impediments include the absence of validated and robust cognitive assessment tools for facilitating translation from animal models to humans. In this review, we describe a state-of-the-art platform poised to overcome these impediments and improve the success of translational research, the Mouse Translational Research Accelerator Platform (MouseTRAP), which is centered on the touchscreen cognitive testing system for rodents. It integrates touchscreen-based tests of high-level cognitive assessment with state-of-the art neurotechnology to record and manipulate molecular and circuit level activity in vivo in animal models during human-relevant cognitive performance. The platform also is integrated with two Open Science platforms designed to facilitate knowledge and data-sharing practices within the rodent touchscreen community, touchscreencognition.org and mousebytes.ca. Touchscreencognition.org includes the Wall, showcasing touchscreen news and publications, the Forum, for community discussion, and Training, which includes courses, videos, SOPs, and symposia. To get started, interested researchers simply create user accounts. We describe the origins of the touchscreen testing system, the novel lines of research it has facilitated, and its increasingly widespread use in translational research, which is attributable in part to knowledge-sharing efforts over the past decade. We then identify the unique features of MouseTRAP that stand to potentially revolutionize translational research, and describe new initiatives to partner with similar platforms such as McGill's M3 platform (m3platform.org).