Selective effects of 5-HT2C receptor modulation on performance of a novel valence-probe visual discrimination task and probabilistic reversal learning in mice

5-HT 2A and 5-HT 2C receptor antagonism differentially modulate reinforcement learning and cognitive flexibility: behavioural and computational evidence

RATIONALE

Cognitive flexibility, the ability to adapt behaviour in response to a changing environment, is disrupted in several neuropsychiatric disorders, including obsessive-compulsive disorder and major depressive disorder. Evidence suggests that flexibility, which can be operationalised using reversal learning tasks, is modulated by serotonergic transmission. However, how exactly flexible behaviour and associated reinforcement learning (RL) processes are modulated by 5-HT action on specific receptors is unknown.

OBJECTIVES

We investigated the effects of 5-HT2A receptor (5-HT2AR) and 5-HT2C receptor (5-HT2CR) antagonism on flexibility and underlying RL mechanisms.

METHODS

Thirty-six male Lister hooded rats were trained on a touchscreen visual discrimination and reversal task. We evaluated the effects of systemic treatments with the 5-HT2AR and 5-HT2CR antagonists M100907 and SB-242084, respectively, on reversal learning and performance on probe trials where correct and incorrect stimuli were presented with a third, probabilistically rewarded, stimulus. Computational models were fitted to task choice data to extract RL parameters, including a novel model designed specifically for this task.

RESULTS

5-HT2AR antagonism impaired reversal learning only after an initial perseverative phase, during a period of random choice and then new learning. 5-HT2CR antagonism, on the other hand, impaired learning from positive feedback. RL models further differentiated these effects. 5-HT2AR antagonism decreased punishment learning rate (i.e. negative feedback) at high and low doses. The low dose also decreased reinforcement sensitivity (beta) and increased stimulus and side stickiness (i.e., the tendency to repeat a choice regardless of outcome). 5-HT2CR antagonism also decreased beta, but reduced side stickiness.

CONCLUSIONS

These data indicate that 5-HT2A and 5-HT2CRs both modulate different aspects of flexibility, with 5-HT2ARs modulating learning from negative feedback as measured using RL parameters and 5-HT2CRs for learning from positive feedback assessed through conventional measures.

Rodent tests of depression and anxiety: Construct validity and translational relevance

Behavioral testing constitutes the primary method to measure the emotional states of nonhuman animals in preclinical research. Emerging as the characteristic tool of the behaviorist school of psychology, behavioral testing of animals, particularly rodents, is employed to understand the complex cognitive and affective symptoms of neuropsychiatric disorders. Following the symptom-based diagnosis model of the DSM, rodent models and tests of depression and anxiety focus on behavioral patterns that resemble the superficial symptoms of these disorders. While these practices provided researchers with a platform to screen novel antidepressant and anxiolytic drug candidates, their construct validity-involving relevant underlying mechanisms-has been questioned. In this review, we present the laboratory procedures used to assess depressive- and anxiety-like behaviors in rats and mice. These include constructs that rely on stress-triggered responses, such as behavioral despair, and those that emerge with nonaversive training, such as cognitive bias. We describe the specific behavioral tests that are used to assess these constructs and discuss the criticisms on their theoretical background. We review specific concerns about the construct validity and translational relevance of individual behavioral tests, outline the limitations of the traditional, symptom-based interpretation, and introduce novel, ethologically relevant frameworks that emphasize simple behavioral patterns. Finally, we explore behavioral monitoring and morphological analysis methods that can be integrated into behavioral testing and discuss how they can enhance the construct validity of these tests.

Foraging Under Uncertainty Follows the Marginal Value Theorem with Bayesian Updating of Environment Representations

Foraging theory has been a remarkably successful approach to understanding the behavior of animals in many contexts. In patch-based foraging contexts, the marginal value theorem (MVT) shows that the optimal strategy is to leave a patch when the marginal rate of return declines to the average for the environment. However, the MVT is only valid in deterministic environments whose statistics are known to the forager; naturalistic environments seldom meet these strict requirements. As a result, the strategies used by foragers in naturalistic environments must be empirically investigated. We developed a novel behavioral task and a corresponding computational framework for studying patch-leaving decisions in head-fixed and freely moving mice. We varied between-patch travel time, as well as within-patch reward depletion rate, both deterministically and stochastically. We found that mice adopt patch residence times in a manner consistent with the MVT and not explainable by simple ethologically motivated heuristic strategies. Critically, behavior was best accounted for by a modified form of the MVT wherein environment representations were updated based on local variations in reward timing, captured by a Bayesian estimator and dynamic prior. Thus, we show that mice can strategically attend to, learn from, and exploit task structure on multiple timescales simultaneously, thereby efficiently foraging in volatile environments. The results provide a foundation for applying the systems neuroscience toolkit in freely moving and head-fixed mice to understand the neural basis of foraging under uncertainty.

"The wrong tools for the right job": a critical meta-analysis of traditional tests to assess behavioural impacts of maternal separation

RATIONALE

Unconditioned tasks in rodents have been the mainstay of behavioural assessment for decades, but their validity and sensitivity to detect the behavioural consequences of early life stress (ELS) remains contentious and highly variable.

OBJECTIVES

In the present study, we carried out a meta-analysis to investigate whether persistent behavioural effects, as assessed using unconditioned procedures in rats, are a reliable consequence of early repeated maternal separation, a commonly used procedure in rodents to study ELS.

METHODS

A literature search identified 100 studies involving maternally separated rats and the following unconditioned procedures: the elevated plus maze (EPM); open field test (OFT); sucrose preference test (SPT) and forced swim task (FST). Studies were included for analysis if the separation of offspring from the dam was at least 60 min every day during the pre-weaning period prior to the start of adolescence.

RESULTS

Our findings show that unconditioned tasks are generally poor at consistently demonstrating differences between control and separated groups with pooled effect sizes that were either small or non-existent (EPM: Hedge's g =  - 0.35, p = 0.01, OFT: Hedge's g =  - 0.32, p = 0.05, SPT: Hedge's g =  - 0.33, p = 0.21, FST: Hedge's g = 0.99, p = 0.0001). Despite considerable procedural variability between studies, heterogeneity statistics were low; indicating the lack of standardization in the maternal separation protocol was the not the cause of these inconsistent effects.

CONCLUSIONS

Our findings indicate that in general, unconditioned tests of depression and anxiety are not sufficient to reveal the full behavioural repertoire of maternal separation stress should not be relied upon in isolation. We argue that more objective tasks that sensitively detect specific cognitive processes are better suited for translational research on stress-related disorders such as depression.

Relationship between hippocampal gene expression and cognitive performance differences in visual discrimination learning task of male rats

Learning to discriminate between environmental visual stimuli is essential to make right decisions and guide appropriate behaviors. Moreover, impairments in visual discrimination learning are observed in several neuropsychiatric disorders. Visual discrimination learning requires perception and memory processing, in which the hippocampus critically involved. To understand the molecular mechanisms underpinning hippocampus function in visual discrimination learning, we examined the hippocampal gene expression profiles of Sprague-Dawley rats with different cognitive performance (high cognition group vs. low cognition group) in the modified visual discrimination learning task, using high-throughput RNA sequencing technology. Compared with the low cognition group, bioinformatics analysis indicated that 319 genes were differentially expressed in the high cognition group with statistical significance, of which 253 genes were down-regulated and 66 genes were up-regulated. The functional enrichment analysis showed that protein translation and energy metabolism were up-regulated pathways, while transforming growth factor beta receptor signaling pathway, bone morphogenetic protein signaling pathway, apoptosis, inflammation response, transport, and glycosaminoglycan metabolism were down-regulated pathways, which were related to good cognitive performance in the visual discrimination learning task. Taken together, our finding reveals the differential gene expression and enrichment biological pathways related to cognitive performance differences in visual discrimination learning of rats, which provides us direct insight into the molecular mechanisms of hippocampus function in visual discrimination learning and may contribute to developing potential treatment strategies for neuropsychiatric disorders accompanied with cognitive impairments.

Importance of additional behavioral observation in psychopharmacology: a case study on agomelatine's effects on feedback sensitivity in probabilistic reversal learning in rats

Since the second half of the twentieth century, many important discoveries in the field of behavioral psychopharmacology have been made using operant conditioning cages. These cages provide objective data collection and have revolutionized behavioral research. Unfortunately, in the rush towards automation, many mistakes may have been made that could have been avoided by observing experimental animals. The study described in this paper is an excellent example of how important additional behavioral observation can be for interpreting instrumental data. In this study, we evaluated the effects of single injections of 3 different doses of agomelatine (5, 10, and 40 mg/kg) on feedback sensitivity in rats. To this end, we tested 40 animals in the instrumental probabilistic reversal learning task in a Latin square design. The highest applied dose of agomelatine, prima facie, reduced the sensitivity of rats to negative feedback - an effect that can be considered antidepressant. However, additional behavioral observation dramatically changed the interpretation of the results and revealed that the perceived effect of agomelatine on sensitivity to negative feedback can actually be attributed to drug-induced drowsiness.

Early-life stress biases responding to negative feedback and increases amygdala volume and vulnerability to later-life stress

Early-life stress (ELS) or adversity, particularly in the form of childhood neglect and abuse, is associated with poor mental and physical health outcomes in adulthood. However, whether these relationships are mediated by the consequences of ELS itself or by other exposures that frequently co-occur with ELS is unclear. To address this question, we carried out a longitudinal study in rats to isolate the effects of ELS on regional brain volumes and behavioral phenotypes relevant to anxiety and depression. We used the repeated maternal separation (RMS) model of chronic ELS, and conducted behavioral measurements throughout adulthood, including of probabilistic reversal learning (PRL), responding on a progressive ratio task, sucrose preference, novelty preference, novelty reactivity, and putative anxiety-like behavior on the elevated plus maze. Our behavioral assessment was combined with magnetic resonance imaging (MRI) for quantitation of regional brain volumes at three time points: immediately following RMS, young adulthood without further stress, and late adulthood with further stress. We found that RMS caused long-lasting, sexually dimorphic biased responding to negative feedback on the PRL task. RMS also slowed response time on the PRL task, but without this directly impacting task performance. RMS animals were also uniquely sensitive to a second stressor, which disproportionately impaired their performance and slowed their responding on the PRL task. MRI at the time of the adult stress revealed a larger amygdala volume in RMS animals compared with controls. These behavioral and neurobiological effects persisted well into adulthood despite a lack of effects on conventional tests of 'depression-like' and 'anxiety-like' behavior, and a lack of any evidence of anhedonia. Our findings indicate that ELS has long-lasting cognitive and neurobehavioral effects that interact with stress in adulthood and may have relevance for understanding the etiology of anxiety and depression in humans.

Trait sensitivity to negative feedback in rats is associated with increased expression of serotonin 5-HT2A receptors in the ventral hippocampus

One of the most important yet still underappreciated mechanisms of depression is distorted cognition, with aberrant sensitivity to negative feedback being one of the best-described examples. As serotonin has been identified as an important modulator of sensitivity to feedback and because the hippocampus has been implicated in the mediation of learning from positive and negative outcomes, the present study aimed to identify differences in the expression of various genes encoding 5-HT receptors in this brain region between the rats displaying trait sensitivity and insensitivity to negative feedback. The results demonstrated that trait sensitivity to negative feedback is associated with increased mRNA expression of the 5-HT2A receptors in the rat ventral hippocampus (vHipp). Further analysis revealed that this increased expression might be modulated epigenetically by miRNAs with a high target score for the Htr2a gene (miR-16-5p and miR-15b-5p). Additionally, although not confirmed at the protein level, trait sensitivity to negative feedback was associated with decreased expression of mRNA encoding the 5-HT7 receptor in the dorsal hippocampus (dHipp). We observed no statistically significant intertrait differences in the expression of the Htr1a, Htr2c, and Htr7 genes in the vHipp and no statistically significant intertrait differences in the expression of the Htr1a, Htr2a, and Htr2c genes in the dHipp of the tested animals. These results suggest that resilience to depression manifested by reduced sensitivity to negative feedback may be mediated via these receptors.

Parallel learning and cognitive flexibility impairments between Fmr1 knockout mice and individuals with fragile X syndrome

Introduction

Fragile X Syndrome (FXS) is a monogenic condition that leads to intellectual disability along with behavioral and learning difficulties. Among behavioral and learning difficulties, cognitive flexibility impairments are among the most commonly reported in FXS, which significantly impacts daily living. Despite the extensive use of the Fmr1 knockout (KO) mouse to understand molecular, synaptic and behavioral alterations related to FXS, there has been limited development of translational paradigms to understand cognitive flexibility that can be employed in both animal models and individuals with FXS to facilitate treatment development.

Methods

To begin addressing this limitation, a parallel set of studies were carried out that investigated probabilistic reversal learning along with other behavioral and cognitive tests in individuals with FXS and Fmr1 KO mice. Fifty-five adolescents and adults with FXS (67% male) and 34 age- and sex-matched typically developing controls (62% male) completed an initial probabilistic learning training task and a probabilistic reversal learning task.

Results

In males with FXS, both initial probabilistic learning and reversal learning deficits were found. However, in females with FXS, we only observed reversal learning deficits. Reversal learning deficits related to more severe psychiatric features in females with FXS, whereas increased sensitivity to negative feedback (lose:shift errors) unexpectedly appear to be adaptive in males with FXS. Male Fmr1 KO mice exhibited both an initial probabilistic learning and reversal learning deficit compared to that of wildtype (WT) mice. Female Fmr1 KO mice were selectively impaired on probabilistic reversal learning. In a prepotent response inhibition test, both male and female Fmr1 KO mice were impaired in learning to choose a non-preferred spatial location to receive a food reward compared to that of WT mice. Neither male nor female Fmr1 KO mice exhibited a change in anxiety compared to that of WT mice.

Discussion

Together, our findings demonstrate strikingly similar sex-dependent learning disturbances across individuals with FXS and Fmr1 KO mice. This suggests the promise of using analogous paradigms of cognitive flexibility across species that may speed treatment development to improve lives of individuals with FXS.

A mutant allele of glycoprotein M6-B (Gpm6b) facilitates behavioral flexibility but increases delay discounting

The neuronal membrane glycoprotein M6B (Gpm6b) gene encodes a membrane glycoprotein that belongs to the proteolipid protein family, and is enriched in neurons, oligodendrocytes, and subset of astrocytes in the central nervous system. GPM6B is thought to play a role in neuronal differentiation, myelination, and inactivation of the serotonin transporter via internalization. Recent human genome-wide association studies (GWAS) have implicated membrane glycoproteins (both GPM6B and GPM6A) in the regulation of traits relevant to psychiatric disorders, including neuroticism, depressed affect, and delay discounting. Mouse studies have implicated Gpm6b in sensorimotor gating and regulation of serotonergic signaling. We used CRISPR to create a mutant Glycoprotein M6B (Gpm6b) allele on a C57BL/6J mouse background. Because Gpm6b is located on the X chromosome, we focused on male Gpm6b mutant mice and their wild-type littermates (WT) in two behavioral tests that measured aspects of impulsive or flexible decision-making. We found that Gpm6b deletion caused deficits in a delay discounting task. In contrast, reward sensitivity was enhanced thereby facilitating behavioral flexibility and improving performance in the probabilistic reversal learning task. Taken together these data further delineate the role of Gpm6b in decision making behaviors that are relevant to multiple psychiatric disorders.

Applications of technology in the assessment and treatment of cannabis use disorder

Cannabis use and Cannabis Use Disorder (CUD) have been increasing. There are no FDA approved medications and evidence-based psychotherapy is limited by insufficient providers, serving very few patients effectively. The lack of resources for prevention and treatment of CUD has resulted in a significant gap between the need for services and access to treatment. The creation of a scalable system to prevent, screen, refer and provide treatment for a chronic, relapsing diagnosis like CUD could be achieved through the application of technology. Many studies have utilized ecological momentary assessments (EMA) in treatment seeking and non-treatment seeking cannabis users. EMA allows for repeated, intensive, longitudinal data collection in vivo. EMA has been studied in cannabis use and its association with affect, craving, withdrawal, other substances, impulsivity, and interpersonal behaviors. EMA has the potential to serve as a valuable monitoring tool in prevention, screening, and treatment for CUD. Research has also focused on the development of internet and application-based treatments for CUD, including a currently available prescription digital therapeutic. Treatment options have expanded to more broadly incorporate telehealth as an option for CUD treatment with broad acceptance and change in regulation following the COVID-19 pandemic. While technology has limitations, including cost, privacy concerns, and issues with engagement, it will be a necessary medium to meet societal health needs as a consequence of an ever-changing cannabis regulatory landscape. Future work should focus on improving existing platforms while ethically incorporating other functions (e.g., sensors) to optimize a public and clinical health approach to CUD.

Neuromolecular Underpinnings of Negative Cognitive Bias in Depression

This selective review aims to summarize the recent advances in understanding the neuromolecular underpinnings of biased cognition in depressive disorder. We begin by considering the cognitive correlates of depressed mood and the key brain systems implicated in its development. We then review the core findings across two domains of biased cognitive function in depression: pessimistic judgment bias and abnormal response to negative feedback. In considering their underlying substrates, we focus on the neurochemical mechanisms identified by genetic, molecular and pharmacological challenge studies. We conclude by discussing experimental approaches to the treatment of depression, which are derived largely from an improved understanding of its cognitive substrates.

Impact of specific serotonin receptor modulation on behavioral flexibility

Serotonin (5-HT) is known to play a critical role in regulation of essential neural processes, whereas more recent research highlights serotonin's modulatory effects on cognition and executive functioning. Current examinations have identified specific serotonin receptors for their direct impact on behavioral flexibility. Providing definitive evidence for the impact of specific receptor targets on behavioral flexibility is difficult, due to the range of behavioral tests used. Due to limited studies and the sheer amount of different serotonin receptor targets, beginning to bring these studies together is important for the field. Our current review of the literature aims to differentiate how modulation of specific 5-HT receptors affects behavioral flexibility. Although more studies have examined 5-HT_2A, 5-HT_2C, and 5-HT₆ receptors, it is unclear why this is the case. Above all, there are some paradoxical results pertaining to these receptor targets. There is a clear distinction between 5-HT_2A and 5-HT_2C, which conveys that these two receptor subtypes have inverse effects when compared to each other. In addition, some findings support one another, such as upregulation of 5-HT₆ receptors impairs flexibility, while blockade alleviates this impairment in both drug-induced and disease model rodent studies. Further understanding how modulatory effects of specific 5-HT receptors impact behavioral flexibility is imperative to advance the development of new therapeutics for neuropsychiatric disorders afflicted by behavioral inflexibility.

Using touchscreen-delivered cognitive assessments to address the principles of the 3Rs in behavioral sciences

Despite considerable advances in both in silico and in vitro approaches, in vivo studies that involve animal model systems remain necessary in many research disciplines. Neuroscience is one such area, with studies often requiring access to a complete nervous system capable of dynamically selecting between and then executing a full range of cognitive and behavioral outputs in response to a given stimulus or other manipulation. The involvement of animals in research studies is an issue of active public debate and concern and is therefore carefully regulated. Such regulations are based on the principles of the 3Rs of Replacement, Reduction and Refinement. In the sub-specialty of behavioral neuroscience, Full/Absolute Replacement remains a major challenge, as the complete ex vivo recapitulation of a system as complex and dynamic as the nervous system has yet to be achieved. However, a number of very positive developments have occurred in this area with respect to Relative Replacement and to both Refinement and Reduction. In this review, we discuss the Refinement- and Reduction-related benefits yielded by the introduction of touchscreen-based behavioral assessment apparatus. We also discuss how data generated by a specific panel of behavioral tasks developed for this platform might substantially enhance monitoring of laboratory animal welfare and provide robust, quantitative comparisons of husbandry techniques to define and ensure maintenance of best practice.

New frontiers in translational research: Touchscreens, open science, and the mouse translational research accelerator platform

Many neurodegenerative and neuropsychiatric diseases and other brain disorders are accompanied by impairments in high-level cognitive functions including memory, attention, motivation, and decision-making. Despite several decades of extensive research, neuroscience is little closer to discovering new treatments. Key impediments include the absence of validated and robust cognitive assessment tools for facilitating translation from animal models to humans. In this review, we describe a state-of-the-art platform poised to overcome these impediments and improve the success of translational research, the Mouse Translational Research Accelerator Platform (MouseTRAP), which is centered on the touchscreen cognitive testing system for rodents. It integrates touchscreen-based tests of high-level cognitive assessment with state-of-the art neurotechnology to record and manipulate molecular and circuit level activity in vivo in animal models during human-relevant cognitive performance. The platform also is integrated with two Open Science platforms designed to facilitate knowledge and data-sharing practices within the rodent touchscreen community, touchscreencognition.org and mousebytes.ca. Touchscreencognition.org includes the Wall, showcasing touchscreen news and publications, the Forum, for community discussion, and Training, which includes courses, videos, SOPs, and symposia. To get started, interested researchers simply create user accounts. We describe the origins of the touchscreen testing system, the novel lines of research it has facilitated, and its increasingly widespread use in translational research, which is attributable in part to knowledge-sharing efforts over the past decade. We then identify the unique features of MouseTRAP that stand to potentially revolutionize translational research, and describe new initiatives to partner with similar platforms such as McGill's M3 platform (m3platform.org).

Serotonergic Innervations of the Orbitofrontal and Medial-prefrontal Cortices are Differentially Involved in Visual Discrimination and Reversal Learning in Rats

Cross-species studies have identified an evolutionarily conserved role for serotonin in flexible behavior including reversal learning. The aim of the current study was to investigate the contribution of serotonin within the orbitofrontal cortex (OFC) and medial prefrontal cortex (mPFC) to visual discrimination and reversal learning. Male Lister Hooded rats were trained to discriminate between a rewarded (A+) and a nonrewarded (B−) visual stimulus to receive sucrose rewards in touchscreen operant chambers. Serotonin was depleted using surgical infusions of 5,7-dihydroxytryptamine (5,7-DHT), either globally by intracebroventricular (i.c.v.) infusions or locally by microinfusions into the OFC or mPFC. Rats that received i.c.v. infusions of 5,7-DHT before initial training were significantly impaired during both visual discrimination and subsequent reversal learning during which the stimulus–reward contingencies were changed (A− vs. B+). Local serotonin depletion from the OFC impaired reversal learning without affecting initial discrimination. After mPFC depletion, rats were unimpaired during reversal learning but slower to respond at the stimuli during all the stages; the mPFC group was also slower to learn during discrimination than the OFC group. These findings extend our understanding of serotonin in cognitive flexibility by revealing differential effects within two subregions of the prefrontal cortex in visual discrimination and reversal learning.

Translational cognitive neuroscience of dementia with touchscreen operant chambers

Translational cognitive neuroscience of dementia involves mainly two areas: the validation of newly developed dementia animal models and the preclinical assessment of novel drug candidates in such model animals. To validate new animal models, a multidomain panel (battery) approach is essential in that dementia is, by definition, not merely a memory disorder but rather a multidomain cognitive/behavior disorder: animal modeling with a certain type of dementia would develop cognitive impairments in multiple (two at minimum) domains in a specific order according to unique spreading patterns of its neuropathology. In new drug development, the availability of highly sensitive tools assessing animal cognition is crucial to the detection of cognitive decline at the earliest stage of the disease, which may be an optimal time point to test a drug candidate. Using interspecies translatable (analogous) cognitive tasks would also be necessary to successfully predict the efficacy of drug candidates in subsequent clinical trials. Currently, this translational prediction is seriously limited given discrepancies in behavioral assessment methods between animals and humans in the preclinical and clinical trials, respectively. Since neurodegenerative diseases are often accompanied by not only cognitive but also affective and movement disorders, simultaneous assessment of task-relevant locomotor behavior and motivation is also important to rule out the effects of potential confounders. The touchscreen operant platform may satisfy these needs by offering several advantages over conventional methodology. In this review, we discuss the touchscreen operant chamber system and highlight some of its qualities as a promising and desirable tool for translational research of dementia.

Withdrawal from escalated cocaine self-administration impairs reversal learning by disrupting the effects of negative feedback on reward exploitation: a behavioral and computational analysis

Addiction is regarded as a disorder of inflexible choice with behavior dominated by immediate positive rewards over longer-term negative outcomes. However, the psychological mechanisms underlying the effects of self-administered drugs on behavioral flexibility are not well understood. To investigate whether drug exposure causes asymmetric effects on positive and negative outcomes we used a reversal learning procedure to assess how reward contingencies are utilized to guide behavior in rats previously exposed to intravenous cocaine self-administration (SA). Twenty-four rats were screened for anxiety in an open field prior to acquisition of cocaine SA over six daily sessions with subsequent long-access cocaine SA for 7 days. Control rats (n = 24) were trained to lever-press for food under a yoked schedule of reinforcement. Higher rates of cocaine SA were predicted by increased anxiety and preceded impaired reversal learning, expressed by a decrease in lose-shift as opposed to win-stay probability. A model-free reinforcement learning algorithm revealed that rats with high, but not low cocaine escalation failed to exploit previous reward learning and were more likely to repeat the same response as the previous trial. Eight-day withdrawal from high cocaine escalation was associated, respectively, with increased and decreased dopamine receptor D2 (DRD2) and serotonin receptor 2C (HTR2C) expression in the ventral striatum compared with controls. Dopamine receptor D1 (DRD1) expression was also significantly reduced in the orbitofrontal cortex of high cocaine-escalating rats. These findings indicate that withdrawal from escalated cocaine SA disrupts how negative feedback is used to guide goal-directed behavior for natural reinforcers and that trait anxiety may be a latent variable underlying this interaction.

Effect of the 5-HT2C Receptor Agonist WAY-163909 on Serotonin and Dopamine Metabolism across the Rat Brain: A Quantitative and Qualitative Neurochemical Study

The effects triggered by serotonin2C (5-hydroxytryptamin_2C, 5-HT_2C) receptor agonists in the brain are often subtle, and methodologies highlighting their widespread actions to account for their multiple modulatory influences on behaviors are still lacking. We report an extended analysis of a neurochemical database on monoamines obtained after the intraperitoneal administration of the preferential 5-HT_2C receptor agonist WAY-163909 (0.3 and 3 mg/kg) in 29 distinct rat brain regions. We focused on the metabolite of 5-HT, 5-hydroxyindoleacetic acid (5-HIAA), the metabolites of dopamine (DA), 3,4-dihydroxyphenylacetic acid (DOPAC) and homovanillic acid (HVA), and the index of the turnovers 5-HIAA/5-HT and DOPAC/DA. WAY-163909 increased and decreased 5-HIAA tissue levels in the amygdala and dorsolateral orbitofrontal cortex, respectively, and decreased the 5-HT turnover in the infralimbic cortex. It enhanced HVA levels in the medial orbitofrontal cortex and DOPAC levels in the amygdala. WAY-163909 increased and decreased DA turnover in the medial orbitofrontal cortex and the anterior insular cortex, respectively. The correlative analysis of the turnovers between pairs of brain regions revealed low levels of correlations across the brain but presented a distinct pattern of correlations after WAY-163909 was compared to saline-treated rats. WAY-163909, notably at 0.3 mg/kg, favored cortico-cortical and cortico-subcortical correlations of both turnovers separately, and frontal DOPAC/DA ratio with cortical and subcortical 5-HIAA/5-HT ratios at 3 mg/kg. In conclusion, the qualitative, but not the quantitative analysis shows that WAY-163909 alters the pattern of correlations across the brain, which could account for its multiple behavioral influences.

Translational tests involving non-reward: methodological considerations

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson's disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Dopamine D2-like receptor stimulation blocks negative feedback in visual and spatial reversal learning in the rat: behavioural and computational evidence

RATIONALE

Dopamine D2-like receptors (D2R) are important drug targets in schizophrenia and Parkinson's disease, but D2R ligands also cause cognitive inflexibility such as poor reversal learning. The specific role of D2R in reversal learning remains unclear.

OBJECTIVES

We tested the hypotheses that D2R agonism impairs reversal learning by blocking negative feedback and that antagonism of D1-like receptors (D1R) impairs learning from positive feedback.

METHODS

Male Lister Hooded rats were trained on a novel visual reversal learning task. Performance on "probe trials", during which the correct or incorrect stimulus was presented with a third, probabilistically rewarded (50% of trials) and therefore intermediate stimulus, revealed individual learning curves for the processes of positive and negative feedback. The effects of D2R and D1R agonists and antagonists were evaluated. A separate cohort was tested on a spatial probabilistic reversal learning (PRL) task after D2R agonism. Computational reinforcement learning modelling was applied to choice data from the PRL task to evaluate the contribution of latent factors.

RESULTS

D2R agonism with quinpirole dose-dependently impaired both visual reversal and PRL. Analysis of the probe trials on the visual task revealed a complete blockade of learning from negative feedback at the 0.25 mg/kg dose, while learning from positive feedback was intact. Estimated parameters from the model that best described the PRL choice data revealed a steep and selective decrease in learning rate from losses. D1R antagonism had a transient effect on the positive probe trials.

CONCLUSIONS

D2R stimulation impairs reversal learning by blocking the impact of negative feedback.