Computational psychopharmacology: a translational and pragmatic approach

Comparable roles for serotonin in rats and humans for computations underlying flexible decision-making

Serotonin is critical for adapting behavior flexibly to meet changing environmental demands. Cognitive flexibility is important for successful attainment of goals, as well as for social interactions, and is frequently impaired in neuropsychiatric disorders, including obsessive-compulsive disorder. However, a unifying mechanistic framework accounting for the role of serotonin in behavioral flexibility has remained elusive. Here, we demonstrate common effects of manipulating serotonin function across two species (rats and humans) on latent processes supporting choice behavior during probabilistic reversal learning, using computational modelling. The findings support a role of serotonin in behavioral flexibility and plasticity, indicated, respectively, by increases or decreases in choice repetition ('stickiness') or reinforcement learning rates following manipulations intended to increase or decrease serotonin function. More specifically, the rate at which expected value increased following reward and decreased following punishment (reward and punishment 'learning rates') was greatest after sub-chronic administration of the selective serotonin reuptake inhibitor (SSRI) citalopram (5 mg/kg for 7 days followed by 10 mg/kg twice a day for 5 days) in rats. Conversely, humans given a single dose of an SSRI (20 mg escitalopram), which can decrease post-synaptic serotonin signalling, and rats that received the neurotoxin 5,7-dihydroxytryptamine (5,7-DHT), which destroys forebrain serotonergic neurons, exhibited decreased reward learning rates. A basic perseverative tendency ('stickiness'), or choice repetition irrespective of the outcome produced, was likewise increased in rats after the 12-day SSRI regimen and decreased after single dose SSRI in humans and 5,7-DHT in rats. These common effects of serotonergic manipulations on rats and humans-identified via computational modelling-suggest an evolutionarily conserved role for serotonin in plasticity and behavioral flexibility and have clinical relevance transdiagnostically for neuropsychiatric disorders.

"The wrong tools for the right job": a critical meta-analysis of traditional tests to assess behavioural impacts of maternal separation

RATIONALE

Unconditioned tasks in rodents have been the mainstay of behavioural assessment for decades, but their validity and sensitivity to detect the behavioural consequences of early life stress (ELS) remains contentious and highly variable.

OBJECTIVES

In the present study, we carried out a meta-analysis to investigate whether persistent behavioural effects, as assessed using unconditioned procedures in rats, are a reliable consequence of early repeated maternal separation, a commonly used procedure in rodents to study ELS.

METHODS

A literature search identified 100 studies involving maternally separated rats and the following unconditioned procedures: the elevated plus maze (EPM); open field test (OFT); sucrose preference test (SPT) and forced swim task (FST). Studies were included for analysis if the separation of offspring from the dam was at least 60 min every day during the pre-weaning period prior to the start of adolescence.

RESULTS

Our findings show that unconditioned tasks are generally poor at consistently demonstrating differences between control and separated groups with pooled effect sizes that were either small or non-existent (EPM: Hedge's g =  - 0.35, p = 0.01, OFT: Hedge's g =  - 0.32, p = 0.05, SPT: Hedge's g =  - 0.33, p = 0.21, FST: Hedge's g = 0.99, p = 0.0001). Despite considerable procedural variability between studies, heterogeneity statistics were low; indicating the lack of standardization in the maternal separation protocol was the not the cause of these inconsistent effects.

CONCLUSIONS

Our findings indicate that in general, unconditioned tests of depression and anxiety are not sufficient to reveal the full behavioural repertoire of maternal separation stress should not be relied upon in isolation. We argue that more objective tasks that sensitively detect specific cognitive processes are better suited for translational research on stress-related disorders such as depression.

Modulation of ventromedial orbitofrontal cortical glutamatergic activity affects the explore-exploit balance and influences value-based decision-making

The balance between exploration and exploitation is essential for decision-making. The present study investigated the role of ventromedial orbitofrontal cortex (vmOFC) glutamate neurons in mediating value-based decision-making by first using optogenetics to manipulate vmOFC glutamate activity in rats during a probabilistic reversal learning (PRL) task. Rats that received vmOFC activation during informative feedback completed fewer reversals and exhibited reduced reward sensitivity relative to rats. Analysis with a Q-learning computational model revealed that increased vmOFC activity did not affect the learning rate but instead promoted maladaptive exploration. By contrast, vmOFC inhibition increased the number of completed reversals and increased exploitative behavior. In a separate group of animals, calcium activity of vmOFC glutamate neurons was recorded using fiber photometry. Complementing our results above, we found that suppression of vmOFC activity during the latter part of rewarded trials was associated with improved PRL performance, greater win-stay responding and selecting the correct choice on the next trial. These data demonstrate that excessive vmOFC activity during reward feedback disrupted value-based decision-making by increasing the maladaptive exploration of lower-valued options. Our findings support the premise that pharmacological interventions that normalize aberrant vmOFC glutamate activity during reward feedback processing may attenuate deficits in value-based decision-making.

Individual differences in computational psychiatry: a review of current challenges

Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.

Probing the antidepressant potential of psilocybin: integrating insight from human research and animal models towards an understanding of neural circuit mechanisms

Interest in the therapeutic potential of serotonergic psychedelic compounds including psilocybin has surged in recent years. While human clinical research suggests psilocybin holds promise as a rapid and long-lasting antidepressant, little is known about how its acute mechanisms of action mediate enduring alterations in cognition and behavior. Human neuroimaging studies point to both acute and sustained modulation of functional connectivity in key cortically dependent brain networks. Emerging evidence in preclinical models highlights the importance of psilocybin-induced neuroplasticity and alterations in the prefrontal cortex (PFC). Overviewing research in both humans and preclinical models suggests avenues to increase crosstalk between fields. We review how acute modulation of PFC circuits may contribute to long-term structural and functional alterations to mediate antidepressant effects. We highlight the potential for preclinical circuit and behavioral neuroscience approaches to provide basic mechanistic insight into how psilocybin modulates cognitive and affective neural circuits to support further development of psilocybin as a promising new treatment for depression.

Prefrontal cortex and depression

The prefrontal cortex (PFC) has emerged as one of the regions most consistently impaired in major depressive disorder (MDD). Although functional and structural PFC abnormalities have been reported in both individuals with current MDD as well as those at increased vulnerability to MDD, this information has not translated into better treatment and prevention strategies. Here, we argue that dissecting depressive phenotypes into biologically more tractable dimensions - negative processing biases, anhedonia, despair-like behavior (learned helplessness) - affords unique opportunities for integrating clinical findings with mechanistic evidence emerging from preclinical models relevant to depression, and thereby promises to improve our understanding of MDD. To this end, we review and integrate clinical and preclinical literature pertinent to these core phenotypes, while emphasizing a systems-level approach, treatment effects, and whether specific PFC abnormalities are causes or consequences of MDD. In addition, we discuss several key issues linked to cross-species translation, including functional brain homology across species, the importance of dissecting neural pathways underlying specific functional domains that can be fruitfully probed across species, and the experimental approaches that best ensure translatability. Future directions and clinical implications of this burgeoning literature are discussed.

Deconstructing and reconstructing behaviour relevant to mental health disorders: The benefits of a psychological approach, with a focus on addiction

RUTHERFORD, L.G. and Milton, A.L. Deconstructing and reconstructing behaviour relevant to mental health disorders: what can psychology offer? NEUROSCI BIOBEHAV REV XX(X)XXX-XXX, 2021. - Current treatments for mental health disorders are successful only for some patients, and there is an unmet clinical need for new treatment development. One challenge for treatment development has been how best to model complex human conditions in animals, where mechanism can be more readily studied with a range of neuroscientific techniques. We suggest that an approach to modelling based on associative animal learning theory provides a good framework for deconstructing complex mental health disorders such that they can be studied in animals. These individual simple models can subsequently be used in combination to 'reconstruct' a more complex model of the mental health disorder of interest. Using examples primarily from the field of drug addiction, we explore the 'psychological approach' and suggest that in addition to facilitating translation and backtranslation of tasks between animal models and patients, it is also highly concordant with the concept of triangulation.

Impaired Learning From Negative Feedback in Stimulant Use Disorder: Dopaminergic Modulation

BACKGROUND

Drug-induced alterations to the dopamine system in stimulant use disorder (SUD) are hypothesized to impair reinforcement learning (RL). Computational modeling enables the investigation of the latent processes of RL in SUD patients, which could elucidate the nature of their impairments.

METHODS

We investigated RL in 44 SUD patients and 41 healthy control participants using a probabilistic RL task that assesses learning from reward and punishment separately. In an independent sample, we determined the modulatory role of dopamine in RL following a single dose of the dopamine D2/3 receptor antagonist amisulpride (400 mg) and the agonist pramipexole (0.5 mg) in a randomised, double-blind, placebo-controlled, crossover design. We analyzed task performance using computational modelling and hypothesized that RL impairments in SUD patients would be differentially modulated by a dopamine D2/3 receptor antagonist and agonist.

RESULTS

Computational analyses in both samples revealed significantly reduced learning rates from punishment in SUD patients compared with healthy controls, whilst their reward learning rates were not measurably impaired. In addition, the dopaminergic receptor agents modulated RL parameters differentially in both groups. Both amisulpride and pramipexole impaired RL parameters in healthy participants, but ameliorated learning from punishment in SUD patients.

CONCLUSION

Our findings suggest that RL impairments seen in SUD patients are associated with altered dopamine function.

Sex Differences and Exogenous Estrogen Influence Learning and Brain Responses to Prediction Errors

Animal studies show marked sex differences as well as effects of estrogen (E2) in the mesocorticolimbic dopaminergic (DA) pathways, which play a critical role in reward processing and reinforcement learning and are also implicated in drug addiction. In this computational pharmacological fMRI study, we investigate the effects of both factors, sex and estrogen, on reinforcement learning and the dopaminergic system in humans; 67 male and 64 naturally cycling female volunteers, the latter in their low-hormone phase, were randomly assigned, double-blind, to take E2 or placebo. They completed a reinforcement learning task in the MRI scanner for which we have previously shown reward prediction error (RPE)-related activity to be dopaminergic. We found RPE-related brain activity to be enhanced in women compared with men and to a greater extent when E2 levels were elevated in both sexes. However, both factors, female sex and E2, slowed adaptation to RPEs (smaller learning rate). This discrepancy of larger RPE-related activity yet smaller learning rates can be explained by organizational sex differences and activational effects of circulating E2, which both affect DA release differently to DA receptor binding capacities.

Chronic exposure to glucocorticoids induces suboptimal decision-making in mice

Anxio-depressive symptoms as well as severe cognitive dysfunction including aberrant decision-making (DM) are documented in neuropsychiatric patients with hypercortisolaemia. Yet, the influence of the hypothalamo-pituitary-adrenal (HPA) axis on DM processes remains poorly understood. As a tractable mean to approach this human condition, adult male C57BL/6JRj mice were chronically treated with corticosterone (CORT) prior to behavioural, physiological and neurobiological evaluation. The behavioural data indicate that chronic CORT delays the acquisition of contingencies required to orient responding towards optimal DM performance in a mouse Gambling Task (mGT). Specifically, CORT-treated animals show a longer exploration and a delayed onset of the optimal DM performance. Remarkably, the proportion of individuals performing suboptimally in the mGT is increased in the CORT condition. This variability seems to be better accounted for by variations in sensitivity to negative rather than to positive outcome. Besides, CORT-treated animals perform worse than control animals in a spatial working memory (WM) paradigm and in a motor learning task. Finally, Western blotting neurobiological analyses show that chronic CORT downregulates glucocorticoid receptor expression in the medial Prefrontal Cortex (mPFC). Besides, corticotropin-releasing factor signalling in the mPFC of CORT individuals negatively correlates with their DM performance. Collectively, this study describes how chronic exposure to glucocorticoids induces suboptimal DM under uncertainty in a mGT, hampers WM and motor learning processes, thus affecting specific emotional, motor, cognitive and neurobiological endophenotypic dimensions relevant for precision medicine in biological psychiatry.

Sex-dependent effects of chronic intermittent voluntary alcohol consumption on attentional, not motivational, measures during probabilistic learning and reversal

Background

Forced alcohol (ethanol, EtOH) exposure has been shown to cause significant impairments on reversal learning, a widely-used assay of cognitive flexibility, specifically on fully-predictive, deterministic versions of this task. However, previous studies have not adequately considered voluntary EtOH consumption and sex effects on probabilistic reversal learning. The present study aimed to fill this gap in the literature.

Methods

Male and female Long-Evans rats underwent either 10 weeks of voluntary intermittent 20% EtOH access or water only (H2O) access. Rats were then pretrained to initiate trials and learn stimulus-reward associations via touchscreen response, and subsequently required to select between two visual stimuli, rewarded with probability 0.70 or 0.30. In the final phase, reinforcement contingencies were reversed.

Results

We found significant sex differences on several EtOH-drinking variables, with females reaching a higher maximum EtOH consumption, exhibiting more high-drinking days, and escalating their EtOH at a quicker rate compared to males. During early abstinence, EtOH drinkers (and particularly EtOH-drinking females) made more initiation omissions and were slower to initiate trials than H2O drinking controls, especially during pretraining. A similar pattern in trial initiations was also observed in discrimination, but not in reversal learning. EtOH drinking rats were unaffected in their reward collection and stimulus response times, indicating intact motivation and motor responding. Although there were sex differences in discrimination and reversal phases, performance improved over time. We also observed sex-independent drinking group differences in win-stay and lose-shift strategies specific to the reversal phase.

Conclusions

Females exhibit increased vulnerability to EtOH effects in early learning: there were sex-dependent EtOH effects on attentional measures during pretraining and discrimination phases. We also found sex-independent EtOH effects on exploration strategies during reversal. Future studies should aim to uncover the neural mechanisms for changes in attention and exploration in both acute and prolonged EtOH withdrawal.