Applying Reinforcement Learning to Rodent Stress Research

Psilocybin restrains activity-based anorexia in female rats by enhancing cognitive flexibility: contributions from 5-HT1A and 5-HT2A receptor mechanisms

Psilocybin has shown promise for alleviating symptoms of depression and is currently in clinical trials for the treatment of anorexia nervosa (AN), a condition that is characterised by persistent cognitive inflexibility. Considering that enhanced cognitive flexibility after psilocybin treatment is reported to occur in individuals with depression, it is plausible that psilocybin could improve symptoms of AN by breaking down cognitive inflexibility. A mechanistic understanding of the actions of psilocybin is required to tailor the clinical application of psilocybin to individuals most likely to respond with positive outcomes. This can only be achieved using incisive neurobiological approaches in animal models. Here, we use the activity-based anorexia (ABA) rat model and comprehensively assess aspects of reinforcement learning to show that psilocybin (post-acutely) improves body weight maintenance in female rats and facilitates cognitive flexibility, specifically via improved adaptation to the initial reversal of reward contingencies. Further, we reveal the involvement of signalling through the serotonin (5-HT) 1 A and 5-HT2A receptor subtypes in specific aspects of learning, demonstrating that 5-HT1A antagonism negates the cognitive enhancing effects of psilocybin. Moreover, we show that psilocybin elicits a transient increase and decrease in cortical transcription of these receptors (Htr2a and Htr1a, respectively), and a further reduction in the abundance of Htr2a transcripts in rats exposed to the ABA model. Together, these findings support the hypothesis that psilocybin could ameliorate cognitive inflexibility in the context of AN and highlight a need to better understand the therapeutic mechanisms independent of 5-HT2A receptor binding.

Taking better advantage of the activity-based anorexia model

The lack of specific treatments for anorexia nervosa (AN) is partly driven by an inadequate understanding of the neurobiological drivers of the condition. The activity-based anorexia (ABA) model recapitulates key characteristics of AN in rats and mice, and can be used to understand factors that predispose, maintain, and rescue anorectic behaviour. With the rapidly evolving suite of technologies to manipulate and record neural activity during the development of ABA, we are better placed than ever before to take advantage of this unique biobehavioural model in order to develop and refine novel treatments for AN. This will require a collective effort to bridge research disciplines in order to capitalise on knowledge gains from genetics, neurobiology, metabolism, and cognition.

Early-life stress biases responding to negative feedback and increases amygdala volume and vulnerability to later-life stress

Early-life stress (ELS) or adversity, particularly in the form of childhood neglect and abuse, is associated with poor mental and physical health outcomes in adulthood. However, whether these relationships are mediated by the consequences of ELS itself or by other exposures that frequently co-occur with ELS is unclear. To address this question, we carried out a longitudinal study in rats to isolate the effects of ELS on regional brain volumes and behavioral phenotypes relevant to anxiety and depression. We used the repeated maternal separation (RMS) model of chronic ELS, and conducted behavioral measurements throughout adulthood, including of probabilistic reversal learning (PRL), responding on a progressive ratio task, sucrose preference, novelty preference, novelty reactivity, and putative anxiety-like behavior on the elevated plus maze. Our behavioral assessment was combined with magnetic resonance imaging (MRI) for quantitation of regional brain volumes at three time points: immediately following RMS, young adulthood without further stress, and late adulthood with further stress. We found that RMS caused long-lasting, sexually dimorphic biased responding to negative feedback on the PRL task. RMS also slowed response time on the PRL task, but without this directly impacting task performance. RMS animals were also uniquely sensitive to a second stressor, which disproportionately impaired their performance and slowed their responding on the PRL task. MRI at the time of the adult stress revealed a larger amygdala volume in RMS animals compared with controls. These behavioral and neurobiological effects persisted well into adulthood despite a lack of effects on conventional tests of 'depression-like' and 'anxiety-like' behavior, and a lack of any evidence of anhedonia. Our findings indicate that ELS has long-lasting cognitive and neurobehavioral effects that interact with stress in adulthood and may have relevance for understanding the etiology of anxiety and depression in humans.

Probing the antidepressant potential of psilocybin: integrating insight from human research and animal models towards an understanding of neural circuit mechanisms

Interest in the therapeutic potential of serotonergic psychedelic compounds including psilocybin has surged in recent years. While human clinical research suggests psilocybin holds promise as a rapid and long-lasting antidepressant, little is known about how its acute mechanisms of action mediate enduring alterations in cognition and behavior. Human neuroimaging studies point to both acute and sustained modulation of functional connectivity in key cortically dependent brain networks. Emerging evidence in preclinical models highlights the importance of psilocybin-induced neuroplasticity and alterations in the prefrontal cortex (PFC). Overviewing research in both humans and preclinical models suggests avenues to increase crosstalk between fields. We review how acute modulation of PFC circuits may contribute to long-term structural and functional alterations to mediate antidepressant effects. We highlight the potential for preclinical circuit and behavioral neuroscience approaches to provide basic mechanistic insight into how psilocybin modulates cognitive and affective neural circuits to support further development of psilocybin as a promising new treatment for depression.

Pupil Correlates of Decision Variables in Mice Playing a Competitive Mixed-Strategy Game

In a competitive game involving an animal and an opponent, the outcome is contingent on the choices of both players. To succeed, the animal must continually adapt to competitive pressure, or else risk being exploited and lose out on rewards. In this study, we demonstrate that head-fixed male mice can be trained to play the iterative competitive game "matching pennies" against a virtual computer opponent. We find that the animals' performance is well described by a hybrid computational model that includes Q-learning and choice kernels. Comparing between matching pennies and a non-competitive two-armed bandit task, we show that the tasks encourage animals to operate at different regimes of reinforcement learning. To understand the involvement of neuromodulatory mechanisms, we measure fluctuations in pupil size and use multiple linear regression to relate the trial-by-trial transient pupil responses to decision-related variables. The analysis reveals that pupil responses are modulated by observable variables, including choice and outcome, as well as latent variables for value updating, but not action selection. Collectively, these results establish a paradigm for studying competitive decision-making in head-fixed mice and provide insights into the role of arousal-linked neuromodulation in the decision process.