Effect of lysergic acid diethylamide (LSD) on reinforcement learning in humans

Effects of psychedelic, DOI, on nucleus accumbens dopamine signaling to predictable rewards and cues in rats

Psychedelics produce lasting therapeutic responses in neuropsychiatric diseases suggesting they may disrupt entrenched associations and catalyze learning. Here, we examine psychedelic 5-HT2A/2C agonist, DOI, effects on dopamine signaling in the nucleus accumbens (NAc) core, a region extensively linked to reward learning, motivation, and drug-seeking. We measure phasic dopamine transients following acute DOI administration in rats during well learned Pavlovian tasks in which sequential cues predict rewards. We find that DOI (0.0-1.2 mg/kg, i.p.) increases dopamine signals, photometrically measured using GRABDA optical sensor, to rewards and proximal reward cues, but not to the distal cues that predict these events. We determine that the elevated dopamine produced by DOI to reward cues occurs independently of DOI-induced changes in reward value. The increased dopamine associated with predictable reward cues and rewards supports DOI-induced increases in prediction error signaling. These findings lay a foundation for developing psychedelic strategies aimed at engaging error-driven learning mechanisms to disrupt entrenched associations or produce new associations.

5-HT 2A and 5-HT 2C receptor antagonism differentially modulate reinforcement learning and cognitive flexibility: behavioural and computational evidence

RATIONALE

Cognitive flexibility, the ability to adapt behaviour in response to a changing environment, is disrupted in several neuropsychiatric disorders, including obsessive-compulsive disorder and major depressive disorder. Evidence suggests that flexibility, which can be operationalised using reversal learning tasks, is modulated by serotonergic transmission. However, how exactly flexible behaviour and associated reinforcement learning (RL) processes are modulated by 5-HT action on specific receptors is unknown.

OBJECTIVES

We investigated the effects of 5-HT2A receptor (5-HT2AR) and 5-HT2C receptor (5-HT2CR) antagonism on flexibility and underlying RL mechanisms.

METHODS

Thirty-six male Lister hooded rats were trained on a touchscreen visual discrimination and reversal task. We evaluated the effects of systemic treatments with the 5-HT2AR and 5-HT2CR antagonists M100907 and SB-242084, respectively, on reversal learning and performance on probe trials where correct and incorrect stimuli were presented with a third, probabilistically rewarded, stimulus. Computational models were fitted to task choice data to extract RL parameters, including a novel model designed specifically for this task.

RESULTS

5-HT2AR antagonism impaired reversal learning only after an initial perseverative phase, during a period of random choice and then new learning. 5-HT2CR antagonism, on the other hand, impaired learning from positive feedback. RL models further differentiated these effects. 5-HT2AR antagonism decreased punishment learning rate (i.e. negative feedback) at high and low doses. The low dose also decreased reinforcement sensitivity (beta) and increased stimulus and side stickiness (i.e., the tendency to repeat a choice regardless of outcome). 5-HT2CR antagonism also decreased beta, but reduced side stickiness.

CONCLUSIONS

These data indicate that 5-HT2A and 5-HT2CRs both modulate different aspects of flexibility, with 5-HT2ARs modulating learning from negative feedback as measured using RL parameters and 5-HT2CRs for learning from positive feedback assessed through conventional measures.

Cognitive functioning associated with acute and subacute effects of classic psychedelics and MDMA - a systematic review and meta-analysis

Classic psychedelics and MDMA have a colorful history of recreational use, and both have recently been re-evaluated as tools for the treatment of psychiatric disorders. Several studies have been carried out to assess potential long-term effects of a regular use on cognition, delivering distinct results for psychedelics and MDMA. However, to date knowledge is scarce on cognitive performance during acute effects of those substances. In this systematic review and meta-analysis, we investigate how cognitive functioning is affected by psychedelics and MDMA during the acute drug effects and the sub-acute ("afterglow") window. Our quantitative analyses suggest that acute cognitive performance is differentially affected by psychedelics when compared to MDMA: psychedelics impair attention and executive function, whereas MDMA primarily affects memory, leaving executive functions and attention unaffected. Our qualitative analyses reveal that executive functioning and creativity may be increased during a window of at least 24 h after the acute effects of psychedelics have subsided, whereas no such results have been observed for MDMA. Our findings may contribute to inform recommendations on harm reduction for recreational settings and to help fostering differential approaches for the use of psychedelics and MDMA within a therapeutic framework.

The influence of psilocybin on subconscious and conscious emotional learning

Serotonergic psychedelics hold promise as a treatment modality for various psychiatric disorders and are currently applied in psychedelic-assisted psychotherapy. We investigated the learning effects of the serotonin receptor agonist psilocybin in a probabilistic cue-reward task with emotional cues in the form of neutral or fearful faces, presented either consciously or subconsciously. This study represents the first investigation into reinforcement learning with psilocybin. Across different dosages, psilocybin preserved learning effects and was statistically noninferior compared to placebo, while suggesting a higher exploratory behavior. Notably, the 20 mg group exhibited significantly better learning rates against the placebo group. Psilocybin induced inferior results with subconscious cues compared to placebo, and better results with conscious neutral cues in some conditions. These findings suggest that modulating serotonin signaling in the brain with psilocybin sufficiently preservers reinforcement learning.

Lasting dynamic effects of the psychedelic 2,5-dimethoxy-4-iodoamphetamine ((±)-DOI) on cognitive flexibility

Psychedelic drugs can aid fast and lasting remission from various neuropsychiatric disorders, though the underlying mechanisms remain unclear. Preclinical studies suggest serotonergic psychedelics enhance neuronal plasticity, but whether neuroplastic changes can also be seen at cognitive and behavioural levels is unexplored. Here we show that a single dose of the psychedelic 2,5-dimethoxy-4-iodoamphetamine ((±)-DOI) affects structural brain plasticity and cognitive flexibility in young adult mice beyond the acute drug experience. Using ex vivo magnetic resonance imaging, we show increased volumes of several sensory and association areas one day after systemic administration of 2 mgkg-1 (±)-DOI. We then demonstrate lasting effects of (±)-DOI on cognitive flexibility in a two-step probabilistic reversal learning task where 2 mgkg-1 (±)-DOI improved the rate of adaptation to a novel reversal in task structure occurring one-week post-treatment. Strikingly, (±)-DOI-treated mice started learning from reward omissions, a unique strategy not typically seen in mice in this task, suggesting heightened sensitivity to previously overlooked cues. Crucially, further experiments revealed that (±)-DOI's effects on cognitive flexibility were contingent on the timing between drug treatment and the novel reversal, as well as on the nature of the intervening experience. (±)-DOI's facilitation of both cognitive adaptation and novel thinking strategies may contribute to the clinical benefits of psychedelic-assisted therapy, particularly in cases of perseverative behaviours and a resistance to change seen in depression, anxiety, or addiction. Furthermore, our findings highlight the crucial role of time-dependent neuroplasticity and the influence of experiential factors in shaping the therapeutic potential of psychedelic interventions for impaired cognitive flexibility.

Ketamine produces no detectable long-term positive or negative effects on cognitive flexibility or reinforcement learning of male rats

RATIONALE

Patients with major depressive disorder (MDD) often experience abnormalities in behavioral adaptation following environmental changes (i.e., cognitive flexibility) and tend to undervalue positive outcomes but overvalue negative outcomes. The probabilistic reversal learning task (PRL) is used to study these deficits across species and to explore drugs that may have therapeutic value. Selective serotonin-reuptake inhibitors (SSRIs) have limited effectiveness in treating MDD and produce inconsistent effects in non-human versions of the PRL. As such, ketamine, a novel and potentially rapid-acting therapeutic, has begun to be examined using the PRL. Two previous studies examining the effects of ketamine in the PRL have shown conflicting results and only examined short-term effects of ketamine.

OBJECTIVE

This experiment examined PRL performance across a 2-week period following a single exposure to a ketamine dose that varied across groups.

METHODS

After five sessions of PRL training, groups of rats received an injection of either 0, 10, 20 or 30 mg/kg ketamine. One-hour post-injection, rats engaged in the PRL, and subsequently sessions continued daily for 2 weeks. Traditional behavioral and computational reinforcement learning-derived measures were examined.

RESULTS

Results showed that ketamine had acute effects 1-h post-injection, including a significant decrease in the value of the punishment learning rate. Beyond 1 h, ketamine produced no detectable improvements nor decrements in performance across 2 weeks.

CONCLUSION

Overall, the present results suggest that the range of ketamine doses examined do not have long-term positive or negative effects on cognitive flexibility or reward processing in healthy rats as measured by the PRL.

Comparable roles for serotonin in rats and humans for computations underlying flexible decision-making

Serotonin is critical for adapting behavior flexibly to meet changing environmental demands. Cognitive flexibility is important for successful attainment of goals, as well as for social interactions, and is frequently impaired in neuropsychiatric disorders, including obsessive-compulsive disorder. However, a unifying mechanistic framework accounting for the role of serotonin in behavioral flexibility has remained elusive. Here, we demonstrate common effects of manipulating serotonin function across two species (rats and humans) on latent processes supporting choice behavior during probabilistic reversal learning, using computational modelling. The findings support a role of serotonin in behavioral flexibility and plasticity, indicated, respectively, by increases or decreases in choice repetition ('stickiness') or reinforcement learning rates following manipulations intended to increase or decrease serotonin function. More specifically, the rate at which expected value increased following reward and decreased following punishment (reward and punishment 'learning rates') was greatest after sub-chronic administration of the selective serotonin reuptake inhibitor (SSRI) citalopram (5 mg/kg for 7 days followed by 10 mg/kg twice a day for 5 days) in rats. Conversely, humans given a single dose of an SSRI (20 mg escitalopram), which can decrease post-synaptic serotonin signalling, and rats that received the neurotoxin 5,7-dihydroxytryptamine (5,7-DHT), which destroys forebrain serotonergic neurons, exhibited decreased reward learning rates. A basic perseverative tendency ('stickiness'), or choice repetition irrespective of the outcome produced, was likewise increased in rats after the 12-day SSRI regimen and decreased after single dose SSRI in humans and 5,7-DHT in rats. These common effects of serotonergic manipulations on rats and humans-identified via computational modelling-suggest an evolutionarily conserved role for serotonin in plasticity and behavioral flexibility and have clinical relevance transdiagnostically for neuropsychiatric disorders.

A role for the serotonin 2A receptor in the expansion and functioning of human transmodal cortex

Integrating independent but converging lines of research on brain function and neurodevelopment across scales, this article proposes that serotonin 2A receptor (5-HT2AR) signalling is an evolutionary and developmental driver and potent modulator of the macroscale functional organization of the human cerebral cortex. A wealth of evidence indicates that the anatomical and functional organization of the cortex follows a unimodal-to-transmodal gradient. Situated at the apex of this processing hierarchy-where it plays a central role in the integrative processes underpinning complex, human-defining cognition-the transmodal cortex has disproportionately expanded across human development and evolution. Notably, the adult human transmodal cortex is especially rich in 5-HT2AR expression and recent evidence suggests that, during early brain development, 5-HT2AR signalling on neural progenitor cells stimulates their proliferation-a critical process for evolutionarily-relevant cortical expansion. Drawing on multimodal neuroimaging and cross-species investigations, we argue that, by contributing to the expansion of the human cortex and being prevalent at the apex of its hierarchy in the adult brain, 5-HT2AR signalling plays a major role in both human cortical expansion and functioning. Owing to its unique excitatory and downstream cellular effects, neuronal 5-HT2AR agonism promotes neuroplasticity, learning and cognitive and psychological flexibility in a context-(hyper)sensitive manner with therapeutic potential. Overall, we delineate a dual role of 5-HT2ARs in enabling both the expansion and modulation of the human transmodal cortex.

Therapeutic mechanisms of psychedelics and entactogens

Recent clinical and preclinical evidence suggests that psychedelics and entactogens may produce both rapid and sustained therapeutic effects across several indications. Currently, there is a disconnect between how these compounds are used in the clinic and how they are studied in preclinical species, which has led to a gap in our mechanistic understanding of how these compounds might positively impact mental health. Human studies have emphasized extra-pharmacological factors that could modulate psychedelic-induced therapeutic responses including set, setting, and integration-factors that are poorly modelled in current animal experiments. In contrast, animal studies have focused on changes in neuronal activation and structural plasticity-outcomes that are challenging to measure in humans. Here, we describe several hypotheses that might explain how psychedelics rescue neuropsychiatric disease symptoms, and we propose ways to bridge the gap between human and rodent studies. Given the diverse pharmacological profiles of psychedelics and entactogens, we suggest that their rapid and sustained therapeutic mechanisms of action might best be described by the collection of circuits that they modulate rather than their actions at any single molecular target. Thus, approaches focusing on selective circuit modulation of behavioral phenotypes might prove more fruitful than target-based methods for identifying novel compounds with rapid and sustained therapeutic effects similar to psychedelics and entactogens.

The effects of Lysergic Acid Diethylamide (LSD) on the Positive Valence Systems: A Research Domain Criteria (RDoC)-Informed Systematic Review

BACKGROUND AND OBJECTIVES

The renewed interest in psychedelic research provides growing evidence of potentially unique effects on various aspects of reward processing systems. Using the Research Domain Criteria (RDoC) framework, as proposed by the National Institute of Mental Health, we aim to synthesize the existing literature concerning the impact of lysergic acid diethylamide (LSD) on the RDoC's Positive Valence Systems (PVS) domain, and to identify potential avenues for further research.

METHODS

Two LSD-related terms (lysergic acid diethylamide and LSD) and 13 PVS-related terms (reward, happiness, bliss, motivation, reinforcement learning, operant, conditioning, satisfaction, decision making, habit, valence, affect, mood) were used to search electronic databases such as PubMed, Scopus, PsychINFO, and Web of Science for relevant articles. A manual search of the reference list resulted in nine additional articles. After screening, articles and data were evaluated and included based on their relevance to the objective of investigating the effects of LSD on the PVS. Articles and data were excluded if they did not provide information about the PVS, were observational in nature, lacked comparators or reference groups, or were duplicates. A risk of bias assessment was performed using the National Toxicology Program's Office of Health Assessment and Translation (NTP OHAT) risk of bias (RoB) tool. Data from the included articles were collected and structured based on the RDoC bio-behavioral matrix, specifically focusing on the PVS domain and its three constituent constructs: reward responsiveness, reward learning, and reward valuation.

RESULTS

We reviewed 28 clinical studies with 477 participants. Lysergic acid diethylamide, assessed at self-report (23 studies), molecular (5 studies), circuit (4 studies), and paradigm (3 studies) levels, exhibited dose-dependent mood improvement (20 short-term and 3 long-term studies). The subjective and neural effects of LSD were linked to the 5-HT2A receptor (molecular). Animal studies (14 studies) suggested LSD could mildly reinforce conditioned place preference without aversion and reduce responsiveness to other rewards. Findings on reward learning were inconsistent but hinted at potential associative learning enhancements. Reward valuation measures indicated potential reductions in effort expenditure for other reinforcers.

CONCLUSION

Our findings are consistent with our previous work, which indicated classical psychedelics, primarily serotonin 2A receptor agonists, enhanced reward responsiveness in healthy individuals and patient populations. Lysergic acid diethylamide exhibits a unique profile in the reward learning and valuation constructs. Using the RDoC-based framework, we identified areas for future research, enhancing our understanding of the impact of LSD on reward processing. However, applying RDoC to psychedelic research faces limitations due to diverse study designs that were not initially RDoC-oriented. Limitations include subjective outcome measure selection aligned with RDoC constructs and potential bias in synthesizing varied studies. Additionally, some human studies were open-label, introducing potential bias compared to randomized, blinded studies.

A Comprehensive Review of the Current Status of the Cellular Neurobiology of Psychedelics

Psychedelic substances have gained significant attention in recent years for their potential therapeutic effects on various psychiatric disorders. This review delves into the intricate cellular neurobiology of psychedelics, emphasizing their potential therapeutic applications in addressing the global burden of mental illness. It focuses on contemporary research into the pharmacological and molecular mechanisms underlying these substances, particularly the role of 5-HT2A receptor signaling and the promotion of plasticity through the TrkB-BDNF pathway. The review also discusses how psychedelics affect various receptors and pathways and explores their potential as anti-inflammatory agents. Overall, this research represents a significant development in biomedical sciences with the potential to transform mental health treatments.

Psychedelics in the treatment of eating disorders: Rationale and potential mechanisms

Eating disorders are serious illnesses showing high rates of mortality and comorbidity with other mental health problems. Psychedelic-assisted therapy has recently shown potential in the treatment of several common comorbidities of eating disorders, including mood disorders, post-traumatic stress disorder, and substance use disorders. The theorized therapeutic mechanisms of psychedelic-assisted therapy suggest that it could be beneficial in the treatment of eating disorders as well. In this review, we summarize preliminary data on the efficacy of psychedelic-assisted therapy in people with anorexia nervosa, bulimia nervosa, and binge eating disorder, which include studies and case reports of psychedelic-assisted therapy with ketamine, MDMA, psilocybin, and ayahuasca. We then discuss the potential therapeutic mechanisms of psychedelic-assisted therapy in these three eating disorders, including both general therapeutic mechanisms and those which are relatively specific to eating disorders. We find preliminary evidence that psychedelic-assisted therapy may be effective in the treatment of anorexia nervosa and bulimia nervosa, with very little data available on binge eating disorder. Regarding mechanisms, psychedelic-assisted therapy may be able to improve beliefs about body image, normalize reward processing, promote cognitive flexibility, and facilitate trauma processing. Just as importantly, it appears to promote general therapeutic factors relevant to both eating disorders and many of their common comorbidities. Lastly, we discuss potential safety concerns which may be associated with these treatments and present recommendations for future research.

Canalization and plasticity in psychopathology

This theoretical article revives a classical bridging construct, canalization, to describe a new model of a general factor of psychopathology. To achieve this, we have distinguished between two types of plasticity, an early one that we call 'TEMP' for 'Temperature or Entropy Mediated Plasticity', and another, we call 'canalization', which is close to Hebbian plasticity. These two forms of plasticity can be most easily distinguished by their relationship to 'precision' or inverse variance; TEMP relates to increased model variance or decreased precision, whereas the opposite is true for canalization. TEMP also subsumes increased learning rate, (Ising) temperature and entropy. Dictionary definitions of 'plasticity' describe it as the property of being easily shaped or molded; TEMP is the better match for this. Importantly, we propose that 'pathological' phenotypes develop via mechanisms of canalization or increased model precision, as a defensive response to adversity and associated distress or dysphoria. Our model states that canalization entrenches in psychopathology, narrowing the phenotypic state-space as the agent develops expertise in their pathology. We suggest that TEMP - combined with gently guiding psychological support - can counter canalization. We address questions of whether and when canalization is adaptive versus maladaptive, furnish our model with references to basic and human neuroscience, and offer concrete experiments and measures to test its main hypotheses and implications. This article is part of the Special Issue on "National Institutes of Health Psilocybin Research Speaker Series".

Development of cross-species translational paradigms for psychiatric research in the Research Domain Criteria era

The past 30 years of IBNS has included research attempting to treat the cognitive and behavioral deficits observed in people with psychiatric conditions. Early work utilized drugs identified from tests thought to be cognition-relevant, however the high failure rate crossing the translational-species barrier led to focus on developing valid cross-species translational tests. The face, predictive, and neurobiological validities used to assess animal models of psychiatry can be used to validate these tests. Clinical sensitivity is another important aspect however, for if the clinical population targeted for treatment does not exhibit task deficits, then why develop treatments? This review covers some work validating cross-species translational tests and suggests future directions. Also covered is the contribution IBNS made to fostering such research and my role in IBNS, making it more available to all including fostering mentor/mentee programs plus spearheading diversity and inclusivity initiatives. All science needs support and IBNS has supported research recreating the behavioral abnormalities that define psychiatric conditions with the aim to improve the lives of people with such conditions.

Can psychedelics enhance group psychotherapy? A discussion on the therapeutic factors

BACKGROUND

Despite the growth of psychedelic research, psychedelic-assisted group psychotherapy (PAGP) has received little attention in comparison to individual psychedelic-assisted psychotherapy models.

METHODS

In this article, we aim to discuss the therapeutic potential of PAGP, as well as outline existing models and the challenges of this approach. Using Irvin Yalom's 11 therapeutic factors of group therapy as a basic framework, we analyse current literature from clinical studies and neurobiological research relative to the topic of PAGP.

RESULTS

We argue that combining psychedelic substances and group psychotherapy may prove beneficial for increasing group connectedness and interpersonal learning, potentially enhancing prosocial behaviour with direct opportunities to practice newly acquired knowledge about previously maladaptive behavioural patterns. Challenges regarding this approach include a more rigid therapy structure and potential loss of openness from patients, which may be ameliorated by adequate therapeutic training.

CONCLUSION

We hope for this article to support clinical research on PAGP by presenting a therapeutic framework and outlining its mechanisms and challenges.

Reinforcement learning modeling reveals a reward-history-dependent strategy underlying reversal learning in squirrel monkeys

Insight into psychiatric disease and development of therapeutics relies on behavioral tasks that study similar cognitive constructs in multiple species. The reversal learning task is one popular paradigm that probes flexible behavior, aberrations of which are thought to be important in a number of disease states. Despite widespread use, there is a need for a high-throughput primate model that can bridge the genetic, anatomic, and behavioral gap between rodents and humans. Here, we trained squirrel monkeys, a promising preclinical model, on an image-guided deterministic reversal learning task. We found that squirrel monkeys exhibited two key hallmarks of behavior found in other species: integration of reward history over many trials and a side-specific bias. We adapted a reinforcement learning model and demonstrated that it could simulate squirrel monkey-like behavior, capture training-related trajectories, and provide insight into the strategies animals employed. These results validate squirrel monkeys as a model in which to study behavioral flexibility. (PsycInfo Database Record (c) 2022 APA, all rights reserved).