The Memory System Engaged During Acquisition Determines the Effectiveness of Different Extinction Protocols

Adolescent self-administration of the synthetic cannabinoid receptor agonist JWH-018 induces neurobiological and behavioral alterations in adult male mice

RATIONALE

The use of synthetic cannabinoid receptor agonists (SCRAs) is growing among adolescents, posing major medical and psychiatric risks. JWH-018 represents the reference compound of SCRA-containing products.

OBJECTIVES

This study was performed to evaluate the enduring consequences of adolescent voluntary consumption of JWH-018.

METHODS

The reinforcing properties of JWH-018 were characterized in male CD1 adolescent mice by intravenous self-administration (IVSA). Afterwards, behavioral, neurochemical, and molecular evaluations were performed at adulthood.

RESULTS

Adolescent mice acquired operant behavior (lever pressing, Fixed Ratio 1-3; 7.5 µg/kg/inf); this behavior was specifically directed at obtaining JWH-018 since it increased under Progressive Ratio schedule of reinforcement, and was absent in vehicle mice. JWH-018 IVSA was reduced by pretreatment of the CB1-antagonist/inverse agonist AM251. Adolescent exposure to JWH-018 by IVSA increased, at adulthood, both nestlet shredding and marble burying phenotypes, suggesting long-lasting repetitive/compulsive-like behavioral effects. JWH-018 did not affect risk proclivity in the wire-beam bridge task. In adult brains, there was an increase of ionized calcium binding adaptor molecule 1 (IBA-1) positive cells in the caudate-putamen (CPu) and nucleus accumbens (NAc), along with a decrease of glial fibrillary acidic protein (GFAP) immunoreactivity in the CPu. These glial alterations in adult brains were coupled with an increase of the chemokine RANTES and a decrease of the cytokines IL2 and IL13 in the cortex, and an increase of the chemokine MPC1 in the striatum.

CONCLUSIONS

This study suggests for the first time that male mice self-administer the prototypical SCRA JWH-018 during adolescence. The adolescent voluntary consumption of JWH-018 leads to long-lasting behavioral and neurochemical aberrations along with glia-mediated inflammatory responses in adult brains.

Corticosterone in the dorsolateral striatum facilitates the extinction of stimulus-response memory

Glucocorticoid hormones are crucially involved in modulating mnemonic processing of stressful or emotionally arousing experiences. They are known to enhance the consolidation of new memories, including those that extinguish older memories. In this study, we investigated whether glucocorticoids facilitate the extinction of a striatum-dependent, and behaviorally more rigid, stimulus-response memory. For this, male rats were initially trained for six days on a stimulus-response task in a T-maze to obtain a reward after making an egocentric right-turn body response, regardless of the starting position in this maze. This training phase was followed by three extinction sessions in which right-turn body responses were not reinforced. Corticosterone administration into the dorsolateral region of the striatum after the first extinction session dose-dependently enhanced the consolidation of extinction memory: Rats administered the higher dose of corticosterone (30 ng), but not lower doses (5 or 10 ng), exhibited significantly fewer right-turn body responses and had longer latencies compared to vehicle-treated animals on the second and third extinction sessions. Co-administration of the glucocorticoid receptor antagonist RU 486 (10 ng) prevented the corticosterone effect, indicating that glucocorticoids enhance the extinction of stimulus-response memory via activation of the glucocorticoid receptor. Corticosterone administration into the dorsomedial striatum did not affect extinction memory. These findings indicate that stress-response mechanisms involving corticosterone actions in the dorsolateral striatum facilitate the extinction of stimulus-response memory that might allow for the development of an opportune behavioral strategy.

Place vs. Response Learning: History, Controversy, and Neurobiology

The present article provides a historical review of the place and response learning plus-maze tasks with a focus on the behavioral and neurobiological findings. The article begins by reviewing the conflict between Edward C. Tolman's cognitive view and Clark L. Hull's stimulus-response (S-R) view of learning and how the place and response learning plus-maze tasks were designed to resolve this debate. Cognitive learning theorists predicted that place learning would be acquired faster than response learning, indicating the dominance of cognitive learning, whereas S-R learning theorists predicted that response learning would be acquired faster, indicating the dominance of S-R learning. Here, the evidence is reviewed demonstrating that either place or response learning may be dominant in a given learning situation and that the relative dominance of place and response learning depends on various parametric factors (i.e., amount of training, visual aspects of the learning environment, emotional arousal, et cetera). Next, the neurobiology underlying place and response learning is reviewed, providing strong evidence for the existence of multiple memory systems in the mammalian brain. Research has indicated that place learning is principally mediated by the hippocampus, whereas response learning is mediated by the dorsolateral striatum. Other brain regions implicated in place and response learning are also discussed in this section, including the dorsomedial striatum, amygdala, and medial prefrontal cortex. An exhaustive review of the neurotransmitter systems underlying place and response learning is subsequently provided, indicating important roles for glutamate, dopamine, acetylcholine, cannabinoids, and estrogen. Closing remarks are made emphasizing the historical importance of the place and response learning tasks in resolving problems in learning theory, as well as for examining the behavioral and neurobiological mechanisms of multiple memory systems. How the place and response learning tasks may be employed in the future for examining extinction, neural circuits of memory, and human psychopathology is also briefly considered.

Threat-induced modulation of hippocampal and striatal memory systems during navigation of a virtual environment

The brain is composed of multiple memory systems that mediate distinct types of navigation. The hippocampus is important for encoding and retrieving allocentric spatial cognitive maps, while the dorsal striatum mediates procedural memories based on stimulus-response (S-R) associations. These memory systems are differentially affected by emotional arousal. In particular, rodent studies show that stress typically impairs hippocampal spatial memory while it spares or sometimes enhances striatal S-R memory. The influence of emotional arousal on these separate navigational memory systems has received less attention in human subjects. We investigated the effect of dynamic changes in anticipatory anxiety on hippocampal spatial and dorsal striatal S-R memory systems while participants attempted to solve a virtual eight-arm radial maze. In Experiment 1, participants completed a hippocampus-dependent spatial version of the eight-arm radial maze that required allocentric spatial memory to successfully navigate the environment. In Experiment 2, participants completed a dorsal striatal S-R version of the maze where no allocentric spatial cues were present, requiring the use of S-R navigation. Anticipatory anxiety was modulated via threat of receiving an unpleasant electrical shock to the wrist during memory retrieval. Results showed that threat of shock was associated with more errors and increased use of non-spatial navigational strategies in the hippocampal spatial task, but did not influence memory performance in the striatal S-R task. Findings indicate a dissociation regarding the influence of anticipatory anxiety on memory systems that has implications for understanding how fear and anxiety contribute to memory-related symptoms in human psychopathologies.

There Is More Than One Kind of Extinction Learning

The view that different kinds of memory are mediated by dissociable neural systems has received extensive experimental support. Dissociations between memory systems are usually observed during initial acquisition, consolidation, and retrieval of memory, however increasing evidence also indicates a role for multiple memory systems in extinction behavior. The present article reviews a recent series of maze learning experiments that provide evidence for a multiple memory systems approach to extinction learning and memory. Evidence is described indicating that: (1) the hippocampus and dorsolateral striatum (DLS) mediate different kinds of extinction learning; (2) the effectiveness of different extinction protocols depends on the kind of memory being extinguished; and (3) whether a neural system is involved in extinction is also determined by the extinction protocol and kind of memory undergoing extinction. Based on these findings, a novel hypothetical model regarding the role of multiple memory systems in extinction is presented. In addition, the relevance of this multiple memory systems approach to other learning paradigms involving extinction (i.e., extinction of conditioned fear) and for treating human psychopathologies characterized by maladaptive memories (e.g., drug addiction and relapse) is briefly considered.

Decision making under uncertainty in a spiking neural network model of the basal ganglia

The mechanisms of decision-making and action selection are generally thought to be under the control of parallel cortico-subcortical loops connecting back to distinct areas of cortex through the basal ganglia and processing motor, cognitive and limbic modalities of decision-making. We have used these properties to develop and extend a connectionist model at a spiking neuron level based on a previous rate model approach. This model is demonstrated on decision-making tasks that have been studied in primates and the electrophysiology interpreted to show that the decision is made in two steps. To model this, we have used two parallel loops, each of which performs decision-making based on interactions between positive and negative feedback pathways. This model is able to perform two-level decision-making as in primates. We show here that, before learning, synaptic noise is sufficient to drive the decision-making process and that, after learning, the decision is based on the choice that has proven most likely to be rewarded. The model is then submitted to lesion tests, reversal learning and extinction protocols. We show that, under these conditions, it behaves in a consistent manner and provides predictions in accordance with observed experimental data.

Hippocampus NMDA receptors selectively mediate latent extinction of place learning

Extinction of maze learning may be achieved with or without the animal performing the previously acquired response. In typical "response extinction," animals are given the opportunity to make the previously acquired approach response toward the goal location of the maze without reinforcement. In "latent extinction," animals are not given the opportunity to make the previously acquired response and instead are confined to the previous goal location without reinforcement. Previous evidence indicates that the effectiveness of these protocols may depend on the type of memory being extinguished. Thus, one aim of the present study was to further examine the effectiveness of response and latent extinction protocols across dorsolateral striatum (DLS)-dependent response learning and hippocampus-dependent place learning tasks. In addition, previous neural inactivation experiments indicate a selective role for the hippocampus in latent extinction, but have not investigated the precise neurotransmitter mechanisms involved. Thus, the present study also examined whether latent extinction of place learning might depend on NMDA receptor activity in the hippocampus. In experiment 1, adult male Long-Evans rats were trained in a response learning task in a water plus-maze, in which animals were reinforced to make a consistent body-turn response to reach an invisible escape platform. Results indicated that response extinction, but not latent extinction, was effective at extinguishing memory in the response learning task. In experiment 2, rats were trained in a place learning task, in which animals were reinforced to approach a consistent spatial location containing the hidden escape platform. In experiment 2, animals also received intra-hippocampal infusions of the NMDA receptor antagonist 2-amino-5-phosphopentanoic acid (AP5; 5.0 or 7.5 ug/0.5 µg) or saline vehicle immediately before response or latent extinction training. Results indicated that both extinction protocols were effective at extinguishing memory in the place learning task. In addition, intra-hippocampal AP5 (7.5 µg) impaired latent extinction, but not response extinction, suggesting that hippocampal NMDA receptors are selectively involved in latent extinction. © 2016 Wiley Periodicals, Inc.

Memory Systems and the Addicted Brain

The view that anatomically distinct memory systems differentially contribute to the development of drug addiction and relapse has received extensive support. The present brief review revisits this hypothesis as it was originally proposed 20 years ago (1) and highlights several recent developments. Extensive research employing a variety of animal learning paradigms indicates that dissociable neural systems mediate distinct types of learning and memory. Each memory system potentially contributes unique components to the learned behavior supporting drug addiction and relapse. In particular, the shift from recreational drug use to compulsive drug abuse may reflect a neuroanatomical shift from cognitive control of behavior mediated by the hippocampus/dorsomedial striatum toward habitual control of behavior mediated by the dorsolateral striatum (DLS). In addition, stress/anxiety may constitute a cofactor that facilitates DLS-dependent memory, and this may serve as a neurobehavioral mechanism underlying the increased drug use and relapse in humans following stressful life events. Evidence supporting the multiple systems view of drug addiction comes predominantly from studies of learning and memory that have employed as reinforcers addictive substances often considered within the context of drug addiction research, including cocaine, alcohol, and amphetamines. In addition, recent evidence suggests that the memory systems approach may also be helpful for understanding topical sources of addiction that reflect emerging health concerns, including marijuana use, high-fat diet, and video game playing.