Explicit disassociation of a conditioned stimulus and unconditioned stimulus during extinction training reduces both time to asymptotic extinction and spontaneous recovery of a conditioned taste aversion

The effects of extinction and an explicitly unpaired treatment on the reinforcing properties of a Pavlovian conditioned stimulus

This series of experiments examined the effects of extinction and an explicitly unpaired treatment on the ability of a conditioned stimulus (CS) to function as a reinforcer. Rats were trained to lever press for food, exposed to pairings of a noise CS and food, and, finally, tested for their willingness to lever press for the CS in the absence of the food. Experiment 1 provided a demonstration of conditioned reinforcement (using controls that were only exposed to unpaired presentations of the CS and food) and showed that it was equivalent after one or four sessions of CS-food pairings. Experiments 2 and 3 showed that, after one session of CS-food pairings, repeated presentations of the CS alone reduced its reinforcing properties; but after four sessions of CS-food pairings, repeated presentations of the CS alone had no effect on these properties. Experiment 4 showed that, after four sessions of CS-food pairings, explicitly unpaired presentations of the CS and food completely undermined conditioned reinforcement. Finally, Experiment 5 provided within-experiment evidence that, after four sessions of CS-food pairings, the reinforcing properties of the CS were disrupted by explicitly unpaired presentations of the CS and food but spared by repeated presentations of the CS alone. Together, these findings indicate that the effectiveness of extinction in undermining the reinforcing properties of a CS depends on its level of conditioning; and that, where extinction fails to disrupt these properties, they are successfully undermined by an explicitly unpaired treatment. They are discussed with respect to findings in the literature on Pavlovian-to-instrumental transfer; and the Rescorla-Wagner model, which anticipates that an explicitly unpaired treatment will be more effective than extinction in reversing the effects of conditioning.

The learning of prospective and retrospective cognitive maps within neural circuits

Brain circuits are thought to form a "cognitive map" to process and store statistical relationships in the environment. A cognitive map is commonly defined as a mental representation that describes environmental states (i.e., variables or events) and the relationship between these states. This process is commonly conceptualized as a prospective process, as it is based on the relationships between states in chronological order (e.g., does reward follow a given state?). In this perspective, we expand this concept on the basis of recent findings to postulate that in addition to a prospective map, the brain forms and uses a retrospective cognitive map (e.g., does a given state precede reward?). In doing so, we demonstrate that many neural signals and behaviors (e.g., habits) that seem inflexible and non-cognitive can result from retrospective cognitive maps. Together, we present a significant conceptual reframing of the neurobiological study of associative learning, memory, and decision making.

Chronic dietary magnesium-L-threonate speeds extinction and reduces spontaneous recovery of a conditioned taste aversion

Elevation of brain magnesium enhances synaptic plasticity and extinction of conditioned fear memories. This experiment examined the generalizability of this phenomenon by studying the effects of a novel magnesium compound, magnesium-L-threonate (MgT), on conditioned taste aversion (CTA) extinction and spontaneous recovery (SR). Adult male Sprague-Dawley rats were maintained on a 23-hour water deprivation cycle and acquired a CTA following the taste of a CS [0.3% saccharin+16 mg/ml MgT (SAC+MgT)] paired with a US [81 mg/kg (i.p.) lithium chloride (LiCl)]. Following CTA acquisition, rats drank a water+MgT solution for up to 1 hour/day over the next 31 days. For 14 additional days, some animals continued water+MgT treatment, but others drank water only to allow MgT to be eliminated from the body. We then employed 2 different extinction paradigms: (1) CS-Only (CSO), in which SAC was presented, every-other day, or (2) Explicitly Unpaired (EU), in which both SAC and LiCl were presented, but on alternate days. EU extinction procedures have been shown to speed CTA extinction and reduce spontaneous recovery of the aversion. Throughout extinction, half of the rats in each group continued to drink MgT (now in SAC or supplemental water+MgT solution), whereas the other half drank SAC only/water only until SAC drinking reached ≥90% of baseline (asymptotic extinction). Rats receiving MgT just before/during extinction drank less SAC on the first day of extinction suggesting that they had retained a stronger CTA. MgT enhanced the rate of extinction. Furthermore, the MgT-treated rats showed a relatively modest SR of the CTA 30 days later - indicating that the extinction procedure was more effective for these animals. Our data suggest that long-term dietary MgT may enhance the consolidation/retention of a CTA, speed extinction, and inhibit SR of this learned aversion.

Stimulation of the dorsal periaqueductal gray enhances spontaneous recovery of a conditioned taste aversion

Due to its relevance to clinical practice, extinction of learned fears has been a major focus of recent research. However, less is known about the means by which conditioned fears re-emerge (i.e., spontaneously recover) as time passes or contexts change following extinction. The periaqueductal gray represents the final common pathway mediating defensive reactions to fear and we have reported previously that the dorsolateral PAG (dlPAG) exhibits a small but reliable increase in neural activity (as measured by c-fos protein immunoreactivity) when spontaneous recovery (SR) of a conditioned taste aversion (CTA) is reduced. Here we extend these correlational studies to determine if inducing dlPAG c-fos expression through electrical brain stimulation could cause a reduction in SR of a CTA. Male Sprague-Dawley rats acquired a strong aversion to saccharin (conditioned stimulus; CS) and then underwent CTA extinction through multiple non-reinforced exposures to the CS. Following a 30-day latency period after asymptotic extinction was achieved; rats either received stimulation of the dorsal PAG (dPAG) or stimulation of closely adjacent structures. Sixty minutes following the stimulation, rats were again presented with the saccharin solution as we tested for SR of the CTA. The brain stimulation evoked c-fos expression around the tip of the electrodes. However, stimulation of the dPAG failed to reduce SR of the previously extinguished CTA. In fact, dPAG stimulation caused rats to significantly suppress their saccharin drinking (relative to controls) - indicating an enhanced SR. These data refute a cause-and-effect relationship between enhanced dPAG c-fos expression and a reduction in SR. However, they highlight a role for the dPAG in modulating SR of extinguished CTAs.

Acute, but not chronic, exposure to d-cycloserine facilitates extinction and modulates spontaneous recovery of a conditioned taste aversion

D-cycloserine, the glutamate N-methyl-D-aspartate receptor partial agonist, has been reported to facilitate the extinction of learned fears acquired in both naturalistic and laboratory settings. The current study extended this literature by evaluating the ability of either chronic or acute administrations of DCS to modulate the extinction and spontaneous recovery of a conditioned taste aversion (CTA). Twenty-three hour fluid-deprived Sprague-Dawley rats acquired a strong CTA following 3 pairings of a conditioned stimulus (CS; 0.3% oral saccharin)+unconditioned stimulus [US; 81 mg/kg (i.p.) lithium chloride (LiCl)]. In separate groups of rats, we then employed 2 different extinction paradigms: (1) CS-only (CSO-EXT) in which saccharin was presented every-other day, or (2) Explicitly Unpaired (EU-EXT) in which both saccharin and LiCl were presented but on alternate days. Previous studies have indicated that the EU-EXT procedure speeds up the extinction process. Further, spontaneous recovery of a CTA emerges following CSO-EXT but the EU-EXT paradigm causes a suppression of spontaneous recovery. DCS (15 mg/kg, i.p.) was administered immediately after daily liquid presentations (saccharin or water, alternate days) during the extinction period. In an acute drug manipulation, DCS (15 mg/kg, i.p.) or saline control injections were administered for 4 days only. This was done during one of 3 different phases of extinction [i.e., static (2-5%), early dynamic (8-16%), or middle dynamic (20-40%) saccharin reacceptance]. Other animals assigned to the chronic DCS condition received daily DCS (15 mg/kg, i.p.) throughout extinction. Changes in saccharin drinking in these animals were compared to the data from rats that received no drug (saline controls). Once rats met our criterion for asymptotic extinction (90% reacceptance of the CS) they entered a 30-day latency period during which they received water for 1 h/day. The day after the completion of the latency period, a final opportunity to drink saccharin was provided (spontaneous recovery test). Saline-treated control rats that went through the EU-EXT procedure achieved asymptotic extinction more quickly than did the CSO-EXT rats and did not exhibit a spontaneous recovery of the CTA. Chronic DCS treatments did not significantly reduce the time to achieve asymptotic CTA extinction in rats exposed to either CSO or EU extinction methods. Further, animals treated with DCS throughout EU-EXT exhibited a spontaneous recovery of the CTA whereas the saline-treated, EU-EXT rats did not. Thus, chronic DCS treatment did not shorten the time to extinguish a CTA and this treatment eliminated the ability of EU-EXT to block spontaneous recovery of the CTA. Acute DCS treatments were more effective in reducing the time required to extinguish a CTA than were chronic drug treatments. Moreover, the timing of these acute DCS treatments affected spontaneous recovery of the CTA depending on the extinction method employed. Acute DCS administrations later in extinction were more effective in reducing spontaneous recovery than were early administrations if the rats went through the CSO-EXT procedure. However, late-in-extinction administrations of DCS facilitated spontaneous recovery of the CTA in rats that experienced the EU-EXT method. These data agree with other findings suggesting that DCS treatments are more effective when administered a limited number of times. Our data extend these findings to the CTA paradigm and further suggest that, depending on the extinction paradigm employed, acute exposure to DCS can speed up CTA extinction and reduce spontaneous recovery of the aversion. The timing of the acute DCS treatment during extinction is generally less important than its duration in predicting the rate of CTA extinction. However, the timing of acute DCS treatments during extinction and the method of extinction employed can interact to affect spontaneous recovery of a CTA.

Periaqueductal gray c-Fos expression varies relative to the method of conditioned taste aversion extinction employed

A conditioned taste aversion (CTA) is acquired when an animal consumes a novel taste (CS) and then experiences the symptoms of poisoning (US). Following CTA training, animals will avoid the taste that was previously associated with malaise. This defensive reaction to a learned fear can be extinguished by repeated exposure to the CS alone (CS-only; CSO-EXT). However, following a latency period in which the CS is not presented, the CTA will spontaneously recover (SR). Through the use of an explicitly unpaired extinction procedure (EU-EXT) we have shown that we can speed up extinction and attenuate SR of the CTA. Here we compared and contrasted the ability of CSO and EU extinction procedures to affect c-Fos expression in the periaqueductal gray (PAG). Fluid-deprived Sprague-Dawley rats acquired a strong CTA [via 3 pairings of 0.3% oral saccharin (SAC; the CS) and 81mg/kg i.p. lithium chloride (LiCl; the US)] followed by extinction trials consisting of multiple exposures to either, (a) the CS every-other day (CSO-EXT), or (b) CS and US on alternate days (EU-EXT). A different group of rats did not receive multiple CS exposures and served as a "no extinction" (NE) control. Both extinction procedures resulted in ≥90% reacceptance of SAC (achieving asymptotic extinction). Some of the animals were sacrificed for c-Fos immunohistochemical analysis following asymptotic extinction. Other rats entered a 30-day latency period where they drank water only. These remaining animals were then tested for SR with a final exposure to SAC before being sacrificed for c-Fos immunohistochemistry. As reported previously, rats in the CS-only group exhibited a significant SR of the CTA. However, animals in the EU extinction group reached asymptotic extinction more rapidly than did CSO rats and they did not show SR of the CTA. As compared to rats that retained their CTA, both groups of extinguished rats showed suppression in the number of c-Fos-labeled neurons in all 4 longitudinal columns of the PAG. The number of c-Fos-labeled cells in the PAG was generally low but there was a reliable increase in c-Fos expression in dorsolateral PAG (dlPAG) following the SR test in the brains of rats that went through the EU-EXT procedure as compared with those that either went through the more-traditional CSO extinction procedure or experienced no extinction at all. The number of c-Fos-labeled neurons in the dlPAG was significantly correlated with the amount of SAC consumed at the SR test. Surprisingly, the brains of EU-extinguished rats and CSO extinguished rats did not differ in the number of c-Fos-labeled neurons in gustatory neocortex, medial prefrontal cortex, basolateral amygdala, or the central nucleus of the amygdala. Thus, behavioral differences in SR between the EU and CSO extinction animals were not represented by corresponding changes in the neural activity of several brain nuclei classically associated with extinction learning. However a detailed analysis of PAG c-Fos expression provided hints about some of the physiological changes evoked by these 2 extinction paradigms that produce very different behavioral outcomes. The findings are clinically relevant as we seek the development of treatments for deficits in fear extinction (e.g. PTSD, phobias).

Unpaired extinction: implications for treating post-traumatic stress disorder

Extinction of fear is important for treating stress-related conditions particularly post-traumatic stress disorder (PTSD). Although traditional extinction presents the feared stimulus by itself, there is evidence from both clinical and basic research that repeatedly presenting the feared stimulus by itself does not prevent fear from returning. This renewal or relapse can be "thwarted" by unpaired extinction-presentations of the feared stimulus and the event producing the fear. However, no matter how effective standard unpaired extinction may be in the laboratory, repeated presentation of a traumatic event is untenable. To make an unpaired extinction procedure more clinically relevant, we classically conditioned the rabbit nictitating membrane response using electrical stimulation or air puff as the unconditioned stimulus and then during unpaired extinction reduced both the intensity of the unconditioned stimulus and the days of unpaired stimulus presentations. We found unpaired extinction reduced conditioned and exaggerated unconditioned responding (an animal analog of PTSD called conditioning-specific reflex modification) and could be accomplished with a weak unconditioned stimulus as long as extended presentations were used. Surprisingly, brief presentations of a weak unconditioned stimulus or extended presentations of a strong one made the exaggerated responses stronger. One implication is that brief treatment may not just be ineffectual; it may heighten the symptoms of PTSD. Another implication is that using strong stimuli may also heighten those symptoms.