The effects of compound stimulus extinction and inhibition of noradrenaline reuptake on the renewal of alcohol seeking

Transcriptional characterization of cocaine withdrawal versus extinction within nucleus accumbens

Substance use disorder is characterized by a maladaptive imbalance wherein drug seeking persists despite negative consequences or drug unavailability. This imbalance correlates with neurobiological alterations some of which are amplified during forced abstinence, thereby compromising the capacity of extinction-based approaches to prevent relapse. Cocaine use disorder (CUD) exemplifies this phenomenon in which neurobiological modifications hijack brain reward regions such as the nucleus accumbens (NAc) to manifest craving and withdrawal-like symptoms. While increasing evidence links transcriptional changes in the NAc to specific phases of addiction, genome-wide changes in gene expression during withdrawal vs. extinction (WD/Ext) have not been examined in a context- and NAc-subregion-specific manner. Here, we used cocaine self-administration (SA) in rats combined with RNA-sequencing (RNA-seq) of NAc subregions (core and shell) to transcriptionally profile the impact of experiencing withdrawal in the home cage or in the previous drug context or experiencing extinction training. As expected, home-cage withdrawal maintained drug seeking in the previous drug context, whereas extinction training reduced it. By contrast, withdrawal involving repetitive exposure to the previous drug context increased drug-seeking behavior. Bioinformatic analyses of RNA-seq data revealed gene expression patterns, networks, motifs, and biological functions specific to these behavioral conditions and NAc subregions. Comparing transcriptomic analysis of the NAc of patients with CUD highlighted conserved gene signatures, especially with rats that were repetitively exposed to the previous drug context. Collectively, these behavioral and transcriptional correlates of several withdrawal-extinction settings reveal fundamental and translational information about potential molecular mechanisms to attenuate drug-associated memories.

Optogenetic stimulation of the locus coeruleus enhances appetitive extinction in rats

Extinction is a specific example of learning where a previously reinforced stimulus or response is no longer reinforced, and the previously learned behaviour is no longer necessary and must be modified. Current theories suggest extinction is not the erasure of the original learning but involves new learning that acts to suppress the original behaviour. Evidence for this can be found when the original behaviour recovers following the passage of time (spontaneous recovery) or reintroduction of the reinforcement (i.e. reinstatement). Recent studies have shown that pharmacological manipulation of noradrenaline (NA) or its receptors can influence appetitive extinction; however, the role and source of endogenous NA in these effects are unknown. Here, we examined the role of the locus coeruleus (LC) in appetitive extinction. Specifically, we tested whether optogenetic stimulation of LC neurons during extinction of a food-seeking behaviour would enhance extinction evidenced by reduced spontaneous recovery in future tests. LC stimulation during extinction trials did not change the rate of extinction but did serve to reduce subsequent spontaneous recovery, suggesting that stimulation of the LC can augment reward-related extinction. Optogenetic inhibition of the LC during extinction trials reduced responding during the trials where it was applied, but no long-lasting changes in the retention of extinction were observed. Since not all LC cells expressed halorhodopsin, it is possible that more complete LC inhibition or pathway-specific targeting would be more effective at suppressing extinction learning. These results provide further insight into the neural basis of appetitive extinction, and in particular the role of the LC. A deeper understanding of the physiological bases of extinction can aid development of more effective extinction-based therapies.

Neural substrates of appetitive and aversive prediction error

Prediction error, defined by the discrepancy between real and expected outcomes, lies at the core of associative learning. Behavioural investigations have provided evidence that prediction error up- and down-regulates associative relationships, and allocates attention to stimuli to enable learning. These behavioural advances have recently been followed by investigations into the neurobiological substrates of prediction error. In the present paper, we review neuroscience data obtained using causal and recording neural methods from a variety of key behavioural designs. We explore the neurobiology of both appetitive (reward) and aversive (fear) prediction error with a focus on the mesolimbic dopamine system, the amygdala, ventrolateral periaqueductal gray, hippocampus, cortex and locus coeruleus noradrenaline. New questions and avenues for research are considered.

Facilitative effects of environmental enrichment for cocaine relapse prevention are dependent on extinction training context and involve increased TrkB signaling in dorsal hippocampus and ventromedial prefrontal cortex

Cocaine-cue extinction training combined with brief interventions of environmental enrichment (EE) was shown previously to facilitate extinction and attenuate reacquisition of cocaine self-administration in rats. It is unknown whether or not the usefulness of this approach would be undermined if extinction training took place in a novel rather than familiar context. Drawing on previous studies involving pharmacological interventions, we hypothesized that the facilitative effects of EE for cocaine relapse prevention would be independent of the context used for extinction training. Rats trained to self-administer cocaine underwent cocaine-cue extinction training in either the familiar self-administration context or a novel context, with or without EE. Rats then were tested for reacquisition of cocaine self-administration in the familiar context. Target brain regions were lysed and probed for memory-related changes in receptors for glutamate and BDNF by western blotting. Contrary to our hypothesis, the facilitative effects of EE for cocaine relapse prevention were dependent on the context used for extinction training. While EE facilitated extinction regardless of context used, it inhibited cocaine relapse only after extinction training in the familiar context. EE was associated with increased GluA2 in nucleus accumbens, TrkB in dorsal hippocampus and activated TrkB in ventromedial prefrontal cortex. Of these, the changes in dorsal hippocampus and ventromedial prefrontal cortex mirrored outcomes of the cocaine relapse tests in that these changes were specific to rats receiving EE plus extinction training in the familiar context. These findings support a role for hippocampal-prefrontal BDNF-TrkB signaling in extinction-based relapse prevention strategies involving EE.

Noradrenergic β-receptor antagonism in the basolateral amygdala impairs reconsolidation, but not extinction, of alcohol self-administration: Intra-BLA propranolol impairs reconsolidation of alcohol self-administration

A critical barrier to recovery from alcohol addiction is relapse propensity. Alcohol cues can trigger relapse, and pharmacologically facilitating processes such as extinction, which decreases cue associations, may help prevent relapse. The noradrenergic system mediates extinction learning for alcohol; however, the neural locus of this effect is unknown. This study sought to determine whether the basolateral amygdala (BLA), a region critical for fear extinction, also mediates extinction of alcohol seeking. Hooded Wistar rats (N = 12-15 per experiment) were implanted with bilateral cannula targeting the BLA and trained to lever press for 10% ethanol during auditory or visual cues. Infusions of the β-receptor antagonist propranolol (2 µg/side) were administered prior to extinction (Experiment 1), and rats assessed for relapse-like behaviour two weeks later, thus allowing for spontaneous recovery. We expected intra-BLA propranolol to impair extinction learning; however, propranolol-treated rats exhibited reduced responding in the test of spontaneous recovery, suggesting enhanced extinction. We investigated this unexpected result by determining if propranolol treatment affected memory processes other than extinction. In a subsequent experiment, rats were infused with propranolol immediately after extinction to target consolidation of extinction (Experiment 2a), and assessed for spontaneous recovery. Propranolol was also infused after self-administration to target reconsolidation of the original learning (Experiment 2b). Propranolol treatment had no effect on consolidation of extinction learning, but impaired reconsolidation of self-administration. Propranolol administered prior to a self-administration session did not affect reinforced responding (Experiment 2c). Extinction and reconsolidation are opposing processes triggered by specific test conditions. We suggest our test conditions induced reconsolidation of self-administration memory by propranolol, rather than modulation of extinction. Thus, our data implicates intra-BLA noradrenergic β-receptors in reconsolidation of alcohol self-administration memory.

Moderate Partially Reduplicated Conditioned Stimuli as Retrieval Cue Can Increase Effect on Preventing Relapse of Fear to Compound Stimuli

The theory of memory reconsolidation argues that consolidated memory is not unchangeable. Once a memory is reactivated it may go back into an unstable state and need new protein synthesis to be consolidated again, which is called "memory reconsolidation". Boundary studies have shown that interfering with reconsolidation through pharmacologic or behavioral intervention can lead to the updating of the initial memory, for example, erasing undesired memories. Behavioral procedures based on memory reconsolidation interference have been shown to be an effective way to inhibit fear memory relapse after extinction. However, the effectiveness of retrieval-extinction differs by subtle differences in the protocol of the reactivation session. This represents a challenge with regard to finding an optimal operational model to facilitate its clinical use for patients suffering from pathogenic memories such as those associated with post-traumatic stress disorder. Most of the laboratory models for fear learning have used a single conditioned stimulus (CS) paired with an unconditioned stimulus (US). This has simplified the real situation of traumatic events to an excessive degree, and thus, limits the clinical application of the findings based on these models. Here, we used a basic visual compound CS model as the CS to ascertain whether partial repetition of the compound CSs in conditioning can reactivate memory into reconsolidation. The results showed that the no retrieval group or the 1/3 ratio retrieval group failed to open the memory reconsolidation time window. The 2/3 repetition retrieval group and the whole repetition retrieval group were able to prevent fear reinstatement, whereas only a 2/3 ratio repetition of the initial compound CS as a reminder could inhibit spontaneous recovery. We inferred that a retrieval-extinction paradigm was also effective in a more complex model of fear if a sufficient prediction error (PE) could be generated in the reactivation period. In addition, in order to achieve an optimal effect, a CS of moderate discrepancy should be used as a reminder.

Recent developments in the behavioural and pharmacological enhancement of extinction of drug seeking

One of the principal barriers to overcoming addiction is the propensity to relapse, even after months or years of abstinence. Relapse can be precipitated by cues and contexts associated with drug use; thus, decreasing the conditioned properties of these cues and contexts may assist in preventing relapse. The predictive power of drug cues and contexts can be reduced by repeatedly presenting them in the absence of the drug reinforcer, a process known as extinction. The potential of extinction to limit relapse has generated considerable interest and research over the past few decades. While pre-clinical animal models suggest extinction learning assists relapse prevention, treatment efficacy is often lacking when extinction learning principles are translated into clinical trials. Conklin and Tiffany (Addiction, 2002) suggest the lack of efficacy in clinical practice may be due to limited translation of procedures demonstrated through animal research and propose several methodological improvements to enhance extinction learning for drug addiction. This review will examine recent advances in the behavioural and pharmacological manipulation of extinction learning, based on research from pre-clinical models. In addition, the translation of pre-clinical findings-both those suggested by Conklin and Tiffany () and novel demonstrations from the past 13 years-into clinical trials and the efficacy of these methods in reducing craving and relapse, where available, will be discussed. Finally, we highlight areas where promising pre-clinical models have not yet been integrated into current clinical practice but, if applied, could improve upon existing behavioural and pharmacological methods.