Previous cocaine self-administration disrupts reward expectancy encoding in ventral striatum

Comprehensive Glycomic and Proteomic Analysis of Mouse Striatum and Lateral Hypothalamus Following Repeated Exposures to Cocaine or Methamphetamine

Substance use disorder is a major concern, with few therapeutic options. Heparan sulfate (HS) and chondroitin sulfate (CS) interact with a plethora of growth factors and their receptors and have profound effects on cellular signaling. Thus, targeting these dynamic interactions might represent a potential novel therapeutic modality. In the present study, we performed mass spectrometry-based glycomic and proteomic analysis to understand the effects of cocaine and methamphetamine (METH) on HS, CS, and the proteome of two brain regions critically involved in drug addiction: the lateral hypothalamus and the striatum. We observed that cocaine and METH significantly alter HS and CS abundances as well as sulfate contents and composition. In particular, repeated METH or cocaine treatments reduced CS 4-O-sulfation and increased CS 6-O-sulfation. Since C4S and C6S exercise differential effects on axon growth, regeneration, and plasticity, these changes likely contribute to drug-induced neural plasticity in these brain regions. Notably, we observed that restoring these alterations by increasing CS 4-0 levels in the lateral hypothalamus by adeno-associated virus delivery of an shRNA to arylsulfatase B (N-acetylgalactosamine-4-sulfatase) ameliorated anxiety and prevented the expression of preference for cocaine in a novelty induced conditioned place preference test during cocaine withdrawal. Finally, proteomics analyses revealed a number of aberrant proteins in METH- and cocaine-treated versus saline-treated mice, including myelin proteolipid protein, calcium/calmodulin-dependent protein kinase type II subunit alpha, synapsin-2, tenascin-R, calnexin, annexin A7, hepatoma-derived growth factor, neurocan, and CSPG5, and oxidative phosphorylation among the top perturbed pathway. Taken together, these data support the role of HS, CS, and associated proteins in stimulants abuse and suggest that manipulation of HSPGs can represent a novel therapeutic strategy.

Nothing to lose? Neural correlates of decision, anticipation, and feedback in the balloon analog risk task

Understanding the subprocesses of risky decision making is a prerequisite for understanding (dys-)functional decisions. For the present fMRI study, we designed a novel variant of the balloon-analog-risk task (BART) that measures three phases: decision making, reward anticipation, and feedback processing. Twenty-nine healthy young adults completed the BART. We analyzed neural activity and functional connectivity. Parametric modulation allowed assessing changes in brain functioning depending on the riskiness of the decision. Our results confirm involvement of nucleus accumbens, insula, anterior cingulate cortex, and dorsolateral prefrontal cortex in all subprocesses of risky decision-making. In addition, subprocesses were differentiated by the strength of activation in these regions, as well as by changes in activity and nucleus accumbens-connectivity by the riskiness of the decision. The presented fMRI-BART variant allows distinguishing activity and connectivity during the subprocesses of risky decision making and shows how activation and connectivity patterns relate to the riskiness of the decision. Hence, it is a useful tool for unraveling impairments in subprocesses of risky decision making in people with high risk behavior.

Anterior cingulate cortex lesions impair multiple facets of task engagement not mediated by dorsomedial striatum neuron firing

The anterior cingulate cortex (ACC) has been implicated across multiple highly specialized cognitive functions-including task engagement, motivation, error detection, attention allocation, value processing, and action selection. Here, we ask if ACC lesions disrupt task performance and firing in dorsomedial striatum (DMS) during the performance of a reward-guided decision-making task that engages many of these cognitive functions. We found that ACC lesions impacted several facets of task performance-including decreasing the initiation and completion of trials, slowing reaction times, and resulting in suboptimal and inaccurate action selection. Reductions in movement times towards the end of behavioral sessions further suggested attenuations in motivation, which paralleled reductions in directional action selection signals in the DMS that were observed later in recording sessions. Surprisingly, however, beyond altered action signals late in sessions-neural correlates in the DMS were largely unaffected, even though behavior was disrupted at multiple levels. We conclude that ACC lesions result in overall deficits in task engagement that impact multiple facets of task performance during our reward-guided decision-making task, which-beyond impacting motivated action signals-arise from dysregulated attentional signals in the ACC and are mediated via downstream targets other than DMS.

Prior cocaine self-administration does not impair the ability to delay gratification in rats during diminishing returns

Previous exposure to drugs of abuse produces impairments in studies of reversal learning, delay discounting and response inhibition tasks. While these studies contribute to the understanding of normal decision-making and how it is impaired by drugs of abuse, they do not fully capture how decision-making impacts the ability to delay gratification for greater long-term benefit. To address this issue, we used a diminishing returns task to study decision-making in rats that had previously self-administered cocaine. This task was designed to test the ability of the rat to choose to delay gratification in the short-term to obtain more reward over the course of the entire behavioral session. Rats were presented with two choices. One choice had a fixed amount of time delay needed to obtain reward [i.e. fixed delay (FD)], while the other choice had a progressive delay (PD) that started at 0 s and progressively increased by 1 s each time the PD option was selected. During the 'reset' variation of the task, rats could choose the FD option to reset the time delay associated with the PD option. Consistent with previous results, we found that prior cocaine exposure reduced rats' overall preference for the PD option in post-task reversal testing during 'no-reset' sessions, suggesting that cocaine exposure made rats more sensitive to the increasing delay of the PD option. Surprisingly, however, we found that rats that had self-administered cocaine 1-month prior, adapted behavior during 'reset' sessions by delaying gratification to obtain more reward in the long run similar to control rats.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Minimal cross-trial generalization in learning the representation of an odor-guided choice task

There is no single way to represent a task. Indeed, despite experiencing the same task events and contingencies, different subjects may form distinct task representations. As experimenters, we often assume that subjects represent the task as we envision it. However, such a representation cannot be taken for granted, especially in animal experiments where we cannot deliver explicit instruction regarding the structure of the task. Here, we tested how rats represent an odor-guided choice task in which two odor cues indicated which of two responses would lead to reward, whereas a third odor indicated free choice among the two responses. A parsimonious task representation would allow animals to learn from the forced trials what is the better option to choose in the free-choice trials. However, animals may not necessarily generalize across odors in this way. We fit reinforcement-learning models that use different task representations to trial-by-trial choice behavior of individual rats performing this task, and quantified the degree to which each animal used the more parsimonious representation, generalizing across trial types. Model comparison revealed that most rats did not acquire this representation despite extensive experience. Our results demonstrate the importance of formally testing possible task representations that can afford the observed behavior, rather than assuming that animals' task representations abide by the generative task structure that governs the experimental design.

Overexpressing Histone Deacetylase 5 in Rat Dorsal Striatum Alters Reward-Guided Decision-Making and Associated Neural Encoding

Accumulating evidence in the past decade implicates histone-modifying enzymes, such as class I histone deacetylases (HDACs), in learning and memory and, recently, habit formation. However, it is unclear whether HDACs play roles in complex cognitive function. To address this issue, we examined the role of dorsal striatal HDAC5, a class II HDAC, in reward-guided decision-making and associated neural encoding in rats. We first injected adeno-associated virus to overexpress a nuclear-localized HDAC5 in dorsal striatum (DS). We then recorded neural correlates from dorsolateral striatum (DLS) as rats performed two reward-guided choice tasks, in which we manipulated either the size of or delay to reward. During these tasks, rats first learned which of two options led to the better reward and then reversed those contingencies in a second block of trials. We found that rats with HDAC5 overexpression in DS responded faster and chose higher value reward more often during the first block of trials but were less able to reverse those contingencies in the second block of trials. At the neural level, HDAC5 overexpression in DS elevated and reduced the number of cells in DLS that increased firing to stimuli and reward, respectively, and shifted encoding toward cues that predicted more immediate reward. These results suggest that the HDAC5 overexpression in DS contributes to inflexible decision-making, demonstrating a role of histone-modifying enzymes in complex cognitive function.SIGNIFICANCE STATEMENT HDACs are important for learning and habit formation. Here, we expanded on these functions and found that overexpression of HDAC5 produced faster and more automatic behavior, and related changes in dorsolateral striatal neural firing in rats performing a value-based decision-making task. These results implicate HDAC5 as a potential therapeutic target for psychiatric conditions that impair decision-making and executive function.

Impaired Learning From Negative Feedback in Stimulant Use Disorder: Dopaminergic Modulation

BACKGROUND

Drug-induced alterations to the dopamine system in stimulant use disorder (SUD) are hypothesized to impair reinforcement learning (RL). Computational modeling enables the investigation of the latent processes of RL in SUD patients, which could elucidate the nature of their impairments.

METHODS

We investigated RL in 44 SUD patients and 41 healthy control participants using a probabilistic RL task that assesses learning from reward and punishment separately. In an independent sample, we determined the modulatory role of dopamine in RL following a single dose of the dopamine D2/3 receptor antagonist amisulpride (400 mg) and the agonist pramipexole (0.5 mg) in a randomised, double-blind, placebo-controlled, crossover design. We analyzed task performance using computational modelling and hypothesized that RL impairments in SUD patients would be differentially modulated by a dopamine D2/3 receptor antagonist and agonist.

RESULTS

Computational analyses in both samples revealed significantly reduced learning rates from punishment in SUD patients compared with healthy controls, whilst their reward learning rates were not measurably impaired. In addition, the dopaminergic receptor agents modulated RL parameters differentially in both groups. Both amisulpride and pramipexole impaired RL parameters in healthy participants, but ameliorated learning from punishment in SUD patients.

CONCLUSION

Our findings suggest that RL impairments seen in SUD patients are associated with altered dopamine function.

A sex-dependent role for the prelimbic cortex in impulsive action both before and following early cocaine abstinence

Although impulsive action is strongly associated with addiction, the neural underpinnings of this relationship and how they are influenced by sex have not been well characterized. Here, we used a titrating reaction time task to assess differences in impulsive action in male and female Long Evans rats both before and after short (4-6 days) or long (25-27 days) abstinence from 2 weeks of cocaine or water/saline self-administration (6 h daily access). Neural activity in the prelimbic cortex (PrL) and nucleus accumbens (NAc) core was assessed at each time point. We found that a history of cocaine self-administration increased impulsivity in all rats following short, but not long, abstinence. Furthermore, male rats with an increased ratio of excited to inhibited neurons in the PrL at the start of each trial in the task exhibited higher impulsivity in the naïve state (before self-administration). Following short abstinence from cocaine, PrL activity in males became more inhibited, and this change in activity predicted the shift in impulsivity. However, PrL activity did not track impulsivity in female rats. Additionally, although the NAc core tracked several aspects of behavior in the task, it did not track impulsivity in either sex. Together, these findings demonstrate a sex-dependent role for the PrL in impulsivity both before and after a history of cocaine.

Prior Cocaine Exposure Increases Firing to Immediate Reward While Attenuating Cue and Context Signals Related to Reward Value in the Insula

The insula contributes to behavioral control and is disrupted by substance abuse, yet we know little about the neural signals underlying these functions or how they are disrupted after chronic drug self-administration. Here, male and female rats self-administered either cocaine (experimental group) or sucrose (control) for 12 consecutive days. After a 1 month withdrawal period, we recorded from insula while rats performed a previously learned reward-guided decision-making task. Cocaine-exposed rats were more sensitive to value manipulations and were faster to respond. These behavioral changes were accompanied by elevated counts of neurons in the insula that increased firing to reward. These neurons also fired more strongly at the start of long-delay trials, when a more immediate reward would be expected, and fired less strongly in anticipation of the actual delivery of delayed rewards. Although reward-related firing to immediate reward was enhanced after cocaine self-administration, reward-predicting cue and context signals were attenuated. In addition to revealing novel firing patterns unique to insula, our data suggest changes in such neural activity likely contribute to impaired decision making observed after drug use.SIGNIFICANCE STATEMENT The insula plays a clear role in drug addiction and drug-induced impairments of decision making, yet there is little understanding of its underlying neural signals. We found that chronic cocaine self-administration reduces cue and context encoding in insula while enhancing signals related to immediate reward. These changes in neural activity likely contribute to impaired decision making and impulsivity observed after drug use.

The effects of cocaine exposure in adolescence: Behavioural effects and neuroplastic mechanisms in experimental models

Drug addiction is a devastating disorder with a huge economic and social burden for modern society. Although an individual may slip into drug abuse throughout his/her life, adolescents are at higher risk, but, so far, only a few studies have attempted to elucidate the underlying cellular and molecular bases of such vulnerability. Indeed, preclinical evidence indicates that psychostimulants and adolescence interact and contribute to promoting a dysfunctional brain. In this review, we have focused our attention primarily on changes in neuroplasticity brought about by cocaine, taking into account that there is much less evidence from exposure to cocaine in adolescence, compared with that from adults. This review clearly shows that exposure to cocaine during adolescence, acute or chronic, as well as contingent or non‐contingent, confers a vulnerable endophenotype, primarily, by causing changes in neuroplasticity. Given the close relationship between drug abuse and psychiatric disorders, we also discuss the translational implications providing an interpretative framework for clinical studies involving addictive as well as affective or psychotic behaviours.

Nucleus accumbens fast-spiking interneurons in motivational and addictive behaviors

The development of drug addiction is associated with functional adaptations within the reward circuitry, within which the nucleus accumbens (NAc) is anatomically positioned as an interface between motivational salience and behavioral output. The functional output of NAc is profoundly altered after exposure to drugs of abuse, and some of the functional changes continue to evolve during drug abstinence, contributing to numerous emotional and motivational alterations related drug taking, seeking, and relapse. As in most brain regions, the functional output of NAc is critically dependent on the dynamic interaction between excitation and inhibition. One of the most prominent sources of inhibition within the NAc arises from fast-spiking interneurons (FSIs). Each NAc FSI innervates hundreds of principal neurons, and orchestrates population activity through its powerful and sustained feedforward inhibition. While the role of NAc FSIs in the context of drug addiction remains poorly understood, emerging evidence suggests that FSIs and FSI-mediated local circuits are key targets for drugs of abuse to tilt the functional output of NAc toward a motivational state favoring drug seeking and relapse. In this review, we discuss recent findings and our conceptualization about NAc FSI-mediated regulation of motivated and cocaine-induced behaviors. We hope that the conceptual framework proposed in this review may provide a useful guidance for ongoing and future studies to determine how FSIs influence the function of NAc and related reward circuits, ultimately leading to addictive behaviors.

Prior cocaine self-administration impairs attention signals in anterior cingulate cortex

Although maladaptive decision-making is a defining feature of drug abuse and addiction, we have yet to ascertain how cocaine self-administration disrupts neural signals in anterior cingulate cortex (ACC), a brain region thought to contribute to attentional control. To address this issue, rats were trained on a reward-guided decision-making task; reward value was manipulated by independently varying the size of or the delay to reward over several trial blocks. Subsequently, rats self-administered either a cocaine (experimental group) or sucrose (control) during 12 consecutive days, after which they underwent a 1-month withdrawal period. Upon completion of this period, rats performed the previously learned reward-guided decision-making task while we recorded from single neurons in ACC. We demonstrate that prior cocaine self-administration attenuates attention and attention-related ACC signals in an intake-dependent manner, and that changes in attention are decoupled from ACC firing. These effects likely contribute to the impaired decision-making-typified by chronic substance abuse and relapse-observed after drug use.

Different Food Odors Control Brain Connectivity in Impulsive Children

BACKGROUND

Impulsivity is a complex multi-dimensional combination of behaviors which include: ineffective impulse control, premature decision-making and inability to delay gratification.

OBJECTIVE

The aim of this work was to explore how food odor perception and its emotional value is affected in impulsive children.

METHODS

Here we compared two cohorts of impulsive and control children with ages between 10 and 16 years. Both groups underwent a functional magnetic resonance imaging experiment, in which foodrelated odor-cues were presented to all of them.

RESULTS

Differences in regions of blood oxygen level dependent activation, as well as connectivity, were calculated. Activations were significant for all odors in the impulsive group in the temporal lobe, cerebellum, supplementary motor area, frontal cortex, medial cingulate cortex, insula, precuneus, precentral, para-hippocampal and calcarine cortices.

CONCLUSION

Connectivity results showed that the expected emotional reward, based on odor perceived and processed in temporal lobes, was the main cue driving responses of impulsive children. This was followed by self-consciousness, the sensation of interaction with the surroundings and feelings of comfort and happiness, modulated by the precuneus together with somatosensory cortex and cingulum. Furthermore, reduced connectivity to frontal areas as well as to other sensory integration areas (piriform cortex), combined to show different sensory processing strategies for olfactory emotional cues in impulsive children. Finally, we hypothesize that the cerebellum plays a pivotal role in modulating decision-making for impulsive children.

Ultrahigh-resolution MRI reveals structural brain differences in serotonin transporter knockout rats after sucrose and cocaine self-administration

Excessive use of cocaine is known to induce changes in brain white and gray matter. It is unknown whether the extent of these changes is related to individual differences in vulnerability to cocaine addiction. One factor increasing vulnerability involves reduced expression of the serotonin transporter (5-HTT). Human studies have shown that inherited 5-HTT downregulation is associated with structural changes in the brain. These genotype-related structural changes may contribute to risk for cocaine addiction. Here, we tested this idea by using ultrahigh-resolution structural magnetic resonance imaging (MRI) on postmortem tissue of 5-HTT-/- and wild-type (5-HTT+/+ ) rats with a history of long access to cocaine or sucrose (control) self-administration. We found that 5-HTT-/- rats, compared with wild-type control animals, self-administered more cocaine, but not sucrose, under long-access conditions. Ultrahigh-resolution structural MRI subsequently revealed that, independent of sucrose or cocaine self-administration, 5-HTT-/- rats had a smaller amygdala. Moreover, we found an interaction between genotype and type of reward for dorsal raphe nucleus volume. The data point to an important but differential role of the amygdala and dorsal raphe nucleus in 5-HTT genotype-dependent vulnerability to cocaine addiction.

Incubation of food craving in rats: A review

Incubation of food craving is an abstinence-dependent increase in responding for reward-paired cues. Incubation of craving was first reported for rats responding for cocaine-paired cues, and later generalized to several drugs of abuse and for food. Incubation of drug and food craving has been reported in clinical studies as well. Incubation of food craving by rats has been reported for standard chow as well as for high fat and sucrose reinforcers. Parametric and other evaluations of the incubation of food craving reveal manipulations that reduce incubation, including environmental enrichment and pharmacological manipulation of dopamine, glutamate, and endogenous opiates. Several brain regions are likely involved in the effect, including mesolimbic terminals and the central nucleus of the amygdala. Further study of the incubation of food craving could facilitate development of treatments for cravings that precede relapse characteristic of drug and food addictions.

Expectancy-Related Changes in Dopaminergic Error Signals Are Impaired by Cocaine Self-Administration

Addiction is a disorder of behavioral control and learning. While this may reflect pre-existing propensities, drug use also clearly contributes by causing changes in outcome processing in prefrontal and striatal regions. This altered processing is associated with behavioral deficits, including changes in learning. These areas provide critical input to midbrain dopamine neurons regarding expected outcomes, suggesting that effects on learning may result from changes in dopaminergic error signaling. Here, we show that dopamine neurons recorded in rats that had self-administered cocaine failed to suppress firing on omission of an expected reward and exhibited lower amplitude and imprecisely timed increases in firing to an unexpected reward. Learning also appeared to have less of an effect on reward-evoked and cue-evoked firing in the cocaine-experienced rats. Overall, the changes are consistent with reduced fidelity of input regarding the expected outcomes, such as their size, timing, and overall value, because of cocaine use.

Model-Free and Model-Based Influences in Addiction-Related Behaviors

BACKGROUND

Disruptions in the decision-making processes that guide action selection are a core feature of many psychiatric disorders, including addiction. Decision making is influenced by the goal-directed and habitual systems that can be computationally characterized using model-based and model-free reinforcement learning algorithms, respectively. Recent evidence suggests an imbalance in the influence of these reinforcement learning systems on behavior in individuals with substance dependence, but it is unknown whether these disruptions are a manifestation of chronic drug use and/or are a preexisting risk factor for addiction.

METHODS

We trained adult male rats on a multistage decision-making task to quantify model-free and model-based processes before and after self-administration of methamphetamine or saline.

RESULTS

Individual differences in model-free, but not model-based, learning prior to any drug use predicted subsequent methamphetamine self-administration; rats with lower model-free behavior took more methamphetamine than rats with higher model-free behavior. This relationship was selective to model-free updating following a rewarded, but not unrewarded, choice. Both model-free and model-based learning were reduced in rats following methamphetamine self-administration, which was due to a decrement in the ability of rats to use unrewarded outcomes appropriately. Moreover, the magnitude of drug-induced disruptions in model-free learning was not correlated with disruptions in model-based behavior, indicating that drug self-administration independently altered both reinforcement learning strategies.

CONCLUSIONS

These findings provide direct evidence that model-free and model-based learning mechanisms are involved in select aspects of addiction vulnerability and pathology, and they provide a unique behavioral platform for conducting systems-level analyses of decision making in preclinical models of mental illness.

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats

Addiction has long been characterized by diminished executive function, control, and impulsivity management. In particular, these deficits often manifest themselves as impairments in reversal learning, delay discounting, and response inhibition. Understanding the neurobiological substrates of these behavioral deficits is of paramount importance to our understanding of addiction. Within the cycle of addiction, periods during and after withdrawal represent a particularly difficult point of intervention in that the negative physical symptoms associated with drug removal and drug craving increase the likelihood that the patient will relapse and return to drug use in order to abate these symptoms. Moreover, it is often during this time that drug induced deficits in executive function hinder the ability of the patient to refrain from drug use. Thus, it is necessary to understand the physiological and behavioral changes associated with withdrawal and drug craving-largely manifesting as deficits in executive control-to develop more effective treatment strategies. In this review, we address the long-term impact that drugs of abuse have on the behavioral and neural correlates that give rise to executive control as measured by reversal learning, delay discounting, and stop-signal tasks, focusing particularly on our work using rats as a model system.