Involvement of the dorsal striatum in cue-controlled cocaine seeking

Changes in dorsomedial striatum activity during expression of goal-directed vs. habit-like cue-induced cocaine seeking

A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking that is goal-directed but not habit-like. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry in rats trained to self-administer cocaine paired with an audiovisual cue to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habit-like cue-induced cocaine seeking and how it is impacted by cue extinction. After minimal fixed-ratio training, rats showed enhanced DMS and DLS calcium responses to cue-reinforced compared to unreinforced lever presses. After rats were trained on goal-promoting fixed ratio schedules or habit-promoting second-order schedules of reinforcement, different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses emerged. Rats trained on habit-promoting second-order schedules showed reduced DMS calcium responses and enhanced DLS dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habit-like behavior and the DLS are unaffected.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Fluoxetine potentiates methylphenidate-induced behavioral responses: Enhanced locomotion or stereotypies and facilitated acquisition of cocaine self-administration

The medical psychostimulant methylphenidate (MP) is used to treat attention-deficit hyperactivity disorder and recreationally as a "cognitive enhancer". MP is a dopamine reuptake inhibitor, but does not affect serotonin. Serotonin contributes to addiction-related gene regulation and behavior. Previously, we showed that enhancing serotonin action by adding a selective serotonin reuptake inhibitor, fluoxetine (FLX), to MP potentiates MP-induced gene regulation in striatum and nucleus accumbens, mimicking cocaine effects. Here, we investigated the behavioral consequences of MP+FLX treatment. Young adult male rats received MP (5 mg/kg, i.p.) or MP+FLX (5 mg/kg each) daily for 6-8 days. Behavioral effects were assessed in an open-field test during the repeated treatment. Two weeks later the motor response to a cocaine challenge (25 mg/kg) and the rate of acquisition of cocaine self-administration behavior were determined. Our results demonstrate that FLX potentiates effects of MP on open-field behavior. However, we found differential behavioral responses to MP+FLX treatment, as approximately half of the rats developed high rates of focal stereotypies (termed "MP+FLX/high reactivity" group), whereas the other half did not, and only showed increased locomotion ("MP+FLX/low reactivity" group). Two weeks later, cocaine-induced locomotion and stereotypies were positively correlated with MP+FLX-induced behavior seen at the end of the repeated MP+FLX treatment. Moreover, the MP+FLX/high reactivity group, but not the low reactivity group, showed facilitated acquisition of cocaine self-administration. These results demonstrate that repeated MP+FLX treatment can facilitate subsequent cocaine taking behavior in a subpopulation of rats. These findings suggest that MP+FLX exposure in some individuals may increase the risk for psychostimulant use later in life.

Cue-induced reinstatement of seeking behavior in male rats is independent from the rewarding value of the primary reinforcer: Effect of mGluR5 blockade

Environmental conditioning factors have a profound impact on alcohol-seeking behavior and the maintenance of alcohol use in individuals with alcohol dependence. Cues associated with alcohol, depending on the perceived value of the primary reinforcer, gain salience and can trigger relapse. This study investigates the correlation between the reward magnitude of the primary reinforcer and the reinstatement evoked by cues predictive of their availability in male rats. Rat self-administration procedures were used to test reinstatement, with reinforcers consisting of 10% alcohol, 10% sucrose, or 2% sodium chloride (NaCl) experienced under need-state conditions. The effect of MTEP ([(2-methyl-1,3-thiazol-4-yl) ethynyl] pyridine), a selective metabotropic glutamate receptor 5 (mGluR5) antagonist, on motivation and reinstatement behaviors was also evaluated. RESULTS: demonstrate that under Fixed Ratio 1 (FR1) schedule, the three reinforcers maintain operant responding with the following order of magnitude 10% sucrose >2% NaCl >10% alcohol > water. Under a progressive ratio (PR) schedule of reinforcement, rats exhibit a significantly higher breakpoint for 2% NaCl (under Na-depletion), followed by 10% sucrose and 10% alcohol. After extinction, a significant reinstatement is observed with the magnitude order of 10% sucrose >10% alcohol >2% NaCl. However, only re-exposure to alcohol-paired cues induced significant reinstatement of alcohol-seeking after 4 and 8 months. Treatment with MTEP significantly reduces reinstatement of responding across all reinforcers, with the strongest effect observed on alcohol-seeking. These findings suggest that mGluR5 plays a general role in controlling cue-reactivity, but the effect is prominent in the case of alcohol compared to natural rewards. In conclusion, the results demonstrate a remarkable dissociation between the rewarding magnitude of the primary reinforcer and its ability to trigger relapse upon presentation of a cue previously associated with it. Importantly, alcohol, despite having lower intrinsic motivational value compared to a natural reward (sucrose) or a consummatory stimulus experienced under need state conditions (NaCl), can elicit more robust and longer-term reinstatement of seeking responses. Finally, our data demonstrate a significant involvement of the mGluR5 system in the regulation of seeking behavior.

The development of compulsive coping behavior depends on dorsolateral striatum dopamine-dependent mechanisms

Humans greatly differ in how they cope with stress, a natural behavior learnt through negative reinforcement. Some individuals engage in displacement activities, others in exercise or comfort eating, and others still in alcohol use. Across species, adjunctive behaviors, such as polydipsic drinking, are used as a form of displacement activity that reduces stress. Some individuals, in particular those that use alcohol to self-medicate, tend to lose control over such coping behaviors, which become excessive and compulsive. However, the psychological and neural mechanisms underlying this individual vulnerability have not been elucidated. Here we tested the hypothesis that the development of compulsive adjunctive behaviors stems from the functional engagement of the dorsolateral striatum (DLS) dopamine-dependent habit system after a prolonged history of adjunctive responding. We measured in longitudinal studies in male Sprague Dawley rats the sensitivity of early established vs compulsive polydipsic water or alcohol drinking to a bilateral infusion into the anterior DLS (aDLS) of the dopamine receptor antagonist α-flupentixol. While most rats acquired a polydipsic drinking response with water, others only did so with alcohol. Whether drinking water or alcohol, the acquisition of this coping response was insensitive to aDLS dopamine receptor blockade. In contrast, after prolonged experience, adjunctive drinking became dependent on aDLS dopamine at a time when it was compulsive in vulnerable individuals. These data suggest that habits may develop out of negative reinforcement and that the engagement of their underlying striatal system is necessary for the manifestation of compulsive adjunctive behaviors.

Resting-State Functional Connectivity of the Dorsal and Ventral Striatum, Impulsivity, and Severity of Use in Recently Abstinent Cocaine-Dependent Individuals

BACKGROUND

Previous studies have focused on both ventral striatum (VS) and dorsal striatum (DS) in characterizing dopaminergic deficits in addiction. Animal studies suggest VS and DS dysfunction each in association with impulsive and compulsive cocaine use during early and later stages of addiction. However, few human studies have aimed to distinguish the roles of VS and DS dysfunction in cocaine misuse.

METHODS

We examined VS and DS resting-state functional connectivity (rsFC) of 122 recently abstinent cocaine-dependent individuals (CDs) and 122 healthy controls (HCs) in 2 separate cohorts. We followed published routines in imaging data analyses and evaluated the results at a corrected threshold with age, sex, years of drinking, and smoking accounted for.

RESULTS

CDs relative to HCs showed higher VS rsFC with the left inferior frontal cortex (IFC), lower VS rsFC with the hippocampus, and higher DS rsFC with the left orbitofrontal cortex. Region-of-interest analyses confirmed the findings in the 2 cohorts examined separately. In CDs, VS-left IFC and VS-hippocampus connectivity was positively and negatively correlated with average monthly cocaine use in the prior year, respectively. In the second cohort where participants were assessed with the Barratt Impulsivity Scale (BIS-11), VS-left IFC and VS-hippocampus connectivity was also positively and negatively correlated with BIS-11 scores in CDs. In contrast, DS-orbitofrontal cortex connectivity did not relate significantly to cocaine use metrics or BIS-11 scores.

CONCLUSION

These findings associate VS rsFC with impulsivity and the severity of recent cocaine use. How DS connectivity partakes in cocaine misuse remains to be investigated.

The Stage-Based Model of Addiction-Using Drosophila to Investigate Alcohol and Psychostimulant Responses

Addiction is a progressive and complex disease that encompasses a wide range of disorders and symptoms, including substance use disorder (SUD), for which there are few therapeutic treatments. SUD is the uncontrolled and chronic use of substances despite the negative consequences resulting from this use. The progressive nature of addiction is organized into a testable framework, the neurobiological stage-based model, that includes three behavioral stages: (1) binge/intoxication, (2) withdrawal/negative affect, and (3) preoccupation/anticipation. Human studies offer limited opportunities for mechanistic insights into these; therefore, model organisms, like Drosophila melanogaster, are necessary for understanding SUD. Drosophila is a powerful model organism that displays a variety of SUD-like behaviors consistent with human and mammalian substance use, making flies a great candidate to study mechanisms of behavior. Additionally, there are an abundance of genetic tools like the GAL4/UAS and CRISPR/Cas9 systems that can be used to gain insight into the molecular mechanisms underlying the endophenotypes of the three-stage model. This review uses the three-stage framework and discusses how easily testable endophenotypes have been examined with experiments using Drosophila, and it outlines their potential for investigating other endophenotypes.

The Neural Processes in Food Decision-making and their Effect on Daily Diet Management in Successful and Unsuccessful Restrained Eaters

This study aimed to explore the neural mechanisms underlying food decision making in unsuccessful restrained eaters (US-REs) and successful restrained eaters (S-REs). During a functional magnetic resonance imaging scan, participants were required to choose between pairs of high- and low-calorie foods under the following conditions: the congruent condition (choose between high- and low-calorie foods with the same level of tastiness) and incongruent condition (choose between high-calorie foods tastier than the corresponding low-calorie foods). Subsequently, the participants' diets were monitored for one week. The behavioral results showed that US-REs (n = 28) chose more high-calorie foods than S-REs (n = 26); in contrast, S-REs spent more time in choosing for the incongruent than the congruent condition. The fMRI results found that US-REs exhibited more activity in reward regions (caudate and thalamus) than S-REs in the congruent condition. In the incongruent condition, S-REs showed stronger functional connectivity between the conflict-monitoring region (anterior cingulate cortex) and inhibitory-control regions (inferior frontal gyrus [IFG] and medial frontal gyrus) than US-REs. In both the conditions, increased activation of the insula, putamen, middle frontal gyrus, and IFG could predict increased food intake among US-REs in the following week. Furthermore, in both the conditions, increased IFG activation could predict decreased food cravings among S-REs during the following week. Our results suggest that US-REs have a strong reward response to food. Compared to US-REs, S-REs are more guided more by the goal of weight control, and exhibit strong functional connections between the conflict-monitoring and inhibitory-control regions. Therefore, eating enjoyment and weight-control goals influence restrained eating in daily life.

The Dopamine System in Mediating Alcohol Effects in Humans

Brain-imaging studies show that the development and maintenance of alcohol use disorder (AUD) is determined by a complex interaction of different neurotransmitter systems and multiple psychological factors. In this context, the dopaminergic reinforcement system appears to be of fundamental importance. We focus on the excitatory and depressant effects of acute versus chronic alcohol intake and its impact on dopaminergic neurotransmission. Furthermore, we describe alterations in dopaminergic neurotransmission as associated with symptoms of alcohol dependence. We specifically focus on neuroadaptations to chronic alcohol consumption and their effect on central processing of alcohol-associated and reward-related stimuli. Altered reward processing, complex conditioning processes, impaired reinforcement learning, and increased salience attribution to alcohol-associated stimuli enable alcohol cues to drive alcohol seeking and consumption. Finally, we will discuss how the neurobiological and neurochemical mechanisms of alcohol-associated alterations in reward processing and learning can interact with stress, cognition, and emotion processing.

Association between iron accumulation in the dorsal striatum and compulsive drinking in alcohol use disorder

RATIONALE

Brain iron accumulation has been observed in neuropsychiatric disorders and shown to be related to neurodegeneration.

OBJECTIVES

In this study, we used quantitative susceptibility mapping (QSM), an emerging MRI technique developed for quantifying tissue magnetic susceptibility, to examine brain iron accumulation in individuals with alcohol use disorder (AUD) and its relation to compulsive drinking.

METHODS

Based on our previous projects, QSM was performed as a secondary analysis with gradient echo sequence images, in 186 individuals with AUD and 274 healthy participants. Whole-brain susceptibility values were calculated with morphology-enabled dipole inversion and referenced to the cerebrospinal fluid. Then, the susceptibility maps were compared between AUD individuals and healthy participants. The relationship between drinking patterns and susceptibility was explored.

RESULTS

Whole-brain analyses showed that the susceptibility in the dorsal striatum (putamen and caudate) among AUD individuals was higher than healthy participants and was positively related to the Obsessive Compulsive Drinking Scale (OCDS) scores and the amount of drinking in the past three months.

CONCLUSIONS

Increased susceptibility suggests higher iron accumulation in the dorsal striatum in AUD. This surrogate for the brain iron level was linearly associated with the compulsive drinking pattern and the recent amount of drinking, which provides us a new clinical perspective in relation to brain iron accumulation, and also might indicate an association of AUD with neuroinflammation as a consequence of brain iron accumulation. The iron accumulation in the striatum is further relevant for functional imaging studies in AUD by potentially producing signal dropout and artefacts in fMRI images.

Deep brain stimulation of the nucleus accumbens in the treatment of severe alcohol use disorder: a phase I pilot trial

Alcohol use disorder (AUD) is a highly prevalent, often refractory, medical illness. The symptoms of AUD are driven by dysfunction in several neurocircuits centered on the nucleus accumbens (NAc). Case reports and animal studies suggest NAc-DBS may be an effective harm-reduction treatment in severe AUD. Six patients with severe, refractory AUD underwent NAc-DBS. Safety metrics and clinical outcomes were recorded. Positron emission tomography (FDG-PET) was used to measure glucose metabolism in the NAc at baseline and 6 months. Functional magnetic resonance imaging (fMRI) was used to characterize postoperative changes in NAc functional connectivity to the rest of the brain, as well as NAc and dorsal striatal reactivity to alcoholic visual cues. This study was registered with ClinicalTrials.gov, NCT03660124. All patients experienced a reduction in craving. There was a significant reduction in alcohol consumption, alcohol-related compulsivity, and anxiety at 12 months. There was no significant change in depression. FDG-PET analysis demonstrated reduced NAc metabolism by 6 months, which correlated with improvements in compulsive drinking behaviors. Clinical improvement correlated with reduced functional connectivity between the NAc and the visual association cortex. Active DBS was associated with reduced activation of the dorsal striatum during passive viewing of alcohol-containing pictures. NAc-DBS is feasible and safe in patients with severe, otherwise refractory AUD. It is associated with a reduction in cravings and addictive behavior. A potential mechanism underlying this process is a down-regulation of the NAc, a disruption of its functional connectivity to the visual association cortex, and interference of cue-elicited dorsal striatum reactivity. Trial Registration NCT03660124 ( www.clinicaltrials.gov ).

Alterations of Dopamine Receptors and the Adaptive Changes of L-Type Calcium Channel Subtypes Regulate Cocaine-Seeking Habit in Tree Shrew

The putamen (Put) is necessary for habitual actions, while the nucleus caudate (Cd) is critical for goal-directed actions. However, compared with the natural reward (such as sucrose)-seeking habit, how drug-related dysfunction or imbalance between the Put and Cd is involved in cocaine-seeking habit, which is not easy to bias behavior to goal-directed actions, is absent. Therefore, in our present study, in comparison with sucrose-habitual behavior, we evaluated the distinctive changes of the two subtypes of dopamine (DA) receptors (D1R and D2R) in cocaine-seeking habitual behavior animals. Moreover, the adaptive changes of Ca_v1.2 and Ca_v1.3, as prime downstream targets of D1R and D2R respectively, were also assessed. Our results showed that a similar percentage of the animals exhibited habitual seeking behavior after cocaine or sucrose variable-interval self-administration (SA) training in tree shrews. In addition, compared with animals with non-habitual behavior, animals with cocaine habitual behavior showed higher D1Rs and Ca_v1.2 expression in the Put accompanied with lower D2Rs and Ca_v1.3 expression in the Cd. However, after sucrose SA training, animals with habitual behavior only showed lower membrane expression of D2R in the Put than animals with non-habitual behavior. These results suggested that the upregulation of D1Rs-Ca_v1.2 signaling may lead to hyper-excitability of the Put, and the inactivation of D2Rs-Ca_v1.3 signaling may result in depressed activity in the Cd. This imbalance function between the Put and Cd, which causes an inability to shift between habits and goal-directed actions, may underlie the compulsive addiction habit.

Sustained inhibitory transmission but dysfunctional dopamine D2 receptor signaling in dorsal striatal subregions following protracted abstinence from amphetamine

Behavioral sensitization to amphetamine is a complex phenomenon that engages several neurotransmitter systems and brain regions. While dysregulated signaling in the mesolimbic dopamine system repeatedly has been linked to behavioral sensitization, later research has implicated dorsal striatal circuits and GABAergic neurotransmission in contributing to behavioral transformation elicited by amphetamine. The aim of this study was thus to determine if repeated amphetamine exposure followed by abstinence would alter inhibitory neurotransmission in dorsal striatal subregions. To this end, male Wistar rats received amphetamine (2.0 mg/kg) in an intermittent manner for a total of five days. Behavioral sensitization to amphetamine was measured in locomotor-activity boxes, while neuroadaptations were recorded in the dorsolateral (DLS) and dorsomedial striatum (DMS) using ex vivo electrophysiology at different timepoints of amphetamine abstinence (2 weeks, 4-5 weeks, 10-11 weeks). Data show that repeated drug-exposure produces behavioral sensitization to the locomotor-stimulatory properties of amphetamine, which sustains for at least ten weeks. Electrophysiological recordings demonstrated a long-lasting suppression of evoked population spikes in both striatal subregions. Furthermore, following ten weeks of abstinence, the responsiveness to a dopamine D2 receptor agonist was significantly impaired in brain slices from rats previously receiving amphetamine. However, neither the frequency nor the amplitude of spontaneous inhibitory currents was affected by treatment at any of the time points analyzed. In conclusion, passive administration of amphetamine initiates long-lasting neuroadaptations in brain regions associated with goal-directed behavior and habitual performance, but these transformations do not appear to be driven by changes in GABAergic neurotransmission.

Negative Urgency Exacerbates Relapse to Cocaine Seeking After Abstinence

BACKGROUND

The mechanisms through which drug-cue-induced negative affective states are involved in relapse have not been defined. We tested the hypothesis that in individuals having developed a dorsolateral striatum (DLS)-dependent cue-controlled cocaine-seeking habit, the loss of the opportunity to enact the drug-seeking response during abstinence results in an urge to act that exacerbates relapse severity mediated by negative urgency.

METHODS

Eighty-seven male Sprague Dawley rats were trained to seek cocaine under the influence of the conditioned reinforcing properties of drug-paired cues or not. We investigated whether the tendency to relapse depended on the aversive state of withdrawal or instead on the loss of opportunity to perform the ingrained drug-seeking response after periods of abstinence. The striatal locus of control over cocaine seeking at baseline and relapse was investigated using in situ hybridization of the cellular activity marker C-fos and assessment of the sensitivity of instrumental drug seeking to dopamine receptor blockade in the dorsomedial striatum-dependent goal-directed and DLS-dependent habit systems.

RESULTS

The development of a DLS-dependent cue-controlled cocaine-seeking habit prior to abstinence resulted in a marked increase in drug seeking at relapse, which was not motivated by a cocaine withdrawal state and was no longer dependent on the DLS habit system. Instead, it reflected the emergence of negative urgency caused by the prevention of the performance of the habit during abstinence and underpinned by transient engagement of the goal-directed system.

CONCLUSIONS

These results show that ingrained cue-controlled drug-seeking habits increase the pressure to relapse.

Interactive role of acid sensing ion channels and glutamatergic system in opioid dependence

Dysregulation in glutamatergic receptors and transporters has been found to mediate drugs of abuse, including morphine. Among glutamate receptors, ionotropic glutamate receptors (iGluRs) are altered with exposure to drugs of abuse. Acid-sensing ion channels (ASICs) are ligand (H+)-gated channels, which are expressed at the excitatory synaptic clefts and play a role in drug dependence. Overexpression of a specific ASIC subtype, ASIC1a, attenuated reinstatement of cocaine. ASICs are revealed to be involved in cocaine and morphine seeking behaviors, and these effects are mediated through modulation of glutamatergic receptors. In this review, we discussed the interactive role of ASICs and glutamate receptors, mainly iGluRs, in opioid dependence. ASICs are also expressed in astrocytes and are suggested to be involved on regulating glutamate uptake. However, little is known about the coupling between ASICs and the astroglial glutamate transporters. In addition, this review discussed the role of nitric oxide in the modulation of ASIC function and potentially opioid dependence. We also discussed the role of ASICs in the modulation of the function of both glutamatergic receptors in post-synaptic neurons and glutamatergic transporters in astrocytes in animals exposed to drugs of abuse.

Relating Compulsivity and Impulsivity With Severity of Behavioral Addictions: A Dynamic Interpretation of Large-Scale Cross-Sectional Findings

BACKGROUND AND AIM

Impulsivity and compulsivity are two key temperament traits involved in behavior regulation. The aim of this study was to test several existing theories in explaining the role of impulsivity and compulsivity in symptom severity in various behavioral addictions.

METHODS

Data were collected from a (representative) general population sample (N = 2,710, mean age:39.8 years (SD:13.6), 51% woman), and from people who are at increased risk of having a behavioral addiction (N = 9,528 in total, mean age: 28.11 (SD:8.3), 34.3% woman), including people with problematic gaming and internet use, pathological gambling, exercise dependence, compulsive buying and work addiction. Symptom severity, reward driven impulsivity and relief driven compulsivity were assessed.

RESULTS

For non-problematic groups, impulsivity is present to about the same extent as compulsivity, whereas for problematic groups, compulsivity dominates over impulsivity in all groups (except for gambling). The strength of the correlation between impulsivity and compulsivity is higher in more severe forms of the disorders (from r = 0.18 to r = 0.59 in the representative population).

DISCUSSION

Based on these data, it appears that relief-driven behavior (negative reinforcement) dominates over reward-driven behavior (positive reinforcement) in more severe cases of a behavioral addiction.

CONCLUSION

This is the first large-scale study to find empirical support for the neuroscientific theory on the dominance of compulsivity ("needing") over impulsivity ("wanting") in more severe cases of a behavioral addiction. Although longitudinal research is needed, a possible shift from impulsivity to compulsivity takes place, similar to substance use addictions, which maintains the circle of addiction.

Developmental Trajectories of Anhedonia in Preclinical Models

This chapter discusses how the complex concept of anhedonia can be operationalized and studied in preclinical models. It provides information about the development of anhedonia in the context of early-life adversity, and the power of preclinical models to tease out the diverse molecular, epigenetic, and network mechanisms that are responsible for anhedonia-like behaviors.Specifically, we first discuss the term anhedonia, reviewing the conceptual components underlying reward-related behaviors and distinguish anhedonia pertaining to deficits in motivational versus consummatory behaviors. We then describe the repertoire of experimental approaches employed to study anhedonia-like behaviors in preclinical models, and the progressive refinement over the past decade of both experimental instruments (e.g., chemogenetics, optogenetics) and conceptual constructs (salience, valence, conflict). We follow with an overview of the state of current knowledge of brain circuits, nodes, and projections that execute distinct aspects of hedonic-like behaviors, as well as neurotransmitters, modulators, and receptors involved in the generation of anhedonia-like behaviors. Finally, we discuss the special case of anhedonia that arises following early-life adversity as an eloquent example enabling the study of causality, mechanisms, and sex dependence of anhedonia.Together, this chapter highlights the power, potential, and limitations of using preclinical models to advance our understanding of the origin and mechanisms of anhedonia and to discover potential targets for its prevention and mitigation.

Deconstructing and reconstructing behaviour relevant to mental health disorders: The benefits of a psychological approach, with a focus on addiction

RUTHERFORD, L.G. and Milton, A.L. Deconstructing and reconstructing behaviour relevant to mental health disorders: what can psychology offer? NEUROSCI BIOBEHAV REV XX(X)XXX-XXX, 2021. - Current treatments for mental health disorders are successful only for some patients, and there is an unmet clinical need for new treatment development. One challenge for treatment development has been how best to model complex human conditions in animals, where mechanism can be more readily studied with a range of neuroscientific techniques. We suggest that an approach to modelling based on associative animal learning theory provides a good framework for deconstructing complex mental health disorders such that they can be studied in animals. These individual simple models can subsequently be used in combination to 'reconstruct' a more complex model of the mental health disorder of interest. Using examples primarily from the field of drug addiction, we explore the 'psychological approach' and suggest that in addition to facilitating translation and backtranslation of tasks between animal models and patients, it is also highly concordant with the concept of triangulation.

Striatonigrostriatal Spirals in Addiction

A biological reward system is integral to all animal life and humans are no exception. For millennia individuals have investigated this system and its influences on human behavior. In the modern day, with the US facing an ongoing epidemic of substance use without an effective treatment, these investigations are of paramount importance. It is well known that basal ganglia contribute to rewards and are involved in learning, approach behavior, economic choices, and positive emotions. This review aims to elucidate the physiological role of striatonigrostriatal (SNS) spirals, as part of basal ganglia circuits, in this reward system and their pathophysiological role in perpetuating addiction. Additionally, the main functions of neurotransmitters such as dopamine and glutamate and their receptors in SNS circuits will be summarized. With this information, the claim that SNS spirals are crucial intermediaries in the shift from goal-directed behavior to habitual behavior will be supported, making this circuit a viable target for potential therapeutic intervention in those with substance use disorders.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Do comorbid personality disorders in cocaine dependence exacerbate neuroanatomical alterations? A structural neuroimaging study

Cocaine dependence (CD) is highly comorbid with personality disorders, with implications for poorer treatment response. The neurobiological mechanisms of this comorbidity are unclear. We aimed to test the role of comorbid personality disorders in the neuroanatomy of CD. We examined 4 groups using high-resolution structural neuroimaging, psychological questionnaires and cognitive tests: CD (n = 19), CD and personality disorder type B (CD + B, n = 21), CD and personality disorder C (CD + C, n = 13) and 21 controls. We compared groups in neuroanatomy and hypothesised that (i) CD would show altered striatal areas ascribed to reward processing (i.e., accumbens, caudate and putamen), (ii) CD + B and CD + C would show altered areas supporting emotional regulation/social valuation and anxiety/avoidance (i.e., OFC and amygdala). The CD + B group had larger caudate volumes than CD (p = .01, d = 0.94) and reduced lateral OFC thickness than CD + C (p = .056, d = 0.71). Exploratory correlations showed that altered neural integrity of the OFC and of the caudate nucleus in these groups exacerbated with worse personality disorder severity and impulsivity scores. CD with and without comorbid personality disorders may have partially distinct underlying mechanisms and targets for treatment.

Cocaine-Induced Changes in Tonic Dopamine Concentrations Measured Using Multiple-Cyclic Square Wave Voltammetry in vivo

For over 40 years, in vivo microdialysis techniques have been at the forefront in measuring the effects of illicit substances on brain tonic extracellular levels of dopamine that underlie many aspects of drug addiction. However, the size of microdialysis probes and sampling rate may limit this technique’s ability to provide an accurate assessment of drug effects in microneural environments. A novel electrochemical method known as multiple-cyclic square wave voltammetry (M-CSWV), was recently developed to measure second-to-second changes in tonic dopamine levels at microelectrodes, providing spatiotemporal resolution superior to microdialysis. Here, we utilized M-CSWV and fast-scan cyclic voltammetry (FSCV) to measure changes in tonic or phasic dopamine release in the nucleus accumbens core (NAcc) after acute cocaine administration. Carbon-fiber microelectrodes (CFM) and stimulating electrodes were implanted into the NAcc and medial forebrain bundle (MFB) of urethane anesthetized (1.5 g/kg i.p.) Sprague-Dawley rats, respectively. Using FSCV, depths of each electrode were optimized by determining maximal MFB electrical stimulation-evoked phasic dopamine release. Changes in phasic responses were measured after a single dose of intravenous saline or cocaine hydrochloride (3 mg/kg; n = 4). In a separate group, changes in tonic dopamine levels were measured using M-CSWV after intravenous saline and after cocaine hydrochloride (3 mg/kg; n = 5). Both the phasic and tonic dopamine responses in the NAcc were augmented by the injection of cocaine compared to saline control. The phasic and tonic levels changed by approximately x2.4 and x1.9, respectively. These increases were largely consistent with previous studies using FSCV and microdialysis. However, the minimal disruption/disturbance of neuronal tissue by the CFM may explain why the baseline tonic dopamine values (134 ± 32 nM) measured by M-CSWV were found to be 10-fold higher when compared to conventional microdialysis. In this study, we demonstrated phasic dopamine dynamics in the NAcc with acute cocaine administration. M-CSWV was able to record rapid changes in tonic levels of dopamine, which cannot be achieved with other current voltammetric techniques. Taken together, M-CSWV has the potential to provide an unprecedented level of physiologic insight into dopamine signaling, both in vitro and in vivo, which will significantly enhance our understanding of neurochemical mechanisms underlying psychiatric conditions.

Fluoxetine Potentiates Oral Methylphenidate-Induced Gene Regulation in the Rat Striatum

Methylphenidate (MP) is combined with selective serotonin reuptake inhibitors (SSRIs) such as fluoxetine (FLX) to treat various disorders. MP, a dopamine reuptake inhibitor, helps manage attention-deficit hyperactivity disorder (ADHD) and is abused as a cognitive enhancer; it has a reduced addiction liability. We showed that combining FLX (serotonin) with MP potentiates MP-induced gene regulation in the striatum. These studies used intraperitoneal drug administration, which is relevant for MP abuse. Clinically, MP and FLX are taken orally (slower bioavailability). Here, we investigated whether chronic oral administration of MP and FLX also altered striatal gene regulation. MP (30/60 mg/kg/day), FLX (20 mg/kg/day), and MP + FLX were administered in rats' drinking water for 8 h/day over 4 weeks. We assessed the expression of dynorphin and substance P (both markers for striatal direct pathway neurons) and enkephalin (indirect pathway) by in situ hybridization histochemistry. Chronic oral MP alone produced a tendency for increased dynorphin and substance P expression and no changes in enkephalin expression. Oral FLX alone did not increase gene expression. In contrast, when given together, FLX greatly enhanced MP-induced expression of dynorphin and substance P and to a lesser degree enkephalin. Thus, FLX potentiated oral MP-induced gene regulation predominantly in direct pathway neurons, mimicking cocaine effects. The three functional domains of the striatum were differentially affected. MP + SSRI concomitant therapies are indicated in ADHD/depression comorbidity and co-exposure occurs with MP misuse as a cognitive enhancer by patients on SSRIs. Our findings indicate that MP + SSRI combinations, even given orally, may enhance addiction-related gene regulation.

Extinction vs. Abstinence: A Review of the Molecular and Circuit Consequences of Different Post-Cocaine Experiences

The intravenous cocaine self-administration model is widely used to characterize the neurobiology of cocaine seeking. When studies are aimed at understanding relapse to cocaine-seeking, a post-cocaine abstinence period is imposed, followed by “relapse” tests to assess the ability of drug-related stimuli (“primes”) to evoke the resumption of the instrumental response previously made to obtain cocaine. Here, we review the literature on the impact of post-cocaine abstinence procedures on neurobiology, finding that the prelimbic and infralimbic regions of the prefrontal cortex are recruited by extinction training, and are not part of the relapse circuitry when extinction training does not occur. Pairing cocaine infusions with discrete cues recruits the involvement of the NA, which together with the dorsal striatum, is a key part of the relapse circuit regardless of abstinence procedures. Differences in molecular adaptations in the NA core include increased expression of GluN1 and glutamate receptor signaling partners after extinction training. AMPA receptors and glutamate transporters are similarly affected by abstinence and extinction. Glutamate receptor antagonists show efficacy at reducing relapse following extinction and abstinence, with a modest increase in efficacy of compounds that restore glutamate homeostasis after extinction training. Imaging studies in humans reveal cocaine-induced adaptations that are similar to those produced after extinction training. Thus, while instrumental extinction training does not have face validity, its use does not produce adaptations distinct from human cocaine users.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

The influence of conditioned stimuli on [11C]-(+)-PHNO PET binding in tobacco smokers after a one week abstinence

Stimuli previously paired with drugs of dependence can produce cravings that are associated with increased dopamine (DA) levels in limbic and striatal brain areas. Positron Emission Tomography (PET) imaging with [¹¹C]-(+)-PHNO allows for a sensitive measurement of changes in DA levels. The purpose of the present study was to investigate changes in DA levels, measured with PET imaging with [¹¹C]-(+)-PHNO, in regions of interest in smokers who had maintained abstinence for 7–10 days. Participants (N = 10) underwent two PET scans on separate days, during which they viewed either smoking-related or neutral images, in counterbalanced order. Craving was measured with the 12-item Tobacco Craving Questionnaire (TCQ) and the Questionnaire on Smoking Urges-Brief (QSU-B). Compared to neutral cues, smoking cues did not increase craving. There were no changes in [¹¹C]-(+)-PHNO binding in the cue condition compared to the neutral condition for most regions of interest (ventral pallidum, globus pallidus, limbic striatum, associative striatum, sensorimotor striatum). However, binding potential in the substantia nigra was greater in the smoking-cue condition, indicating decreased synaptic dopamine. There is a potential change of DA level occurring in midbrain following the presentation of smoking-related cues. However, this preliminary finding would need to be validated with a larger sample.

Neural Substrates and Circuits of Drug Addiction

Drug addiction is a chronic relapsing disorder, and a significant amount of research has been devoted to understand the factors that contribute to the development, loss of control, and persistence of compulsive addictive behaviors. In this review, we provide an overview of various theories of addiction to drugs of abuse and the neurobiology involved in elements of the addiction cycle. Specific focus is devoted to the role of the mesolimbic pathway in acute drug reinforcement and occasional drug use, the role of the mesocortical pathway and associated areas (e.g., the dorsal striatum) in escalation/dependence, and the contribution of these pathways and associated circuits to conditioned responses, drug craving, and loss of behavioral control that may underlie drug relapse. By enhancing the understanding of the neurobiological factors that mediate drug addiction, continued preclinical and clinical research will aid in the development of novel therapeutic interventions that can serve as effective long-term treatment strategies for drug-dependent individuals.

Endocannabinoid and dopaminergic system: the pas de deux underlying human motivation and behaviors

Endocannabinoid system (ECS) has been identified ever since cannabinoid, an active substance of Cannabis, was known to interact with endogenous cannabinoid (endocannabinoid/eCB) receptors. It later turned out that eCB was more intricate than previously thought. It has a pervasive role and exerts a multitude of cellular signaling mechanisms, regulating various physiological neurotransmission pathways in the human brain, including the dopaminergic (DA) system. eCB roles toward DA system were robust, clearly delineated, and reproducible with respect to physiological as well as pathological neurochemical and neurobehavioral manifestations of DA system, particularly those involving the nigrostriatal and mesocorticolimbic pathways. The eCB–DA system regulates the basics in the Maslow’s pyramid of hierarchy of needs required for individual survival such as food and sexual activity for reproductive purpose to those of higher needs in the pyramid, including self-actualization behaviors leading to achievement and reward (e.g., academic- and/or work-related performance and achievements). It is, thus, interesting to specifically discuss the eCB–DA system, not only on the molecular level, but also its tremendous potential to be developed as a future therapeutic strategy for various neuropsychiatric problems, including obesity, drug addiction and withdrawal, pathological hypersexuality, or low motivation behaviors.

Methamphetamine seeking after prolonged abstinence is associated with activated projections from anterior intralaminar nucleus of thalamus to dorsolateral striatum in female rats

Methamphetamine (Meth) seeking progressively increases after cessation from drug self-administration (incubation of Meth craving). We have previously shown that both dorsomedial and dorsolateral striatum (DMS and DLS) play critical roles in this incubation in male rats. Moreover, our recent anatomical tracing study examined afferent projections into DMS and demonstrated a novel role of projections from anterior intralaminar nucleus of thalamus (AIT) to DMS in incubation of Meth craving in male rats. Here we investigated projection-specific activation of afferent glutamate projections into DLS associated with incubated Meth seeking in female rats. We trained female rats to self-administer Meth (6-h/d for 10 d). On abstinence day 12, we injected cholera toxin subunit B (CTb, a retrograde tracer) unilaterally into DLS. On abstinence day 26, we tested rats for relapse to Meth seeking and measured Fos (a neuronal activity marker), and double-labeling of CTb and Fos in anterior cingulate cortex, anterior insula cortex, orbitofrontal cortex, basolateral amygdala, AIT, and parafascicular nuclei of thalamus. We observed neuronal activation in both cortical and thalamic regions associated with incubated Meth seeking. At the circuit level, AIT➔DLS projections were strongly activated, followed by other corticostriatal projections. Overall our results suggest that AIT to DLS may play a role in Meth seeking after prolonged abstinence in female rats.

Clinical and Neural Correlates of Reward and Relief Drinking

BACKGROUND

Alcohol use disorder (AUD) is heterogenous. One approach to parsing this heterogeneity is to phenotype individuals by their underlying motivation to drink, specifically drinking for reward (i.e., positive reinforcement) or for relief (i.e., negative reinforcement/normalizing). Reward- versus relief-motivated behavior is thought to be associated with a shift from ventral to dorsal striatal (DS) signaling. The present study examined whether reward and relief drinking were differentially associated with other clinical characteristics and with alcohol cue-elicited activation of the ventral and dorsal striatum.

METHODS

Non-treatment-seeking heavy drinkers (N = 184; 61 female, 123 male) completed the UCLA Reward, Relief, Habit Drinking Scale (RRHDS) and the Reasons for Heavy Drinking Questionnaire (RHDQ), to categorize drinking motivation. Measures of alcohol use, alcohol problems, mood, and craving were also collected. A subset of participants (N = 45; 17 female, 28 male) also completed a functional neuroimaging alcohol cue reactivity task.

RESULTS

RRHDS-designated relief/habit drinkers scored lower than reward drinkers on the RHDQ Reinforcement subscale (p = 0.04) and higher on the RHDQ Normalizing subscale (p = 0.004). Relief/habit drinkers also demonstrated greater AUD severity on a host of clinical measures. Relief/habit drinkers displayed higher cue-elicited DS activation compared with reward drinkers (p = 0.04), while ventral striatal cue-elicited activation did not significantly differ between groups.

CONCLUSIONS

Our findings support and extend the differentiation of reward from relief/habit-motivated drinking and suggest that differences in DS response to conditioned alcohol cues may underlie this distinction. Elucidating neurobiological and clinical differences between these subtypes may facilitate treatment matching and precision medicine for AUD.

Effects of dose on acquisition and persistence of a new response for a remifentanil-associated stimulus

Previous research demonstrated that a remifentanil-associated stimulus facilitated the acquisition of a previously unlearned response; however, it is unclear how long a remifentanil-associated stimulus maintains conditioned reinforcing properties under conditions of daily testing. To address this gap, we exposed adult male rats to response-independent stimulus presentations and deliveries of remifentanil (1.0, 3.2, or 10.0 μg/kg/infusion). Rats either received the stimulus presentations and remifentanil deliveries together (Paired Pavlovian conditioning) or according to separate clocks (Random control group). In the sessions following Pavlovian conditioning, we allowed rats to emit nose-poke responses for the presentation of the stimulus alone and measured the extent to which the stimulus facilitated and maintained a previously unlearned response. We tested responding for the stimulus presentations across 28 daily sessions to assess the Pavlovian extinction (degradation of the drug-stimulus association) of the conditioned reinforcing properties of the remifentanil-associated stimulus. We observed the highest and most persistent levels of responding in rats with a Paired Pavlovian conditioning history at 3.2 and 10.0 μg/kg/infusion. In addition, we included analyses of the variability in responding for each group, which revealed individual differences in the susceptibility of the remifentanil-associated stimulus acting as a conditioned reinforcer. These findings demonstrate that a remifentanil-associated stimulus has the ability to sustain drug-seeking behavior and underscores the importance of Pavlovian conditioning in promoting drug abuse.

Molecular and circuit mechanisms regulating cocaine memory

Risk of relapse is a major challenge in the treatment of substance use disorders. Several types of learning and memory mechanisms are involved in substance use and have implications for relapse. Associative memories form between the effects of drugs and the surrounding environmental stimuli, and exposure to these stimuli during abstinence causes stress and triggers drug craving, which can lead to relapse. Understanding the neural underpinnings of how these associations are formed and maintained will inform future advances in treatment practices. A large body of research has expanded our knowledge of how associative memories are acquired and consolidated, how they are updated through reactivation and reconsolidation, and how competing extinction memories are formed. This review will focus on the vast literature examining the mechanisms of cocaine Pavlovian associative memories with an emphasis on the molecular memory mechanisms and circuits involved in the consolidation, reconsolidation, and extinction of these memories. Additional research elucidating the specific signaling pathways, mechanisms of synaptic plasticity, and epigenetic regulation of gene expression in the circuits involved in associative learning will reveal more distinctions between consolidation, reconsolidation, and extinction learning that can be applied to the treatment of substance use disorders.

BOLD activation during cue induced craving in adolescent inhalant users

Inhalants are legally available substances, most of them inexpensive, which are often abused by adolescents. Craving causes their continued use and repeated relapses. There is a need to understand the cue-induced craving and the associated neural mechanisms. In absence of any such prior study, the present study compared the hemodynamic changes in brain associated with craving effect in adolescent inhalant users and healthy controls using blood oxygen level dependent (BOLD) mechanism. This was an observational case control study with twelve adolescents, aged 12-18 years, with current use of inhalants as their primary drug, and twelve healthy, age and gender-matched adolescents, with no lifetime use of inhalants. Clinical assessments included Teen Addiction Severity Index and Visual Analogue Scale for craving. Participants abstained from all substances during 48 h prior to fMRI, confirmed by urinalysis. A validated visual cue block paradigm with neutral and craving cues was presented during the BOLD assessments in a 3 T MR system. The inhalant users exhibited BOLD activation in inferior frontal gyrus, inferior parietal lobule, superior occipital gyrus, cingulate gyrus, lentiform nucleus, thalamus, and culmen as compared to control group. The control group exhibited activation of insula as compared to cases. The results may be attributed to visuo-spatial attention, visual perception, working memory, and motivation associated with visual cue reactivity. This preliminary study provides important findings pertaining to activation patterns in response to cue-induced craving among adolescent inhalant users.

Computational models of drug use and addiction: A review

In this brief review, we describe current computational models of drug-use and addiction that fall into 2 broad categories: mathematically based models that rely on computational theories, and brain-based models that link computations to brain areas or circuits. Across categories, many are models of learning and decision-making, which may be compromised in addiction. Several mathematical models take predictive coding approaches, focusing on Bayesian prediction error. Other models focus on learning processes and (traditional) prediction error. Brain-based models have incorporated prefrontal cortex, basal ganglia, and the dopamine system, based on the effects of drugs on dopamine, motivation, and executive control circuits. Several models specifically describe how behavioral control may transition from habitual to goal-directed systems, consistent with computational accounts of compromised "model-based" control. Some brain-based models have linked this to the transition of behavioral control from ventral to dorsal striatum. Overall, we propose that while computational models capture some aspects of addiction and have advanced our thinking, most have focused on the effects of drug use rather than addiction per se, most have not been tested on and/or supported by human data, and few capture multiple stages and symptoms of addiction. We conclude by suggesting a path forward for computational models of addiction. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Double dissociation between actions of dopamine D1 and D2 receptors of the ventral and dorsolateral striatum to produce reinstatement of cocaine seeking behavior

One of the hallmarks of addiction is the enduring vulnerability to relapse. Following repeated use, cocaine (COC) induces neuroadaptations within the dopamine (DA) system, arguably underlying several aspects of COC-seeking behavior. Peripheral stimulation of D2, but not D1, receptors induces relapse. However, where in the brain these effects occur is still matter of debate. The D1 and D2 receptors (D1R; D2R) are highly expressed in the nucleus accumbens (NAcc) and the dorsolateral striatum (DLS), but their specific involvement in the reinstatement of COC-seeking remains elusive. We assessed the reinstating effects of intracerebral infusions of agonists of D1R (SKF82958) or D2R (quinelorane) within the NAcc or DLS of rats after extinction of COC self-administration (COC SA). To assess whether we could block peripheral D2 agonist (quinelorane) induced reinstatement, we simultaneously infused either a D1R (SCH23390) or a D2R (raclopride) antagonist within the NAcc or DLS. When infused into the NAcc, but not into the DLS, SKF82958 induced reinstatement of COC-seeking; conversely, quinelorane had no effect when injected into the NAcc, but induced reinstatement when infused into the DLS while the D1R agonist has no effect. While administration of raclopride into the NAcc or DLS impedes the reinstating effect of a systemic quinelorane injection, the infusion of SCH23390 into the NAcc or DLS surprisingly, blocks the reinstatement induced by the peripheral D2R stimulation. Our results point to a double dissociation between D1R and D2R of the NAcc and DLS, highlighting their complex interactions within both structures, in the reinstatement of COC-seeking behavior.

The transition to compulsion in addiction

Compulsion is a cardinal symptom of drug addiction (severe substance use disorder). However, compulsion is observed in only a small proportion of individuals who repeatedly seek and use addictive substances. Here, we integrate accounts of the neuropharmacological mechanisms that underlie the transition to compulsion with overarching learning theories, to outline how compulsion develops in addiction. Importantly, we emphasize the conceptual distinctions between compulsive drug-seeking behaviour and compulsive drug-taking behaviour (that is, use). In the latter, an individual cannot stop using a drug despite major negative consequences, possibly reflecting an imbalance in frontostriatal circuits that encode reward and aversion. By contrast, an individual may compulsively seek drugs (that is, persist in seeking drugs despite the negative consequences of doing so) when the neural systems that underlie habitual behaviour dominate goal-directed behavioural systems, and when executive control over this maladaptive behaviour is diminished. This distinction between different aspects of addiction may help to identify its neural substrates and new treatment strategies.

Amperometric measurements of cocaine cue and novel context-evoked glutamate and nitric oxide release in the nucleus accumbens core

Cue-induced reinstatement of cocaine seeking after self-administration (SA) and extinction relies on glutamate release in the nucleus accumbens core (NAcore), which activates neuronal nitric oxide synthase interneurons. Nitric oxide (NO) is required for structural plasticity in NAcore medium spiny neurons, as well as cued cocaine seeking. However, NO release in the NAcore during reinstatement has yet to be directly measured. Furthermore, the temporal relationship between glutamate release and the induction of an NO response also remains unknown. Using wireless amperometric recordings in awake behaving rats, we quantified the magnitude and temporal dynamics of novel context- and cue-induced reinstatement-evoked glutamate and NO release in the NAcore. We found that re-exposure to cocaine-conditioned stimuli following SA and extinction increased extracellular glutamate, leading to release of NO in the NAcore. In contrast, exposing drug-naïve rats to a novel context led to a lower magnitude rise in glutamate in the NAcore relative to cue-induced reinstatement. Interestingly, novel context exposure evoked a higher magnitude NO response relative to cue-induced reinstatement. Despite differences in magnitude, novel context evoked-NO release in the NAcore was also temporally delayed when compared to glutamate. These results demonstrate a dissociation between the magnitude of cocaine cue- and novel context-evoked glutamate and NO release in the NAcore, yet similarity in the temporal dynamics of their release. Together, these data contribute to a greater understanding of the relationship between glutamate and NO, two neurotransmitters implicated in encoding the valence of distinct contextual stimuli.

Interfacing behavioral and neural circuit models for habit formation

Habits are an important mechanism by which organisms can automate the control of behavior to alleviate cognitive demand. However, transitions to habitual control are risky because they lead to inflexible responding in the face of change. The question of how the brain controls transitions into habit is thus an intriguing one. How do we regulate when our repeated actions become automated? When is it advantageous or disadvantageous to release actions from cognitive control? Decades of research have identified a variety of methods for eliciting habitual responding in animal models. Progress has also been made to understand which brain areas and neural circuits control transitions into habit. Here, I discuss existing research on behavioral and neural circuit models for habit formation (with an emphasis on striatal circuits), and discuss strategies for combining information from different paradigms and levels of analysis to prompt further progress in the field.

The neurobiology of addiction

Substance and alcohol use disorders impose large health and economic burdens on individuals, families, communities, and society. Neither prevention nor treatment efforts are effective in all individuals. Results are often modest. Advances in neuroscience and addiction research have helped to describe the neurobiological changes that occur when a person transitions from recreational substance use to a substance use disorder or addiction. Understanding both the drivers and consequences of substance use in vulnerable populations, including those whose brains are still maturing, has revealed behavioral and biological characteristics that can increase risks of addiction. These findings are particularly timely, as law- and policymakers are tasked to reverse the ongoing opioid epidemic, as more states legalize marijuana, as new products including electronic cigarettes and newly designed abused substances enter the legal and illegal markets, and as "deaths of despair" from alcohol and drug misuse continue.

Dorsolateral striatal miR-134 modulates excessive methamphetamine intake in self-administering rats

Increasing evidence indicates that excessive drug consumption is sufficient for the transition from recreational and controlled drug use to uncontrolled use and addiction. However, the underlying mechanisms are debated. Some neurobehavioral and neuroimaging evidence indicates that dorsolateral striatum (dlStr)-dependent habit learning plays a key role in excessive drug intake and the transition to addiction, but little is known about the molecular events. The present study investigated whether dlStr miR-134, an important regulator of synaptic transmission and plasticity, is involved in excessive methamphetamine intake. We established excessive and uncontrolled methamphetamine self-administration model in rats by permitting animals extended access to drug (6 h/session/d, LgA group), whereas animals that were limited to access to drug (2 h/session/d, ShA group) exhibited low and controlled self-administration. miR-134 expression in dlStr was significantly increased and its target LIMK1 expression was decreased in the LgA group, but not in the ShA group, compared with the saline control group. However, passive methamphetamine exposure did not alter miR-134 and LIMK1 levels in dlStr. We also found that down-regulation of miR-134 in dlStr through local microinjection of a lentivirus carrying miR-134 sponge (LV-miR-134-Sil) significantly reduced methamphetamine infusions and excessive consumption in LgA group, rather than ShA group. These results indicated that dlStr miR-134, perhaps via its target LIMK1, contributed to excessive and uncontrolled methamphetamine intake, supporting the hypothesis that stimulus-response habit formation is an important mechanism underlying the transition from controlled drug use to uncontrolled drug use and addiction.

Histone deacetylase inhibition differentially attenuates cue-induced reinstatement: An interaction of environment and acH3K9 expression in the dorsal striatum

Substance use disorder is driven by complex gene-environment interactions. Epigenetic histone regulation is a significant contributor to several behavioral phenotypes of drug abuse. The primary epigenetic mechanisms that drive drug taking and drug seeking are still being investigated, and it is unclear how environmental conditions alter epigenetic histone acetylation to change behaviors geared toward drug reward. This study examined the effects of environmental condition on amphetamine self-administration, and whether drug-taking and drug-seeking behaviors could be influenced through inhibition of an epigenetic regulator, histone deacetylase (HDAC). Male rats reared for 30 days in enriched (EC), isolated (IC), or standard conditions (SC) prior to amphetamine (0.03, 0.05, 0.1 mg/kg/infusion, IV) self-administration, extinction, and reinstatement sessions. The HDAC inhibitor, Trichostatin A (TsA; 0.3 mg/kg, IV), was injected 30 min prior to operant sessions. After amphetamine-induced reinstatement (0.25 mg/kg, subcutaneous [s.c.]), tissue was extracted for Western blot analyses of acetylated histone H3 lysine 9 (acH3K9) in the nucleus accumbens (NAc) and dorsal striatum (DSt). While TsA did not significantly affect amphetamine self-administration or extinction, TsA decreased cue-, but not drug-induced reinstatement in IC rats only. In the DSt, but not in the NAc, IC rats exhibited significantly less acH3K9 expression than EC and SC rats, irrespective of TsA treatment. HDAC inhibition decreases cue-induced reinstatement of amphetamine seeking in IC rats. While IC rats exhibit less acH3K9 expression in the DSt, future studies are needed to elucidate the critical epigenetic factors that drive substance abuse, particularly in vulnerable populations. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Here, we review the neural circuit bases of habits, compulsions, and addictions, behaviors which are all characterized by relatively automatic action performance. We discuss relevant studies, primarily from the rodent literature, and describe how major headway has been made in identifying the brain regions and neural cell types whose activity is modulated during the acquisition and performance of these automated behaviors. The dorsal striatum and cortical inputs to this structure have emerged as key players in the wider basal ganglia circuitry encoding behavioral automaticity, and changes in the activity of different neuronal cell-types in these brain regions have been shown to co-occur with the formation of automatic behaviors. We highlight how disordered functioning of these neural circuits can result in neuropsychiatric disorders, such as obsessive-compulsive disorder (OCD) and drug addiction. Finally, we discuss how the next phase of research in the field may benefit from integration of approaches for access to cells based on their genetic makeup, activity, connectivity and precise anatomical location.

Hippocampal BDNF regulates a shift from flexible, goal-directed to habit memory system function following cocaine abstinence

The transition from recreational drug use to addiction involves pathological learning processes that support a persistent shift from flexible, goal‐directed to habit behavioral control. Here, we examined the molecular mechanisms supporting altered function in hippocampal (HPC) and dorsolateral striatum (DLS) memory systems following abstinence from repeated cocaine. After 3 weeks of cocaine abstinence (experimenter‐ or self‐administered), we tested new behavioral learning in male rats using a dual‐solution maze task, which provides an unbiased approach to assess HPC‐ versus DLS‐dependent learning strategies. Dorsal hippocampus (dHPC) and DLS brain tissues were collected after memory testing to identify transcriptional adaptations associated with cocaine‐induced shifts in behavioral learning. Our results demonstrate that following prolonged cocaine abstinence rats show a bias toward the use of an inflexible, habit memory system (DLS) in lieu of a more flexible, easily updated memory system involving the HPC. This memory system bias was associated with upregulation and downregulation of brain‐derived neurotrophic factor (BDNF) gene expression and transcriptionally permissive histone acetylation (acetylated histone H3, AcH3) in the DLS and dHPC, respectively. Using viral‐mediated gene transfer, we overexpressed BDNF in the dHPC during cocaine abstinence and new maze learning. This manipulation restored HPC‐dependent behavioral control. These findings provide a system‐level understanding of altered plasticity and behavioral learning following cocaine abstinence and inform mechanisms mediating the organization of learning and memory more broadly.

Beyond drug-induced alteration of glutamate homeostasis, astrocytes may contribute to dopamine-dependent intrastriatal functional shifts that underlie the development of drug addiction: A working hypothesis

The transition from recreational drug use to compulsive drug‐seeking habits, the hallmark of addiction, has been shown to depend on a shift in the locus of control over behaviour from the ventral to the dorsolateral striatum. This process has hitherto been considered to depend on the aberrant engagement of dopamine‐dependent plasticity processes within neuronal networks. However, exposure to drugs of abuse also triggers cellular and molecular adaptations in astrocytes within the striatum which could potentially contribute to the intrastriatal transitions observed during the development of drug addiction. Pharmacological interventions aiming to restore the astrocytic mechanisms responsible for maintaining homeostatic glutamate concentrations in the nucleus accumbens, that are altered by chronic exposure to addictive drugs, abolish the propensity to relapse in both preclinical and, to a lesser extent, clinical studies. Exposure to drugs of abuse also alters the function of astrocytes in the dorsolateral striatum, wherein dopaminergic mechanisms control drug‐seeking habits, associated compulsivity and relapse. This suggests that drug‐induced alterations in the glutamatergic homeostasis maintained by astrocytes throughout the entire striatum may interact with dopaminergic mechanisms to promote aberrant plasticity processes that contribute to the maintenance of maladaptive drug‐seeking habits. Capitalising on growing evidence that astrocytes play a fundamental regulatory role in glutamate and dopamine transmission in the striatum, we present an innovative model of a quadripartite synaptic microenvironment within which astrocytes channel functional interactions between the dopaminergic and glutamatergic systems that may represent the primary striatal functional unit that undergoes drug‐induced adaptations eventually leading to addiction.

Cue Reactivity in the Ventral Striatum Characterizes Heavy Cannabis Use, Whereas Reactivity in the Dorsal Striatum Mediates Dependent Use

BACKGROUND

Animal models of addiction suggest that the transition from incentive-driven drug use to habitual and ultimately compulsive drug use is mediated by a shift from ventral to dorsal striatal cue control over drug seeking. Previous studies in human cannabis users reported elevated trait impulsivity and neural cue reactivity in striatal circuits; however, these studies were not able to separate addiction-related from exposure-related adaptations.

METHODS

To differentiate the adaptive changes, the current functional magnetic resonance imaging study examined behavioral and neural cue reactivity in dependent (n = 18) and nondependent (n = 20) heavy cannabis users and a nonusing reference group (n = 44).

RESULTS

Irrespective of dependence status, cannabis users demonstrated elevated trait impulsivity as well as increased ventral striatal reactivity and striatal frontal coupling in response to drug cues. Dependent users selectively exhibited dorsal striatal reactivity and decreased striatal limbic coupling during cue exposure. An exploratory analysis revealed that higher ventral caudate neural cue reactivity was associated with stronger cue-induced arousal and craving in dependent users, whereas this pattern was reversed in nondependent users.

CONCLUSIONS

Taken together, the current findings suggest that exaggerated responses of the ventral striatal reward system may promote excessive drug use in humans, whereas adaptations in dorsal striatal systems engaged in habit formation may promote the transition to addictive use.

Compulsive Alcohol Seeking Results from a Failure to Disengage Dorsolateral Striatal Control over Behavior

The acquisition of drug, including alcohol, use is associated with activation of the mesolimbic dopamine system. However, over the course of drug exposure the control over drug seeking progressively devolves to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms. The causal importance of this functional recruitment of aDLS in the switch from controlled to compulsive drug use in vulnerable individuals remains to be established. Here we tested the hypothesis that individual differences in the susceptibility to aDLS dopamine-dependent control over alcohol seeking predicts and underlies the development of compulsive alcohol seeking. Male alcohol-preferring rats, the alcohol-preferring phenotype of which was confirmed in an intermittent two-bottle choice procedure, were implanted bilaterally with cannulae above the aDLS and trained instrumentally on a seeking-taking chained schedule of alcohol reinforcement until some individuals developed compulsive seeking behavior. The susceptibility to aDLS dopamine control over behavior was investigated before and after the development of compulsivity by measuring the extent to which bilateral aDLS infusions of the dopamine receptor antagonist α-flupenthixol (0, 5, 10, and 15 μg/side) decreased alcohol seeking at different stages of training, as follows: (1) after acquisition of instrumental taking responses for alcohol; (2) after alcohol-seeking behavior was well established; and (3) after the development of punishment-resistant alcohol seeking. Only alcohol-seeking, not alcohol-taking, responses became dependent on aDLS dopamine. Further, marked individual differences in the susceptibility of alcohol seeking to aDLS dopamine receptor blockade actually predicted the vulnerability to develop compulsive alcohol seeking, but only in subjects dependent on aDLS dopamine-dependent control.SIGNIFICANCE STATEMENT Over the course of addictive drug exposure, there is a transition in the control over drug seeking from ventral to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms, but it is unclear whether this is causally involved in the development of compulsive drug seeking. We tested the hypothesis that individual differences in the reliance of alcohol seeking on aDLS dopamine predicts and underlies the emergence of compulsive alcohol seeking. We identified individual differences in the reliance of well established alcohol seeking, but not taking behavior, on aDLS mechanisms and also showed that this predicted the subsequent development of compulsive alcohol-seeking behavior. Thus, those individuals in whom alcohol seeking depended on aDLS mechanisms were vulnerable subsequently to display compulsivity.

Neuronal scaffolding protein spinophilin is integral for cocaine-induced behavioral sensitization and ERK1/2 activation

Spinophilin is a scaffolding protein enriched in dendritic spines with integral roles in the regulation of spine density and morphology, and the modulation of synaptic plasticity. The ability of spinophilin to alter synaptic strength appears to involve its scaffolding of key synaptic proteins, including the important structural element F-actin, AMPA/NMDA modulator protein phosphatase 1, and neuromodulatory G-protein coupled receptors, including dopamine receptor D2 and metabotropic glutamate receptor 5. Additionally, spinophilin is highly expressed in the striatum, a brain region that is fundamentally involved in reward-processing and locomotor activity which receives both glutamatergic and dopaminergic inputs. Therefore, we aimed to investigate the role of spinophilin in behavioral responses to cocaine, evaluating wild-type and spinophilin knockout mice followed by the examination of underlying molecular alterations. Although acute locomotor response was not affected, deletion of spinophilin blocked the development and expression of behavioral sensitization to cocaine while maintaining normal conditioned place preference. This behavioral alteration in spinophilin knockout mice was accompanied by attenuated c-Fos and ∆FosB expression following cocaine administration and blunted cocaine-induced phosphorylation of ERK1/2 in the striatum, with no change in other relevant signaling molecules. Therefore, we suggest spinophilin fulfills an essential role in cocaine-induced behavioral sensitization, likely via ERK1/2 phosphorylation and induction of c-Fos and ∆FosB in the striatum, a mechanism that may underlie specific processes in cocaine addiction.

Encoding prediction signals during appetitive and aversive Pavlovian conditioning in the primate lateral hypothalamus

The lateral hypothalamus (LH), which plays a role in homeostatic functions such as appetite regulation, is also linked to arousal and motivational behavior. However, little is known about how these components are encoded in the LH. Thus cynomolgus monkeys were conditioned with two distinct contexts, i.e., an appetitive context with available rewards and an aversive context with predicted air puffs. Different LH neuron groups encoded different degrees of expectation, predictability, and risks of rewards in a specific manner. A nearly equal number of one-third of the recorded LH neurons showed a positive or negative correlation between their response to visual conditioned stimuli (CS) that predicted the probabilistic delivery of rewards (0%, 50%, and 100%) and the associative values. For another one-third of recorded neurons, a nearly equal number showed a positive or negative correlation between their responses to rewards [appetitive unconditioned stimulus (US)] and reward predictability. Some neurons exhibited their highest or lowest trace-period responses in the 50% reward trials. These response modulations were represented independently and overlaid on a consistent excitatory or inhibitory response across the conditioning events. LH neurons also showed consistent responses in the aversive context. However, the responses to aversive conditioning events depending on the air puff value and predictability were less common. The multifaceted modulation of consistent activity related to outcome predictions may reflect motivational and arousal signals. Furthermore, it may underlie the role the LH plays in the integration and relay of signals to cortices for adaptive and goal-directed physiological and behavioral responses to environmental changes.

NEW & NOTEWORTHY The lateral hypothalamus (LH) is implicated in motivational and arousal behavior; however, the detailed information carried by single LH neurons remains unclear. We demonstrate that primate LH neurons encode multiple combinations of signals concerning different degrees of expectation, appreciation, and uncertainty of rewards in consistent responses across conditioning events and between different contexts. This multifaceted modulation of activity may underlie the role of the LH as a critical node integrating motivational signals with arousal signals.

Addictive behaviour in experimental animals: prospects for translation

Since the introduction of intravenous drug self-administration methodology over 50 years ago, experimental investigation of addictive behaviour has delivered an enormous body of data on the neural, psychological and molecular mechanisms of drug reward and reinforcement and the neuroadaptations to chronic use. Whether or not these behavioural and molecular studies are viewed as modelling the underpinnings of addiction in humans, the discussion presented here highlights two areas-the impact of drug-associated conditioned stimuli-or drug cues-on drug seeking and relapse, and compulsive cocaine seeking. The degree to which these findings translate to the clinical state of addiction is considered in terms of the underlying neural circuitry and also the ways in which this understanding has helped develop new treatments for addiction. The psychological and neural mechanisms underlying drug memory reconsolidation and extinction established in animal experiments show particular promise in delivering new treatments for relapse prevention to the clinic.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Dopamine and addiction: what have we learned from 40 years of research

Among the neurotransmitters involved in addiction, dopamine (DA) is clearly the best known. The critical role of DA in addiction is supported by converging evidence that has been accumulated in the last 40 years. In the present review, first we describe the dopaminergic system in terms of connectivity, functioning and involvement in reward processes. Second, we describe the functional, structural, and molecular changes induced by drugs within the DA system in terms of neuronal activity, synaptic plasticity and transcriptional and molecular adaptations. Third, we describe how genetic mouse models have helped characterizing the role of DA in addiction. Fourth, we describe the involvement of the DA system in the vulnerability to addiction and the interesting case of addiction DA replacement therapy in Parkinson's disease. Finally, we describe how the DA system has been targeted to treat patients suffering from addiction and the result obtained in clinical settings and we discuss how these different lines of evidence have been instrumental in shaping our understanding of the physiopathology of drug addiction.