Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum

Withdrawal from escalated cocaine self-administration impairs reversal learning by disrupting the effects of negative feedback on reward exploitation: a behavioral and computational analysis

Addiction is regarded as a disorder of inflexible choice with behavior dominated by immediate positive rewards over longer-term negative outcomes. However, the psychological mechanisms underlying the effects of self-administered drugs on behavioral flexibility are not well understood. To investigate whether drug exposure causes asymmetric effects on positive and negative outcomes we used a reversal learning procedure to assess how reward contingencies are utilized to guide behavior in rats previously exposed to intravenous cocaine self-administration (SA). Twenty-four rats were screened for anxiety in an open field prior to acquisition of cocaine SA over six daily sessions with subsequent long-access cocaine SA for 7 days. Control rats (n = 24) were trained to lever-press for food under a yoked schedule of reinforcement. Higher rates of cocaine SA were predicted by increased anxiety and preceded impaired reversal learning, expressed by a decrease in lose-shift as opposed to win-stay probability. A model-free reinforcement learning algorithm revealed that rats with high, but not low cocaine escalation failed to exploit previous reward learning and were more likely to repeat the same response as the previous trial. Eight-day withdrawal from high cocaine escalation was associated, respectively, with increased and decreased dopamine receptor D2 (DRD2) and serotonin receptor 2C (HTR2C) expression in the ventral striatum compared with controls. Dopamine receptor D1 (DRD1) expression was also significantly reduced in the orbitofrontal cortex of high cocaine-escalating rats. These findings indicate that withdrawal from escalated cocaine SA disrupts how negative feedback is used to guide goal-directed behavior for natural reinforcers and that trait anxiety may be a latent variable underlying this interaction.

Alcohol exposure in utero disrupts cortico-striatal coordination required for behavioral flexibility

Deficits in behavioral flexibility are a hallmark of multiple psychiatric, neurological, and substance use disorders. These deficits are often marked by decreased function of the prefrontal cortex (PFC); however, the genesis of such executive deficits remains understudied. Here we report how the most preventable cause of developmental disability, in utero exposure to alcohol, alters cortico-striatal circuit activity leading to impairments in behavioral flexibility in adulthood. We utilized a translational touch-screen task coupled with in vivo electrophysiology in adult mice to examine single unit and coordinated activity of the lateral orbital frontal cortex (OFC) and dorsolateral striatum (DS) during flexible behavior. Prenatal alcohol exposure (PAE) decreased OFC, and increased DS, single unit activity during reversal learning and altered the number of choice responsive neurons in both regions. PAE also decreased coordinated activity within the OFC and DS as measured by oscillatory field activity and altered spike-field coupling. Furthermore, PAE led to sustained connectivity between regions past what was seen in control animals. These findings suggest that PAE causes altered coordination within and between the OFC and DS, promoting maladaptive perseveration. Our model suggests that in optimally functioning mice OFC disengages the DS and updates the newly changed reward contingency, whereas in PAE animals, aberrant and persistent OFC to DS signaling drives behavioral inflexibility during early reversal sessions. Together, these findings demonstrate how developmental exposure alters circuit-level activity leading to behavioral deficits and suggest a critical role for coordination of neural timing during behaviors requiring executive function.

Hippocampal BDNF regulates a shift from flexible, goal-directed to habit memory system function following cocaine abstinence

The transition from recreational drug use to addiction involves pathological learning processes that support a persistent shift from flexible, goal-directed to habit behavioral control. Here, we examined the molecular mechanisms supporting altered function in hippocampal (HPC) and dorsolateral striatum (DLS) memory systems following abstinence from repeated cocaine. After 3 weeks of cocaine abstinence (experimenter- or self-administered), we tested new behavioral learning in male rats using a dual-solution maze task, which provides an unbiased approach to assess HPC- versus DLS-dependent learning strategies. Dorsal hippocampus (dHPC) and DLS brain tissues were collected after memory testing to identify transcriptional adaptations associated with cocaine-induced shifts in behavioral learning. Our results demonstrate that following prolonged cocaine abstinence rats show a bias toward the use of an inflexible, habit memory system (DLS) in lieu of a more flexible, easily updated memory system involving the HPC. This memory system bias was associated with upregulation and downregulation of brain-derived neurotrophic factor (BDNF) gene expression and transcriptionally permissive histone acetylation (acetylated histone H3, AcH3) in the DLS and dHPC, respectively. Using viral-mediated gene transfer, we overexpressed BDNF in the dHPC during cocaine abstinence and new maze learning. This manipulation restored HPC-dependent behavioral control. These findings provide a system-level understanding of altered plasticity and behavioral learning following cocaine abstinence and inform mechanisms mediating the organization of learning and memory more broadly.

Fractionating the all-or-nothing definition of goal-directed and habitual decision-making

Goal-directed and habitual decision-making are fundamental processes that support the ongoing adaptive behavior. There is a growing interest in examining their disruption in psychiatric disease, often with a focus on a disease shifting control from one process to the other, usually a shift from goal-directed to habitual control. However, several different experimental procedures can be used to probe whether decision-making is under goal-directed or habitual control, including outcome devaluation and contingency degradation. These different experimental procedures may recruit diverse behavioral and neural processes. Thus, there are potentially many opportunities for these disease phenotypes to manifest as alterations to both goal-directed and habitual controls. In this review, we highlight the examples of behavioral and neural circuit divergence and similarity, and suggest that interpretation based on behavioral processes recruited during testing may leave more room for goal-directed and habitual decision-making to coexist. Furthermore, this may improve our understanding of precisely what the involved neural mechanisms underlying aspects of goal-directed and habitual behavior are, as well as how disease affects behavior and these circuits.

Chemogenetic Silencing of Prelimbic Cortex to Anterior Dorsomedial Striatum Projection Attenuates Operant Responding

Operant (instrumental) conditioning is a laboratory analog for voluntary behavior and involves learning to make a response for a reinforcing outcome. The prelimbic cortex (PL), a region of the rodent medial prefrontal cortex, and the dorsomedial striatum (DMS), have been separately established as important in the acquisition of minimally-trained operant behavior. Despite dense anatomical connections between the two regions, experimenters have only recently linked projections from the PL to the posterior DMS (pDMS) in the acquisition of an operant response. Yet, it is still unknown if these projections mediate behavioral expression, and if more anterior regions of the DMS (aDMS), which receive dense projections from the PL, are also involved. Therefore, we utilized designer receptors exclusively activated by designer drugs (DREADDs) to test whether or not projections from the PL to the aDMS influence the expression of operant behavior. Rats underwent bilateral PL-targeted infusions of either a DREADD virus (AAV8-hSyn-hM4D(Gi)-mCherry) or a control virus (AAV8-hSyn-GFP). In addition, guide cannulae were implanted bilaterally in the aDMS. Rats were tested with both clozapine-N-oxide (CNO) (DREADD ligand) and vehicle infusions into the aDMS. Animals that had received the DREADD virus, but not the control virus, showed attenuated responding when they received CNO microinfusions into the aDMS, compared to vehicle infusions. Patch clamp electrophysiology verified the inhibitory effect of CNO on DREADDs-expressing PL neurons in acute brain slices. GFP-expressing control PL neurons were unaffected by CNO. The results add to the recent literature suggesting that connections between the PL and aDMS are important for the expression of minimally-trained operant responding.

Goal-directed control on interval schedules does not depend on the action-outcome correlation

When an organism's action is based on an anticipation of its consequences, that action is said to be goal-directed. It has long been thought that goal-directed control is made possible by experiencing a strong correlation between response rates and reward rates (Dickinson, 1985). To test this idea, we designed a set of experiments to determine whether the response rate-reward rate correlation is a reliable predictor of goal-directed control on interval schedules. In Experiment 1, rats were trained on random interval (RI) schedules in which the response rate-reward rate correlation was manipulated across groups. In tests of reward devaluation, rats behaved in a goal-directed manner regardless of the experienced correlation. In Experiment 2, rats once again experienced either a strong or weak correlation, but on RI schedules with lower overall reward densities. This time, behavior appeared habitual regardless of the experienced correlation. Experiment 3 confirmed that the density of the RI schedule influences goal-directed control, and also revealed that extensive training on these schedules resulted in goal-directed action. Finally, in Experiment 4 goal-directed responding was greater and emerged sooner on fixed than random interval schedules, but, again, was manifest after extensive training on the RI schedule. Taken together, our data suggest that goal-directed and habitual control are not determined by the correlation between response rates and reward rates. We discuss the importance of temporal uncertainty, action-outcome contiguity, and reinforcement probability in goal-directed control. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Inhibition of FGF Receptor-1 Suppresses Alcohol Consumption: Role of PI3 Kinase Signaling in Dorsomedial Striatum

Excessive alcohol intake leads to mesostriatal neuroadaptations, and to addiction phenotypes. We recently found in rodents that alcohol increases fibroblast growth factor 2 (FGF2) expression in the dorsomedial striatum (DMS), which promotes alcohol consumption. Here, we show that systemic or intra-DMS blockade of the FGF2 receptor, FGF receptor-1 (FGFR1), suppresses alcohol consumption, and that the effects of FGF2-FGFR1 on alcohol drinking are mediated via the phosphoinositide 3 kinase (PI3K) signaling pathway. Specifically, we found that sub-chronic alcohol treatment (7 d × 2.5 g/kg, i.p.) increased Fgfr1 mRNA expression in the dorsal hippocampus and dorsal striatum. However, prolonged and excessive voluntary alcohol consumption in a two-bottle choice procedure increased Fgfr1 expression selectively in DMS. Importantly, systemic administration of the FGFR1 inhibitor PD173074 to mice, as well as its infusion into the DMS of rats, decreased alcohol consumption and preference, with no effects on natural reward consumption. Finally, inhibition of the PI3K, but not of the mitogen-activated protein kinase (MAPK) signaling pathway, blocked the effects of FGF2 on alcohol intake and preference. Our results suggest that activation of FGFR1 by FGF2 in the DMS leads to activation of the PI3K signaling pathway, which promotes excessive alcohol consumption, and that inhibition of FGFR1 may provide a novel therapeutic target for alcohol use disorder.SIGNIFICANCE STATEMENT Long-term alcohol consumption causes neuroadaptations in the mesostriatal reward system, leading to addiction-related behaviors. We recently showed that alcohol upregulates the expression of fibroblast growth factor 2 (FGF2) in dorsomedial striatum (DMS) or rats and mice, and in turn, FGF2 increases alcohol consumption. Here, we show that long-term alcohol intake also increases the expression of the FGF2 receptor, FGFR1 in the DMS. Importantly, inhibition of FGFR1 activity by a selective receptor antagonist reduces alcohol drinking, when given systemically or directly into the DMS. We further show that the effects of FGF2-FGFR1 on alcohol drinking are mediated via activation of the PI3K intracellular signaling pathway, providing an insight on the mechanism for this effect.

Genetic Selection for Alcohol Preference in Mice Alters Dorsal Striatum Neurotransmission

BACKGROUND

Although it is widely acknowledged that the risk of developing an alcohol use disorder (AUD) is strongly influenced by genetic factors, very little is known about how this genetic predisposition may alter neurotransmission in a way that promotes AUD susceptibility. The dorsal striatum has garnered increased attention as a brain region of interest in AUD development given its significant roles in goal-directed and habitual behavior.

METHODS

In the present work, dorsal striatal neurotransmission parameters were measured in preclinical mouse models of high and low AUD risk. We performed brain slice whole-cell patch clamp electrophysiological recordings from medium spiny neurons (MSNs) in the dorsomedial (DMS) and dorsolateral (DLS) striatum of naïve adult male and female selectively bred high- and low-alcohol-preferring lines of mice (HAP and LAP).

RESULTS

We found that MSNs of HAP mice were significantly more excitable than those of LAP mice, specifically in the DLS. Additionally, the frequencies of spontaneous glutamate- and GABA-mediated currents were both elevated in HAP mice relative to LAP mice in both dorsal striatal subregions, whereas amplitude differences were more variable between lines and subregions. AMPAR/NMDAR current ratios were significantly lower in HAP mice in both DLS and DMS.

CONCLUSIONS

Collectively, these results suggest that genetic predisposition for high or low alcohol consumption produces significantly different basal functional states within both DLS and DMS which may be important factors in the behavioral phenotypes of HAP and LAP mice.

Contributions of the basal ganglia to action sequence learning and performance

Animals engage in intricately woven and choreographed action sequences that are constructed from trial-and-error learning. The mechanisms by which the brain links together individual actions which are later recalled as fluid chains of behavior are not fully understood, but there is broad consensus that the basal ganglia play a crucial role in this process. This paper presents a comprehensive review of the role of the basal ganglia in action sequencing, with a focus on whether the computational framework of reinforcement learning can capture key behavioral features of sequencing and the neural mechanisms that underlie them. While a simple neurocomputational model of reinforcement learning can capture key features of action sequence learning, this model is not sufficient to capture goal-directed control of sequences or their hierarchical representation. The hierarchical structure of action sequences, in particular, poses a challenge for building better models of action sequencing, and it is in this regard that further investigations into basal ganglia information processing may be informative.

Neuroendocrinological mechanisms underlying impulsive and compulsive behaviors in obesity: a narrative review of fMRI studies

Impulsivity and compulsivity are multidimensional constructs that are increasingly considered determinants of obesity. Studies using functional magnetic resonance imaging (fMRI) have provided insight on how differences in brain response during tasks exploring facets of impulsivity and compulsivity relate to the ingestive behaviors that support the etiology and maintenance of obesity. In this narrative review, we provide an overview of neuroimaging studies exploring impulsivity and compulsivity factors as they relate to weight status. Special focus will be placed on studies examining the impulsivity-related dimensions of attentional bias, delayed gratification and emotion regulation. Discussions of compulsivity within the context of obesity will be restricted to fMRI studies investigating habit formation and response flexibility under shifting contingencies. Further, we will highlight neuroimaging research demonstrating how alterations in neuroendocrine functioning are linked to excessive food intake and may serve as a driver of the impulsive and compulsive behaviors observed in obesity. Research on the associations between brain response with neuroendocrine factors, such as insulin, peptide YY (PYY), leptin, ghrelin and glucagon-like peptide 1 (GLP-1), will be reviewed.

Acute alcohol and cognition: Remembering what it causes us to forget

Addiction has been conceptualized as a specific form of memory that appropriates typically adaptive neural mechanisms of learning to produce the progressive spiral of drug-seeking and drug-taking behavior, perpetuating the path to addiction through aberrant processes of drug-related learning and memory. From that perspective, to understand the development of alcohol use disorders, it is critical to identify how a single exposure to alcohol enters into or alters the processes of learning and memory, so that involvement of and changes in neuroplasticity processes responsible for learning and memory can be identified early. This review characterizes the effects produced by acute alcohol intoxication as a function of brain region and memory neurocircuitry. In general, exposure to ethanol doses that produce intoxicating effects causes consistent impairments in learning and memory processes mediated by specific brain circuitry, whereas lower doses either have no effect or produce a facilitation of memory under certain task conditions. Therefore, acute ethanol does not produce a global impairment of learning and memory, and can actually facilitate particular types of memory, perhaps particular types of memory that facilitate the development of excessive alcohol use. In addition, the effects on cognition are dependent on brain region, task demands, dose received, pharmacokinetics, and tolerance. Additionally, we explore the underlying alterations in neurophysiology produced by acute alcohol exposure that help to explain these changes in cognition and highlight future directions for research. Through understanding the impact that acute alcohol intoxication has on cognition, the preliminary changes potentially causing a problematic addiction memory can better be identified.

The neurobiology of addiction

Substance and alcohol use disorders impose large health and economic burdens on individuals, families, communities, and society. Neither prevention nor treatment efforts are effective in all individuals. Results are often modest. Advances in neuroscience and addiction research have helped to describe the neurobiological changes that occur when a person transitions from recreational substance use to a substance use disorder or addiction. Understanding both the drivers and consequences of substance use in vulnerable populations, including those whose brains are still maturing, has revealed behavioral and biological characteristics that can increase risks of addiction. These findings are particularly timely, as law- and policymakers are tasked to reverse the ongoing opioid epidemic, as more states legalize marijuana, as new products including electronic cigarettes and newly designed abused substances enter the legal and illegal markets, and as "deaths of despair" from alcohol and drug misuse continue.

Encoding of the Intent to Drink Alcohol by the Prefrontal Cortex Is Blunted in Rats with a Family History of Excessive Drinking

The prefrontal cortex (PFC) plays a central role in guiding decision making, and its function is altered by alcohol use and an individual's innate risk for excessive alcohol drinking. The primary goal of this work was to determine how neural activity in the PFC guides the decision to drink. Towards this goal, the within-session changes in neural activity were measured from medial PFC (mPFC) of rats performing a drinking procedure that allowed them to consume or abstain from alcohol in a self-paced manner. Recordings were obtained from rats that either lacked or expressed an innate risk for excessive alcohol intake, Wistar or alcohol-preferring (P) rats, respectively. Wistar rats exhibited patterns of neural activity consistent with the intention to drink or abstain from drinking, whereas these patterns were blunted or absent in P rats. Collectively, these data indicate that neural activity patterns in mPFC associated with the intention to drink alcohol are influenced by innate risk for excessive alcohol drinking. This observation may indicate a lack of control over the decision to drink by this otherwise well-validated supervisory brain region.

Recruitment and disruption of ventral pallidal cue encoding during alcohol seeking

A critical area of inquiry in the neurobiology of alcohol abuse is the mechanism by which cues gain the ability to elicit alcohol use. Previously, we found that cue-evoked activity in rat ventral pallidum robustly encodes the value of sucrose cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue-evoked activity and behavioral latency after instrumental training (Richard et al., 2018, Elife, 7, e33107). Here, we assessed: (a) ventral pallidal representations of Pavlovian versus instrumental cues trained with alcohol reward, and (b) the impact of non-associative alcohol exposure on ventral pallidal representations of sucrose cues. Decoding of cue identity based on ventral pallidum firing was blunted for the Pavlovian alcohol cue in comparison to both the instrumental cue trained with alcohol and either cue type trained with sucrose. Further, non-associative alcohol exposure had opposing effects on ventral pallidal encoding of sucrose cues trained on instrumental versus Pavlovian associations, enhancing decoding accuracy for an instrumental discriminative stimulus and reducing decoding accuracy for a Pavlovian conditioned stimulus. These findings suggest that alcohol exposure can drive biased engagement of specific reward-related signals in the ventral pallidum.

Novel Adenosine Analog, N6-(4-Hydroxybenzyl)-Adenosine, Dampens Alcohol Drinking and Seeking Behaviors

Adenosine signaling is associated with ethanol-related behaviors. We previously found that adenosine A_2A receptor (A_2AR) activation dampens ethanol drinking behaviors in equilibrative nucleoside transporter 1 (ENT1) knockout mice, and A_2AR inhibition augments reward-seeking behavior in wild-type mice. The novel adenosine analog N6-(4-hydroxybenzyl)-adenosine (NHBA), which is isolated from the rhizomes of Gastrodia elata, activates A_2AR and inhibits ENT1. Here, we examined the effects of NHBA on ethanol drinking in the two-bottle choice test and operant ethanol seeking behaviors. We selected mice exhibiting high ethanol drinking behavior in the two-bottle choice test. NHBA (0.1 mg/kg, i.p.) reduced ethanol drinking behavior in a limited-access 3-hour drinking session in high-consumption ethanol drinking mice, and NHBA (0.1 mg/kg, i.p.) did not alter locomotor activity in the open-field test. Operant conditioning with 10% ethanol and 10% sucrose (10E10S) reward increased zone entries and time spent in the ethanol zone, while NHBA (0.1 mg/kg, i.p.) dampened ethanol zone preference in the Y-maze. Furthermore, NHBA (0.1 mg/kg, i.p.) devalued 10E10S and 10% ethanol (10E) reward after operant conditioning with 10E10S and 10E. Taken together, NHBA through A_2AR activation and ENT1 modulation may dampen ethanol drinking and seeking behaviors, suggesting that NHBA is a potential therapeutic agent for treating alcohol use disorder. SIGNIFICANCE STATEMENT: Our work highlights that A_2AR activation and ENT1 inhibition by a novel adenosine analog isolated from Gastrodia elata, N6-(4-hydroxybenzyl)-adenosine, decreases ethanol drinking and seeking behaviors. We suggest that NHBA is a potential therapeutic agent to treat alcohol use disorder.

Could the link between drug addiction in adulthood and substance use in adolescence result from a blurring of the boundaries between incentive and hedonic processes?

There is a broad consensus that the development of drug addiction in adulthood is closely linked to the onset of drug use in adolescence. However, the relationship between drug exposure during adolescence and subsequent vulnerability to addiction is yet to be fully understood. This review will first use evidence from adult studies on reward and addiction to give an up-to-date reference point of normal reward-circuitry and the maladaptive changes that later occur in addiction. This will then be compared with current evidence from adolescent studies on reward-circuitry. Similarities between the reward processes governing characteristic behavioral traits in adolescence and the reward profile in adult addiction could help to explain why the risk of later developing addiction is increased when substance use is initiated in adolescence. We argue that the age of onset is a major risk factor in the development of substance use disorder due to a blurring of the boundaries between incentive and hedonic processes, which occurs during adolescence. A deeper understanding of the processes that mediate this blurring could open new avenues for the prevention and treatment of adult drug addiction.

Dorsolateral striatal miR-134 modulates excessive methamphetamine intake in self-administering rats

Increasing evidence indicates that excessive drug consumption is sufficient for the transition from recreational and controlled drug use to uncontrolled use and addiction. However, the underlying mechanisms are debated. Some neurobehavioral and neuroimaging evidence indicates that dorsolateral striatum (dlStr)-dependent habit learning plays a key role in excessive drug intake and the transition to addiction, but little is known about the molecular events. The present study investigated whether dlStr miR-134, an important regulator of synaptic transmission and plasticity, is involved in excessive methamphetamine intake. We established excessive and uncontrolled methamphetamine self-administration model in rats by permitting animals extended access to drug (6 h/session/d, LgA group), whereas animals that were limited to access to drug (2 h/session/d, ShA group) exhibited low and controlled self-administration. miR-134 expression in dlStr was significantly increased and its target LIMK1 expression was decreased in the LgA group, but not in the ShA group, compared with the saline control group. However, passive methamphetamine exposure did not alter miR-134 and LIMK1 levels in dlStr. We also found that down-regulation of miR-134 in dlStr through local microinjection of a lentivirus carrying miR-134 sponge (LV-miR-134-Sil) significantly reduced methamphetamine infusions and excessive consumption in LgA group, rather than ShA group. These results indicated that dlStr miR-134, perhaps via its target LIMK1, contributed to excessive and uncontrolled methamphetamine intake, supporting the hypothesis that stimulus-response habit formation is an important mechanism underlying the transition from controlled drug use to uncontrolled drug use and addiction.

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Here, we review the neural circuit bases of habits, compulsions, and addictions, behaviors which are all characterized by relatively automatic action performance. We discuss relevant studies, primarily from the rodent literature, and describe how major headway has been made in identifying the brain regions and neural cell types whose activity is modulated during the acquisition and performance of these automated behaviors. The dorsal striatum and cortical inputs to this structure have emerged as key players in the wider basal ganglia circuitry encoding behavioral automaticity, and changes in the activity of different neuronal cell-types in these brain regions have been shown to co-occur with the formation of automatic behaviors. We highlight how disordered functioning of these neural circuits can result in neuropsychiatric disorders, such as obsessive-compulsive disorder (OCD) and drug addiction. Finally, we discuss how the next phase of research in the field may benefit from integration of approaches for access to cells based on their genetic makeup, activity, connectivity and precise anatomical location.

Indirect Medium Spiny Neurons in the Dorsomedial Striatum Regulate Ethanol-Containing Conditioned Reward Seeking

Adenosine 2A receptor (A_2AR)-containing indirect medium spiny neurons (iMSNs) in the dorsomedial striatum (DMS) contribute to reward-seeking behaviors. However, those roles for ethanol-seeking behaviors remain unknown. To investigate ethanol-seeking behaviors, we used an ethanol-containing reward (10% ethanol and 10% sucrose solution; 10E10S). Upon conditioning with 10E10S, mice that initially only preferred 10% sucrose, not 10E10S, showed a stronger preference for 10E10S. Then, we investigated whether the manipulation of the DMS-external globus pallidus (GPe) iMSNs circuit alters the ethanol-containing reward (10E10S) seeking behaviors using the combination of pharmacologic and optogenetic approaches. DMS A_2AR activation dampened operant conditioning-induced ethanol-containing reward, whereas A_2AR antagonist abolished the effects of the A_2AR agonist and restored ethanol-containing reward-seeking. Moreover, pre-ethanol exposure potentiated the A_2AR-dependent reward-seeking. Interestingly, mice exhibiting ethanol-containing reward-seeking showed the reduction of the DMS iMSNs activity, suggesting that disinhibiting iMSNs decreases reward-seeking behaviors. In addition, we found that A_2AR activation reversed iMSNs neural activity in the DMS. Similarly, optogenetic stimulation of the DMS-GPe iMSNs reduced ethanol-containing reward-seeking, whereas optogenetic inhibition of the DMS-GPe iMSNs reversed this change. Together, our study demonstrates that DMS A_2AR and iMSNs regulate ethanol-containing reward-seeking behaviors.SIGNIFICANCE STATEMENT Our findings highlight the mechanisms of how operant conditioning develops the preference of ethanol-containing conditioned reward. Mice exhibiting ethanol-containing reward-seeking showed a reduction of the indirect medium spiny neuronal activity in the dorsomedial striatum. Pharmacological activation of adenosine A_2A receptor (A_2AR) or optogenetic activation of indirect medium spiny neurons dampened operant conditioned ethanol-containing reward-seeking, whereas inhibiting this neuronal activity restored ethanol-containing reward-seeking. Furthermore, repeated intermittent ethanol exposure potentiated A_2AR-dependent reward-seeking. Therefore, our finding suggests that A_2AR-containing indirect medium spiny neuronal activation reduces ethanol-containing reward-seeking, which may provide a potential therapeutic target for alcohol use disorder.

Presynaptic Ethanol Actions: Potential Roles in Ethanol Seeking

Ethanol produces intoxication through actions on numerous molecular and cellular targets. Adaptations involving these and other targets contribute to chronic drug actions that underlie continued and problematic drinking. Among the mechanisms involved in these ethanol actions are alterations in presynaptic mechanisms of synaptic transmission, including presynaptic protein function and excitation-secretion coupling. At synapses in the central nervous system (CNS), excitation-secretion coupling involves ion channel activation followed by vesicle fusion and neurotransmitter release. These mechanisms are altered by presynaptic neurotransmitter receptors and prominently by G protein-coupled receptors (GPCRs). Studies over the last 20-25 years have revealed that acute ethanol exposure alters neurotransmitter secretion, with especially robust effects on synapses that use the neurotransmitter gamma-aminobutyric acid (GABA). Intracellular signaling pathways involving second messengers such as cyclic AMP and calcium are implicated in these acute ethanol actions. Ethanol-induced release of neuropeptides and small molecule neurotransmitters that act on presynaptic GPCRs also contribute to presynaptic potentiation at synapses in the amygdala and hippocampus and inhibition of GABA release in the striatum. Prolonged exposure to ethanol alters neurotransmitter release at many CNS GABAergic and glutamatergic synapses, and changes in GPCR function are implicated in many of these neuroadaptations. These presynaptic neuroadaptations appear to involve compensation for acute drug effects at some synapses, but "allostatic" effects that result in long-term resetting of synaptic efficacy occur at others. Current investigations are determining how presynaptic neuroadaptations contribute to behavioral changes at different stages of alcohol drinking, with increasing focus on circuit adaptations underlying these behaviors. This chapter will discuss the acute and chronic presynaptic effects of ethanol in the CNS, as well as some of the consequences of these effects in amygdala and corticostriatal circuits that are related to excessive seeking/drinking and ethanol abuse.

Optogenetic control of alcohol-seeking behavior via the dorsomedial striatal circuit

Alcohol consumption alters glutamatergic transmission in many brain regions, including the dorsomedial striatum (DMS); this aberrant plasticity is thought to be responsible for alcohol-seeking behavior. Recent studies reported that alcohol induced such plasticity specifically in direct pathway spiny projection neurons (dSPNs) of the DMS. However, it is unknown how this specific change contributes to alcohol-seeking behavior and relapse. Here, we first demonstrated that operant alcohol self-administration increased NMDA receptor activity in DMS dSPNs. Next, we found that optogenetic inhibition of dSPNs reversibly decreased operant lever presses for alcohol and alcohol intake. Furthermore, optogenetic stimulation of corticostriatal inputs at low and moderate frequencies induced reliable LTD in DMS slices. Surprisingly, in vivo delivery of the LTD-inducing protocol increased operant alcohol self-administration; this effect was blocked by a D2R antagonist. Importantly, LTD induction in the presence of both D1 and D2 receptor antagonists produced a long-lasting decrease in operant alcohol self-administration. Our results suggest that suppressing DMS dSPNs activity and their cortical inputs represents a novel treatment mechanism for alcohol use disorder.

Sex Differences in Ethanol Reward Seeking Under Conflict in Mice

BACKGROUND

Alcohol use disorders are characterized by inflexible alcohol seeking that occurs despite adverse consequences. Males and females are differentially sensitive to ethanol (EtOH) reward, but it is unclear whether sex differences in EtOH seeking under reward-aversion conflict are present.

METHODS

To investigate sex differences in EtOH seeking under conflict, adult male and female C57BL/6J mice underwent chronic intermittent EtOH (CIE) exposure by vapor inhalation or served as air-exposed controls. After CIE, mice were trained in a modified EtOH conditioned place preference paradigm. During 3 conditioning sessions, 2 g/kg EtOH was administered prior to confinement in the "EtOH-paired" chamber. On alternating days, saline was injected prior to confinement in the "saline-paired" chamber. After conditioning, mice experienced a footshock in the EtOH-paired chamber. EtOH-seeking behavior was assessed before and after footshock.

RESULTS

Control and CIE-exposed males reduced the time spent in and increased latency to enter the reward-paired chamber following footshock. Control females did not alter EtOH-seeking behavior following footshock. CIE-exposed females spent more time in the EtOH-paired chamber at baseline. However, following a footshock, CIE-exposed females significantly reduced the time spent in and increased latency to enter the EtOH-paired chamber.

CONCLUSIONS

Nondependent female mice exhibited aversion-resistant alcohol seeking to a greater degree than males. Chronic EtOH exposure did not impact EtOH seeking in males. In females, CIE enhanced EtOH seeking in the absence of conflict, but reduced EtOH seeking after an aversive experience. While these sex-specific effects of CIE are not present when reward seeking is assessed in the absence of an aversive experience, multiple factors may underlie the differences in reward seeking despite adverse consequences, including reward- and aversion-related learning and decision making under conflict. These data highlight the importance of considering sex as a variable influencing EtOH seeking and provide a greater understanding of how sex interacts with EtOH exposure to alter behavior.

Beyond drug-induced alteration of glutamate homeostasis, astrocytes may contribute to dopamine-dependent intrastriatal functional shifts that underlie the development of drug addiction: A working hypothesis

The transition from recreational drug use to compulsive drug‐seeking habits, the hallmark of addiction, has been shown to depend on a shift in the locus of control over behaviour from the ventral to the dorsolateral striatum. This process has hitherto been considered to depend on the aberrant engagement of dopamine‐dependent plasticity processes within neuronal networks. However, exposure to drugs of abuse also triggers cellular and molecular adaptations in astrocytes within the striatum which could potentially contribute to the intrastriatal transitions observed during the development of drug addiction. Pharmacological interventions aiming to restore the astrocytic mechanisms responsible for maintaining homeostatic glutamate concentrations in the nucleus accumbens, that are altered by chronic exposure to addictive drugs, abolish the propensity to relapse in both preclinical and, to a lesser extent, clinical studies. Exposure to drugs of abuse also alters the function of astrocytes in the dorsolateral striatum, wherein dopaminergic mechanisms control drug‐seeking habits, associated compulsivity and relapse. This suggests that drug‐induced alterations in the glutamatergic homeostasis maintained by astrocytes throughout the entire striatum may interact with dopaminergic mechanisms to promote aberrant plasticity processes that contribute to the maintenance of maladaptive drug‐seeking habits. Capitalising on growing evidence that astrocytes play a fundamental regulatory role in glutamate and dopamine transmission in the striatum, we present an innovative model of a quadripartite synaptic microenvironment within which astrocytes channel functional interactions between the dopaminergic and glutamatergic systems that may represent the primary striatal functional unit that undergoes drug‐induced adaptations eventually leading to addiction.

Outcome-specific Pavlovian-to-instrumental transfer (PIT) with alcohol cues and its extinction

The acquired motivational impact of conditioned stimuli has been studied using the Pavlovian-to-instrumental transfer (PIT) task, where a cue paired with a reward is consistently shown to energize responses separately trained with that same reward ("specific" PIT). However, most alcohol studies have shown that alcohol-related cues elevate responses trained with either the same alcohol reward or with other non-alcoholic rewards ("general" PIT). The effects of extinction on this alcohol PIT effect have not been fully explored. We tested the hypothesis that cues signaling different-tasting alcohols might acquire specific craving reactions for those alcohols leading to specific PIT, but that these effects might be sensitive to extinction. Three experiments examined the specificity of PIT using alcohol and non-alcohol outcomes. Rats first consumed different-flavored alcohol solutions in their home cages. Then they were trained to perform two responses, each reinforced with distinctly flavored solutions, using a Polycose fading procedure. The outcomes were sweet (4% sucrose) or salty (0.9% NaCl) ethanol (10% v/v) solutions (Experiments 1 and 2) or one plain or salty alcohol vs. a non-alcoholic sweet solution (Experiment 3). Then, two cues were each differentially paired with these outcomes. In PIT tests, animals performed both responses in the presence and absence of these cues without any rewards. Experiments 1, 2, and 3 showed that a cue paired with a flavored alcohol produced a small but consistent bias toward the response trained with the same alcohol solution (specific PIT). Experiment 2 showed that extinction eliminated this effect. Experiment 3 demonstrated that specific PIT occurred when contrasting salty, or plain, alcohol to a non-alcoholic solution. These results provide evidence that alcohol-related stimuli can elicit craving for specific types of alcohol (as revealed by specific PIT), but that this effect is sensitive to extinction. This paradigm of contrasting two distinctly flavored alcohols may be an especially useful animal model of alcohol addiction.

Impaired cognitive flexibility following NMDAR-GluN2B deletion is associated with altered orbitofrontal-striatal function

A common feature across neuropsychiatric disorders is inability to discontinue an action or thought once it has become detrimental. Reversal learning, a hallmark of executive control, requires plasticity within cortical, striatal and limbic circuits and is highly sensitive to disruption of N-methyl-D-aspartate receptor (NMDAR) function. In particular, selective deletion or antagonism of GluN2B containing NMDARs in cortical regions including the orbitofrontal cortex (OFC), promotes maladaptive perseveration. It remains unknown whether GluN2B functions to maintain local cortical activity necessary for reversal learning, or if it exerts a broader influence on the integration of neural activity across cortical and subcortical systems. To address this question, we utilized in vivo electrophysiology to record neuronal activity and local field potentials (LFP) in the orbitofrontal cortex and dorsal striatum (dS) of mice with deletion of GluN2B in neocortical and hippocampal principal cells while they performed touchscreen reversal learning. Reversal impairment produced by corticohippocampal GluN2B deletion was paralleled by an aberrant increase in functional connectivity between the OFC and dS. These alterations in coordination were associated with alterations in local OFC and dS firing activity. These data demonstrate highly dynamic patterns of cortical and striatal activity concomitant with reversal learning, and reveal GluN2B as a molecular mechanism underpinning the timing of these processes.

Compulsivity in Alcohol Use Disorder and Obsessive Compulsive Disorder: Implications for Neuromodulation

Alcohol use Disorder (AUD) is one of the leading causes of morbidity and mortality worldwide. The progression of the disorder is associated with the development of compulsive alcohol use, which in turn contributes to the high relapse rate and poor longer term functioning reported in most patients, even with treatment. While the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) defines AUD by a cluster of symptoms, parsing its heterogeneous phenotype by domains of behavior such as compulsivity may be a critical step to improve outcomes of this condition. Still, neurobiological underpinnings of compulsivity need to be fully elucidated in AUD in order to better design targeted treatment strategies. In this manuscript, we review and discuss findings supporting common mechanisms between AUD and OCD, dissecting the construct of compulsivity and focusing specifically on characteristic disruptions in habit learning and cognitive control in the two disorders. Finally, neuromodulatory interventions are proposed as a probe to test compulsivity as key pathophysiologic feature of AUD, and as a potential therapy for the subgroup of individuals with compulsive alcohol use, i.e., the more resistant stage of the disorder. This transdiagnostic approach may help to destigmatize the disorder, and suggest potential treatment targets across different conditions.

Voluntary Ethanol Intake Produces Subregion-Specific Neuroadaptations in Striatal and Cortical Areas of Wistar Rats

BACKGROUND

Addiction has been conceptualized as a shift from controlled recreational use toward compulsive and habitual drug-taking behavior. Although the brain reward system is vital for alcohol reward and reinforcement, other neuronal circuits may be involved in controlling long-term alcohol-seeking and drug-taking behaviors. The aim of this study was to outline alcohol-induced neuroplasticity in defined cortical and striatal subregions, previously implicated in alcohol use disorder.

METHODS

Male Wistar rats were allowed to voluntarily consume ethanol (EtOH) in an intermittent manner for 2 months, after which ex vivo electrophysiological recordings were performed and data compared with isolated water controls housed in parallel.

RESULTS

Field potential recordings revealed an increase in field excitatory postsynaptic potentials (fEPSPs) in the dorsomedial striatum (DMS) of rats consuming EtOH, while a depression of evoked potentials was detected in the dorsolateral striatum (DLS). Mean activity in cortical (medial prefrontal cortex, lateral orbitofrontal cortex [OFC]), and accumbal regions (nucleus accumbens [nAc] core/shell) was not significantly altered as compared to water-drinking controls, but a correlation between the amount of alcohol consumed and evoked potentials could be found in both dorsal striatal subregions, OFC, and nAc core. Removal of EtOH for 1 to 2 days was sufficient to restore neurotransmission in the DLS, while the increase in fEPSP amplitude sustained in the DMS.

CONCLUSIONS

These preclinical findings are in line with clinical observations indicating that alcohol produces neurophysiological transformations in dorsal striatal circuits, which in turn may lead to disruptions in decision-making processes that could further promote alcohol misuse.

Nicotine Produces a High-Approach, Low-Avoidance Phenotype in Response to Alcohol-Associated Cues in Male Rats

BACKGROUND

Nicotine and alcohol use are highly comorbid. Modulation of drug-paired extrinsic and intrinsic cues likely plays a role in this interaction, as cues can acquire motivational properties and augment drug seeking. The motivational properties of cues can be measured through Pavlovian conditioning paradigms, in which cues either elicit approach following pairing with the reinforcing properties of alcohol or elicit avoidance following pairing with the aversive consequences of alcohol. The present experiments tested whether nicotine would enhance the incentive properties of an appetitive ethanol (EtOH) cue and diminish the avoidance of an aversive EtOH cue in Pavlovian paradigms.

METHODS

In experiment 1, male Long-Evans rats with or without prior chronic intermittent access to EtOH were administered nicotine or saline injections prior to Pavlovian conditioned approach (PavCA) sessions, during which conditioned approach to the cue ("sign-tracking") or the EtOH delivery location ("goal-tracking") was measured. In experiment 2, male Long-Evans rats were administered nicotine or saline injections prior to pairing a flavor cue with increasing doses of EtOH (i.p.) in an adaptation of the conditioned taste avoidance (CTA) paradigm.

RESULTS

Results from PavCA indicate that, regardless of EtOH exposure, nicotine enhanced responding elicited by EtOH-paired cues with no effect on a similar cue not explicitly paired with EtOH. Furthermore, nicotine reduced sensitivity to EtOH-induced CTA, as indicated by a rightward shift in the dose-response curve of passively administered EtOH. The ED₅₀ , or the dose of EtOH that produced a 50% reduction in intake relative to baseline, was significantly higher in nicotine-treated rats compared to saline-treated rats.

CONCLUSIONS

We conclude that nicotine increases the approach and diminishes the avoidance elicited by Pavlovian cues paired, respectively, with the reinforcing and aversive properties of EtOH consumption in male rats. As such, nicotine may enhance alcoholism liability by engendering an attentional bias toward cues that predict the reinforcing outcomes of drinking.

Inflexible habitual decision-making during choice between cocaine and a nondrug alternative

The concept of compulsive cocaine-seeking habits is difficult to reconcile with other evidence showing that humans and even rats remain able to shift their choice away from the drug and toward an alternative nondrug reward, when available. This paradox could dissolve if preference for the nondrug option reflected in fact inflexible habitual decision-making (i.e., fixed in a habitual control mode, with no return to a goal-directed control mode). Previous research in rats has shown that prior drug use can favor habit formation, but whether the resulting habits are inflexible or not is largely unknown. Here we addressed this question by manipulating the value of water in rats that chose between water and cocaine in a discrete-trials procedure. Rats preferred water when thirsty and maintained this preference despite water devaluation by satiation. Only with repeated daily testing under water satiation did they progressively reverse their preference toward cocaine. Additional evidence showed that this progressive reversal of preference reflected in fact new interoceptive discrimination learning. Overall, this study suggests that rats seem to be stuck in a habitual decision-making mode, unable to return to a goal-directed mode upon experiencing a change in options value. It also reveals that inflexible decision-making does not necessarily promote drug choice, but can also under some circumstances favor abstinence.

Compulsive Alcohol Seeking Results from a Failure to Disengage Dorsolateral Striatal Control over Behavior

The acquisition of drug, including alcohol, use is associated with activation of the mesolimbic dopamine system. However, over the course of drug exposure the control over drug seeking progressively devolves to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms. The causal importance of this functional recruitment of aDLS in the switch from controlled to compulsive drug use in vulnerable individuals remains to be established. Here we tested the hypothesis that individual differences in the susceptibility to aDLS dopamine-dependent control over alcohol seeking predicts and underlies the development of compulsive alcohol seeking. Male alcohol-preferring rats, the alcohol-preferring phenotype of which was confirmed in an intermittent two-bottle choice procedure, were implanted bilaterally with cannulae above the aDLS and trained instrumentally on a seeking-taking chained schedule of alcohol reinforcement until some individuals developed compulsive seeking behavior. The susceptibility to aDLS dopamine control over behavior was investigated before and after the development of compulsivity by measuring the extent to which bilateral aDLS infusions of the dopamine receptor antagonist α-flupenthixol (0, 5, 10, and 15 μg/side) decreased alcohol seeking at different stages of training, as follows: (1) after acquisition of instrumental taking responses for alcohol; (2) after alcohol-seeking behavior was well established; and (3) after the development of punishment-resistant alcohol seeking. Only alcohol-seeking, not alcohol-taking, responses became dependent on aDLS dopamine. Further, marked individual differences in the susceptibility of alcohol seeking to aDLS dopamine receptor blockade actually predicted the vulnerability to develop compulsive alcohol seeking, but only in subjects dependent on aDLS dopamine-dependent control.SIGNIFICANCE STATEMENT Over the course of addictive drug exposure, there is a transition in the control over drug seeking from ventral to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms, but it is unclear whether this is causally involved in the development of compulsive drug seeking. We tested the hypothesis that individual differences in the reliance of alcohol seeking on aDLS dopamine predicts and underlies the emergence of compulsive alcohol seeking. We identified individual differences in the reliance of well established alcohol seeking, but not taking behavior, on aDLS mechanisms and also showed that this predicted the subsequent development of compulsive alcohol-seeking behavior. Thus, those individuals in whom alcohol seeking depended on aDLS mechanisms were vulnerable subsequently to display compulsivity.

Low cognitive flexibility as a risk for heavy alcohol drinking in non-human primates

Chronic alcohol abuse is frequently considered a habitual or inflexible behavior; however, measures of pre-existing cognitive flexibility prior to initiation of alcohol use are usually not available. This study used rhesus monkeys and an attentional set-shifting task to investigate whether pre-existing cognitive flexibility would predict increased risk for heavy alcohol drinking. As previously reported, monkeys were given 30 daily set-shifting sessions prior to alcohol access. These sessions consisted of the same sequence of eight unique visual discriminations (sets) of two objects that varied on two dimensions (shapes and colors). The ratio of errors per trials, session duration, and maximum set reached were primary dependent variables from each session and were used to compose a session performance index (PI) that ranged from a low performance PI of 31 to an optimal performance PI of 247. Here, animals underwent an alcohol induction period followed by 22 weeks of daily (22-h) self-administration sessions with free access to water and alcohol. Based on average daily alcohol intake during 22 weeks of 22-h/day access, the monkeys were categorized as non-heavy (mean = 2.0 ± 0.3 g/kg/day; n = 3) and heavy (mean = 3.3 ± 0.5 g/kg/day; n = 6) drinkers. The two groups diverged in performance on the set-shifting task across the 30 pre-alcohol sessions, and at the end of the pre-alcohol testing, the group average PI was 216 ± 27 and 137 ± 71 for the future non-heavy and heavy drinkers, respectively. The data show that low cognitive flexibility assessed with a set-shifting procedure was predictive of future classification as a heavy alcohol drinker. The data highlight individual differences in both cognitive flexibility and in alcohol self-administration in this population of rhesus monkeys.

Addictive behaviour in experimental animals: prospects for translation

Since the introduction of intravenous drug self-administration methodology over 50 years ago, experimental investigation of addictive behaviour has delivered an enormous body of data on the neural, psychological and molecular mechanisms of drug reward and reinforcement and the neuroadaptations to chronic use. Whether or not these behavioural and molecular studies are viewed as modelling the underpinnings of addiction in humans, the discussion presented here highlights two areas-the impact of drug-associated conditioned stimuli-or drug cues-on drug seeking and relapse, and compulsive cocaine seeking. The degree to which these findings translate to the clinical state of addiction is considered in terms of the underlying neural circuitry and also the ways in which this understanding has helped develop new treatments for addiction. The psychological and neural mechanisms underlying drug memory reconsolidation and extinction established in animal experiments show particular promise in delivering new treatments for relapse prevention to the clinic.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Translational tests involving non-reward: methodological considerations

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson's disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Modelling Differential Vulnerability to Substance Use Disorder in Rodents: Neurobiological Mechanisms

Despite the prevalence of drug use within society, only a subset of individuals actively taking addictive drugs lose control over their intake and develop compulsive drug-seeking and intake that typifies substance use disorder (SUD). Although research in this field continues to be an important and dynamic discipline, the specific neuroadaptations that drive compulsive behaviour in humans addicted to drugs and the neurobiological mechanisms that underlie an individual's innate susceptibility to SUD remain surprisingly poorly understood. Nonetheless, it is clear from research within the clinical domain that some behavioural traits are recurrently co-expressed in individuals with SUD, thereby inviting the hypothesis that certain behavioural endophenotypes may be predictive, or at least act in some way, to modify an individual's probability for developing this disorder. The analysis of such endophenotypes and their catalytic relationship to the expression of addiction-related behaviours has been greatly augmented by experimental approaches in rodents that attempt to capture diagnostically relevant aspects of this progressive brain disorder. This work has evolved from an early focus on aberrant drug reinforcement mechanisms to a now much richer account of the putatively impaired cognitive control processes that ultimately determine individual trajectories to compulsive drug-related behaviours. In this chapter we discuss the utility of experimental approaches in rodents designed to elucidate the neurobiological and genetic underpinnings of so-called risk traits and how these innate vulnerabilities collectively contribute to the pathogenesis of SUD.

Behavioral and neural mechanisms underlying habitual and compulsive drug seeking

Addiction is characterized by compulsive drug use despite negative consequences. Here we review studies that indicate that compulsive drug use, and in particular punishment resistance in animal models of addiction, is related to impaired cortical control over habitual behavior. In humans and animals, instrumental behavior is supported by goal-directed and habitual systems that rely on distinct corticostriatal networks. Chronic exposure to addictive drugs or stress has been shown to bias instrumental response strategies toward habit learning, and impair prefrontal cortical (PFC) control over responding. Moreover, recent work has implicated prelimbic PFC hypofunction in the punishment resistance that has been observed in a subset of animals with an extended history of cocaine self-administration. This may be related to a broader role for prelimbic PFC in mediating adaptive responding and behavioral flexibility, including exerting goal-directed control over behavior. We hypothesize that impaired cortical control and reduced flexibility between habitual and goal-directed systems may be critically involved in the development of maladaptive, compulsive drug use.

An extended history of drug self-administration results in multiple sources of control over drug seeking behavior

It is widely recognized that across the development of drug addiction, cues associated with drug use come to exert increasing control over drug seeking and taking behaviors. However, there remain gaps in our knowledge regarding how the different types of drug related cues affect drug seeking and taking behaviors, and how the emergence of cue control over these behaviors relates to the onset of drug seeking compulsions. This paper reviews the literature on drug self-administration in animals to address these gaps. It first identifies the different types of cues that acquire control over reward seeking behavior generally, and examines whether the same types of cues acquire control over drug seeking behavior specifically. It then examines how the role of drug related cues in motivating and reinforcing drug seeking behavior changes across an extended drug-taking history, with a particular focus on the case of nicotine. The evidence reviewed shows that, after an extended history of drug taking, drug seeking behaviors are controlled by contextual cues associated with the development of drug seeking habits, response contingent cues that accompany delivery of the drug, as well as internal states that correlate with levels of drug intake. These multiple sources of control over drug seeking are discussed in relation to the generation of an addicted phenotype in animal models and the hypothesized progression from internal control over drug use to compulsive drug seeking.

Defining the place of habit in substance use disorders

It has long been suggested that alcohol or substance use disorders could emerge from the progressive development and dominance of drug habits. Like habits, drug-related behaviors are often triggered by drug-associated cues. Like habits, addictive behaviors are strong, rigid and "hard to break". Like habits, these behaviors are insensitive to their outcome and persist despite negative consequences. "Pathological habit" thus appears as a good candidate to explain the transition to compulsive drug use. However, drug use could also be considered as a goal-directed choice, driven by the expectation of drug outcomes. For example, drug addicts may engage in drug-seeking behaviors because they view the drug as more valuable than available alternatives. Substance use disorders therefore may not be all about habit, nor fully intentional, and could be considered as resulting from an imbalance between goal-directed and habitual control. The main objective of this review is to disentangle the relative contribution of habit formation and impairment of goal-directed behavior in this unbalanced control of addictive behaviors. Although deficits in goal-directed behavior have been demonstrated in alcohol and substance use disorders, reliable demonstration of abnormal habit formation has been curtailed by the paucity of paradigms designed to assess habit as a positive result. Refining our animal and human model of habit is therefore required to precisely define the place of habit in substance use disorders and develop appropriate and adapted neurobehavioral treatments.

Alternations in functional connectivity of amygdalar subregions under acute social stress

The amygdala has long been considered a vital region involved in acute and chronic stress responses. Extensive evidences from animal and human studies suggest that the functional connectivity of amygdalar subnuclei (basolateral amygdala (BLA), centromedial amygdala (CMA) and superficial amygdala (SFA)) undergo specific alterations in stress-related psychopathology. However, whether and how intrinsic functional connectivity within the amygdalar subcomponents is differently altered in the aftermath of an acute stressor remains unknown. In the present study, using a within-subject design, we examined the impact of acute psychological social stress on the functional connectivity of amygdalar subregions at rest. Results showed that stress mainly affected the connectivity pattern of CMA. In particular, in the stress condition compared with the control, the connectivity of CMA to left posterior cingulate cortex and right thalamus was decreased under stress, while the connectivity of CMA to left caudate connectivity was increased at rest post-stressor. The findings suggest that healthy individuals may adapt to threatening surroundings by reducing threatening information input, and shifting to well-learned procedural behaviors.

Drug-Induced Glucocorticoids and Memory for Substance Use

The biological stress response of the body forms one of the foundations of adaptive behavior, including promoting (and impairing) different forms of memory. This response transcends stressful experiences and underlies reactions to challenges and even reinforcers such as addictive substances. Nevertheless, drug-induced stress responses are rarely incorporated into models of addiction. We propose here that drug-induced stress responses (particularly glucocorticoids) play a crucial role in addictive behavior by modulating the formation of memories for substance-use experiences. We review the contributions of amygdala-, striatum-, and hippocampus-based memory systems to addiction, and reveal common effects of addictive drugs and acute stress on these different memories. We suggest that the contributions of drug-induced stress responses to memory may provide insights into the mechanisms driving addictive behavior.

An Aplysia-like synaptic switch for rapid protection against ethanol-induced synaptic inhibition in a mammalian habit circuit

Decades of work in Aplysia californica established the general rule that principles of synaptic plasticity and their molecular mechanisms are evolutionarily conserved from mollusks to mammals. However, an exquisitely sensitive, activity-dependent homosynaptic mechanism that protects against the depression of neurotransmitter release in Aplysia sensory neuron terminals has, to date, not been uncovered in other animals, including mammals. Here, we discover that depression at a mammalian synapse that is implicated in habit formation and habit learning acceleration by ethanol, the fast-spiking interneuron (FSI) to medium spiny principal projection neuron (MSN) synapse of the dorsolateral striatum, is subject to this type of synaptic protection. We show that this protection against synaptic depression is calcium- and PDZ domain interaction-dependent. These findings support activity dependent protection against synaptic depression as an Aplysia-like synaptic switch in mammals that may represent a leveraging point for treating alcohol use disorders.

Dopaminergic Modulation of Goal-Directed Behavior in a Rodent Model of Attention-Deficit/Hyperactivity Disorder

Aside from its clinical symptoms of inattention, impulsivity and hyperactivity, patients with Attention/Deficit-Hyperactivity Disorder (ADHD) display reward and motivational impairments. These impairments may reflect a deficit in action control, that is, an inability to flexibly adapt behavior to changing consequences. We previously showed that spontaneously hypertensive rats (SHR), an inbred rodent model of ADHD, show impairments in goal-directed action control, and instead are predominated by habits. In this study, we examined the effects of specific dopamine receptor sub-type (D1 and D2) agonists and antagonists on goal-directed behavior in SHR and the normotensive inbred control strain Wistar-Kyoto (WKY) rats. Rats acquired an instrumental response for different-flavored food rewards. A selective-satiety outcome devaluation procedure followed by a choice test in extinction revealed outcome-insensitive habitual behavior in SHR rats. Outcome-sensitive goal-directed behavior was restored in SHR rats following injection prior to the choice test of the dopamine D2 receptor agonist Quinpirole or dopamine D1 receptor antagonist SCH23390, whereas WKY rats showed habitual responding following exposure to these drugs. This novel finding indicates that the core behavioral deficit in ADHD might not be a consequence of dopamine hypofunction, but rather is due to a misbalance between activation of dopamine D1 and D2 receptor pathways that govern action control.

Stimulus control of actions and habits: A role for reinforcer predictability and attention in the development of habitual behavior

Goal-directed actions are instrumental behaviors whose performance depends on the organism's knowledge of the reinforcing outcome's value. In contrast, habits are instrumental behaviors that are insensitive to the outcome's current value. Although habits in everyday life are typically controlled by stimuli that occasion them, most research has studied habits using free-operant procedures in which no discrete stimuli are present to occasion the response. We therefore studied habit learning when rats were reinforced for lever pressing on a random-interval 30-s schedule in the presence of a discriminative stimulus (S) but not in its absence. In Experiment 1, devaluing the reinforcer with taste aversion conditioning weakened instrumental responding in a 30-s S after 4, 22, and 66 sessions of instrumental training. Even extensive practice thus produced goal-directed action, not habit. Experiments 2 and 3 contrastingly found habit when the duration of S was increased from 30 s to 8 min. Experiment 4 then found habit with the 30-s S when it always contained a reinforcer; goal-directed action was maintained when reinforcers were earned at the same rate but occurred in only 50% of Ss (as in the previous experiments). The results challenge the view that habits are an inevitable consequence of repeated reinforcement (as in the law of effect) and instead suggest that discriminated habits develop when the reinforcer becomes predictable. Under those conditions, organisms may pay less attention to their behavior, much as they pay less attention to signals associated with predicted reinforcers in Pavlovian conditioning. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Individual differences in the neuropsychopathology of addiction

Drug addiction or substance-use disorder is a chronically relapsing disorder that progresses through binge/intoxication, withdrawal/negative affect and preoccupation/anticipation stages. These stages represent diverse neurobiological mechanisms that are differentially involved in the transition from recreational to compulsive drug use and from positive to negative reinforcement. The progression from recreational to compulsive substance use is associated with downregulation of the brain reward systems and upregulation of the brain stress systems. Individual differences in the neurobiological systems that underlie the processing of reward, incentive salience, habits, stress, pain, and executive function may explain (i) the vulnerability to substance-use disorder; (ii) the diversity of emotional, motivational, and cognitive profiles of individuals with substance-use disorders; and (iii) heterogeneous responses to cognitive and pharmacological treatments. Characterization of the neuropsychological mechanisms that underlie individual differences in addiction-like behaviors is the key to understanding the mechanisms of addiction and development of personalized pharmacotherapy.

Synaptic plasticity mechanisms common to learning and alcohol use disorder

Alcohol use disorders include drinking problems that span a range from binge drinking to alcohol abuse and dependence. Plastic changes in synaptic efficacy, such as long-term depression and long-term potentiation are widely recognized as mechanisms involved in learning and memory, responses to drugs of abuse, and addiction. In this review, we focus on the effects of chronic ethanol (EtOH) exposure on the induction of synaptic plasticity in different brain regions. We also review findings indicating that synaptic plasticity occurs in vivo during EtOH exposure, with a focus on ex vivo electrophysiological indices of plasticity. Evidence for effects of EtOH-induced or altered synaptic plasticity on learning and memory and EtOH-related behaviors is also reviewed. As this review indicates, there is much work needed to provide more information about the molecular, cellular, circuit, and behavioral consequences of EtOH interactions with synaptic plasticity mechanisms.

Role of Dorsal Striatum Histone Deacetylase 5 in Incubation of Methamphetamine Craving

BACKGROUND

Methamphetamine (meth) seeking progressively increases after withdrawal (incubation of meth craving). We previously demonstrated an association between histone deacetylase 5 (HDAC5) gene expression in the rat dorsal striatum and incubation of meth craving. Here we used viral constructs to study the causal role of dorsal striatum HDAC5 in this incubation.

METHODS

In experiment 1 (overexpression), we injected an adeno-associated virus bilaterally into dorsal striatum to express either green fluorescent protein (control) or a mutant form of HDAC5, which strongly localized to the nucleus. After training rats to self-administer meth (10 days, 9 hours/day), we tested the rats for relapse to meth seeking on withdrawal days 2 and 30. In experiment 2 (knockdown), we injected an adeno-associated virus bilaterally into the dorsal striatum to express a short hairpin RNA either against luciferase (control) or against HDAC5. After training rats to self-administer meth, we tested the rats for relapse on withdrawal days 2 and 30. We also measured gene expression of other HDACs and potential HDAC5 downstream targets.

RESULTS

We found that HDAC5 overexpression in dorsal striatum increased meth seeking on withdrawal day 30 but not day 2. In contrast, HDAC5 knockdown in the dorsal striatum decreased meth seeking on withdrawal day 30 but not on day 2; this manipulation also altered other HDACs (Hdac1 and Hdac4) and potential HDAC5 targets (Gnb4 and Suv39h1).

CONCLUSIONS

Results demonstrate a novel role of dorsal striatum HDAC5 in incubation of meth craving. These findings also set up future work to identify HDAC5 targets that mediate this incubation.

The Action Representation Elicited by Different Types of Drug-Related Cues in Heroin-Abstinent Individuals

Drug related cue-induced reactivity plays a significant role in maintaining drug use and relapse in addicted individuals. The activation of Dorsolateral striatum-Sensorimotor system (DLS-SM) has been suggested as an important route through which drug cues may induce automatic drug using behavior. The current study used fMRI to investigate the reactivity of heroin abstinent individuals to different types of cues, to clarify the characteristics of the cues that induce the activation of the sensorimotor area. Forty heroin-dependent abstinent individuals and 29 healthy subjects were recruited to perform the heroin cue-reactivity task during fMRI. The participants’ subjective craving and physical signs were evaluated before and after scanning. Whole-brain analysis showed that compared to drug use tool and drug cues, cues related to drug use action were more likely to activate posterior central gyrus, para-hippocampus, supra marginal gyrus, superior parietal lobule (SPL) and inferior parietal lobule (IPL). These areas are involved in motor preparation and output, indicating that the sensorimotor area is also an important neural basis of craving and automatic drug using behavior, and may mediate craving and drug seeking behavior. Our findings thus suggest that cues related to drug using action may induce automatic drug seeking behavior more than cues related only to the drug itself.

Acute drug effects on habitual and non-habitual responding in crossed high alcohol preferring mice

RATIONALE

Drug reward plays a central role in acquiring drug-seeking behavior. However, subjects may continue using drugs despite negative consequences because self-administration becomes habitual, and divorced from outcome values. Although a history of drug and alcohol use expedite habit acquisition, and in spite of the fact that self-administration leads to intoxication, the acute effects of drugs on habitual responding are not well understood.

OBJECTIVES

We sought to observe how acute ethanol and amphetamine affect the balance between habitual and goal-directed behavior, as measured by a fluid-reinforced operant conditioning task.

METHODS

Selectively bred crossed high-alcohol-preferring (cHAP) mice were trained on an operant conditioning task reinforced on a variable interval schedule with 1% banana solution, which was subsequently devalued via LiCl pairing in half the animals. Ethanol (1.0 g/kg), amphetamine (2.0 mg/kg), or saline was administered prior to a post-devaluation test.

RESULTS

Overall, mice showed habitual behavior, but when divided into high- or low-responding groups based on training response rates, saline-treated, low-responding animals devalued, while saline-treated high-responding animals did not. Furthermore, amphetamine elicited devaluation even in high-responding animals, while ethanol prevented devaluation even in low-responding animals.

CONCLUSIONS

These data show that ethanol shifts animals toward behaving habitually. This may illuminate why alcohol-intoxicated individuals display impaired judgment about the relative merits of drinking, and potentially serve as a mechanism by which intoxicated subjects resume previously devalued behaviors, such as comorbid drug use. These findings also show that high variable interval response rates facilitate a shift from goal-directed to habitual behavior.

Muscarinic M5 receptors modulate ethanol seeking in rats

Despite the cost to both individual and society, alcohol use disorders (AUDs) remain a major health risk within society, and both relapse and heavy drinking are still poorly controlled with current medications. Here we demonstrate for the first time that a centrally active and selective negative allosteric modulator for the rat M₅ muscarinic acetylcholine receptor (mAChR), ML375, decreases ethanol self-administration and attenuates cue-induced reinstatement of ethanol seeking in ethanol-preferring (iP) rats. Importantly, ML375 did not affect sucrose self-administration or general locomotor activity indicative of a selective effect on ethanol seeking. Based on the expression profile of M₅ mAChRs in the brain and the distinct roles different aspects of the dorsal striatum have on long-term and short-term ethanol use, we studied whether intra-striatal microinjection of ML375 modulated ethanol intake in rats. We show in iP rats with an extensive history of ethanol intake that intra-dorsolateral (DL), but not intra-dorsomedial, striatal injections of ML375 reduced ethanol self-administration to a similar extent as the nicotinic acetylcholine receptor ligand varenicline, which has preclinical and clinical efficacy in reducing the reinforcing effects of ethanol. These data implicate the DL striatum as a locus for the effects of cholinergic-acting drugs on ethanol seeking in rats with a history of long-term ethanol use. Accordingly, we demonstrate in rats that selectively targeting the M₅ mAChR can modulate both voluntary ethanol intake and cue-induced ethanol seeking and thereby provide direct evidence that the M₅ mAChR is a potential novel target for pharmacotherapies aimed at treating AUDs.

Dorsolateral Striatum Engagement Interferes with Early Discrimination Learning

In current models, learning the relationship between environmental stimuli and the outcomes of actions involves both stimulus-driven and goal-directed systems, mediated in part by the DLS and DMS, respectively. However, though these models emphasize the importance of the DLS in governing actions after extensive experience has accumulated, there is growing evidence of DLS engagement from the onset of training. Here, we used in vivo photosilencing to reveal that DLS recruitment interferes with early touchscreen discrimination learning. We also show that the direct output pathway of the DLS is preferentially recruited and causally involved in early learning and find that silencing the normal contribution of the DLS produces plasticity-related alterations in a PL-DMS circuit. These data provide further evidence suggesting that the DLS is recruited in the construction of stimulus-elicited actions that ultimately automate behavior and liberate cognitive resources for other demands, but with a cost to performance at the outset of learning.