Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum

Discriminating goal-directed and habitual cocaine seeking in rats using a novel outcome devaluation procedure

Habits are theorized to play a key role in compulsive cocaine seeking, yet there is limited methodology for assessing habitual responding for intravenous (IV) cocaine. We developed a novel outcome devaluation procedure to discriminate goal-directed from habitual responding in cocaine-seeking rats. This procedure elicits devaluation temporarily and requires no additional training, allowing repeated testing at different time points. After training male rats to self-administer IV cocaine, we devalued the drug outcome via experimenter-administered IV cocaine (a "satiety" procedure) prior to a 10-min extinction test. Many rats were sensitive to outcome devaluation, a hallmark of goal-directed responding. These animals reduced responding when given a dose of experimenter-administered cocaine that matched or exceeded satiety levels during self-administration. However, other rats were insensitive to experimenter-administered cocaine, suggesting their responding was habitual. Importantly, reinforcement schedules and neural manipulations that produce goal-directed responding (i.e., ratio schedules or dorsolateral striatum lesions) caused sensitivity to outcome devaluation, whereas reinforcement schedules and neural manipulations that produce habitual responding (i.e., interval schedules or dorsomedial striatum lesions) caused insensitivity. Satiety-based outcome devaluation is an innovative new tool to dissect the neural and behavioral mechanisms underlying IV cocaine-seeking behavior.

Drinking history dependent functionality of the dorsolateral striatum on gating alcohol and quinine-adulterated alcohol front-loading and binge drinking

After an extended alcohol-drinking history, alcohol use can transition from controlled to compulsive, causing deleterious consequences. Alcohol use can be segregated into two distinct behaviors, alcohol seeking and alcohol taking. Expression of habitual and compulsive alcohol seeking depends on the dorsolateral striatum (DLS), a brain region thought to engage after extended alcohol access. However, it is unknown whether the DLS is also involved in compulsive-like alcohol taking. The purpose of this experiment was to identify whether the DLS gates compulsive-like binge alcohol drinking. To ask this question, we gave adult male and female C57BL/6J mice a binge-like alcohol-drinking history, which we have previously demonstrated to produce compulsive-like alcohol drinking (Bauer, McVey, & Boehm, 2021), or a water-drinking history. We then tested the involvement of the DLS on gating binge-like alcohol drinking and compulsive-like quinine-adulterated alcohol drinking via intra-DLS AMPA receptor antagonism. We hypothesized that pharmacological lesioning of the DLS would reduce compulsive-like quinine-adulterated alcohol (QuA) drinking, but not non-adulterated alcohol drinking, in male and female C57BL/6J mice. Three important findings were made. First, compulsive-like alcohol drinking is significantly blunted in cannulated mice. Because of this, we conclude that we were not able to adequately assess the effect of intra-DLS lesioning on compulsive-like alcohol drinking. Second, we found that the DLS gates binge-like alcohol drinking initially, which replicates findings in our previous work (Bauer, McVey, Germano, Zhang, & Boehm, 2022). However, following an extended alcohol history, the DLS no longer drives this behavior. Finally, alcohol and QuA front-loading is DLS-dependent in alcohol-history mice. Intra-DLS NBQX altered these drinking behaviors without altering ambulatory locomotor activity. These data demonstrate the necessity of the DLS in binge-like alcohol drinking before, but not following, an extended binge-like alcohol-drinking history and in alcohol front-loading in alcohol-history mice.

Food for thought: diet-induced impairments to decision-making and amelioration by N-acetylcysteine in male rats

RATIONALE

Attempts to lose weight often fail despite knowledge of the health risks associated with obesity and determined efforts. We previously showed that rodents fed an obesogenic diet displayed premature habitual behavioural control and weakened flexible decision-making based on the current value of outcomes produced by their behaviour. Thus, habitual control may contribute to failed attempts to modify eating behaviours.

OBJECTIVES

To examine the effects of an obesogenic diet on behavioural control and glutamate transmission in dorsal striatum regions and to assess the ability of N-acetylcysteine (NAC) to reverse deficits.

METHODS

Here, we examined diet-induced changes to decision-making and used in vitro electrophysiology to investigate the effects of diet on glutamate transmission within the dorsomedial (DMS) and dorsolateral (DLS) striatum, areas that control goal-directed and habitual behaviours, respectively. We administered NAC in order to normalize glutamate release and tested whether this would restore goal-directed performance following an obesogenic diet.

RESULTS

We found that an obesogenic diet reduced sensitivity to outcome devaluation and increased glutamate release in the DMS, but not DLS. Administration of NAC restored goal-directed control and normalized mEPSCs in the DMS. Finally, NAC administered directly to the DMS was sufficient to reinstate sensitivity to outcome devaluation following an obesogenic diet.

CONCLUSIONS

These data indicate that obesogenic diets alter neural activity in the basal ganglia circuit responsible for goal-directed learning and control which leads to premature habitual control. While the effects of diet are numerous and widespread, normalization of glutamatergic activity in this circuit is sufficient for restoring goal-directed behaviour.

Duration- and sex-dependent neural circuit control of voluntary physical activity

RATIONALE

Exercise participation remains low despite clear benefits. Rats engage in voluntary wheel running (VWR) that follows distinct phases of acquisition, during which VWR escalates, and maintenance, during which VWR remains stable. Understanding mechanisms driving acquisition and maintenance of VWR could lead to novel strategies to promote exercise. The two phases of VWR resemble those that occur during operant conditioning and, therefore, might involve similar neural substrates. The dorsomedial (DMS) dorsal striatum (DS) supports the acquisition of operant conditioning, whereas the dorsolateral striatum (DLS) supports its maintenance.

OBJECTIVES

Here we sought to characterize the roles of DS subregions in VWR. Females escalate VWR and operant conditioning faster than males. Thus, we also assessed for sex differences.

METHODS

To determine the causal role of DS subregions in VWR, we pharmacologically inactivated the DMS or DLS of adult, male and female, Long-Evans rats during the two phases of VWR. The involvement of DA receptor 1 (D1)-expressing neurons in the DS was investigated by quantifying cfos mRNA within this neuronal population.

RESULTS

We observed that, in males, the DMS and DLS are critical for VWR exclusively during acquisition and maintenance, respectively. In females, the DMS is also critical only during acquisition, but the DLS contributes to VWR during both VWR phases. DLS D1 neurons could be an important driver of VWR escalation during acquisition.

CONCLUSIONS

The acquisition and maintenance of VWR involve unique neural substrates in the DS that vary by sex. Results reveal targets for sex-specific strategies to promote exercise.

How the brain regulates alcohol intake

A neural pathway involved in goal-oriented behaviours becomes dysregulated during binge drinking and alcohol use disorder.

The role of anterior insular cortex inputs to dorsolateral striatum in binge alcohol drinking

How does binge drinking alcohol change synaptic function, and do these changes maintain binge consumption? The anterior insular cortex (AIC) and dorsolateral striatum (DLS) are brain regions implicated in alcohol use disorder. In male, but not female mice, we found that binge drinking alcohol produced glutamatergic synaptic adaptations selective to AIC inputs within the DLS. Photoexciting AIC→DLS circuitry in male mice during binge drinking decreased alcohol, but not water consumption and altered alcohol drinking mechanics. Further, drinking mechanics alone from drinking session data predicted alcohol-related circuit changes. AIC→DLS manipulation did not alter operant, valence, or anxiety-related behaviors. These findings suggest that alcohol-mediated changes at AIC inputs govern behavioral sequences that maintain binge drinking and may serve as a circuit-based biomarker for the development of alcohol use disorder.

Striatonigrostriatal circuit architecture for disinhibition of dopamine signaling

The basal ganglia operate largely in closed parallel loops, including an associative circuit for goal-directed behavior originating from the dorsomedial striatum (DMS) and a somatosensory circuit important for habit formation originating from the dorsolateral striatum (DLS). An exception to this parallel circuit organization has been proposed to explain how information might be transferred between striatal subregions, for example, from the DMS to the DLS during habit formation. The "ascending spiral hypothesis" proposes that the DMS disinhibits dopamine signaling in the DLS through a tri-synaptic, open-loop striatonigrostriatal circuit. Here, we use transsynaptic and intersectional genetic tools to investigate both closed- and open-loop striatonigrostriatal circuits. We find strong evidence for closed loops, which would allow striatal subregions to regulate their own dopamine release. We also find evidence for functional synapses in open loops. However, these synapses are unable to modulate tonic dopamine neuron firing, questioning the prominence of their role in mediating crosstalk between striatal subregions.

Alterations of Dopamine Receptors and the Adaptive Changes of L-Type Calcium Channel Subtypes Regulate Cocaine-Seeking Habit in Tree Shrew

The putamen (Put) is necessary for habitual actions, while the nucleus caudate (Cd) is critical for goal-directed actions. However, compared with the natural reward (such as sucrose)-seeking habit, how drug-related dysfunction or imbalance between the Put and Cd is involved in cocaine-seeking habit, which is not easy to bias behavior to goal-directed actions, is absent. Therefore, in our present study, in comparison with sucrose-habitual behavior, we evaluated the distinctive changes of the two subtypes of dopamine (DA) receptors (D1R and D2R) in cocaine-seeking habitual behavior animals. Moreover, the adaptive changes of Ca_v1.2 and Ca_v1.3, as prime downstream targets of D1R and D2R respectively, were also assessed. Our results showed that a similar percentage of the animals exhibited habitual seeking behavior after cocaine or sucrose variable-interval self-administration (SA) training in tree shrews. In addition, compared with animals with non-habitual behavior, animals with cocaine habitual behavior showed higher D1Rs and Ca_v1.2 expression in the Put accompanied with lower D2Rs and Ca_v1.3 expression in the Cd. However, after sucrose SA training, animals with habitual behavior only showed lower membrane expression of D2R in the Put than animals with non-habitual behavior. These results suggested that the upregulation of D1Rs-Ca_v1.2 signaling may lead to hyper-excitability of the Put, and the inactivation of D2Rs-Ca_v1.3 signaling may result in depressed activity in the Cd. This imbalance function between the Put and Cd, which causes an inability to shift between habits and goal-directed actions, may underlie the compulsive addiction habit.

Negative Urgency Exacerbates Relapse to Cocaine Seeking After Abstinence

BACKGROUND

The mechanisms through which drug-cue-induced negative affective states are involved in relapse have not been defined. We tested the hypothesis that in individuals having developed a dorsolateral striatum (DLS)-dependent cue-controlled cocaine-seeking habit, the loss of the opportunity to enact the drug-seeking response during abstinence results in an urge to act that exacerbates relapse severity mediated by negative urgency.

METHODS

Eighty-seven male Sprague Dawley rats were trained to seek cocaine under the influence of the conditioned reinforcing properties of drug-paired cues or not. We investigated whether the tendency to relapse depended on the aversive state of withdrawal or instead on the loss of opportunity to perform the ingrained drug-seeking response after periods of abstinence. The striatal locus of control over cocaine seeking at baseline and relapse was investigated using in situ hybridization of the cellular activity marker C-fos and assessment of the sensitivity of instrumental drug seeking to dopamine receptor blockade in the dorsomedial striatum-dependent goal-directed and DLS-dependent habit systems.

RESULTS

The development of a DLS-dependent cue-controlled cocaine-seeking habit prior to abstinence resulted in a marked increase in drug seeking at relapse, which was not motivated by a cocaine withdrawal state and was no longer dependent on the DLS habit system. Instead, it reflected the emergence of negative urgency caused by the prevention of the performance of the habit during abstinence and underpinned by transient engagement of the goal-directed system.

CONCLUSIONS

These results show that ingrained cue-controlled drug-seeking habits increase the pressure to relapse.

Effects of chronic alcohol exposure on motivation-based value updating

Dysfunctional decision-making has been observed in alcohol dependence. However, the specific underlying processes disrupted have yet to be identified. Important to goal-directed decision-making is one's motivational state, which is used to update the value of actions. As ethanol dependence disrupts decision-making processes, we hypothesized that ethanol dependence could alter sensitivity to motivational state and/or value updating, thereby reducing the capability for adaptive behavior. Here we employed a sequential instrumental learning task to examine this hypothesis. In two experiments, mice underwent chronic intermittent ethanol (CIE) or air (Air) vapor exposure and repeated withdrawal procedures to induce ethanol dependence. Mice were then trained on a sequence of distal and proximal lever pressing for sucrose under either mild or more severe food restriction. Half of all Air and CIE mice then underwent a motivational shift to a less hungry state and effects of this motivational shift were evaluated across three days. First, mice were re-exposed to sucrose, and effects of food restriction state and CIE exposure on lick and consummatory behavior were examined in the absence of lever pressing. Over the next two days, mice underwent a brief non-rewarded test and then a rewarded test where the ability to retrieve and infer sucrose value to guide lever pressing was measured. In the sucrose re-exposure session, prior CIE exposure altered sucrose-seeking in mice with a history of mild but not more severe food restriction, suggesting altered motivational sensitivity. During lever press testing, CIE mice were insensitive to decreases in motivational state and did not reduce proximal lever pressing regardless of food restriction state. Mildly restricted CIE mice, but not severely restricted CIE mice, also did not reduce distal pressing to the same degree as Air mice following a downshift in motivational state. Our findings suggest that ethanol dependence may disrupt motivational processes supporting value updating that are important for decision-making.

Chronic Intermittent Ethanol Administration during Adolescence Produces Sex Dependent Impairments in Behavioral Flexibility and Survivability

Chronic intermittent ethanol exposure during adolescence produces behavioral impairments and neurobiological changes that can last into young adulthood. One such behavioral impairment is reduced behavioral flexibility, a behavioral impairment that has been correlated with the risk for increased ethanol intake. In the current study, we investigated if chronic intermittent ethanol exposure during adolescence alters cognition, including behavioral flexibility, over a 22-month testing period. Female and male rats were treated with either 3.0 g/kg or 5.0 g/kg ethanol via gavage in a chronic intermittent fashion during adolescence and then tested every 4 to 5 months on a series of cognitive measures in the Morris water maze. Chronic intermittent ethanol selectively impaired behavioral flexibility in both female and male rats, although the pattern of results was different as a function of sex. In addition, female, but not male, rats were impaired in a short-term relearning test. Finally, male rats administered ethanol during adolescence were significantly more likely to not survive the 22-month experiment compared to female rats administered ethanol during adolescence. The current results demonstrate that adolescence is a unique period of development where chronic intermittent ethanol exposure produces long-lasting, selective cognitive impairments across the lifespan.

Alcohol dependence decreases functional activation of the caudate nucleus during model-based decision processes

BACKGROUND

Impaired decision making, a key characteristic of alcohol dependence (AD), manifests in continuous alcohol consumption despite severe negative consequences. The neural basis of this impairment in individuals with AD and differences with known neural decision mechanisms among healthy subjects are not fully understood. In particular, it is unclear whether the choice behavior among individuals with AD is based on a general impairment of decision mechanisms or is mainly explained by altered value attribution, with an overly high subjective value attributed to alcohol-related stimuli.

METHODS

Here, we use a functional magnetic resonance imaging (fMRI) monetary reward task to compare the neural processes of model-based decision making and value computation between AD individuals (n = 32) and healthy controls (n = 32). During fMRI, participants evaluated monetary offers with respect to dynamically changing constraints and different levels of uncertainty.

RESULTS

Individuals with AD showed lower activation associated with model-based decision processes in the caudate nucleus than controls, but there were no group differences in value-related neural activity or task performance.

CONCLUSIONS

Our findings highlight the role of the caudate nucleus in impaired model-based decisions of alcohol-dependent individuals.

Evaluating habit formation across pairs of female and male selectively bred alcohol-preferring and non-preferring rats

Some individuals with alcohol use disorder (AUD) continue to drink because they have developed a habit where they do not consider the consequences of their actions. Genetically selected lines of alcohol-preferring and non-preferring rats allow for exploration of how specific endophenotypes, such as tendency to form habits, may be risk factors that interact with a genetic predisposition of AUD. While high alcohol drinking (HAD) and alcohol-preferring (P) rats were selectively bred to consume high amounts of freely available ethanol, they exhibit differences in alcohol-seeking behaviors as well as impulsive behaviors, and may represent different behavioral models of AUD. The goal of the current study was to compare the tendency to develop habitual behaviors across female and male HAD1, HAD2, and P rats and their respective alcohol non-preferring counterparts. Alcohol-naïve rats were trained on a variable interval schedule using a non-ethanol reinforcer and were then tested in two extinction sessions, one prior to a reinforcer devaluation (conditioned taste aversion) procedure and one after. There were no differences in total lever presses between P and alcohol non-preferring (NP) rats, but there were differences between HAD and low-alcohol drinking (LAD) rats. All six strains decreased lever pressing after reinforcer devaluation. However, P and NP females did not increase latency to first lever press after devaluation, suggesting some inclination toward habitual behavior that was not apparent in either the HAD or LAD lines. Selective breeding for alcohol preference does not seem to influence the tendency to form habits, whereas background strain and sex may have an influence on this behavior.

Reinforcement History Dependent Effects of Low Dose Ethanol on Reward Motivation in Male and Female Mice

Alcohol use disorders (AUDs) are more prevalent in men than in women, though AUD diagnoses in women are growing rapidly, making an understanding of sex differences in alcohol-related behaviors increasingly important. The development of AUDs involves the transition from casual, low levels of alcohol drinking to higher, maladaptive levels. The ability of low dose alcohol to drive reward and drug seeking may differ in males and females, and this could underlie differences in susceptibility to AUD. In this study we sought to determine whether a history of chronic, low dose ethanol exposure (0.5 g/kg; i.p.) could drive sucrose reward seeking and motivation, and whether this differed between male and female mice. Adult mice were trained to lever press for a liquid sucrose reward on two reinforcement schedules: a random interval (RI) schedule and a variable ratio (VR) schedule. After training, mice were tested on each of these levers for reward motivation using a progressive ratio test. We found that a history of low dose ethanol exposure increased sucrose reward motivation in male mice, but only on the RI lever and only when exposure occurred proximal to learning. Female mice were more motivated for sucrose on the RI lever than the VR lever regardless of ethanol exposure condition. These findings indicate that training on different reinforcement schedules affects reward motivation. Further, we show that males are more susceptible to the effects of low dose ethanol on sucrose reward motivation than females. These data broaden our understanding of sex differences in reward seeking as a result of ethanol exposure.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Cortical control of striatal fast-spiking interneuron synchrony

KEY POINTS

Electrical synapses between striatal fast-spiking interneurons in adult mice occur in ∼8% of assayed pairs. Coincident, convergent cortical input onto fast-spiking interneurons significantly contributes to fast-spiking interneuron synchrony Electrical synapses between fast-spiking interneurons provide only minor enhancement of fast-spiking interneuron synchrony. These results suggest a mechanism by which adult mouse fast-spiking interneurons of the striatum synchronize in the face of declining expression of the electrical synapse-forming connexin-36 protein.

ABSTRACT

Inhibitory fast-spiking interneurons in the dorsal striatum regulate actions and action strategies, including habits. Fast-spiking interneurons are widely believed to synchronize their firing due to the electrical synapses formed between these neurons. However, neuronal modeling data suggest convergent cortical input may also drive synchrony in fast-spiking interneuron networks. To better understand how fast-spiking interneuron synchrony arises, we performed dual whole-cell patch clamp electrophysiology experiments to inform a simple Bayesian network modeling cortico-fast-spiking interneuron circuitry. Dual whole-cell patch clamp electrophysiology revealed that while responsivity to corticostriatal input activation was high in fast-spiking interneurons, few of these neurons exhibited electrical coupling in adult mice. In simulations of a cortico-fast-spiking interneuron network informed by these data, the degree of glutamatergic cortical convergence onto fast-spiking interneurons significantly increased fast-spiking interneuron synchronization while manipulations of electrical coupling between these neurons exerted relatively little impact. These results suggest that the primary source of functional coordination of fast-spiking interneuron activity in adulthood arises from convergent corticostriatal input activation. Abstract figure legend Dual whole-cell patch clamp recordings of dorsal striatal fast-spiking interneurons (FSIs; red circles) rarely (8 percentage) form electrical synapses with other FSIs in adult mouse. In a two-layer in silico model of cortical pyramidal neuron (gray triangles) input to FSIs using empirically defined cortico-FSI synaptic weights, synchronous FSI-FSI activity (in the absence of abundant electrical synapses) is achievable by convergent cortical pyramidal excitation of FSIs. This article is protected by copyright. All rights reserved.

Prenatal Opioid Exposure Impairs Endocannabinoid and Glutamate Transmission in the Dorsal Striatum

The opioid crisis has contributed to a growing population of children exposed to opioids during fetal development; however, many of the long-term effects of opioid exposure on development are unknown. We previously demonstrated that opioids have deleterious effects on endocannabinoid plasticity at glutamate synapses in the dorsal striatum of adolescent rodents, but it is unclear whether prenatal opioid exposure produces similar neuroadaptations. Using a mouse model of prenatal methadone exposure (PME), we performed proteomics, phosphoproteomics, and patch-clamp electrophysiology in the dorsolateral striatum (DLS) and dorsomedial striatum (DMS) to examine synaptic functioning in adolescent PME offspring. PME impacted the proteome and phosphoproteome in a region- and sex-dependent manner. Many proteins and phosphorylated proteins associated with glutamate transmission were differentially abundant in PME offspring, which was associated with reduced glutamate release in the DLS and altered the rise time of excitatory events in the DMS. Similarly, the intrinsic excitability properties of DMS neurons were significantly affected by PME. Last, pathway analyses revealed an enrichment in retrograde endocannabinoid signaling in the DLS, but not in the DMS, of males. Electrophysiology studies confirmed that endocannabinoid-mediated synaptic depression was impaired in the DLS, but not DMS, of PME-males. These results indicate that PME induces persistent neuroadaptations in the dorsal striatum and could contribute to the aberrant behavioral development described in offspring with prenatal opioid exposure.

Intra-dorsolateral striatal AMPA receptor antagonism reduces binge-like alcohol drinking in male and female C57BL/6J mice

The dorsolateral striatum (DLS) is involved in addiction, reward, and alcohol related behaviors. The DLS primarily receives excitatory inputs which are gated by post-synaptic AMPA receptors. We antagonized AMPA receptors in the DLS to investigate how such modulation affects binge-like alcohol drinking in male and female C57BL/6J mice and whether an associated alcohol drinking history alters dorsomedial striatum (DMS) and DLS AMPA receptor expression. We also investigated the effect of intra-DLS NBQX on locomotor activity and saccharin drinking in mice. Mice were allowed free access to 20% alcohol for two hours each day for a total of seven days. Mice received an intra-DLS infusion of one of four concentrations of NBQX (saline, 0.15, 0.5, or 1.5 μg/side), an AMPA receptor antagonist, immediately prior to alcohol access on day 7. Two-hour binge alcohol intakes, locomotor activity, and blood alcohol concentrations were determined. Intra-DLS NBQX reduced binge-like alcohol drinking in a U-shaped manner in male and female mice. Intake predicted blood alcohol concentration, and locomotor activity was not affected. In a follow up experiment, we assessed whether the most effective NBQX concentration for reducing alcohol consumption also reduced saccharin drinking, finding intra-DLS NBQX did not alter saccharin drinking in male and female mice. These data suggest that AMPA receptors in the DLS play a role in the modulation of binge-like alcohol drinking. These findings further validate the importance of the DLS for alcohol related behaviors and alcohol use disorder.

Diet-induced deficits in goal-directed control are rescued by agonism of group II metabotropic glutamate receptors in the dorsomedial striatum

Many overweight or obese people struggle to sustain the behavioural changes necessary to achieve and maintain weight loss. In rodents, obesogenic diet can disrupt goal-directed control of responding for food reinforcers, which may indicate that diet can disrupt brain regions associated with behavioural control. We investigated a potential glutamatergic mechanism to return goal-directed control to rats who had been given an obesogenic diet prior to operant training. We found that an obesogenic diet reduced goal-directed control and that systemic injection of LY379268, a Group II metabotropic glutamate receptor (mGluR2/3) agonist, returned goal-directed responding in these rats. Further, we found that direct infusion of LY379268 into the dorsomedial striatum, a region associated with goal-directed control, also restored goal-directed responding in the obesogenic-diet group. This indicates that one mechanism through which obesogenic diet disrupts goal-directed control is glutamatergic, and infusion of a mGluR2/3 agonist into the DMS is sufficient to ameliorate deficits in goal-directed control.

Computational analysis of probabilistic reversal learning deficits in male subjects with alcohol use disorder

BACKGROUND

Alcohol use disorder is characterized by perseverative alcohol use despite negative consequences. This hallmark feature of addiction potentially relates to impairments in behavioral flexibility, which can be measured by probabilistic reversal learning (PRL) paradigms. We here aimed to examine the cognitive mechanisms underlying impaired PRL task performance in patients with alcohol use disorder (AUDP) using computational models of reinforcement learning.

METHODS

Twenty-eight early abstinent AUDP and 27 healthy controls (HC) performed an extensive PRL paradigm. We compared conventional behavioral variables of choices (perseveration; correct responses) between groups. Moreover, we fitted Bayesian computational models to the task data to compare differences in latent cognitive variables including reward and punishment learning and choice consistency between groups.

RESULTS

AUDP and HC did not significantly differ with regard to direct perseveration rates after reversals. However, AUDP made overall less correct responses and specifically showed decreased win-stay behavior compared to HC. Interestingly, AUDP showed premature switching after no or little negative feedback but elevated proneness to stay when accumulation of negative feedback would make switching a more optimal option. Computational modeling revealed that AUDP compared to HC showed enhanced learning from punishment, a tendency to learn less from positive feedback and lower choice consistency.

CONCLUSION

Our data do not support the assumption that AUDP are characterized by increased perseveration behavior. Instead our findings provide evidence that enhanced negative reinforcement and decreased non-drug-related reward learning as well as diminished choice consistency underlie dysfunctional choice behavior in AUDP.

On the interrelation between alcohol addiction-like behaviors in rats

RATIONALE

Alcohol use disorder (AUD) is a complex, heterogeneous disorder that only occurs in a minority of alcohol users. Various behavioral constructs, including excessive intake, habit formation, motivation for alcohol and resistance to punishment have been implicated in AUD, but their interrelatedness is unclear.

OBJECTIVE

The aim of this study was therefore to explore the relation between these AUD-associated behavioral constructs in rats. We hypothesised that a subpopulation of animals could be identified that, based on these measures, display consistent AUD-like behavior.

METHODS

Lister Hooded rats (n = 47) were characterised for alcohol consumption, habit formation, motivation for alcohol and quinine-adulterated alcohol consumption. The interrelation between these measures was evaluated through correlation and cluster analyses. In addition, addiction severity scores were computed using different combinations of the behavioral measures, to assess the consistency of the AUD-like subpopulation.

RESULTS

We found that the data was uniformly distributed, as there was no significant tendency of the behavioral measures to cluster in the dataset. On the basis of multiple ranked addiction severity scores, five animals (~ 11%) were classified as displaying AUD-like behavior. The composition of the remaining subpopulation of animals with the highest addiction severity score (9 rats; ~ 19%) varied, depending on the combination of measures included.

CONCLUSION

Consistent AUD-like behavior was detected in a small proportion of alcohol drinking rats. Alcohol consumption, habit formation, motivation for alcohol and punishment resistance contribute in varying degrees to the AUD-like phenotype across the population. These findings emphasise the importance of considering the heterogeneity of AUD-like behavior.

Assessment of automated craving across substances and across cultures: stability-analysis of the Craving Automated Scale (CAS)

BACKGROUND

The transition from hedonic to compulsive use in Substance Use Disorders (SUD) is a critical point in SUD progression and hence relevant for assessment and treatment. To measure the habitual patterns of substance consumption, the Craving Automated Scales (CAS) for alcohol (CAS-A), substances (CAS-S) and cigarette smoking (CAS-CS) were developed and introduced to different countries. In this study, we aimed to investigate the structural stability of CAS across substances and cultures.

METHODS

This study analyzed the CAS-scores of a sample of 370 participants in Germany, China and the UK, including 262 opioid-users, 65 smokers and 43 alcohol-users. We performed stability analyses to check the stability (i. e. factorial invariance) of factor solutions. Based on confirmed stability of the general factor (gfactor) solution and the calculations rule obtained in the previous validation of CAS-alcohol (CAS-A), the factor structures of CAS-A, CAS-S and CAS-CS were compared.

RESULTS

The gfactor solutions based on calculations rule shows good stability, with the mean stability coefficients of 0.990 and 0.977 for CAS-S and CAS-CS respectively. The gfactor patterns were similar for CAS-A, CAS-S and CAS-CS, as well as across samples (Germany, China and the UK), with most factor-loadings larger than 0.7. Based on these findings, CAS-S and CAS-CS were also associated with established clinical measures of SUD.

CONCLUSIONS

Our findings suggest the two-gfactor solution based on a proposed calculation rule has a high stability across substances and cultures. This could be in line with common neurobiological mechanisms underlying habitual substance use. Moreover, comparing CAS with established clinical tools suggests that CAS might assess the automated behavior in substance consumption in a more sophisticated way.

Neurobiological mechanisms of control in alcohol use disorder - moving towards mechanism-based non-invasive brain stimulation treatments

Alcohol use disorder (AUD) is characterized by excessive habitual drinking and loss of control over alcohol intake despite negative consequences. Both of these aspects foster uncontrolled drinking and high relapse rates in AUD patients. Yet, common interventions mostly focus on the phenomenological level, and prioritize the reduction of craving and withdrawal symptoms. Our review provides a mechanistic understanding of AUD and suggests alternative therapeutic approaches targeting the mechanisms underlying dysfunctional alcohol-related behaviours. Specifically, we explain how repeated drinking fosters the development of rigid drinking habits and is associated with diminished cognitive control. These behavioural and cognitive effects are then functionally related to the neurobiochemical effects of alcohol abuse. We further explain how alterations in fronto-striatal network activity may constitute the neurobiological correlates of these alcohol-related dysfunctions. Finally, we discuss limitations in current pharmacological AUD therapies and suggest non-invasive brain stimulation (like TMS and tDCS interventions) as a potential addition/alternative for modulating the activation of both cortical and subcortical areas to help re-establish the functional balance between controlled and automatic behaviour.

Striatonigrostriatal Spirals in Addiction

A biological reward system is integral to all animal life and humans are no exception. For millennia individuals have investigated this system and its influences on human behavior. In the modern day, with the US facing an ongoing epidemic of substance use without an effective treatment, these investigations are of paramount importance. It is well known that basal ganglia contribute to rewards and are involved in learning, approach behavior, economic choices, and positive emotions. This review aims to elucidate the physiological role of striatonigrostriatal (SNS) spirals, as part of basal ganglia circuits, in this reward system and their pathophysiological role in perpetuating addiction. Additionally, the main functions of neurotransmitters such as dopamine and glutamate and their receptors in SNS circuits will be summarized. With this information, the claim that SNS spirals are crucial intermediaries in the shift from goal-directed behavior to habitual behavior will be supported, making this circuit a viable target for potential therapeutic intervention in those with substance use disorders.

Maintained goal-directed control with overtraining on ratio schedules

It is thought that goal-directed control of actions weakens or becomes masked by habits over time. We tested the opposing hypothesis that goal-directed control becomes stronger over time, and that this growth is modulated by the overall action-outcome contiguity. Despite group differences in action-outcome contiguity early in training, rats trained under random and fixed ratio schedules showed equivalent goal-directed control of lever pressing that appeared to grow over time. We confirmed that goal-directed control was maintained after extended training under another type of ratio schedule-continuous reinforcement-using specific satiety and taste aversion devaluation methods. These results add to the growing literature showing that extensive training does not reliably weaken goal-directed control and that it may strengthen it, or at least maintain it.

The learning of prospective and retrospective cognitive maps within neural circuits

Brain circuits are thought to form a "cognitive map" to process and store statistical relationships in the environment. A cognitive map is commonly defined as a mental representation that describes environmental states (i.e., variables or events) and the relationship between these states. This process is commonly conceptualized as a prospective process, as it is based on the relationships between states in chronological order (e.g., does reward follow a given state?). In this perspective, we expand this concept on the basis of recent findings to postulate that in addition to a prospective map, the brain forms and uses a retrospective cognitive map (e.g., does a given state precede reward?). In doing so, we demonstrate that many neural signals and behaviors (e.g., habits) that seem inflexible and non-cognitive can result from retrospective cognitive maps. Together, we present a significant conceptual reframing of the neurobiological study of associative learning, memory, and decision making.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Individual differences in the engagement of habitual control over alcohol seeking predict the development of compulsive alcohol seeking and drinking

Excessive drinking is an important behavioural characteristic of alcohol addiction, but not the only one. Individuals addicted to alcohol crave alcoholic beverages, spend time seeking alcohol despite negative consequences and eventually drink to intoxication. With prolonged use, control over alcohol seeking devolves to anterior dorsolateral striatum, dopamine-dependent mechanisms implicated in habit learning and individuals in whom alcohol seeking relies more on these mechanisms are more likely to persist in seeking alcohol despite the risk of punishment. Here, we tested the hypothesis that the development of habitual alcohol seeking predicts the development of compulsive seeking and that, once developed, it is associated with compulsive alcohol drinking. Male alcohol-preferring rats were pre-exposed intermittently to a two-bottle choice procedure and trained on a seeking-taking chained schedule of alcohol reinforcement until some individuals developed punishment-resistant seeking behaviour. The associative basis of their seeking responses was probed with an outcome-devaluation procedure, early or late in training. After seeking behaviour was well established, subjects that had developed greater resistance to outcome devaluation (were more habitual) were more likely to show punishment-resistant (compulsive) alcohol seeking. These individuals also drank more alcohol, despite quinine adulteration, even though having similar alcohol preference and intake before and during instrumental training. They were also less sensitive to changes in the contingency between seeking responses and alcohol outcome, providing further evidence of recruitment of the habit system. We therefore provide direct behavioural evidence that compulsive alcohol seeking emerges alongside compulsive drinking in individuals who have preferentially engaged the habit system.

The effects of the dopamine D2/3 agonist quinpirole on incentive value and palatability-based choice in a rodent model of attention-deficit/hyperactivity disorder

RATIONALE

Palatability and incentive value influence animal food choice. Dopamine D2/3 receptor signaling may mediate the effects of palatability and incentive value on choice. Dopamine signaling is disrupted in attention-deficit hyperactivity disorder (ADHD). Investigating behavioral choice processes under D2/3 receptor agonists will help elucidate behavioral and pharmacological correlates of ADHD.

OBJECTIVES

To determine (1) how changes in incentive value affects choice of actions for outcomes that differ in palatability; (2) the effects of the D2/3 agonist quinpirole on choice based on palatability and incentive value; (3) how choice differs in spontaneously hypertensive rats (SHR; ADHD model) compared with control strains.

METHODS

Rats responded instrumentally for two food outcomes (chocolate and grain pellets) that differed in palatability. Following specific satiety of one outcome, rats underwent a choice test. Prior to the choice test, rats were given intra-peritoneal quinpirole (0.01-0.1 mg/kg) body weight. These manipulations were conducted in three strains of rats: SHR rats; the normotensive Wistar-Kyoto (WKY) controls; and Wistar outbred (WIS) controls.

RESULTS

All rat strains responded more vigorously for chocolate pellets compared with grain pellets. Quinpirole reduced the effects of palatability and dose-dependently increased the effects of incentive value on choice. SHR rats were the least influenced by incentive value, whereas WKY rats were the least influenced by palatability.

CONCLUSIONS

These results show that D2/3 signaling modulates choice based on palatability and incentive value. Disruption of this process in SHR rats may mirror motivational impairments observed in ADHD.

Impaired cognitive flexibility following NMDAR-GluN2B deletion is associated with altered orbitofrontal-striatal function

A common feature across neuropsychiatric disorders is inability to discontinue an action or thought once it has become detrimental. Reversal learning, a hallmark of executive control, requires plasticity within cortical, striatal and limbic circuits and is highly sensitive to disruption of N-methyl-d-aspartate receptor (NMDAR) function. In particular, selective deletion or antagonism of GluN2B containing NMDARs in cortical regions including the orbitofrontal cortex (OFC), promotes maladaptive perseveration. It remains unknown whether GluN2B functions to maintain local cortical activity necessary for reversal learning, or if it exerts a broader influence on the integration of neural activity across cortical and subcortical systems. To address this question, we utilized in vivo electrophysiology to record neuronal activity and local field potentials (LFP) in the orbitofrontal cortex and dorsal striatum (dS) of mice with deletion of GluN2B in neocortical and hippocampal principal cells while they performed touchscreen reversal learning. Reversal impairment produced by corticohippocampal GluN2B deletion was paralleled by an aberrant increase in functional connectivity between the OFC and dS. These alterations in coordination were associated with alterations in local OFC and dS firing activity. These data demonstrate highly dynamic patterns of cortical and striatal activity concomitant with reversal learning, and reveal GluN2B as a molecular mechanism underpinning the timing of these processes.

Context, attention, and the switch between habit and goal-direction in behavior

This article reviews recent findings from the author’s laboratory that may provide new insights into how habits are made and broken. Habits are extensively practiced behaviors that are automatically evoked by antecedent cues and performed without their goal (or reinforcer) “in mind.” Goal-directed actions, in contrast, are instrumental behaviors that are performed because their goal is remembered and valued. New results suggest that actions may transition to habit after extended practice when conditions encourage reduced attention to the behavior. Consistent with theories of attention and learning, a behavior may command less attention (and become habitual) as its reinforcer becomes well-predicted by cues in the environment; habit learning is prevented if presentation of the reinforcer is uncertain. Other results suggest that habits are not permanent, and that goal-direction can be restored by several environmental manipulations, including exposure to unexpected reinforcers or context change. Habits are more context-dependent than goal-directed actions are. Habit learning causes retroactive interference in a way that is reminiscent of extinction: It inhibits, but does not erase, goal-direction in a context-dependent way. The findings have implications for the understanding of habitual and goal-directed control of behavior as well as disordered behaviors like addictions.

Astrocyte-neuron interaction in the dorsal striatum-pallidal circuits and alcohol-seeking behaviors

In the striatum, two main types of GABAergic medium spiny neurons (MSNs), denoted striatonigral (or direct-pathway MSNs, dMSNs) and striatopallidal neurons (indirect-pathway MSNs, iMSNs), form circuits with distinct pallidal nuclei, which sends "GO" or "NO-GO" signals through the thalamus. These striatopallidal circuits evaluate and execute reward-seeking and taking behaviors. Especially, the dorsal striatum can be further divided into the dorsomedial striatum (DMS, equivalent to caudate in primates and humans) and dorsolateral striatum (DLS, equivalent to putamen), which orchestrates goal-directed and habitual reward-seeking and taking behaviors, respectively. Using optogenetics, chemogenetics and in vivo calcium imaging technologies combined with electrophysiology and digitalized behavior phenotyping, recent studies have revealed cell-, circuit- and context-specific functions of these microcircuits in addictive behaviors. Also, region-specific astrocytes regulate the homeostatic activities of the dMSNs and iMSNs as well as the downstream circuits, which determine the net balance of cortico-striato-pallidal activities to the thalamic neurons. This review will summarize the recent progress of striatopallidal circuits focusing on astrocyte-neuron interaction and, reward- and alcohol-seeking behaviors. Our review will also discuss the translational and clinical implications of these microcircuit studies. This article is part of the special Issue on "Neurocircuitry Modulating Drug and Alcohol Abuse".

None for the Road? Stricter Drink Driving Laws and Road Accidents

Reducing drink drive limits is generally regarded an effective strategy to save lives on the road. Using several new administrative data sources, we evaluate the effect of a stricter limit introduced in Scotland in 2014. This reduction had no effect on drink driving and road collisions. Estimates from a supply-of-offenses function suggests that the reform did not have much ex-ante scope for sizeable effects. The unavailability of cheaper alternative means of transportation and weak law enforcement seem to have been the main channels behind the lack of an impact. We find no externality on a wide range of domains, from alcohol consumption to criminal activities other than drink driving.

Problematic eating as an issue of habitual control

Obesity has reached alarming rates worldwide. Although many people attempt to control weight by modifying their food-related behaviours, this typically only has short-term effects and most dieters regain the weight that was lost. Why do so many people struggle to regulate their food-related behaviours? One possible explanation is that these behaviours have become habits that are not immediately sensitive to their consequences. Here we review experimental evidence for a shift to habitual control over food-related behaviours and the neural systems that control them and how this relates to difficulty changing ones' eating behavior.

A Randomized Controlled Trial Evaluating the FIT Game's Efficacy in Increasing Fruit and Vegetable Consumption

Few children eat the recommended amounts of fruits and vegetables (FV). Although incentive-based interventions can increase FV consumption, this approach is costly and may be viewed as controversial due to the possible negative effects on intrinsic motivation. The FIT Game was designed to address these challenges. Four elementary schools were randomly assigned to either cooperatively play the FIT Game (n = 881) for ~8 weeks or to a no-game Control condition (n = 978). The FIT Game was presented daily as comic-book formatted episodes projected onto a large screen in the school cafeteria throughout lunchtime. All children could see the episodes which communicated daily whole-school vegetable-eating goals and illustrated the progress of the game's heroes when these goals were collectively met. Photo estimates of FV consumption and skin carotenoid concentrations (biomarker of carotenoid consumption) were collected at baseline, during the last 5 days of the FIT Game, and 3 months after the intervention concluded. Control schools followed the same FV consumption-monitoring procedures for the same duration. At the conclusion of the intervention phase, children attending the FIT Game schools consumed more vegetables (d = 0.41), more fruit (d = 0.39), and had higher skin carotenoids (d = 0.66) than at baseline. These statistically significant increases were maintained at a 3-month follow-up for vegetables (d = 0.21, the food targeted for change) and carotenoids (d = 0.53). Thus, the no-cost virtual incentives of the FIT Game increased FV consumption in the short- and long-run, without negatively impacting intrinsic motivation.

Inactivation of posterior but not anterior dorsomedial caudate-putamen impedes learning with self-administered nicotine stimulus in male rats

The rodent caudate-putamen is a large heterogeneous neural structure with distinct anatomical connections that differ in their control of learning processes. Previous research suggests that the anterior and posterior dorsomedial caudate-putamen (a- and p-dmCPu) differentially regulate associative learning with a non-contingent nicotine stimulus. The current study used bilateral NMDA-induced excitotoxic lesions to the a-dmCPu and p-dmCPu to determine the functional involvement of a-dmCPu and p-dmCPu in appetitive learning with contingent nicotine stimulus. Rats with a-dmCPu, p-dmCPu, or sham lesions were trained to lever-press for intravenous nicotine (0.03 mg/kg/inf) followed by access to sucrose 30 s later. After 1, 3, 9, and 20 nicotine-sucrose training sessions, appetitive learning in the form of a goal-tracking response was assessed using a non-contingent nicotine-alone test. All rats acquired nicotine self-administration and learned to retrieve sucrose from a receptacle at equal rates. However, rats with lesions to p-dmCPu demonstrated blunted learning of the nicotine-sucrose association. Our primary findings show that rats with lesions to p-dmCPu had a blunted goal-tracking response to a non-contingent nicotine administration after 20 consecutive days of nicotine-sucrose pairing. Our findings extend previous reports to a contingent model of nicotine self-administration and show that p-dmCPu is involved in associative learning with nicotine stimulus using a paradigm where rats voluntarily self-administer nicotine infusions that are paired with access to sucrose-a paradigm that closely resembles learning processes observed in humans.

Long-term alcohol consumption alters dorsal striatal dopamine release and regulation by D2 dopamine receptors in rhesus macaques

The dorsal striatum (DS) is implicated in behavioral and neural processes including action control and reinforcement. Alcohol alters these processes in rodents, and it is believed that the development of alcohol use disorder involves changes in DS dopamine signaling. In nonhuman primates, the DS can be divided into caudate and putamen subregions. As part of a collaborative effort examining the effects of long-term alcohol self-administration in rhesus macaques, we examined DS dopamine signaling using fast-scan cyclic voltammetry. We found that chronic alcohol self-administration resulted in several dopamine system adaptations. Most notably, dopamine release was altered in a sex- and region-dependent manner. Following long-term alcohol consumption, male macaques, regardless of abstinence status, had reduced dopamine release in putamen, while only male macaques in abstinence had reduced dopamine release in caudate. In contrast, female macaques had enhanced dopamine release in the caudate, but not putamen. Dopamine uptake was also enhanced in females, but not males (regardless of abstinence state). We also found that dopamine D2/3 autoreceptor function was reduced in male, but not female, alcohol drinkers relative to control groups. Finally, we found that blockade of nicotinic acetylcholine receptors inhibited evoked dopamine release in nonhuman primates. Altogether, our findings demonstrate that long-term alcohol consumption can sex-dependently alter dopamine release, as well as its feedback control mechanisms in both DS subregions.

Depression in the Direct Pathway of the Dorsomedial Striatum Permits the Formation of Habitual Action

In order to achieve optimal outcomes in an ever-changing environment, humans and animals generally manage their action control via either goal-directed action or habitual action. These two action strategies are thought to be encoded in distinct parallel circuits in the dorsal striatum, specifically, the posterior dorsomedial striatum (DMS) and the dorsolateral striatum (DLS), respectively. The striatum is primarily composed of two subtypes of medium spiny neurons (MSNs): the direct-pathway striatonigral and the indirect-pathway striatopallidal MSNs. MSN-subtype-specific synaptic plasticity in the DMS and the DLS has been revealed to underlie goal-directed action and habitual action, respectively. However, whether any MSN-subtype-specific synaptic plasticity in the DMS is associated with habitual action, and if so, whether the synaptic plasticity affects the formation of habitual action, are not known. This study demonstrates that postsynaptic depression in the excitatory synapses of the direct-pathway striatonigral MSNs in the DMS is formed after habit learning. Moreover, chemogenetically rescuing this depression compromises the acquisition, but not the expression, of habitual action. These findings reveal that an MSN-subtype-specific synaptic plasticity in the DMS affects habitual action and suggest that plasticity in the DMS as well as in the DLS contributes to the formation of habitual action.

Striatal Astrocytes Shape Behavioral Flexibility via Regulation of the Glutamate Transporter EAAT2

BACKGROUND

Striatal circuits must be modulated for behavioral flexibility, the ability to adapt to environmental changes. Striatal astrocytes contribute to circuit neuromodulation by controlling the activity of ambient neurotransmitters. In particular, extracellular glutamate levels are tightly controlled by the astrocytic glutamate transporter EAAT2, influencing synaptic functioning and neural network activity. However, it remains unclear if EAAT2 responds to environmental cues to specifically shape action control.

METHODS

To investigate the relationship between behavioral flexibility and experience-dependent regulation of EAAT2 expression in the dorsal striatum, mice were trained on an instrumental task. We manipulated EAAT2 expression using chemogenetic activation of astrocytic Gq signaling or in vivo morpholinos and determined the ability to adapt to novel environmental contingencies.

RESULTS

The loss of behavioral flexibility with task overtraining is associated with the upregulation of EAAT2, which results in enhanced glutamate clearance and altered modulation of glutamatergic neurotransmission in the lateral part of the dorsal striatum. Interfering with EAAT2 upregulation in this striatal area preserves behavioral flexibility.

CONCLUSIONS

Astrocytes are emerging as critical regulators of striatal functions. This work demonstrates that plasticity of EAAT2 expression in the lateral part of the dorsal striatum shapes behavior, thus providing novel mechanistic insights into how flexibility in action control is regulated.

Altered excitatory transmission in striatal neurons after chronic ethanol consumption in selectively bred crossed high alcohol-preferring mice

Genetic predisposition to heavy drinking is a risk factor for alcohol misuse. We used selectively bred crossed high alcohol-preferring (cHAP) mice to study sex differences in alcohol drinking and its effect on glutamatergic activity in dorsolateral (DLS) and dorsomedial (DMS) striatum. We performed whole-cell patch-clamp recording in neurons from male and female cHAP mice with 5-week alcohol drinking history and alcohol-naïve controls. In DMS, alcohol-naïve males' neurons displayed lower cell capacitance and higher membrane resistance than females' neurons, both effects reversed by drinking. Conversely, in DLS neurons, drinking history increased capacitance only in males and changed membrane resistance only in females. Altered biophysical membrane properties were accompanied by disrupted glutamatergic transmission. Drinking history increased spontaneous excitatory postsynaptic current (sEPSC) amplitude in DMS and frequency in DLS female neurons, compared to alcohol-naïve females, without effect in males. Acute ethanol differentially impacted DMS and DLS neurons by sex and drinking history. In DMS, acute alcohol significantly increased sEPSC frequency only in neurons from alcohol-naïve females, an effect that disappeared after drinking history. In DLS, acute alcohol had opposing effects in males and females based on drinking history. Estrous cycle also impacted DMS and DLS neurons differently: sEPSC amplitudes were higher in DMS cells from drinking history than alcohol-naïve females, whereas estrous cycle, not drinking history, modified DLS firing rate. Our data show sex differences in cHAP ethanol consumption and neurophysiology, suggesting differential dysregulation of glutamatergic drive onto DMS and DLS after chronic ethanol consumption.

Dynamic Changes of Arc Expression in Dorsal Striatum of Mice After Self-Administration of Sucrose

Region-specific plasticity in the striatal circuit plays an important role in the development and long-term maintenance of skills and sequential movement procedures. Studies investigating the molecular substrates that contribute to the plasticity changes during motor skill processes have documented a transition in expression from the dorsomedial striatum (DMS) to the dorsolateral striatum (DLS); however, few studies have explored the expression pattern of molecular substrates in the dorsal striatum during progression of instrumental learning. To address this issue, the activity-regulated cytoskeleton-associated protein (Arc) expressions in the subregional dorsal striatum were analyzed during the early and late learning phases of the 10-day sucrose self-administration process. We found that Arc protein is primarily detected in the DMS only in the initial learning stage; however, it is expressed in the DLS during both early and late learning stages. Moreover, Arc expression in the DMS correlated with the number of rewards received later in the training. These data indicated that the Arc expression in subregions of the dorsal striatum shows region-specific transfer and that Arc expression in the DMS contributes to obtaining reward in later learning stage during the process of instrumental learning.

Baclofen attenuates fMRI alcohol cue reactivity in treatment-seeking alcohol dependent individuals

RATIONALE

Baclofen has been shown to effect fMRI alcohol cue reactivity in alcohol dependence, but potential varying effects related to baclofen dose levels have not been examined.

OBJECTIVE

This study investigated whether baclofen attenuates craving and alcohol cue-elicited activation in alcohol-dependent treatment seekers, and the relationship between this response and clinical outcomes (Morley et al. 2018; Morley et al. 2013).

METHODS

Participants included 30 alcohol-dependent individuals who had received daily baclofen 30 mg (n = 11), 75 mg (n = 8) or placebo (n = 11) for at least 2 weeks. Using functional magnetic resonance imaging (fMRI), we examined alcohol cue-elicited neural activation during a visual alcohol cue reactivity task 120 min following treatment administration, and alcohol cue reactivity and percentage of heavy drinking days (% HDD) associations were assessed.

RESULTS

Both baclofen-treated groups reported fewer post-scan % HDD when compared to the placebo-treated group, but no subjective craving group differences were found. Increased alcohol cue-elicited activation was seen in placebo compared to the 75 mg/day baclofen participants in two clusters spanning prefrontal regions implicated in cue reactivity, chiefly frontal regions (i.e., frontal and precentral gyri, anterior cingulate cortex), but no observed alcohol cue reactivity differences between placebo and 30 mg/day baclofen groups. Post-scan % HDD was positively correlated with increased alcohol cue-elicited activation in a cluster encompassing the bilateral caudate nucleus and dorsal anterior cingulate cortex when comparing placebo versus 75 mg/day baclofen groups, and several clusters including prefrontal and mesolimbic regions when comparing placebo versus 30 mg/day baclofen groups.

CONCLUSIONS

Baclofen administration attenuates alcohol cue-elicited activation and reduced the association in baclofen-treated participants between increased activity in key drug cue reactivity regions and higher post-scan % HDD observed in placebo-treated participants, suggesting a dose-specific response effect that may lead to reduced heavy drinking in chronic alcohol-dependent individuals.

TRIAL REGISTRATION

ClinicalTrials.gov , NCT01711125, https://clinicaltrials.gov/ct2/show /NCT01711125.

Optogenetic induction of orbitostriatal long-term potentiation in the dorsomedial striatum elicits a persistent reduction of alcohol-seeking behavior in rats

Uncontrolled drug-seeking and -taking behaviors are generally driven by maladaptive corticostriatal synaptic plasticity. The orbital frontal cortex (OFC) and its projections to the dorsomedial striatum (DMS) have been extensively implicated in drug-seeking and relapse behaviors. The influence of the synaptic plasticity of OFC projections to the DMS (OFC→DMS) on drug-seeking and -taking behaviors has not been fully characterized. To investigate this, we trained rats to self-administer 20% alcohol and then delivered an in vivo optogenetic protocol designed to induce long-term potentiation (LTP) selectively at OFC→DMS synapses. We selected LTP induction because we found that voluntary alcohol self-administration suppressed OFC→DMS transmission and LTP may normalize this transmission, consequently reducing alcohol-seeking behavior. Importantly, ex vivo slice electrophysiology studies confirmed that this in vivo optical stimulation protocol resulted in a significant increase in excitatory OFC→DMS transmission strength on day two after stimulation, suggesting that LTP was induced in vivo. Rat alcohol-seeking and -taking behaviors were significantly reduced on days 1-3, but not on days 7-11, after LTP induction. Striatal synaptic plasticity is modulated by several critical neurotransmitter receptors, including dopamine D1 receptors (D1Rs) and adenosine A2A receptors (A2ARs). We found that delivery of in vivo optical stimulation in the presence of a D1R antagonist abolished the LTP-associated decrease in alcohol-seeking behavior, whereas delivery in the presence of an A2AR antagonist may facilitate this LTP-induced behavioral change. These results demonstrate that alcohol-seeking behavior was negatively regulated by the potentiation of excitatory OFC→DMS neurotransmission. Our findings provide direct evidence that the OFC exerts "top-down" control of alcohol-seeking behavior via the DMS.

Different Effects of Alcohol Exposure on Action and Outcome-Related Orbitofrontal Cortex Activity

Alcohol dependence can result in long-lasting deficits to decision-making and action control. Neurobiological investigations have identified orbitofrontal cortex (OFC) as important for outcome-related contributions to goal-directed actions during decision-making. Prior work has shown that alcohol dependence induces long-lasting changes to OFC function that persist into protracted withdrawal and disrupts goal-directed control over actions. However, it is unclear whether these changes in function alter representation of action and outcome-related neural activity in OFC. Here, we used the well-validated chronic intermittent ethanol (CIE) exposure and withdrawal procedure to model alcohol dependence in mice and performed in vivo extracellular recordings during an instrumental task in which lever-press actions made for a food outcome. We found alcohol dependence disrupted goal-directed action control and increased OFC activity associated with lever-pressing but decreased OFC activity during outcome-related epochs. The ability to decode outcome-related information, but not action information, from OFC activity following CIE exposure was reduced. Hence, chronic alcohol exposure induced a long-lasting disruption to OFC function such that activity associated with actions was enhanced, but OFC activity contributions to outcome-related information was diminished. This has important implications for hypotheses regarding compulsive and habitual phenotypes observed in addiction.

Neurobiology of alcohol seeking behavior

Alcohol addiction is a chronic relapsing brain disease characterized by an impaired ability to stop or control alcohol use despite adverse consequences. A main challenge of addiction treatment is to prevent relapse, which occurs in more than >50% of newly abstinent patients with alcohol disorder within 3 months. In people suffering from alcohol addiction, stressful events, drug-associated cues and contexts, or re-exposure to a small amount of alcohol trigger a chain of behaviors that frequently culminates in relapse. In this review, we first present the preclinical models that were developed for the study of alcohol seeking behavior, namely the reinstatement model of alcohol relapse and compulsive alcohol seeking under a chained schedule of reinforcement. We then provide an overview of the neurobiological findings obtained using these animal models, focusing on the role of opioids systems, corticotropin-release hormone and neurokinins, followed by dopaminergic, glutamatergic, and GABAergic neurotransmissions in alcohol seeking behavior.

Input-selective adenosine A1 receptor-mediated synaptic depression of excitatory transmission in dorsal striatum

The medial (DMS) and lateral (DLS) dorsal striatum differentially drive goal-directed and habitual/compulsive behaviors, respectively, and are implicated in a variety of neuropsychiatric disorders. These subregions receive distinct inputs from cortical and thalamic regions which uniquely determine dorsal striatal activity and function. Adenosine A₁ receptors (A1Rs) are prolific within striatum and regulate excitatory glutamate transmission. Thus, A1Rs may have regionally-specific effects on neuroadaptive processes which may ultimately influence striatally-mediated behaviors. The occurrence of A1R-driven plasticity at specific excitatory inputs to dorsal striatum is currently unknown. To better understand how A1Rs may influence these behaviors, we first sought to understand how A1Rs modulate these distinct inputs. We evaluated A1R-mediated inhibition of cortico- and thalamostriatal transmission using in vitro whole-cell, patch clamp slice electrophysiology recordings in medium spiny neurons from both the DLS and DMS of C57BL/6J mice in conjunction with optogenetic approaches. In addition, conditional A1R KO mice lacking A1Rs at specific striatal inputs to DMS and DLS were generated to directly determine the role of these presynaptic A1Rs on the measured electrophysiological responses. Activation of presynaptic A1Rs produced significant and prolonged synaptic depression (A1R-SD) of excitatory transmission in the both the DLS and DMS of male and female animals. Our findings indicate that A1R-SD at corticostriatal and thalamostriatal inputs to DLS can be additive and that A1R-SD in DMS occurs primarily at thalamostriatal inputs. These findings advance the field's understanding of the functional roles of A1Rs in striatum and implicate their potential contribution to neuropsychiatric diseases.

Mechanism for differential recruitment of orbitostriatal transmission during actions and outcomes following chronic alcohol exposure

Psychiatric disease often produces symptoms that have divergent effects on neural activity. For example, in drug dependence, dysfunctional value-based decision-making and compulsive-like actions have been linked to hypo- and hyperactivity of orbital frontal cortex (OFC)-basal ganglia circuits, respectively; however, the underlying mechanisms are unknown. Here we show that alcohol-exposed mice have enhanced activity in OFC terminals in dorsal striatum (OFC-DS) associated with actions, but reduced activity of the same terminals during periods of outcome retrieval, corresponding with a loss of outcome control over decision-making. Disrupted OFC-DS terminal activity was due to a dysfunction of dopamine-type 1 receptors on spiny projection neurons (D1R SPNs) that resulted in increased retrograde endocannabinoid signaling at OFC-D1R SPN synapses reducing OFC-DS transmission. Blocking CB1 receptors restored OFC-DS activity in vivo and rescued outcome-based control over decision-making. These findings demonstrate a circuit-, synapse-, and computation-specific mechanism gating OFC activity in alcohol-exposed mice.