Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum

Optogenetic inhibition of light-captured alcohol-taking striatal engrams facilitates extinction and suppresses reinstatement

BACKGROUND

Alcohol use disorder (AUD) is a complex condition, and it remains unclear which specific neuronal substrates mediate alcohol-seeking and -taking behaviors. Engram cells and their related ensembles, which encode learning and memory, may play a role in this process. We aimed to assess the precise neural substrates underlying alcohol-seeking and -taking behaviors and determine how they may affect one another.

METHODS

Using FLiCRE (Fast Light and Calcium-Regulated Expression; a newly developed technique which permits the trapping of acutely activated neuronal ensembles) and operant self-administration (OSA), we tagged striatal neurons activated during alcohol-taking behaviors. We used FLiCRE to express an inhibitory halorhodopsin in alcohol-taking neurons, permitting loss-of-function manipulations.

RESULTS

We found that the inhibition of OSA-tagged alcohol-taking neurons decreased both alcohol-seeking and -taking behaviors in future OSA trials. In addition, optogenetic inhibition of these OSA-tagged alcohol-taking neurons during extinction training facilitated the extinction of alcohol-seeking behaviors. Furthermore, inhibition of these OSA-tagged alcohol-taking neurons suppressed the reinstatement of alcohol-seeking behaviors, but, interestingly, it did not significantly suppress alcohol-taking behaviors during reinstatement.

CONCLUSIONS

Our findings suggest that alcohol-taking neurons are crucial for future alcohol-seeking behaviors during extinction and reinstatement. These results may help in the development of new therapeutic approaches to enhance extinction and suppress relapse in individuals with AUD.

Manipulations of the context-response relationship reduce the expression of response habits

Habitual instrumental behaviour is believed to rely on stimulus-response (S-R) associations. However, the method most commonly used to identify habitual behaviour, outcome devaluation, provides only indirect evidence of S-R control. Therefore, it is important to have a better understanding of the S-R association believed to underlie habitual responding. Under free-operant conditions, the context itself likely serves as at least part of the relevant stimuli in the association, and so modifications to the predictive power of the context should alter the expression of habits. The following experiments investigated how changes to the relationship between the training context and performance of the response, either by changing the context during testing or by exposing animals to the context alone, without the response lever present, impacted behavioural control during a devaluation test. We found evidence that the training context is important for the expression of habits; testing animals in a different context than where they were trained resulted in increased goal-directed control (Experiment 1). Furthermore, context alone exposure also increased goal-directed control with animals that received context alone exposure showing stronger devaluation effects, whether the context alone exposure happened on the last day of training (Experiment 2) or throughout training (Experiment 3). These findings are consistent with prior reports that the training context is important for the expression of habits and extends these findings by using sensory-specific satiety as a means for devaluation and by using context alone exposure to alter behavioural control.

Bad habits-good goals? Meta-analysis and translation of the habit construct to alcoholism

Excessive alcohol consumption remains a global public health crisis, with millions suffering from alcohol use disorder (AUD, or simply "alcoholism"), leading to significantly reduced life expectancy. This review examines the interplay between habitual and goal-directed behaviors and the associated neurobiological changes induced by chronic alcohol exposure. Contrary to a strict habit-goal dichotomy, our meta-analysis of the published animal experiments combined with a review of human studies reveals a nuanced transition between these behavioral control systems, emphasizing the need for refined terminology to capture the probabilistic nature of decision biases in individuals with a history of chronic alcohol exposure. Furthermore, we distinguish habitual responding from compulsivity, viewing them as separate entities with diverse roles throughout the stages of the addiction cycle. By addressing species-specific differences and translational challenges in habit research, we provide insights to enhance future investigations and inform strategies for combatting AUD.

Chronic alcohol induces subcircuit-specific striatonigral plasticity enhancing the sensorimotor basal ganglia role in action execution

Functional deficits in basal ganglia (BG) circuits contribute to cognitive and motor dysfunctions in alcohol use disorder. Chronic alcohol exposure alters synaptic function and neuronal excitability in the dorsal striatum, but it remains unclear how it affects BG output that is mediated by the substantia nigra pars reticulata (SNr). Here, we describe a neuronal subpopulation-specific synaptic organization of striatal and subthalamic (STN) inputs to the medial and lateral SNr. Chronic alcohol exposure (CIE) potentiated dorsolateral striatum (DLS) inputs but did not change dorsomedial striatum and STN inputs to the SNr. Chemogenetic inhibition of DLS direct pathway neurons revealed an enhanced role for DLS direct pathway neurons in execution of an instrumental lever-pressing task. Overall, we reveal a subregion-specific organization of striatal and subthalamic inputs onto the medial and lateral SNr and find that potentiated DLS-SNr inputs are accompanied by altered BG control of action execution following CIE.

The impact of abstinence from chronic alcohol consumption on the mouse striatal proteome: sex and subregion-specific differences

Alcohol misuse is the third leading preventable cause of death in the world. The World Health Organization currently estimates that 1 in 20 deaths are directly alcohol related. One of the ways in which consuming excessive levels of alcohol can both directly and indirectly affect human mortality and morbidity, is through chronic inflammation. Recently, studies have suggested a link between increased alcohol use and the incidence of neuroinflammatory-related diseases. However, the mechanism in which alcohol potentially influences neuroinflammatory processes is still being uncovered. We implemented an unbiased proteomics exploration of alcohol-induced changes in the striatum, with a specific emphasis on proteins related to inflammation. The striatum is a brain region that is critically involved with the progression of alcohol use disorder. Using mass spectrometry following voluntary alcohol self-administration in mice, we show that distinct protein abundances and signaling pathways in different subregions of the striatum are disrupted by chronic exposure to alcohol compared to water drinking control mice. Further, in mice that were allowed to experience abstinence from alcohol compared to mice that were non-abstinent, the overall proteome and signaling pathways showed additional differences, suggesting that the responses evoked by chronic alcohol exposure are dependent on alcohol use history. To our surprise we did not find that chronic alcohol drinking or abstinence altered protein abundance or pathways associated with inflammation, but rather affected proteins and pathways associated with neurodegeneration and metabolic, cellular organization, protein translation, and molecular transport processes. These outcomes suggest that in this drinking model, alcohol-induced neuroinflammation in the striatum is not a primary outcome controlling altered neurobehavioral function, but these changes are rather mediated by altered striatal neuronal structure and cellular health.

Optogenetic inhibition of light-captured alcohol-taking striatal engrams facilitates extinction and suppresses reinstatement

Background

Alcohol use disorder (AUD) is a complex condition, and it remains unclear which specific neuronal substrates mediate alcohol-seeking and -taking behaviors. Engram cells and their related ensembles, which encode learning and memory, may play a role in this process. We aimed to assess the precise neural substrates underlying alcohol-seeking and -taking behaviors and determine how they may affect one another.

Methods

Using FLiCRE (Fast Light and Calcium-Regulated Expression; a newly developed technique which permits the trapping of acutely activated neuronal ensembles) and operant-self administration (OSA), we tagged striatal neurons activated during alcohol-taking behaviors. We used FLiCRE to express an inhibitory halorhodopsin in alcohol-taking neurons, permitting loss-of-function manipulations.

Results

We found that the inhibition of OSA-tagged alcohol-taking neurons decreased both alcohol-seeking and -taking behaviors in future OSA trials. In addition, optogenetic inhibition of these OSA-tagged alcohol-taking neurons during extinction training facilitated the extinction of alcohol-seeking behaviors. Furthermore, inhibition of these OSA-tagged alcohol-taking neurons suppressed the reinstatement of alcohol-seeking behaviors, but, interestingly, it did not significantly suppress alcohol-taking behaviors during reinstatement.

Conclusions

Our findings suggest that alcohol-taking neurons are crucial for future alcohol-seeking behaviors during extinction and reinstatement. These results may help in the development of new therapeutic approaches to enhance extinction and suppress relapse in individuals with AUD.

Closed-loop recruitment of striatal interneurons prevents compulsive-like grooming behaviors

Compulsive behaviors have been associated with striatal hyperactivity. Parvalbumin-positive striatal interneurons (PVIs) in the striatum play a crucial role in regulating striatal activity and suppressing prepotent inappropriate actions. To investigate the potential role of striatal PVIs in regulating compulsive behaviors, we assessed excessive self-grooming-a behavioral metric of compulsive-like behavior-in male Sapap3 knockout mice (Sapap3-KO). Continuous optogenetic activation of PVIs in striatal areas receiving input from the lateral orbitofrontal cortex reduced self-grooming events in Sapap3-KO mice to wild-type levels. Aiming to shorten the critical time window for PVI recruitment, we then provided real-time closed-loop optogenetic stimulation of striatal PVIs, using a transient power increase in the 1-4 Hz frequency band in the orbitofrontal cortex as a predictive biomarker of grooming onsets. Targeted closed-loop stimulation at grooming onsets was as effective as continuous stimulation in reducing grooming events but required 87% less stimulation time, paving the way for adaptive stimulation therapeutic protocols.

Ceftriaxone reverses diet-induced deficits in goal-directed control

RATIONALE

Obesity is associated with numerous health risks and ever-increasing rates are a significant global concern. However, despite weight loss attempts many people have difficulty maintaining weight loss. Previous studies in animals have shown that chronic access to an obesogenic diet can disrupt goal-directed behavior, impairing the ability of animals to flexibly adjust food-seeking behavior following changes in the value of earned outcomes. Changes in behavioral control have been linked to disruption of glutamate transmission in the dorsal medial striatum (DMS), a region critical for the acquisition and expression of goal-directed behavior.

OBJECTIVES

The goal of this study was to test whether ceftriaxone, a beta-lactam antibiotic shown elsewhere to upregulate the expression of the glutamate transporter GLT-1, would improve goal-directed control following long-term exposure to an obesogenic diet.

METHODS

Male and female rats were given access to either standard chow or chow plus sweetened condensed milk (SCM) for 6 weeks. Access to SCM was ended and rats received daily injections of either ceftriaxone or saline for 6 days. Rats were then trained to press a lever to earn a novel food reward and, finally, were assessed for sensitivity to outcome devaluation. Histological analyses examined changes to GLT-1 protein levels and morphological changes to astrocytes, within the DMS.

RESULTS

We found that ceftriaxone robustly restored goal-directed behavior in animals following long-term exposure to SCM. While we did not observe changes in protein levels of GLT-1 in the DMS, we observed that SCM induced changes in the morphology of astrocytes in the DMS, and that ceftriaxone mitigated these changes.

CONCLUSIONS

These results demonstrate that long-term access to a SCM diet impairs goal-directed behavior while also altering the morphology of astrocytes in the DMS. Furthermore, these results suggest that ceftriaxone administration can reverse the impairment of goal-directed behavior potentially through its actions on astrocytes in decision-making circuitry.

Mesocorticolimbic system reactivity to alcohol use-related visual cues as a function of alcohol sensitivity phenotype: A pilot fMRI study

Low sensitivity (LS) to alcohol is a risk factor for alcohol use disorder (AUD). Compared to peers with high sensitivity (HS), LS individuals drink more, report more problems, and exhibit potentiated alcohol cue reactivity (ACR). Heightened ACR suggests LS confers AUD risk via incentive sensitization, which is thought to take place in the mesocorticolimbic system. This study examined neural ACR in LS and HS individuals. Young adults (N = 32, M age=20.3) were recruited based on the Alcohol Sensitivity Questionnaire (HS: n = 16; LS: n = 16; 9 females/group). Participants completed an event-related fMRI ACR task. Group LS had higher ACR in left ventrolateral prefrontal cortex than group HS. In group LS, ACR in left caudomedial orbitofrontal cortex or left putamen was low at low alcohol use levels and high at heavier or more problematic alcohol use levels, whereas the opposite was true in group HS. Alcohol use level also was associated with the level of ACR in left substantia nigra among males in group LS. Taken together, results suggest elevated mesocorticolimbic ACR among LS individuals, especially those using alcohol at hazardous levels. Future studies with larger samples are warranted to determine the neurobiological loci underlying LS-based amplified ACR and AUD risk.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration. We then exposed them to four days of punishment testing in which footshock was delivered randomly on one-third of trials. Before and after punishment testing (four days pre-punishment and ≥ four days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance for cocaine was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment in males, although it was associated with habitual responding both pre- and post-punishment in females, indicating that punishment resistance was predicted by habitual responding in food-seeking females. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Changes in dorsomedial striatum activity during expression of goal-directed vs. habit-like cue-induced cocaine seeking

A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking that is goal-directed but not habit-like. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry in rats trained to self-administer cocaine paired with an audiovisual cue to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habit-like cue-induced cocaine seeking and how it is impacted by cue extinction. After minimal fixed-ratio training, rats showed enhanced DMS and DLS calcium responses to cue-reinforced compared to unreinforced lever presses. After rats were trained on goal-promoting fixed ratio schedules or habit-promoting second-order schedules of reinforcement, different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses emerged. Rats trained on habit-promoting second-order schedules showed reduced DMS calcium responses and enhanced DLS dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habit-like behavior and the DLS are unaffected.

Correlation of striatal dopamine D2/3 receptor availability with GABA level in the anterior cingulate cortex in healthy controls but not in alcohol-dependent subjects and individuals at high risk: A multimodal magnetic resonance spectroscopy and positron emission tomography study

BACKGROUND

The association of impaired dopaminergic neurotransmission with the development and maintenance of alcohol use disorder is well known. More specifically, reduced dopamine D2/3 receptors in the striatum of subjects with alcohol dependence (AD) compared to healthy controls have been found in previous studies. Furthermore, alterations of gamma-aminobutyric acid (GABA) and glutamate (Glu) levels in the anterior cingulate cortex (ACC) of AD subjects have been documented in several studies. However, the interaction between cortical Glu levels and striatal dopamine D2/3 receptors has not been investigated in AD thus far.

METHODS

This study investigated dopamine D2/3 receptor availability via 18F-fallypride positron emission tomography (PET) and GABA as well as Glu levels via magnetic resonance spectroscopy (MRS) in 19 detoxified AD subjects, 18 healthy controls (low risk, LR) controls and 19 individuals at high risk (HR) for developing AD, carefully matched for sex, age and smoking status.

RESULTS

We found a significant negative correlation between GABA levels in the ACC and dopamine D2/3 receptor availability in the associative striatum of LR but not in AD or HR individuals. Contrary to our expectations, we did not observe a correlation between Glu concentrations in the ACC and striatal D2/3 receptor availability.

CONCLUSIONS

The results may reflect potential regulatory cortical mechanisms on mesolimbic dopamine receptors and their disruption in AD and individuals at high risk, mirroring complex neurotransmitter interactions associated with the pathogenesis of addiction. This is the first study combining 18F-fallypride PET and MRS in AD subjects and individuals at high risk.

Integrating and fragmenting memories under stress and alcohol

Stress can powerfully influence the way we form memories, particularly the extent to which they are integrated or situated within an underlying spatiotemporal and broader knowledge architecture. These different representations in turn have significant consequences for the way we use these memories to guide later behavior. Puzzlingly, although stress has historically been argued to promote fragmentation, leading to disjoint memory representations, more recent work suggests that stress can also facilitate memory binding and integration. Understanding the circumstances under which stress fosters integration will be key to resolving this discrepancy and unpacking the mechanisms by which stress can shape later behavior. Here, we examine memory integration at multiple levels: linking together the content of an individual experience, threading associations between related but distinct events, and binding an experience into a pre-existing schema or sense of causal structure. We discuss neural and cognitive mechanisms underlying each form of integration as well as findings regarding how stress, aversive learning, and negative affect can modulate each. In this analysis, we uncover that stress can indeed promote each level of integration. We also show how memory integration may apply to understanding effects of alcohol, highlighting extant clinical and preclinical findings and opportunities for further investigation. Finally, we consider the implications of integration and fragmentation for later memory-guided behavior, and the importance of understanding which type of memory representation is potentiated in order to design appropriate interventions.

Pan-striatal reduction in the expression of the astrocytic dopamine transporter precedes the development of dorsolateral striatum dopamine-dependent incentive heroin seeking habits

The emergence of compulsive drug-seeking habits, a hallmark feature of substance use disorder, has been shown to be predicated on the engagement of dorsolateral striatal control over behaviour. This process involves the dopamine-dependent functional coupling of the anterior dorsolateral striatum (aDLS) with the nucleus accumbens core, but the mechanisms by which this coupling occurs have not been fully elucidated. The striatum is tiled by a syncytium of astrocytes that express the dopamine transporter (DAT), the level of which is altered in individuals with heroin use disorder. Astrocytes are therefore uniquely placed functionally to bridge dopamine-dependent mechanisms across the striatum. Here we tested the hypothesis that exposure to heroin influences the expression of DAT in striatal astrocytes across the striatum before the development of DLS-dependent incentive heroin seeking habits. Using Western-blot, qPCR, and RNAscope™, we measured DAT protein and mRNA levels in whole tissue, culture and in situ astrocytes from striatal territories of rats with a well-established cue-controlled heroin seeking habit and rats trained to respond for heroin or food under continuous reinforcement. Incentive heroin seeking habits were associated with a reduction in DAT protein levels in the anterior aDLS that was preceded by a heroin-induced reduction in DAT mRNA and protein in astrocytes across the striatum. Striatal astrocytes were also shown to be susceptible to direct dopamine- and opioid-induced downregulation of DAT expression. These results suggest that astrocytes may critically regulate the striatal dopaminergic adaptations that lead to the development of incentive heroin seeking habits.

Converging Effects of Chronic Pain and Binge Alcohol Consumption on Anterior Insular Cortex Neurons Projecting to the Dorsolateral Striatum in Male Mice

Chronic pain and alcohol use disorder (AUD) are highly comorbid, and patients with chronic pain are more likely to meet the criteria for AUD. Evidence suggests that both conditions alter similar brain pathways, yet this relationship remains poorly understood. Prior work shows that the anterior insular cortex (AIC) is involved in both chronic pain and AUD. However, circuit-specific changes elicited by the combination of pain and alcohol use remain understudied. The goal of this work was to elucidate the converging effects of binge alcohol consumption and chronic pain on AIC neurons that send projections to the dorsolateral striatum (DLS). Here, we used the Drinking-in-the-Dark (DID) paradigm to model binge-like alcohol drinking in mice that underwent spared nerve injury (SNI), after which whole-cell patch-clamp electrophysiological recordings were performed in acute brain slices to measure intrinsic and synaptic properties of AIC→DLS neurons. In male, but not female, mice, we found that SNI mice with no prior alcohol exposure consumed less alcohol compared with sham mice. Electrophysiological analyses showed that AIC→DLS neurons from SNI-alcohol male mice displayed increased neuronal excitability and increased frequency of miniature excitatory postsynaptic currents. However, mice exposed to alcohol prior to SNI consumed similar amounts of alcohol compared with sham mice following SNI. Together, our data suggest that the interaction of chronic pain and alcohol drinking have a direct effect on both intrinsic excitability and synaptic transmission onto AIC→DLS neurons in mice, which may be critical in understanding how chronic pain alters motivated behaviors associated with alcohol.

Adolescents rats engage the orbitofrontal-striatal pathway differently than adults during impulsive actions

Adolescence is characterized by increased impulsive and risk-taking behaviors. To better understand the neural networks that subserves impulsivity in adolescents, we used a reward-guided behavioral model that quantifies age differences in impulsive actions in adult and adolescent rats of both sexes. Using chemogenetics, we identified orbitofrontal cortex (OFC) projections to the dorsomedial striatum (DMS) as a critical pathway for age-related execution of impulsive actions. Simultaneous recording of single units and local field potentials in the OFC and DMS during task performance revealed an overall muted response in adolescents during impulsive actions as well as age-specific differences in theta power and OFC-DMS functional connectivity. Collectively, these data reveal that the OFC-DMS pathway is critical for age-differences in reward-guided impulsive actions and provide a network mechanism to enhance our understanding of how adolescent and adult brains coordinate behavioral inhibition.

Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum

Lack of cognitive flexibility is a hallmark of substance use disorders and has been associated with drug-induced synaptic plasticity in the dorsomedial striatum (DMS). Yet the possible impact of altered plasticity on real-time striatal neural dynamics during decision-making is unclear. Here, we identified persistent impairments induced by chronic ethanol (EtOH) exposure on cognitive flexibility and striatal decision signals. After a substantial withdrawal period from prior EtOH vapor exposure, male, but not female, rats exhibited reduced adaptability and exploratory behavior during a dynamic decision-making task. Reinforcement learning models showed that prior EtOH exposure enhanced learning from rewards over omissions. Notably, neural signals in the DMS related to the decision outcome were enhanced, while those related to choice and choice-outcome conjunction were reduced, in EtOH-treated rats compared to the controls. These findings highlight the profound impact of chronic EtOH exposure on adaptive decision-making, pinpointing specific changes in striatal representations of actions and outcomes as underlying mechanisms for cognitive deficits.

Astrocytic GABAergic Regulation in Alcohol Use and Major Depressive Disorders

Gamma-aminobutyric acid (GABA) is the major inhibitory neurotransmitter in the central nervous system (CNS). Most GABAergic neurons synthesize GABA from glutamate and release it in the synaptic cleft in the CNS. However, astrocytes can also synthesize and release GABA, activating GABA receptors in the neighboring neurons in physiological and pathological conditions. As the primary homeostatic glial cells in the brain, astrocytes play a crucial role in regulating GABA homeostasis and synaptic neurotransmission. Accumulating evidence demonstrates that astrocytic GABA dysregulation is implicated in psychiatric disorders, including alcohol use disorder (AUD) and major depressive disorder (MDD), the most prevalent co-occurring psychiatric disorders. Several current medications and emerging pharmacological agents targeting GABA levels are in clinical trials for treating AUD and MDD. This review offers a concise summary of the role of astrocytic GABA regulation in AUD and MDD. We also provide an overview of the current understanding and areas of debate regarding the mechanisms by which astrocytes regulate GABA in the CNS and their potential significance in the molecular basis of AUD and MDD, paving the way toward future research directions and potential therapeutic target areas within this field.

Arbitration between model-free and model-based control is not affected by transient changes in tonic serotonin levels

BACKGROUND

Serotonin has been suggested to modulate decision-making by influencing the arbitration between model-based and model-free control. Disruptions in these control mechanisms are involved in mental disorders such as drug dependence or obsessive-compulsive disorder. While previous reports indicate that lower brain serotonin levels reduce model-based control, it remains unknown whether increases in serotonergic availability might thus increase model-based control. Moreover, the mediating neural mechanisms have not been studied yet.

AIM

The first aim of this study was to investigate whether increased/decreased tonic serotonin levels affect the arbitration between model-free and model-based control. Second, we aimed to identify the underlying neural processes.

METHODS

We employed a sequential two-stage Markov decision-task and measured brain responses during functional magnetic resonance imaging in 98 participants in a randomized, double-blind cross-over within-subject design. To investigate the influence of serotonin on the balance between model-free and model-based control, we used a tryptophan intervention with three intervention levels (loading, balanced, depletion). We hypothesized that model-based behaviour would increase with higher serotonin levels.

RESULTS

We found evidence that neither model-free nor model-based control were affected by changes in tonic serotonin levels. Furthermore, our tryptophan intervention did not elicit relevant changes in Blood-Oxygenation-Level Dependent activity.

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Habit and persistence

Voluntary behaviors (operants) can come in two varieties: Goal-directed actions, which are emitted based on the remembered value of the reinforcer, and habits, which are evoked by antecedent cues and performed without the reinforcer's value in active memory. The two are perhaps most clearly distinguished with the reinforcer-devaluation test: Goal-directed actions are suppressed when the reinforcer is separately devalued and responding is tested in extinction, and habitual behaviors are not. But what is the function of habit learning? Habits are often thought to be strong and unusually persistent. The present selective review examines this idea by asking whether habits identified by the reinforcer-devaluation test are more resistant to extinction, resistant to the effects of other contingency change, vulnerable to relapse, resistant to the weakening effects of context change, or permanently in place once they are learned. Surprisingly little evidence supports the idea that habits are permanent or more persistent. Habits are more context-specific than goal-directed actions are. Methods that make behavior persistent do not necessarily work by encouraging habit. The function of habit learning may not be to make a behavior strong or more persistent but to make it automatic and efficient in a particular context.

Sex and individual differences in the effect of chronic low-dose ethanol on behavioral strategy selection

BACKGROUND

The development of an alcohol use disorder (AUD) involves impaired behavioral control and flexibility. Behavioral inflexibility includes an inability to shift behavior in response to changes in behavioral outcomes. Low levels of ethanol drinking may promote the formation of inflexible, habitual reward seeking, but this may depend on the timing of ethanol exposure in relation to learning. The goal of this study was to determine whether a history of low-dose ethanol exposure promoted contingency-insensitive sucrose seeking and altered behavioral strategy selection.

METHODS

Male and female C57BL/6J mice were trained to perform a response (lever press) for sucrose on two different reinforcement schedules: one that is thought to promote inflexible responding (random interval) and one that maintains flexible responding (variable ratio [VR]). Following instrumental training each day, mice were exposed to saline or low-dose ethanol (0.5 g/kg; i.p.) either proximal (1 h after) or distal (4 h after) to learning. Mice were then tested for sensitivity to changes in contingency in a contingency degradation test.

RESULTS

A history of low-dose ethanol exposure shifted behavioral strategy selection, as measured by reward tracking behavior, but this depended on sex and reinforcement schedule history. Both male and female mice used different strategies depending on the reinforcement schedule, but only males exhibited ethanol-induced shifts in strategy selection. A history of low-dose ethanol exposure did not impact contingency sensitivity in males but promoted insensitivity in females specifically on the VR lever.

CONCLUSIONS

Female mice show distinct behavioral effects of repeated, low-dose ethanol exposure as compared to males, with sex differences in the use of reward tracking strategies to guide behavior. Future studies should investigate sex differences in the neural consequences of chronic low-dose ethanol exposure that may underlie behavioral changes.

Positive correlation between measures of habitual responding and motivated responding in mice

Habit and motivation are thought to be separate processes, with motivated behavior often considered to be goal directed, whereas habits are defined by the absence of goal-directed control over behavior. However, there has been increasing interrogation of the binary nature of habitual versus goal-directed behavior. Furthermore, although drug and alcohol exposure can promote the formation of habits, drug seeking itself can also be highly flexible, pointing toward the need for complex consideration of the parallel processes that drive behavior. The goal of the current study was to determine whether there was a relation between motivation-as measured by progressive ratio-and habit-as measured by contingency degradation-and whether this relation was affected by ethanol exposure history and sex. The results showed that these measures were positively correlated such that greater contingency insensitivity was associated with achieving higher break points on the progressive-ratio task. However, this relation depended on reinforcement schedule history, ethanol exposure history, and sex. These point to potential relations between measures of habit and motivation and stress the importance of carefully parsing behavioral findings and assays. These findings are also expected to inform future substance use research, as drug history may affect these relations.

Multiple Memory Subsystems: Reconsidering Memory in the Mind and Brain

The multiple-memory-systems framework-that distinct types of memory are supported by distinct brain systems-has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of multiple memory subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: First, opposing memory representations are colocated in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.

Neural Circuitries and Alcohol Use Disorder: Cutting Corners in the Cycle

An implicit tenet of the alcohol use disorder (AUD) research field is that knowledge of how alcohol interacts with the brain is critical to the development of an understanding of vulnerability to AUD and treatment approaches. Gaining this understanding requires the mapping of brain function critical to specific components of this heterogeneous disorder. Early approaches in humans and animal models focused on the determination of specific brain regions sensitive to alcohol action and their participation in AUD-relevant behaviors. Broadly speaking, this research has focused on three domains, Binge/Intoxication, Negative Affect/Withdrawal, and Preoccupation/Anticipation, with a number of regions identified as participating in each. With the generational advances in technologies that the field of neuroscience has undergone over the last two decades, this focus has shifted to a circuit-based analysis. A wealth of new data has sharpened the field's focus on the specific roles of the interconnectivity of multiple brain regions in AUD and AUD-relevant behaviors, as well as demonstrating that the three major domains described above have much fuzzier edges than originally thought.In this chapter, we very briefly review brain regions previously implicated in aspects of AUD-relevant behavior from animal model research. Next, we move to a more in-depth overview of circuit-based approaches, and the utilization of these approaches in current AUD research.

Chronic alcohol exposure differentially alters calcium activity of striatal cell populations during actions

Alcohol Use Disorder (AUD) can induce long lasting alterations to executive function. This includes altered action control, which can manifest as dysfunctional goal-directed control. Cortical and striatal circuits mediate goal-directed control over behavior, and prior research has found chronic alcohol disrupts these circuits. In particular, prior in vivo and ex vivo work have identified alterations to function and activity of dorsal medial striatum (DMS), which is necessary for goal-directed control. However, unknown is whether these alterations manifest as altered activity of select DMS populations during behavior. Here we examine effects of prior chronic alcohol exposure on calcium activity modulation during action-related behaviors via fiber photometry of genetically-identified DMS populations including the direct and indirect output pathways, and fast-spiking interneurons. We find that prior chronic alcohol exposure leads to increased calcium modulation of the direct pathway during action related behavior. In contrast, prior chronic alcohol exposure led to decreased calcium activity modulation of the indirect pathway and the fast-spiking interneuron population around action-related events. Together, our findings suggest an imbalance in striatal activity during action control. This disruption may contribute to the altered goal-directed control previously reported.

The development of compulsive coping behavior depends on dorsolateral striatum dopamine-dependent mechanisms

Humans greatly differ in how they cope with stress, a natural behavior learnt through negative reinforcement. Some individuals engage in displacement activities, others in exercise or comfort eating, and others still in alcohol use. Across species, adjunctive behaviors, such as polydipsic drinking, are used as a form of displacement activity that reduces stress. Some individuals, in particular those that use alcohol to self-medicate, tend to lose control over such coping behaviors, which become excessive and compulsive. However, the psychological and neural mechanisms underlying this individual vulnerability have not been elucidated. Here we tested the hypothesis that the development of compulsive adjunctive behaviors stems from the functional engagement of the dorsolateral striatum (DLS) dopamine-dependent habit system after a prolonged history of adjunctive responding. We measured in longitudinal studies in male Sprague Dawley rats the sensitivity of early established vs compulsive polydipsic water or alcohol drinking to a bilateral infusion into the anterior DLS (aDLS) of the dopamine receptor antagonist α-flupentixol. While most rats acquired a polydipsic drinking response with water, others only did so with alcohol. Whether drinking water or alcohol, the acquisition of this coping response was insensitive to aDLS dopamine receptor blockade. In contrast, after prolonged experience, adjunctive drinking became dependent on aDLS dopamine at a time when it was compulsive in vulnerable individuals. These data suggest that habits may develop out of negative reinforcement and that the engagement of their underlying striatal system is necessary for the manifestation of compulsive adjunctive behaviors.

A dual-pathway architecture enables chronic stress to promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions by promoting the formation of inflexible, potentially maladaptive, habits. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted approach in male and female mice, we reveal a dual pathway, amygdala-striatal, neuronal circuit architecture by which a recent history of chronic stress shapes learning to disrupt flexible goal-directed behavior in favor of inflexible habits. Chronic stress inhibits activity of basolateral amygdala projections to the dorsomedial striatum to impede the action-outcome learning that supports flexible, goal-directed decisions. Stress also increases activity in direct central amygdala projections to the dorsomedial striatum to promote the formation of rigid, inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to promote premature habit formation. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and other psychiatric conditions.

Food Restriction Level and Reinforcement Schedule Differentially Influence Behavior during Acquisition and Devaluation Procedures in Mice

Behavioral strategies are often classified based on whether reinforcer value controls reinforcement. Value-sensitive behaviors, in which animals update their actions when reinforcer value is changed, are classified as goal-directed; conversely, value-insensitive actions, where behavior remains consistent when the reinforcer is removed or devalued, are considered habitual. Basic reinforcement schedules can help to bias behavior toward either process: random ratio (RR) schedules are thought to promote the formation of goal-directed behaviors while random intervals (RIs) promote habitual control. However, how the schedule-specific features of these tasks interact with other factors that influence learning to control behavior has not been well characterized. Using male and female mice, we asked how distinct food restriction levels, a strategy often used to increase task engagement, interact with RR and RI schedules to control performance during task acquisition and devaluation procedures. We determined that food restriction level has a stronger effect on the behavior of mice following RR schedules compared with RI schedules, and that it promotes a decrease in response rate during devaluation procedures that is best explained by the effects of extinction rather than devaluation. Surprisingly, food restriction accelerated the decrease in response rates observed following devaluation across sequential extinction sessions, but not within a single session. Our results support the idea that the relationships between schedules and behavioral control strategies are not clear-cut and suggest that an animal's engagement in a task must be accounted for, together with the structure of reinforcement schedules, to appropriately interpret the cognitive underpinnings of behavior.

Stimulant-like subjective effects of alcohol are not related to resting-state connectivity in healthy men

Individual differences in subjective, stimulant-like effects of alcohol are associated with the risk of developing alcohol use disorder. Specifically, individuals who experience more pronounced stimulant-like effects from alcohol are more likely to continue and escalate their usage. The neural basis for these individual differences in subjective response is not yet known. Using a within-subject design, 27 healthy male social drinkers completed three fMRI scans after ingesting a placebo, 0.4 and 0.8 g/kg alcohol, in a randomized order under double-blind conditions. Subjective stimulant effects of alcohol were assessed at regular intervals during each session. Seed-based and regional homogeneity analyses were conducted to evaluate changes in resting-state functional connectivity in relation to the stimulant effect of alcohol. Results indicated that 0.4 g/kg alcohol increased the connectivity to thalamus, and 0.8 g/kg alcohol decreased the connectivity to ventral anterior insula, primarily from the superior parietal lobule. Both doses reduced regional homogeneity in the superior parietal lobule but without an exact overlap with clusters showing connectivity changes in the seed-based analyses. The self-reported stimulant effect of alcohol was not significantly related to changes in seed-based connectivity or regional homogeneity. These findings suggest that alcohol-induced stimulation effects are not related to these indices of neural activity.

Estradiol Receptors Inhibit Long-Term Potentiation in the Dorsomedial Striatum

Estradiol, a female sex hormone and the predominant form of estrogen, has diverse effects throughout the brain including in learning and memory. Estradiol modulates several types of learning that depend on the dorsomedial striatum (DMS), a subregion of the basal ganglia involved in goal-directed learning, cued action-selection, and motor skills. A cellular basis of learning is synaptic plasticity, and the presence of extranuclear estradiol receptors ERα, ERβ, and G-protein-coupled estrogen receptor (GPER) throughout the DMS suggests that estradiol may influence rapid cellular actions including those involved in plasticity. To test whether estradiol affects synaptic plasticity in the DMS, corticostriatal long-term potentiation (LTP) was induced using theta-burst stimulation (TBS) in ex vivo brain slices from intact male and female C57BL/6 mice. Extracellular field recordings showed that female mice in the diestrous stage of the estrous cycle exhibited LTP similar to male mice, while female mice in estrus did not exhibit LTP. Furthermore, antagonists of ERα or GPER rescued LTP in estrous females and agonists of ERα or GPER reduced LTP in diestrous females. In males, activating ERα but not GPER reduced LTP. These results uncover an inhibitory action of estradiol receptors on cellular learning in the DMS and suggest a cellular mechanism underlying the impairment in certain types of DMS-based learning observed in the presence of high estradiol. Because of the dorsal striatum's role in substance use disorders, these findings may provide a mechanism underlying an estradiol-mediated progression from goal-directed to habitual drug use.

Changes in dorsomedial striatum activity mediate expression of goal-directed vs. habit-like cue-induced cocaine seeking

A preclinical model of cue exposure therapy, cue extinction, reduces cue-induced cocaine seeking when drug seeking is goal-directed but not habitual. Goal-directed and habitual behaviors differentially rely on the dorsomedial striatum (DMS) and dorsolateral striatum (DLS), but the effects of cue extinction on dorsal striatal responses to cue-induced drug seeking are unknown. We used fiber photometry to examine how dorsal striatal intracellular calcium and extracellular dopamine activity differs between goal-directed and habitual cue-induced cocaine seeking and how it is impacted by cue extinction. Rats trained to self-administer cocaine paired with an audiovisual cue on schedules of reinforcement that promote goal-directed or habitual cocaine seeking had different patterns of dorsal striatal calcium and dopamine responses to cue-reinforced lever presses. Cue extinction reduced calcium and dopamine responses during subsequent drug seeking in the DMS, but not in the DLS. Therefore, cue extinction may reduce goal-directed behavior through its effects on the DMS, whereas habitual behavior and the DLS are unaffected.

External globus pallidus input to the dorsal striatum regulates habitual seeking behavior in male mice

The external globus pallidus (GPe) coordinates action-selection through GABAergic projections throughout the basal ganglia. GPe arkypallidal (arky) neurons project exclusively to the dorsal striatum, which regulates goal-directed and habitual seeking. However, the role of GPe arky neurons in reward-seeking remains unknown. Here, we identified that a majority of arky neurons target the dorsolateral striatum (DLS). Using fiber photometry, we found that arky activities were higher during random interval (RI; habit) compared to random ratio (RR; goal) operant conditioning. Support vector machine analysis demonstrated that arky neuron activities have sufficient information to distinguish between RR and RI behavior. Genetic ablation of this arkyGPe→DLS circuit facilitated a shift from goal-directed to habitual behavior. Conversely, chemogenetic activation globally reduced seeking behaviors, which was blocked by systemic D1R agonism. Our findings reveal a role of this arkyGPe→DLS circuit in constraining habitual seeking in male mice, which is relevant to addictive behaviors and other compulsive disorders.

Alcohol potentiates multiple GABAergic inputs to dorsal striatum fast-spiking interneurons

Parvalbumin-expressing dorsal striatal fast-spiking interneurons, comprising ∼1% of the total dorsal striatal neuronal population, are necessary for the expression of compulsive-like ethanol consumption mice. Fast-spiking interneurons are driven to fire by glutamatergic inputs derived primarily from the cortex. However, these neurons also receive substantial GABAergic input from two sources: the globus pallidus and the reticular nucleus of the thalamus. How ethanol modulates inhibitory input onto fast-spiking neurons is unclear and, more broadly, alcohol effects on GABAergic synaptic transmission onto GABAergic interneurons are understudied. Examining this, we found that acute bath application of ethanol (50 mM) potentiated GABAergic transmission from both the globus pallidus and the reticular nucleus of the thalamus onto fast-spiking interneurons in mouse of both sexes. This ethanol-induced potentiation required postsynaptic calcium and was not accompanied by a sustained change in presynaptic GABA release probability. Examining whether this ethanol effect persisted following chronic intermittent ethanol exposure, we found attenuated acute-ethanol potentiation of GABAergic transmission from both the globus pallidus and the reticular nucleus of the thalamus onto striatal fast-spiking interneurons. These data underscore the impact of ethanol on GABAergic signaling in the dorsal striatum and support the notion that ethanol may disinhibit the dorsolateral striatum.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration (2 h/day). We then exposed them to 4 days of punishment testing, in which footshock (0.4 mA, 0.3 s) was delivered randomly on one-third of trials, immediately following completion of seeking and prior to extension of the taking lever. Before and after punishment testing (4 days pre-punishment and ≥4 days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

FGF2 activity regulates operant alcohol self-administration and mesolimbic dopamine transmission

Fibroblast growth factor 2 (FGF2) is involved in the development and maintenance of the brain dopamine system. We previously showed that alcohol exposure alters the expression of FGF2 and its receptor, FGF receptor 1 (FGFR1) in mesolimbic and nigrostriatal brain regions, and that FGF2 is a positive regulator of alcohol drinking. Here, we determined the effects of FGF2 and of FGFR1 inhibition on alcohol consumption, seeking and relapse, using a rat operant self-administration paradigm. In addition, we characterized the effects of FGF2-FGFR1 activation and inhibition on mesolimbic and nigrostriatal dopamine neuron activation using in vivo electrophysiology. We found that recombinant FGF2 (rFGF2) increased the firing rate and burst firing activity of dopaminergic neurons in the mesolimbic and nigrostriatal systems and led to increased operant alcohol self-administration. In contrast, the FGFR1 inhibitor PD173074 suppressed the firing rate of these dopaminergic neurons, and reduced operant alcohol self-administration. Alcohol seeking behavior was not affected by PD173074, but this FGFR1 inhibitor reduced post-abstinence relapse to alcohol consumption, albeit only in male rats. The latter was paralleled by the increased potency and efficacy of PD173074 in inhibiting dopamine neuron firing. Together, our findings suggest that targeting the FGF2-FGFR1 pathway can reduce alcohol consumption, possibly via altering mesolimbic and nigrostriatal neuronal activity.

Goal-directed and habitual decision making under stress in gambling disorder: An fMRI study

The development of addictive behaviors has been suggested to be related to a transition from goal-directed to habitual decision making. Stress is a factor known to prompt habitual behavior and to increase the risk for addiction and relapse. In the current study, we therefore used functional MRI to investigate the balance between goal-directed 'model-based' and habitual 'model-free' control systems and whether acute stress would differentially shift this balance in gambling disorder (GD) patients compared to healthy controls (HCs). Using a within-subject design, 22 patients with GD and 20 HCs underwent stress induction or a control condition before performing a multistep decision-making task during fMRI. Salivary cortisol levels showed that the stress induction was successful. Contrary to our hypothesis, GD patients did not show impaired goal-directed 'model-based' decision making, which remained similar to HCs after stress induction. Bayes factors provided three times more evidence against a difference between the groups or a group-by-stress interaction on the balance between model-based and model-free decision making. Similarly, no differences were found between groups and conditions on the neural estimates of model-based or model-free decision making. These results challenge the notion that GD is related to an increased reliance on habitual (or decreased goal-directed) control, even during stress.

Reinforcer value moderates the effects of prenatal alcohol exposure on learning and reversal

Introduction

Fetal Alcohol Spectrum Disorders (FASD) are the leading cause of preventable developmental disability and are commonly characterized by alterations in executive function. Reversal learning tasks are reliable, cross-species methods for testing a frequently impaired aspect of executive control, behavioral flexibility. Pre-clinical studies commonly require the use of reinforcers to motivate animals to learn and perform the task. While there are several reinforcers available, the most commonly employed are solid (food pellets) and liquid (sweetened milk) rewards. Previous studies have examined the effects of different solid rewards or liquid dietary content on learning in instrumental responding and found that rodents on liquid reward with higher caloric content performed better with increased response and task acquisition rate. The influence of reinforcer type on reversal learning and how this interacts with developmental insults such as prenatal alcohol exposure (PAE) has not been explored.

Methods

We tested whether reinforcer type during learning or reversal would impact an established deficit in PAE mice.

Results

We found that all male and female mice on liquid reward, regardless of prenatal exposure were better motivated to learn task behaviors during pre-training. Consistent with previous findings, both male and female PAE mice and Saccharine control mice were able to learn the initial stimulus reward associations irrespective of the reinforcer type. During the initial reversal phase, male PAE mice that received pellet rewards exhibited maladaptive perseverative responding whereas male mice that received liquid rewards performed comparable to their control counterparts. Female PAE mice that received either reinforcer types did not exhibit any deficits on behavioral flexibility. Female saccharine control mice that received liquid, but not pellet, rewards showed increased perseverative responding during the early reversal phase.

Discussion

These data suggest that reinforcer type can have a major impact on motivation, and therefore performance, during reversal learning. Highly motivating rewards may mask behavioral deficits seen with more moderately sought rewards and gestational exposure to the non-caloric sweetener, saccharine, can impact behavior motivated by those reinforcers in a sex-dependent manner.

Computational Mechanisms of Addiction and Anxiety: A Developmental Perspective

A central goal of computational psychiatry is to identify systematic relationships between transdiagnostic dimensions of psychiatric symptomatology and the latent learning and decision-making computations that inform individuals' thoughts, feelings, and choices. Most psychiatric disorders emerge prior to adulthood, yet little work has extended these computational approaches to study the development of psychopathology. Here, we lay out a roadmap for future studies implementing this approach by developing empirically and theoretically informed hypotheses about how developmental changes in model-based control of action and Pavlovian learning processes may modulate vulnerability to anxiety and addiction. We highlight how insights from studies leveraging computational approaches to characterize the normative developmental trajectories of clinically relevant learning and decision-making processes may suggest promising avenues for future developmental computational psychiatry research.

Negative impact of daily screen use on inhibitory control network in preadolescence: A two-year follow-up study

The COVID-19 pandemic has made an unprecedented shift in children's daily lives. Children are increasingly spending time with screens to learn and connect with others. As the online environment rapidly substitutes in-person experience, understanding children's neuropsychological trajectories associated with screen experiences is important. Previous findings suggest that excessive screen use can lead children to prefer more immediate rewards over delayed outcomes. We hypothesized that increased screen time delays a child's development of inhibitory control system in the brain (i.e., fronto-striatal circuitry). By analyzing neuropsychological data from 8324 children (9-11ys) from the ABCD Study, we found that children who had more screen time showed a higher reward orientation and weaker fronto-striatal connectivity. Importantly, we found that the daily screen exposure mediated the effect of reward sensitivity on the development of the inhibitory control system in the brain over a two year period. These findings suggest possible negative long-term impacts of increased daily screen time on children's neuropsychological development. The results further demonstrated that screen time influences dorsal striatum connectivity, which suggests that the effect of daily screen use is a habitual seeking behavior. The study provides neural and behavioral evidence for the negative impact of daily screen use on developing children.

Distinct cortico-striatal compartments drive competition between adaptive and automatized behavior

Cortical and basal ganglia circuits play a crucial role in the formation of goal-directed and habitual behaviors. In this study, we investigate the cortico-striatal circuitry involved in learning and the role of this circuitry in the emergence of inflexible behaviors such as those observed in addiction. Specifically, we develop a computational model of cortico-striatal interactions that performs concurrent goal-directed and habit learning. The model accomplishes this by distinguishing learning processes in the dorsomedial striatum (DMS) that rely on reward prediction error signals as distinct from the dorsolateral striatum (DLS) where learning is supported by salience signals. These striatal subregions each operate on unique cortical input: the DMS receives input from the prefrontal cortex (PFC) which represents outcomes, and the DLS receives input from the premotor cortex which determines action selection. Following an initial learning of a two-alternative forced choice task, we subjected the model to reversal learning, reward devaluation, and learning a punished outcome. Behavior driven by stimulus-response associations in the DLS resisted goal-directed learning of new reward feedback rules despite devaluation or punishment, indicating the expression of habit. We repeated these simulations after the impairment of executive control, which was implemented as poor outcome representation in the PFC. The degraded executive control reduced the efficacy of goal-directed learning, and stimulus-response associations in the DLS were even more resistant to the learning of new reward feedback rules. In summary, this model describes how circuits of the dorsal striatum are dynamically engaged to control behavior and how the impairment of executive control by the PFC enhances inflexible behavior.

Ghrelin/GHS-R1A antagonism in memory test and its effects on central molecular signaling involved in addiction in rats

Central ghrelin signaling seems to play important role in addiction as well as memory processing. Antagonism of the growth hormone secretagogue receptor (GHS-R1A) has been recently proposed as a promising tool for the unsatisfactory drug addiction therapy. However, molecular aspects of GHS-R1A involvement in specific brain regions remain unclear. The present study demonstrated for the first time that acute as well as subchronic (4 days) administration of the experimental GHS-R1A antagonist JMV2959 in usual intraperitoneal doses including 3 mg/kg, had no influence on memory functions tested in the Morris Water Maze in rats as well as no significant effects on the molecular markers linked with memory processing in selected brain areas in rats, specifically on the β-actin, c-Fos, two forms of the calcium/calmodulin-dependent protein kinase II (CaMKII, p-CaMKII) and the cAMP-response element binding protein (CREB, p-CREB), within the medial prefrontal cortex (mPFC), nucleus accumbens (NAc), dorsal striatum, and hippocampus (HIPP). Furthermore, following the methamphetamine intravenous self-administration in rats, the 3 mg/kg JMV2959 pretreatment significantly reduced or prevented the methamphetamine-induced significant decrease of hippocampal β-actin and c-Fos as well as it prevented the significant decrease of CREB in the NAC and mPFC. These results imply, that the GHS-R1A antagonist/JMV2959 might reduce/prevent some of the memory-linked molecular changes elicited by methamphetamine addiction within brain structures associated with memory (HIPP), reward (NAc), and motivation (mPFC), which may contribute to the previously observed significant JMV2959-induced reduction of the methamphetamine self-administration and drug-seeking behavior in the same animals. Further research is necessary to corroborate these results.

Circuit dysfunctions of associative and sensorimotor basal ganglia loops in alcohol use disorder: insights from animal models

Persons that develop Alcohol Use Disorder (AUD) experience behavioral changes that include compulsion to seek and take alcohol despite its negative consequences on the person's psychosocial, health and economic spheres, inability to limit alcohol intake and a negative emotional/ motivational state that emerges during withdrawal. During all the stages of AUD executive functions, i.e. the person's ability to direct their behavior towards a goal, working memory and cognitive flexibility are eroded. Animal models of AUD recapitulate aspects of action selection impairment and offer the opportunity to benchmark the underlying circuit mechanisms. Here we propose a circuit-based approach to AUD research focusing on recent advances in behavioral analysis, neuroanatomy, genetics, and physiology to guide future research in the field.

The role of dorsomedial striatum adenosine 2A receptors in the loss of goal-directed behaviour

RATIONALE

Adenosine A_2A receptors (A_2AR) in the dorsal striatum have been implicated in goal-directed behaviour. While activation of these receptors with several methods has resulted in an insensitivity to outcome devaluation, particular explanations for how they disrupt behaviour have not been explored. We both confirm a role for A_2A receptors in goal-directed responding and evaluate additional behavioural aspects of goal-directed control to more fully understand the role of A_2A receptors in instrumental behaviour.

OBJECTIVES

To examine the effects of the adenosine A_2A agonist CGS-21680 in the DMS on response-outcome encoding, updating representations of outcome value and on the ability to inhibit behaviour when reward is not available.

METHODS

Male rats were trained to lever press for food reward. The A_2AR agonist CGS-21680 was infused into the dorsomedial striatum either before an outcome devaluation test, prior to training with two distinct response-outcome associations or prior to a test of discriminative stimulus control over instrumental performance.

RESULTS

Intra-DMS administration of CGS-21680 impaired sensitivity to outcome devaluation. CGS-21680 treatment did not impair acquisition of specific response-outcome associations, selective control of responding based on the presence of stimuli that signaled when reward was or was not available, discrimination between stimuli or lever choices nor did it influence the effect of devaluation on the amounts of food eaten in a consumption test.

CONCLUSIONS

CGS-21680 impairs the ability to modulate responding based on recent changes to outcome value, an effect that is not accounted for by impairments in behavioural inhibition, discrimination, encoding the specific outcome of a response or the effectiveness of specific satiety.

Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice

Behavioral strategies are often classified based on whether reinforcement is controlled by the value of the reinforcer. Value-sensitive behaviors, in which animals update their actions when reinforcer value is changed, are classified as goal-directed; conversely, value-insensitive actions, where behavior remains consistent when the reinforcer is removed or devalued, are considered habitual. Understanding the features of operant training that bias behavioral control toward either strategy is essential to understanding the cognitive and neuronal processes on which they rely. Using basic reinforcement principles, behavior can be biased toward relying on either process: random ratio (RR) schedules are thought to promote the formation of goal-directed behaviors while random intervals (RI) promote habitual control. However, how the schedule-specific features of these task structures relate to external factors to influence behavior is not well understood. Using male and female mice on distinct food restriction levels, we trained each group on RR schedules with responses-per-reinforcer rates matched to their RI counterparts to control for differences in reinforcement rate. We determined that food restriction level has a stronger effect on the behavior of mice following RR schedules than mice following RI schedules and that food restriction better predicted sensitivity to outcome devaluation than training schedule. Our results support the idea the relationships between RR or RI schedules with goal-directed or habitual behaviors, respectively, are more nuanced than previously appreciated and suggest that an animal's engagement in a task must be accounted for, together with the structure of reinforcement schedules, to appropriately interpret the cognitive underpinnings of behavior.

Chronic Voluntary Alcohol Consumption Alters Promoter Methylation and Expression of Fgf-2 and Fgfr1

Alcohol abuse accounts for 3.3 million deaths annually, rendering it a global health issue. Recently, fibroblast growth factor 2 (FGF-2) and its target, fibroblast growth factor receptor 1 (FGFR1), were discovered to positively regulate alcohol-drinking behaviors in mice. We tested whether alcohol intake and withdrawal alter DNA methylation of Fgf-2 and Fgfr1 and if there is a correlation regarding mRNA expression of these genes. Blood and brain tissues of mice receiving alcohol intermittently over a six-week period were analyzed using direct bisulfite sequencing and qRT-PCR analysis. Assessment of Fgf-2 and Fgfr1 promoter methylation revealed changes in the methylation of cytosines in the alcohol group compared with the control group. Moreover, we showed that the altered cytosines coincided with binding motives of several transcription factors. We also found that Fgf-2 and Fgfr1 gene expression was significantly decreased in alcohol-receiving mice compared with control littermates, and that this effect was specifically detected in the dorsomedial striatum, a brain region involved in the circuitry of the reward system. Overall, our data showed alcohol-induced alterations in both mRNA expression and methylation pattern of Fgf-2 and Fgfr1. Furthermore, these alterations showed a reward system regional specificity, therefore, resembling potential targets for future pharmacological interventions.

Voluntary and forced exposure to ethanol vapor produces similar escalation of alcohol drinking but differential recruitment of brain regions related to stress, habit, and reward in male rats

A major limitation of the most widely used current animal models of alcohol dependence is that they use forced exposure to ethanol including ethanol-containing liquid diet and chronic intermittent ethanol (CIE) vapor to produce clinically relevant blood alcohol levels (BAL) and addiction-like behaviors. We recently developed a novel animal model of voluntary induction of alcohol dependence using ethanol vapor self-administration (EVSA). However, it is unknown whether EVSA leads to an escalation of alcohol drinking per se, and whether such escalation is associated with neuroadaptations in brain regions related to stress, reward, and habit. To address these issues, we compared the levels of alcohol drinking during withdrawal between rats passively exposed to alcohol (CIE) or voluntarily exposed to EVSA and measured the number of Fos+ neurons during acute withdrawal (16 h) in key brain regions important for stress, reward, and habit-related processes. CIE and EVSA rats exhibited similar BAL and similar escalation of alcohol drinking and motivation for alcohol during withdrawal. Acute withdrawal from EVSA and CIE recruited a similar number of Fos+ neurons in the Central Amygdala (CeA), however, acute withdrawal from EVSA recruited a higher number of Fos+ neurons in every other brain region analyzed compared to acute withdrawal from CIE. In summary, while the behavioral measures of alcohol dependence between the voluntary (EVSA) and passive (CIE) model were similar, the recruitment of neuronal ensembles during acute withdrawal was very different. The EVSA model may be particularly useful to unveil the neuronal networks and pharmacology responsible for the voluntary induction and maintenance of alcohol dependence and may improve translational studies by providing preclinical researchers with an animal model that highlights the volitional aspects of alcohol use disorder.

Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates

We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.