Defining the place of habit in substance use disorders

Leveraging cognitive neuroscience for making and breaking real-world habits

Habits are the behavioral output of two brain systems. A stimulus-response (S-R) system that encourages us to efficiently repeat well-practiced actions in familiar settings, and a goal-directed system concerned with flexibility, prospection, and planning. Getting the balance between these systems right is crucial: an imbalance may leave people vulnerable to action slips, impulsive behaviors, and even compulsive behaviors. In this review we examine how recent advances in our understanding of these competing brain mechanisms can be harnessed to increase the control over both making and breaking habits. We discuss applications in everyday life, as well as validated and emergent interventions for clinical populations affected by the balance between these systems. As research in this area accelerates, we anticipate a rapid influx of new insights into intentional behavioral change and clinical interventions, including new opportunities for personalization of these interventions based on the neurobiology, environmental context, and personal preferences of an individual.

The Neurocircuitry of Substance Use Disorder, Treatment, and Change: A Resource for Clinical Psychiatrists

Substance use disorder (SUD) is common in psychiatric patients and has a negative impact on health and well-being. However, SUD often goes untreated, and there is a need for psychiatrists, of all specialties, to address this pervasive clinical problem. In this review, the authors' goal is to provide a resource that describes treatments for SUD, using neuroscience as a framework. They discuss the effect of pharmacotherapy on craving, intoxication, and withdrawal and its ability to interrupt the cycle of substance use in SUD. The neuroscience of stress is reviewed, including medications targeting neurotransmitter systems activated by alarm and fear. Neuroplasticity and promising treatments that use this mechanism, including ketamine, psilocybin, and transcranial magnetic stimulation (TMS), are discussed. The authors conclude by listing resources and practice guidelines for physicians interested in learning more about treatments for SUD.

Role of dopamine in reward expectation and predictability during execution of action sequences

Reward-associated cues serve different functions depending on whether they precede or terminate action sequences. Cues that precede action sequences and signal opportunity for reward could serve as GO signals to initiate the sequence, whereas sequence termination cues could serve as response feedback by signaling reward delivery. Reward expectation during sequence execution depends on these cues and might condition whether behavior is habitual or goal-directed. However, it remains unknown how sequence initiation and termination cues differentially affect reward expectation and contribute to habit learning. Further, while mesolimbic dopamine plays a key role in cue-induced reward expectation and sequence learning, how dynamic changes in dopamine signals differ depending on the response strategy is unclear. Here, we determined how mesolimbic DA signals change over training during cue-mediated sequence learning, depending on the type of cue and the nature of behavioral control. We found sequence initiation and termination cues differentially affect reward expectation during action sequences, with the termination cue contributing to habit and automaticity. Distinct response strategies induced by sequence initiation and termination cues induced differential changes in mesolimbic DA signals that captured variations in reward expectation along sequence execution. Notably, habit-like behavior induced by the sequence termination cue was associated with a rapid shift in DA signals from reward retrieval to the cue. This habit-like behavior was reflected in behavioral inflexibility and attenuated DA reward prediction error signals. Finally, using optogenetics, we provide evidence that phasic DA activity elicited by the sequence termination cue is critical for the development of habit-like behavior.

Psychometric evaluation of the Self-Report Habit Index for assessing habitual e-cigarette use behavior in high school adolescents

Background

E-cigarettes are the most-used nicotine product among adolescents, but limited psychometrically-sound, e-cigarette-relevant measures exist for adolescents. We examined psychometric properties of the Self-Report Habit Index (SRHI) for assessing adolescents' habitual e-cigarette use.

Methods

During Fall 2022, 4855 students from eight Connecticut high schools completed an anonymous survey. The analytic sample comprised 491 students who reported past-month e-cigarette use and completed the SRHI (Age M=15.94, SD=1.24 years, 56 % female, 37.1 % Hispanic, 57.6 % White). We examined the SRHI's latent factor structure; internal reliability; measurement invariance and between-groups differences (e.g., nicotine vs. nicotine-free vaping); and associations with total e-cigarette flavors used in the past month, past-30-day vaping frequency, and e-cigarette dependence.

Results

The SRHI's 6-item, 1-factor structure was confirmed. Internal reliability was excellent. The SRHI was scalar invariant for all subgroups tested. Nicotine (vs. nicotine-free) and daily (vs. non-daily) e-cigarette use were associated with greater habitual e-cigarette use behavior. In adjusted models, habitual e-cigarette use was associated with using more e-cigarette flavors, vaping more frequently, and greater e-cigarette dependence. Habitual e-cigarette use incrementally accounted for variance in past-month flavors used and vaping frequency beyond dependence.

Conclusions

The SRHI evidenced solid psychometric properties for assessing habitual e-cigarette use behavior among high school students. Relationships between habitual use and frequency of use, e-cigarette flavors, and dependence might be expected as these constructs are associated with the three characterizing features of habitual behaviors: frequent repetition, cue-driven elicitation, and automaticity. Future prospective research can clarify the temporal ordering of habitual e-cigarette use and dependence in adolescents.

Differential effects of acute and prolonged morphine withdrawal on motivational and goal-directed control over reward-seeking behaviour

Opioid addiction is a relapsing disorder marked by uncontrolled drug use and reduced interest in normally rewarding activities. The current study investigated the impact of spontaneous withdrawal from chronic morphine exposure on emotional, motivational and cognitive processes involved in regulating the pursuit and consumption of food rewards in male rats. In Experiment 1, rats experiencing acute morphine withdrawal lost weight and displayed somatic signs of drug dependence. However, hedonically driven sucrose consumption was significantly elevated, suggesting intact and potentially heightened reward processing. In Experiment 2, rats undergoing acute morphine withdrawal displayed reduced motivation when performing an effortful response for palatable food reward. Subsequent reward devaluation testing revealed that acute withdrawal disrupted their ability to exert flexible goal-directed control over reward seeking. Specifically, morphine-withdrawn rats were impaired in using current reward value to select actions both when relying on prior action-outcome learning and when given direct feedback about the consequences of their actions. In Experiment 3, rats tested after prolonged morphine withdrawal displayed heightened rather than diminished motivation for food rewards and retained their ability to engage in flexible goal-directed action selection. However, brief re-exposure to morphine was sufficient to impair motivation and disrupt goal-directed action selection, though in this case, rats were only impaired in using reward value to select actions in the presence of morphine-paired context cues and in the absence of response-contingent feedback. We suggest that these opioid-withdrawal induced deficits in motivation and goal-directed control may contribute to addiction by interfering with the pursuit of adaptive alternatives to drug use.

Animal Models of Excessive Alcohol Consumption in Rodents

The development of animal models that demonstrate excessive levels of alcohol consumption has played an important role in advancing our knowledge about neurobiological underpinnings and environmental circumstances that engender such maladaptive behavior. The use of these preclinical models has also provided valuable opportunities for discovering new and novel therapeutic targets that may be useful in the treatment of alcohol use disorder (AUD). While no single model can fully capture the complexities of AUD, the goal is to develop animal models that closely approximate characteristics of heavy alcohol drinking in humans to enhance their translational value and utility. A variety of experimental approaches have been employed to produce the desired phenotype of interest-robust and reliable excessive levels of alcohol drinking. Here we provide an updated review of five animal models that are commonly used. The models entail procedural manipulations of scheduled access to alcohol (time of day, duration, frequency), periods of time when access to alcohol is withheld, and history of alcohol exposure. Specially, the models involve (a) scheduled access to alcohol, (b) scheduled periods of alcohol deprivation, (c) scheduled intermittent access to alcohol, (d) scheduled-induced polydipsia, and (e) chronic alcohol (dependence) and withdrawal experience. Each of the animal models possesses unique experimental features that engender excessive levels of alcohol consumption. Both advantages and disadvantages of each model are described along with discussion of future work to be considered in developing more optimal models. Ultimately, the validity and utility of these models will lie in their ability to aid in the discovery of new and novel potential therapeutic targets as well as serve as a platform to evaluate treatment strategies that effectively reduce excessive levels of alcohol consumption associated with AUD.

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Sex and individual differences in the effect of chronic low-dose ethanol on behavioral strategy selection

BACKGROUND

The development of an alcohol use disorder (AUD) involves impaired behavioral control and flexibility. Behavioral inflexibility includes an inability to shift behavior in response to changes in behavioral outcomes. Low levels of ethanol drinking may promote the formation of inflexible, habitual reward seeking, but this may depend on the timing of ethanol exposure in relation to learning. The goal of this study was to determine whether a history of low-dose ethanol exposure promoted contingency-insensitive sucrose seeking and altered behavioral strategy selection.

METHODS

Male and female C57BL/6J mice were trained to perform a response (lever press) for sucrose on two different reinforcement schedules: one that is thought to promote inflexible responding (random interval) and one that maintains flexible responding (variable ratio [VR]). Following instrumental training each day, mice were exposed to saline or low-dose ethanol (0.5 g/kg; i.p.) either proximal (1 h after) or distal (4 h after) to learning. Mice were then tested for sensitivity to changes in contingency in a contingency degradation test.

RESULTS

A history of low-dose ethanol exposure shifted behavioral strategy selection, as measured by reward tracking behavior, but this depended on sex and reinforcement schedule history. Both male and female mice used different strategies depending on the reinforcement schedule, but only males exhibited ethanol-induced shifts in strategy selection. A history of low-dose ethanol exposure did not impact contingency sensitivity in males but promoted insensitivity in females specifically on the VR lever.

CONCLUSIONS

Female mice show distinct behavioral effects of repeated, low-dose ethanol exposure as compared to males, with sex differences in the use of reward tracking strategies to guide behavior. Future studies should investigate sex differences in the neural consequences of chronic low-dose ethanol exposure that may underlie behavioral changes.

Positive correlation between measures of habitual responding and motivated responding in mice

Habit and motivation are thought to be separate processes, with motivated behavior often considered to be goal directed, whereas habits are defined by the absence of goal-directed control over behavior. However, there has been increasing interrogation of the binary nature of habitual versus goal-directed behavior. Furthermore, although drug and alcohol exposure can promote the formation of habits, drug seeking itself can also be highly flexible, pointing toward the need for complex consideration of the parallel processes that drive behavior. The goal of the current study was to determine whether there was a relation between motivation-as measured by progressive ratio-and habit-as measured by contingency degradation-and whether this relation was affected by ethanol exposure history and sex. The results showed that these measures were positively correlated such that greater contingency insensitivity was associated with achieving higher break points on the progressive-ratio task. However, this relation depended on reinforcement schedule history, ethanol exposure history, and sex. These point to potential relations between measures of habit and motivation and stress the importance of carefully parsing behavioral findings and assays. These findings are also expected to inform future substance use research, as drug history may affect these relations.

Associations between relapse and drinking behaviors in patients with alcohol use disorders: A 6-month prospective study

BACKGROUND

Habitual behaviors, rather than goal-oriented behaviors, mainly characterize drinking patterns in patients with alcohol use disorder (AUD). However, few studies have focused on the influence of drinking behavior on AUD relapse. This prospective study examined associations between drinking behavior patterns and alcohol-use relapse using the 20-item questionnaire for drinking behavior patterns (DBP-20).

METHODS

We enrolled patients with AUD and compared the cohort's demographic data and 6-month outcomes based on the DBP-20 and the Alcohol Use Disorders Identification Test between two groups (alcohol use relapse vs. abstinence). We also assessed the results for significant factors related to relapse.

RESULTS

We included 105 patients with AUD. More patients in the relapse group (n = 63) were active smokers and lived alone, while fewer took medication with cyanamide or disulfiram than those in the abstinence group (n = 42). The DBP-20 automaticity subscale score was higher in the relapse group than that in the abstinence group. Current smoker, living alone, and automatic drinking habits were significantly associated with AUD relapse.

CONCLUSIONS

Automaticity may be a risky drinking behavior that leads to future relapse in patients with AUD, justifying behavioral strategies to combat automatic drinking for relapse prevention.

Persistence of extensively trained avoidance is not elevated in anxiety disorders in an outcome devaluation paradigm

BACKGROUND

A habitual avoidance component may enforce the persistence of maladaptive avoidance behavior in anxiety disorders. Whether habitual avoidance is acquired more strongly in anxiety disorders is unclear.

METHODS

Individuals with current social anxiety disorder, panic disorder and/or agoraphobia (n = 62) and healthy individuals (n = 62) completed a devaluation paradigm with extensive avoidance training, followed by the devaluation of the aversive outcome. In the subsequent test phase, habitual response tendencies were inferred from compatibility effects. Neutral control trials were added to assess general approach learning in the absence of previous extensive avoidance training.

RESULTS

The compatibility effects indicating habitual control did not differ between patients with anxiety disorders and healthy controls. Patients showed lower overall approach accuracy, but this effect was unrelated to the compatibility effects.

CONCLUSIONS

In this study, anxiety disorders were characterized by reduced approach but not stronger habitual avoidance. These results do not indicate a direct association between anxiety disorders and the acquisition of pervasive habitual avoidance in this devaluation paradigm.

Revealing abrupt transitions from goal-directed to habitual behavior

A fundamental tenet of animal behavior is that decision-making involves multiple 'controllers.' Initially, behavior is goal-directed, driven by desired outcomes, shifting later to habitual control, where cues trigger actions independent of motivational state. Clark Hull's question from 1943 still resonates today: "Is this transition abrupt, or is it gradual and progressive?"1 Despite a century-long belief in gradual transitions, this question remains unanswered2,3 as current methods cannot disambiguate goal-directed versus habitual control in real-time. Here, we introduce a novel 'volitional engagement' approach, motivating animals by palatability rather than biological need. Offering less palatable water in the home cage4,5 reduced motivation to 'work' for plain water in an auditory discrimination task when compared to water-restricted animals. Using quantitative behavior and computational modeling6, we found that palatability-driven animals learned to discriminate as quickly as water-restricted animals but exhibited state-like fluctuations when responding to the reward-predicting cue-reflecting goal-directed behavior. These fluctuations spontaneously and abruptly ceased after thousands of trials, with animals now always responding to the reward-predicting cue. In line with habitual control, post-transition behavior displayed motor automaticity, decreased error sensitivity (assessed via pupillary responses), and insensitivity to outcome devaluation. Bilateral lesions of the habit-related dorsolateral striatum7 blocked transitions to habitual behavior. Thus, 'volitional engagement' reveals spontaneous and abrupt transitions from goal-directed to habitual behavior, suggesting the involvement of a higher-level process that arbitrates between the two.

Does stress consistently favor habits over goal-directed behaviors? Data from two preregistered exact replication studies

Instrumental learning is controlled by two distinct parallel systems: goal-directed (action-outcome) and habitual (stimulus-response) processes. Seminal research by Schwabe and Wolf (2009, 2010) has demonstrated that stress renders behavior more habitual by decreasing goal-directed control. More recent studies yielded equivocal evidence for a stress-induced shift towards habitual responding, yet these studies used different paradigms to evaluate instrumental learning or used different stressors. Here, we performed exact replications of the original studies by exposing participants to an acute stressor either before (cf. Schwabe and Wolf, 2009) or directly after (cf. Schwabe and Wolf, 2010) an instrumental learning phase in which they had learned that distinct actions led to distinct, rewarding food outcomes (i.e., instrumental learning). Then, following an outcome devaluation phase in which one of the food outcomes was consumed until participants were satiated, action-outcome associations were tested in extinction. Despite successful instrumental learning and outcome devaluation and increased subjective and physiological stress levels following stress exposure, the stress and no-stress groups in both replication studies responded indifferently to valued and devalued outcomes. That is, non-stressed participants failed to demonstrate goal-directed behavioral control, thereby rendering the critical test of a shift from goal-directed to habitual control in the stress group inapt. Several reasons for these replication failures are discussed, including the rather indiscriminate devaluation of outcomes that may have contributed to indifferent responding during extinction, which emphasize the need to further our understanding of the boundary conditions in research aimed at demonstrating a stress-induced shift towards habitual control.

Interaction between habits as action sequences and goal-directed behavior under time pressure

Human behavior consists in large parts of action sequences that are often repeated in mostly the same way. Through extensive repetition, sequential responses become automatic or habitual, but our environment often confronts us with events to which we have to react flexibly and in a goal-directed manner. To assess how implicitly learned action sequences interfere with goal-directed control, we developed a novel behavioral paradigm in which we combined action sequence learning through repetition with a goal-directed task component. So-called dual-target trials require the goal-directed selection of the response with the highest reward probability in a fast succession of trials with short response deadlines. Importantly, the response primed by the learned action sequence is sometimes different from that required by the goal-directed task. As expected, we found that participants learned the action sequence through repetition, as evidenced by reduced reaction times (RT) and error rates (ER), while still acting in a goal-directed manner in dual-target trials. Specifically, we found that the learned action sequence biased choices in the goal-directed task toward the sequential response, and this effect was more pronounced the better individuals had learned the sequence. Our novel task may help shed light on the acquisition of automatic behavioral patterns and habits through extensive repetition, allows to assess positive features of habitual behavior (e.g., increased response speed and reduced error rates), and importantly also the interaction of habitual and goal-directed behaviors under time pressure.

Disrupting reconsolidation by PKA inhibitor in BLA reduces heroin-seeking behavior

Drug abuse is considered a maladaptive pathology of emotional memory and is associated with craving and relapse induced by drug-associated stimuli or drugs. Reconsolidation is an independent memory process with a strict time window followed by the reactivation of drug-associated stimulus depending on the basolateral amygdala (BLA). Pharmacology or behavior treatment that disrupts the reconsolidation can effectively attenuate drug-seeking in addicts. Here, we hypothesized that heroin-memory reconsolidation requires cAMP-dependent protein kinase A (PKA) of BLA based on the fundamental effect of PKA in synaptic plasticity and memory process. After 10 days of acquisition, the rats underwent 11 days of extinction training and then received the intra-BLA infusions of the PKA inhibitor Rp-cAMPS at different time windows with/without a reactivation session. The results show that PKA inhibitor treatment in the reconsolidation time window disrupts the reconsolidation and consequently reduces cue-induced reinstatement, heroin-induced reinstatement, and spontaneous recovery of heroin-seeking behavior in the rats. In contrast, there was no effect on cue-induced reinstatement in the intra-BLA infusion of PKA inhibitor 6 h after reactivation or without reactivation. These data suggest that PKA inhibition disrupts the reconsolidation of heroin-associated memory, reduces subsequent drug seeking, and prevents relapse, which is retrieval-dependent, time-limited, and BLA-dependent.

Experiences of peer support workers supporting individuals with substance use disorders in Egypt: phenomenological analysis

Background

Peer support work for substance use disorders is widely implemented in high-income countries. More research is still needed to understand its applicability in settings which have proportionately low budgets allocated to mental health. Peer Support Workers are individuals who managed to achieve recovery from substance use disorders and help people remain engaged in their recovery and prevent relapse through shared understanding.

Aim

To investigate the experience of peer support workers providing recovery support to people with substance use disorders in Egypt.

Methods

A qualitative phenomenological design was used in which 17 adults working as peer support workers for substance use disorders were recruited by means of purposive and snowball sampling. A semi-structured interview with participants was conducted by phone or video-call. Interviews were transcribed and thematically analysed based on descriptive phenomenology.

Results

Three superordinate themes were identified: role responsibility, Peer Support Workers’ need for organizational and stakeholders’ support, and challenges to the role integrity.

Conclusion and recommendations

The findings indicate the need for national and governmental support to peer support workers engaged with people with substance use disorders in Egypt and educating families and the public about the role of peer support workers in substance use disorders.

Prenatal nicotine alters development of the laterodorsal tegmentum: Possible role for attention-deficit/hyperactivity disorder and drug dependence

As we cycle between the states of wakefulness and sleep, a bilateral cholinergic nucleus in the pontine brain stem, the laterodorsal tegmentum (LDT), plays a critical role in controlling salience processing, attention, behavioral arousal, and electrophysiological signatures of the sub- and microstates of sleep. Disorders involving abnormal alterations in behavioral and motivated states, such as drug dependence, likely involve dysfunctions in LDT signaling. In addition, as the LDT exhibits connectivity with the thalamus and mesocortical circuits, as well as receives direct, excitatory input from the prefrontal cortex, a role for the LDT in cognitive symptoms characterizing attention-deficit/hyperactivity disorder (ADHD) including impulsivity, inflexibility, and dysfunctions of attention is suggested. Prenatal nicotine exposure (PNE) is associated with a higher risk for later life development of drug dependence and ADHD, suggesting alteration in development of brain regions involved in these behaviors. PNE has been shown to alter glutamate and cholinergic signaling within the LDT. As glutamate and acetylcholine are major excitatory mediators, these alterations would likely alter excitatory output to target regions in limbic motivational circuits and to thalamic and cortical networks mediating executive control. Further, PNE alters neuronal development and transmission within prefrontal cortex and limbic areas that send input to the LDT, which would compound effects of differential processing within the PNE LDT. When taken together, alterations in signaling in the LDT are likely to play a role in negative behavioral outcomes seen in PNE individuals, including a heightened risk of drug dependence and ADHD behaviors.

Quantifying value-based determinants of drug and non-drug decision dynamics

RATIONALE

A growing body of research suggests that substance use disorder (SUD) may be characterized as disorders of decision making. However, drug choice studies assessing drug-associated decision making often lack more complex and dynamic conditions that better approximate contexts outside the laboratory and may lead to incomplete conclusions regarding the nature of drug-associated value.

OBJECTIVES

The current study assessed isomorphic (choice between identical food options) and allomorphic (choice between remifentanil [REMI] and food) choice across dynamically changing reward probabilities, magnitudes, and differentially reward-predictive stimuli in male rats to better understand determinants of drug value. Choice data were analyzed at aggregate and choice-by-choice levels using quantitative matching and reinforcement learning (RL) models, respectively.

RESULTS

Reductions in reward probability or magnitude independently reduced preferences for food and REMI commodities. Inclusion of reward-predictive cues significantly increased preference for food and REMI rewards. Model comparisons revealed that reward-predictive stimuli significantly altered the economic substitutability of food and REMI rewards at both levels of analysis. Furthermore, model comparisons supported the reformulation of reward value updating in RL models from independent terms to a shared, relative term, more akin to matching models.

CONCLUSIONS

The results indicate that value-based quantitative choice models can accurately capture choice determinants within complex decision-making contexts and corroborate drug choice as a multidimensional valuation process. Collectively, the present study indicates commonalities in decision-making for drug and non-drug rewards, validates the use of economic-based SUD therapies (e.g., contingency management), and implicates the neurobehavioral processes underlying drug-associated decision-making as a potential avenue for future SUD treatment.

Glutamatergic input from the insula to the ventral bed nucleus of the stria terminalis controls reward-related behavior

Individuals suffering from substance use disorder often experience relapse events that are attributed to drug craving. Insular cortex (IC) function is implicated in processing drug-predictive cues and is thought to be a critical substrate for drug craving, but the downstream neural circuit effectors of the IC that mediate reward processing are poorly described. Here, we uncover the functional connectivity of an IC projection to the ventral bed nucleus of the stria terminalis (vBNST), a portion of the extended amygdala that has been previously shown to modulate dopaminergic activity within the ventral tegmental area (VTA), and investigate the role of this pathway in reward-related behaviors. We utilized ex vivo slice electrophysiology and in vivo optogenetics to examine the functional connectivity of the IC-vBNST projection and bidirectionally control IC-vBNST terminals in various reward-related behavioral paradigms. We hypothesized that the IC recruits mesolimbic dopamine signaling by activating VTA-projecting, vBNST neurons. Using slice electrophysiology, we found that the IC sends a glutamatergic projection onto vBNST-VTA neurons. Photoactivation of IC-vBNST terminals was sufficient to reinforce behavior in a dopamine-dependent manner. Moreover, silencing the IC-vBNST projection was aversive and resulted in anxiety-like behavior without affecting food consumption. This work provides a potential mechanism by which the IC processes exteroceptive triggers that are predictive of reward.

A Circuit-Based Information Approach to Substance Abuse Research

Recent animal research on substance-use disorders (SUDs) has emphasized learning models and the identification of 'addiction-prone' animals. Meanwhile, basic neuroscientific research has elucidated molecular, cellular, and circuit functions with increasing sophistication. However, SUD-related research is hampered by continued arguments over which animal models are more 'addiction like', as well as the facile assignment of behaviors to a given brain region and vice versa. We argue that SUD-related research would benefit from a 'bottom-up' approach including: (i) the characterization of different brain circuits to understand their normal function as well as how they respond to drugs and contribute to SUDs; and (ii) a focus on the use patterns and neurobiological effects of different substances to understand the range of critical SUD-related in vivo phenotypes.

Clinical Neuroscience of Addiction: What Clinical Psychologists Need to Know and Why

The last three decades in psychological research have been marked by interdisciplinary science. Addiction represents a prime example of a disorder marked by a complex interaction among psychosocial and biological factors. This review highlights critical findings in the basic neuroscience of addiction and translates them into clinical language that can inform clinical psychologists in their research, teaching, and practice. From mechanisms of reward processing, learning and memory, allostasis, incentive-sensitization, withdrawal, tolerance, goal-directed decision making, habit learning, genetics, inflammation, and the microbiome, the common theme of this review is to illustrate the clinical utility of basic neuroscience research and to identify opportunities for clinical science. The thoughtful integration of basic and clinical science provides a powerful tool to fulfill the scientific mission of improving health care. Clinical psychologists have a crucial role to play in the translational science of addiction.

Feeding the addiction: Narrowing of goals to habits

Whilst the initiation of cocaine use is typically goal-directed and motivated by the rewarding effects of the drug, drug-taking can become habitual over time, rendering the user less sensitive to cocaine's hedonic value. Experimental studies suggest that patients with cocaine use disorder (CUD) are particularly prone to develop habits, even in non-drug related contexts. CUD patients have previously been shown to consume higher levels of high-calorie foods and report more uncontrolled eating, suggesting a tendency towards habitual or dysregulated food-related behaviours. We investigated this in CUD patients compared with healthy controls. Participants were presented with a series of food images and asked to rate their willingness to pay for, and their motivation to consume the foods. Self-reported motivations for food choices were collected using a validated questionnaire. Our data suggests CUD patients display goal-narrowing towards cocaine, as well as habitual tendencies towards both cocaine and food. These findings stress the importance of addressing non-drug related behaviours when treating CUD patients. Further, they suggest that habits may provide a novel and additional target for psychological interventions, for example, through the retraining of maladaptive habits. Whilst research into the feasibility and efficacy of habit retraining is certainly required, the potential for a new avenue of treatment should not be ignored.

Behavioral, neurobiological, and neurochemical mechanisms of ethanol self-administration: A translational review

Alcohol use disorder has multiple characteristics including excessive ethanol consumption, impaired control over drinking behaviors, craving and withdrawal symptoms, compulsive seeking behaviors, and is considered a chronic condition. Relapse is common. Determining the neurobiological targets of ethanol and the adaptations induced by chronic ethanol exposure is critical to understanding the clinical manifestation of alcohol use disorders, the mechanisms underlying the various features of the disorder, and for informing medication development. In the present review, we discuss ethanol's interactions with a variety of neurotransmitter systems, summarizing findings from preclinical and translational studies to highlight recent progress in the field. We then describe animal models of ethanol self-administration, emphasizing the value, limitations, and validity of commonly used models. Lastly, we summarize the behavioral changes induced by chronic ethanol self-administration, with an emphasis on cue-elicited behavior, the role of ethanol-related memories, and the emergence of habitual ethanol seeking behavior.

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.

Neural substrates of habit

Active reward pursuit is supported by the balance between the cognitive and habitual control of behavior. The cognitive, goal-directed strategy relies on the prospective evaluation of anticipated consequences, which allows behavior to readily adapt when circumstances change. Repetition of successful actions promotes less cognitively taxing habits, in which behavior is automatically executed without prospective consideration. Disruption in either of these behavioral regulatory systems contributes to the symptoms that underlie many psychiatric disorders. Here, I review recently identified neural substrates, at multiple neural levels, that contribute to habits and outline gaps in knowledge that must be addressed to fully understand the neural mechanisms of behavioral control.

Capturing habitualness of drinking and smoking behavior in humans

BACKGROUND

Recent findings suggest that overreliance on habit may be common in individuals diagnosed with addiction. To advance our understanding of habit in clinical samples and from behavioral measures, this study examines the interrelations between self-reported habit index for smoking and drinking as well as behavioral measures of intraindividual variability in smoking and drinking.

METHODS

Treatment-seeking heavy drinking smokers (N = 416) completed the Self-Report Habit Index (SRHI) adapted for both smoking and drinking. "Behavioral habitualness" was computed from the degree of intraindividual variability in patterns of smoking and drinking over the past month. Using the 28-day Timeline-Follow Back (TLFB) interview, we derived two measures of intraindividual variability: interclass correlation (ICC) and autocorrelation [AR(7) coefficients].

RESULTS

Self-report measures of habit were robustly associated with clinical severity of drinking and smoking with higher habit scores indicating greater severity of drinking and smoking, respectively. ICC and AR(7) coefficients, the behavioral measure of "patterness" and putative habit, were not associated with SRHI scores. While ICC for smoking was associated with higher nicotine dependence scores, this pattern was not found for drinking ICC and alcohol problem severity.

CONCLUSIONS

These results support the construct validity of the self-report measures of habit for smoking and drinking, as well an initial evaluation of behavioral measure of smoking "patterness" as a potential proxy for habit smoking. Because habit represents a complex phenotype with limited clinical translation, additional studies capturing a wider range of substance use severity and coupled with brain-based validation methods are warranted.

Interfacing behavioral and neural circuit models for habit formation

Habits are an important mechanism by which organisms can automate the control of behavior to alleviate cognitive demand. However, transitions to habitual control are risky because they lead to inflexible responding in the face of change. The question of how the brain controls transitions into habit is thus an intriguing one. How do we regulate when our repeated actions become automated? When is it advantageous or disadvantageous to release actions from cognitive control? Decades of research have identified a variety of methods for eliciting habitual responding in animal models. Progress has also been made to understand which brain areas and neural circuits control transitions into habit. Here, I discuss existing research on behavioral and neural circuit models for habit formation (with an emphasis on striatal circuits), and discuss strategies for combining information from different paradigms and levels of analysis to prompt further progress in the field.

Reward, Relief and Habit Drinking: Initial Validation of a Brief Assessment Tool

AIMS

Alcohol use disorder is highly heterogeneous. One approach to understanding this heterogeneity is the identification of drinker subtypes. A candidate classification consists of reward and relief subtypes. The current study examines a novel self-report measure of reward, relief, and habit drinking for its clinical correlates and subjective response (SR) to alcohol administration.

METHODS

Non-treatment-seeking heavy drinkers (n = 140) completed the brief reward, relief, habit drinking scale (RRHDS). A subset of this sample (n = 67) completed an intravenous alcohol administration. Individuals were classified into drinker subtypes. A crowdsourced sample of heavy drinkers (n = 187) completed the RRHDS and a validated reward relief drinking scale to compare drinking classification results.

RESULTS

The majority of the sample was classified as reward drinkers (n = 100), with fewer classified as relief (n = 19) and habit (n = 21) drinkers. Relief and habit drinkers reported greater tonic alcohol craving compared to reward drinkers. Reward drinkers endorsed drinking for enhancement, while relief drinkers endorsed drinking for coping. Regarding the alcohol administration, the groups differed in negative mood, such that relief/habit drinkers reported a decrease in negative mood during alcohol administration, compared to reward drinkers. The follow-up crowdsourcing study found a 62% agreement in reward drinker classification between measures and replicated the tonic craving findings.

CONCLUSIONS

Our findings suggest that reward drinkers are dissociable from relief/habit drinkers using the brief measure. However, relief and habit drinkers were not successfully differentiated, which suggests that these constructs may overlap phenotypically. Notably, measures of dysphoric mood were better at detecting group differences than measures capturing alcohol's rewarding effects.

The Fyn kinase inhibitor, AZD0530, suppresses mouse alcohol self-administration and seeking

Fyn is a member of the Src family of protein tyrosine kinases (PTKs) that plays an important role not only in normal synaptic functions but also in brain pathologies including alcohol use disorder. We previously reported that repeated cycles of binge drinking and withdrawal activate Fyn in the dorsomedial striatum (DMS) of rodents, and that Fyn signaling in the DMS contributes to rat alcohol intake and relapse. Here, we used AZD0530, a CNS penetrable inhibitor of Src PTKs developed for the treatment of Alzheimer disease and cancer and tested its efficacy to suppress alcohol-dependent molecular and behavioral effects. We show that systemic administration of AZD0530 prevents alcohol-induced Fyn activation and GluN2B phosphorylation in the DMS of mice. We further report that a single dose of AZD0530 reduces alcohol operant self-administration and promotes extinction of alcohol self-administration without altering basal and dopamine D1 receptor-dependent locomotion. Together, our findings suggest that AZD0530, through its inhibitory actions on Fyn kinase, dampens alcohol seeking and drinking.

Fractionating the all-or-nothing definition of goal-directed and habitual decision-making

Goal-directed and habitual decision-making are fundamental processes that support the ongoing adaptive behavior. There is a growing interest in examining their disruption in psychiatric disease, often with a focus on a disease shifting control from one process to the other, usually a shift from goal-directed to habitual control. However, several different experimental procedures can be used to probe whether decision-making is under goal-directed or habitual control, including outcome devaluation and contingency degradation. These different experimental procedures may recruit diverse behavioral and neural processes. Thus, there are potentially many opportunities for these disease phenotypes to manifest as alterations to both goal-directed and habitual controls. In this review, we highlight the examples of behavioral and neural circuit divergence and similarity, and suggest that interpretation based on behavioral processes recruited during testing may leave more room for goal-directed and habitual decision-making to coexist. Furthermore, this may improve our understanding of precisely what the involved neural mechanisms underlying aspects of goal-directed and habitual behavior are, as well as how disease affects behavior and these circuits.

Ethanol pre-exposure does not increase delay discounting in P rats, but does impair the ability to dynamically adapt behavioral allocation to changing reinforcer contingencies

Increased subjective discounting of delayed rewards is associated with substance abuse, and individuals tend to discount their drug of choice at a greater rate compared to monetary rewards. While there is evidence indicating that increased delay discounting (DD) is a risk factor for substance abuse, some results suggest that exposure to drugs of abuse also increases DD, but effects are mixed. The current study examined whether ethanol pre-exposure increases DD and if an ethanol reinforcer would be discounted at a greater rate than sucrose. Alcohol preferring (P) rats were pre-exposed to either ethanol or sucrose using an intermittent access protocol (IAP) for 8 weeks. Then animals completed an operant fixed choice procedure where each pre-exposure group was split into either an ethanol or sucrose reinforcer group. Afterwards, animals completed an adjusting delay DD task using the same groups as the fixed choice task. Animals that received access to ethanol in the IAP showed increased delayed reward preference in a delay and session dependent manner. Specifically, ethanol pre-exposed animals took more sessions to decrease their preference for the delayed reward at longer delays. In the adjusting delay task, no differences in mean adjusting delays were seen, but ethanol pre-exposure impaired animals' ability to reach stability criteria. The observed results are not consistent with ethanol pre-exposure causing a change in DD. Rather they indicate ethanol pre-exposure impaired animals' ability to reallocate their behavior in response to a change in reinforcer contingencies. The current findings extend prior results showing alcohol naïve P rats exhibit both increased DD and decreased response inhibition (Beckwith and Czachowski 2014, 2016) by demonstrating that after alcohol exposure they exhibit a form of behavioral inflexibility. Hence, a "two-hit" genetic vulnerability/environmental acceleration of addictive behavior is supported.

Recruitment and disruption of ventral pallidal cue encoding during alcohol seeking

A critical area of inquiry in the neurobiology of alcohol abuse is the mechanism by which cues gain the ability to elicit alcohol use. Previously, we found that cue-evoked activity in rat ventral pallidum robustly encodes the value of sucrose cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue-evoked activity and behavioral latency after instrumental training (Richard et al., 2018, Elife, 7, e33107). Here, we assessed: (a) ventral pallidal representations of Pavlovian versus instrumental cues trained with alcohol reward, and (b) the impact of non-associative alcohol exposure on ventral pallidal representations of sucrose cues. Decoding of cue identity based on ventral pallidum firing was blunted for the Pavlovian alcohol cue in comparison to both the instrumental cue trained with alcohol and either cue type trained with sucrose. Further, non-associative alcohol exposure had opposing effects on ventral pallidal encoding of sucrose cues trained on instrumental versus Pavlovian associations, enhancing decoding accuracy for an instrumental discriminative stimulus and reducing decoding accuracy for a Pavlovian conditioned stimulus. These findings suggest that alcohol exposure can drive biased engagement of specific reward-related signals in the ventral pallidum.

A Convenient Electrochemiluminescent Immunosensor for Detecting Methamphetamine Antibody

An antibody-based immunotherapy for methamphetamine (MA) addictive treatment is has been drawing more and more attention in recent years. However, studies about methamphetamine antibody (anti-MA) immunodetections are rare, owing to the lack of immunogenicity of small molecule MA. This study provides a simple and effective approach to develop a convenient electrochemiluminescent (ECL) immunosensor for the testing of anti-MA. In short, the synthetic holoantigen of MA is immobilized on a homemade gold nanoparticles modified electrode as the sensing host for the specific recognition and detection of anti-MA. The research suggested, under optimal experimental conditions, the ECL intensity on resultant immunosensor has a wide-linear regression toward the anti-MA quantity within the range from 0.03 to 3.07 ng with a detection limit of 2.32 pg. It responded to the dosage of anti-MA in spiked blood samples with satisfactory recovery. According to the research, the developed sensor shows promise as a portable Anti-MA fast seized device which performs quickly and offers convenience, and will be helpful for forensic identification and clinical treatment.

Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder

RATIONALE

Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation.

OBJECTIVES

We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD).

METHODS

We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation.

RESULTS

Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients.

CONCLUSIONS

Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD.

Credit assignment to state-independent task representations and its relationship with model-based decision making

It is widely accepted that agents learn action values based on experience in a “model-free” manner (i.e., without holding a model of the environment). Environments usually embody many features, where a subset is considered relevant for model-free outcome learning. In this study, we show that a putative model-free system assigns credit to outcome-irrelevant task representations, regardless of stimulus features. The degree of impact of these associations is strongly linked to deployment of model-based strategies. Our findings motivate a reconsideration of how model-free representations are formed and regulated according to the structure of the environment.

Model-free learning enables an agent to make better decisions based on prior experience while representing only minimal knowledge about an environment’s structure. It is generally assumed that model-free state representations are based on outcome-relevant features of the environment. Here, we challenge this assumption by providing evidence that a putative model-free system assigns credit to task representations that are irrelevant to an outcome. We examined data from 769 individuals performing a well-described 2-step reward decision task where stimulus identity but not spatial-motor aspects of the task predicted reward. We show that participants assigned value to spatial-motor representations despite it being outcome irrelevant. Strikingly, spatial-motor value associations affected behavior across all outcome-relevant features and stages of the task, consistent with credit assignment to low-level state-independent task representations. Individual difference analyses suggested that the impact of spatial-motor value formation was attenuated for individuals who showed greater deployment of goal-directed (model-based) strategies. Our findings highlight a need for a reconsideration of how model-free representations are formed and regulated according to the structure of the environment.

The Molecular Basis of Drug Addiction: Linking Epigenetic to Synaptic and Circuit Mechanisms

Addiction is a disease in which, after a period of recreational use, a subset of individuals develops compulsive use that does not stop even in light of major negative consequences. Here, we review the evidence for underlying epigenetic remodeling in brain in two settings. First, excessive dopamine signaling during drug use may modulate gene expression, altering synaptic function and circuit activity and leading over time to maladaptive behaviors in vulnerable individuals. Second, on a longer timescale, life experience can shape the epigenetic landscape in brain and thereby may contribute to an individual's vulnerability by amplifying drug-induced changes in gene expression that drive the transition to addiction. We conclude by exploring how epigenetic mechanisms might serve as therapeutic targets for addiction treatments.

Genetic basis of psychopathological dimensions shared between schizophrenia and bipolar disorder

Shared genetic vulnerability between schizophrenia (SCZ) and bipolar disorder (BP) was demonstrated, but the genetic underpinnings of specific symptom domains are unclear. This study investigated which genes and gene sets may modulate specific psychopathological domains and if genome-wide significant loci previously associated with SCZ or BP may play a role. Genome-wide data were available in patients with SCZ (n = 226) or BP (n = 228). Phenotypes under investigation were depressive and positive symptoms severity, suicidal ideation, onset age and substance use disorder comorbidity. Genome-wide analyses were performed at gene and gene set level, while 148 genome-wide significant loci previously associated with SCZ and/or BP were investigated. Each sample was analyzed separately then a meta-analysis was performed. SH3GL2 and CLVS1 genes were associated with suicidal ideation in SCZ (p = 5.62e-08 and 0.01, respectively), the former also in the meta-analysis (p = .01). SHC4 gene was associated with depressive symptoms severity in BP (p = .003). A gene set involved in cellular differentiation (GO:0048661) was associated with substance disorder comorbidity in the meta-analysis (p = .03). Individual loci previously associated with SCZ or BP did not modulate the phenotypes of interest. This study provided confirmatory and new findings. SH3GL2 (endophilin A1) showed a role in suicidal ideation that may be due to its relevance to the glutamate system. SHC4 regulates BDNF-induced MAPK activation and was previously associated with depression. CLVS1 is involved in lysosome maturation and was for the first time associated with a psychiatric trait. GO:0048661 may mediate the risk of substance disorder through an effect on neurodevelopment/neuroplasticity.

Inflexible habitual decision-making during choice between cocaine and a nondrug alternative

The concept of compulsive cocaine-seeking habits is difficult to reconcile with other evidence showing that humans and even rats remain able to shift their choice away from the drug and toward an alternative nondrug reward, when available. This paradox could dissolve if preference for the nondrug option reflected in fact inflexible habitual decision-making (i.e., fixed in a habitual control mode, with no return to a goal-directed control mode). Previous research in rats has shown that prior drug use can favor habit formation, but whether the resulting habits are inflexible or not is largely unknown. Here we addressed this question by manipulating the value of water in rats that chose between water and cocaine in a discrete-trials procedure. Rats preferred water when thirsty and maintained this preference despite water devaluation by satiation. Only with repeated daily testing under water satiation did they progressively reverse their preference toward cocaine. Additional evidence showed that this progressive reversal of preference reflected in fact new interoceptive discrimination learning. Overall, this study suggests that rats seem to be stuck in a habitual decision-making mode, unable to return to a goal-directed mode upon experiencing a change in options value. It also reveals that inflexible decision-making does not necessarily promote drug choice, but can also under some circumstances favor abstinence.

Compulsive methamphetamine taking and abstinence in the presence of adverse consequences: Epigenetic and transcriptional consequences in the rat brain

Methamphetamine addiction is characterized by compulsive binges of drug intake despite adverse life consequences. A model of methamphetamine self-administration that includes contingent footshocks to constitute adverse consequences has helped to segregate rats that reduce or stop lever pressing for methamphetamine (sensitive) from those that continue to lever press for the drug (resistant) in the presence of negative outcomes. We have observed differential DNA hydroxymethylation and increased expression of potassium channel mRNAs in the nucleus accumbens of sensitive compared to resistant rats, suggesting a role of these channels in suppressing methamphetamine intake. There were also significant increases in nerve growth factor (NGF) expression and activation of its downstream signaling pathway (NGF-TrkA and p75NTR/MAPK signaling) in only the dorsal striatum of sensitive rats after a month of abstinence. In contrast, oxytocin mRNA expression was increased in only the nucleus accumbens of resistant rats compared to sensitive rats euthanized after that time. These results indicate that footshocks can differentiate two behavioral phenotypes with differential biochemical and epigenetic consequences in the ventral and dorsal striatum.

Dissociable components of the reward circuit are involved in appraisal versus choice

People can evaluate a set of options as a whole, or they can approach those same options with the purpose of making a choice between them. A common network has been implicated across these two types of evaluations, including regions of ventromedial prefrontal cortex and the posterior midline. We test the hypothesis that sub-components of this reward circuit are differentially involved in triggering more automatic appraisal of one’s options (Dorsal Value Network) versus explicitly comparing between those options (Ventral Value Network). Participants undergoing fMRI were instructed to appraise how much they liked a set of products (Like) or to choose the product they most preferred (Choose). Activity in the Dorsal Value Network consistently tracked set liking, across both task-relevant (Like) and task-irrelevant (Choose) trials. In contrast, the Ventral Value Network was particularly sensitive to evaluation condition (more active during Choose than Like trials). Within vmPFC, anatomically distinct regions were dissociated in their sensitivity to choice (ventrally, in medial OFC) versus appraisal (dorsally, in pregenual ACC). Dorsal regions additionally tracked decision certainty across both types of evaluation. These findings suggest that separable mechanisms drive decisions about how good one’s options are versus decisions about which option is best.

Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling

A well-established notion in cognitive neuroscience proposes that multiple brain systems contribute to choice behaviour. These include: (1) a model-free system that uses values cached from the outcome history of alternative actions, and (2) a model-based system that considers action outcomes and the transition structure of the environment. The widespread use of this distinction, across a range of applications, renders it important to index their distinct influences with high reliability. Here we consider the two-stage task, widely considered as a gold standard measure for the contribution of model-based and model-free systems to human choice. We tested the internal/temporal stability of measures from this task, including those estimated via an established computational model, as well as an extended model using drift-diffusion. Drift-diffusion modeling suggested that both choice in the first stage, and RTs in the second stage, are directly affected by a model-based/free trade-off parameter. Both parameter recovery and the stability of model-based estimates were poor but improved substantially when both choice and RT were used (compared to choice only), and when more trials (than conventionally used in research practice) were included in our analysis. The findings have implications for interpretation of past and future studies based on the use of the two-stage task, as well as for characterising the contribution of model-based processes to choice behaviour.

Stress-induced impairment in goal-directed instrumental behaviour is moderated by baseline working memory

Acute stress has been found to impair goal-directed instrumental behaviour, a cognitively flexible behaviour that requires cognitive control. The current study aimed to investigate the role of individual differences in baseline and stress-induced changes in working memory (WM) on the shift to less goal-directed responding under stress. To this end, 112 healthy participants performed an instrumental learning task. In phase 1, participants learned instrumental actions that were associated with two different food rewards. In phase 2, one of these food rewards was devalued by eating until satiety. Before the extinction test in phase 3, participants were subjected to the Maastricht Acute Stress Test or a no-stress control procedure. Results showed that the effect of stress on instrumental behaviour is modulated by baseline, but not stress-induced changes in WM capacity. Specifically, only at low baseline WM capacity did stress induce a shift to less goal-directed behaviour. These findings highlight that our cognitive resources are limited and for those who already have limited resources at baseline taking into account motivational value is impaired under stress.

Stochastic synaptic plasticity underlying compulsion in a model of addiction

Activation of the mesolimbic dopamine system reinforces goal-directed behaviours. With repetitive stimulation-for example, by chronic drug abuse-the reinforcement may become compulsive and intake continues even in the face of major negative consequences. Here we gave mice the opportunity to optogenetically self-stimulate dopaminergic neurons and observed that only a fraction of mice persevered if they had to endure an electric shock. Compulsive lever pressing was associated with an activity peak in the projection terminals from the orbitofrontal cortex (OFC) to the dorsal striatum. Although brief inhibition of OFC neurons temporarily relieved compulsive reinforcement, we found that transmission from the OFC to the striatum was permanently potentiated in persevering mice. To establish causality, we potentiated these synapses in vivo in mice that stopped optogenetic self-stimulation of dopamine neurons because of punishment; this led to compulsive lever pressing, whereas depotentiation in persevering mice had the converse effect. In summary, synaptic potentiation of transmission from the OFC to the dorsal striatum drives compulsive reinforcement, a defining symptom of addiction.

Regulation of habit formation in the dorsal striatum

Habits are an essential and pervasive component of our daily lives that allow us to efficiently perform routine tasks. But their disruption contributes to the symptoms that underlie many psychiatric diseases. Emerging data are revealing the cellular and molecular mechanisms of habit formation in the dorsal striatum. New data suggest that in both the dorsolateral and dorsomedial striatum histone deacetylase (HDAC) activity acts as a critical negative regulator of the transcriptional processes underlying habit formation. In this review, we discuss this recent work and draw conclusions relevant to the treatment of diseases marked by maladaptive habits.

Are Cocaine-Seeking "Habits" Necessary for the Development of Addiction-Like Behavior in Rats?

Drug self-administration models of addiction typically require animals to make the same response (e.g., a lever-press or nose-poke) over and over to procure and take drugs. By their design, such procedures often produce behavior controlled by stimulus-response (S-R) habits. This has supported the notion of addiction as a "drug habit," and has led to considerable advances in our understanding of the neurobiological basis of such behavior. However, to procure such drugs as cocaine, addicts often require considerable ingenuity and flexibility in seeking behavior, which, by definition, precludes the development of habits. To better model drug-seeking behavior in addicts, we first developed a novel cocaine self-administration procedure [puzzle self-administration procedure (PSAP)] that required rats to solve a new puzzle every day to gain access to cocaine, which they then self-administered on an intermittent access (IntA) schedule. Such daily problem-solving precluded the development of S-R seeking habits. We then asked whether prolonged PSAP/IntA experience would nevertheless produce "symptoms of addiction." It did, including escalation of intake, sensitized motivation for drug, continued drug use in the face of adverse consequences, and very robust cue-induced reinstatement of drug seeking, especially in a subset of "addiction-prone" rats. Furthermore, drug-seeking behavior continued to require dopamine neurotransmission in the core of the nucleus accumbens (but not the dorsolateral striatum). We conclude that the development of S-R seeking habits is not necessary for the development of cocaine addiction-like behavior in rats.SIGNIFICANCE STATEMENT Substance-use disorders are often characterized as "habitual" behaviors aimed at obtaining and administering drugs. Although the actions involved in consuming drugs may involve a rigid repertoire of habitual behaviors, evidence suggests that addicts must be very creative and flexible when trying to procure drugs, and thus drug seeking cannot be governed by habit alone. We modeled flexible drug-seeking behavior in rats by requiring animals to solve daily puzzles to gain access to cocaine. We find that habitual drug-seeking isn't necessary for the development of addiction-like behavior, and that our procedure doesn't result in transfer of dopaminergic control from the ventral to dorsal striatum. This approach may prove useful in studying changes in neuropsychological function that promote the transition to addiction.

Lever Insertion as a Salient Stimulus Promoting Insensitivity to Outcome Devaluation

Flexible and efficient decision-making in complex environments can be achieved through constant interactions between the goal-directed and habitual systems. While goal-directed behavior is considered dependent upon Response-Outcome (R-O) associations, habits instead rely on Stimulus-Response (S-R) associations. However, the stimuli that support the S-R association underlying habitual responding in typical instrumental procedures are poorly defined. To resolve this issue, we designed a discrete-trials procedure, in which rats must wait for lever insertion and complete a sequence of five lever presses to obtain a reward (20% sucrose or grain-based pellets). Lever insertion thus constituted an audio-visual stimulus signaling the opportunity for reward. Using sensory-specific satiety-induced devaluation, we found that rats trained with grain-based pellets remained sensitive to outcome devaluation over the course of training with this procedure whereas rats trained with a solution of 20% sucrose rapidly developed habit, and that insensitivity to outcome devaluation in rats trained with sucrose did not result from a bias in general satiety. Importantly, although rats trained with pellets were sensitive to satiety-induced devaluation, their performance was not affected by degradation of instrumental contingency and devaluation by conditioned taste aversion (CTA), suggesting that these rats may also have developed habitual responding. To test whether the discrete-trials procedure biases subjects towards habitual responding, we compared discrete-trials to free-running instrumental responding, and found that rats trained with sucrose in a fixed-ratio 5 (FR5) procedure with continuous presentation of the lever were goal-directed. Together, these results demonstrate that discrete presentations of a stimulus predictive of reward availability promoted the formation of S-R habit in rats trained with liquid sucrose. Further research is necessary to explain inconsistencies in sensitivity to outcome devaluation when rats are trained with grain-based pellets.