Habit, choice, and addiction

Assessment of reduction in stimulus generalization of ethanol-seeking during recovery: A rapid procedure

Previously, we developed a procedure which showed that longer histories of reinforced alternative behavior decrease the risk of relapse caused by a range of stimuli which had previously occasioned drinking. The decrease in relapse risk was likely due to a decrease in attention to the stimuli over the course of repeated engagement in the alternative behavior. However, this previous procedure was time consuming and did not mirror the procedure we used to observe changes in relapse risk. This study aimed at replicating the previous relationship between the duration of engaging in an alternative behavior and shift in stimulus generalization for drinking using a procedure that allows longitudinal analysis over time and is consistent with other procedures we have developed. Rats were trained to respond for ethanol in the presence of one stimulus (16 kHz tone; food Fixed Ratio (FR)150 and ethanol FR5), and for food in the under another stimulus (8 kHz tone; food and ethanol FR5). Then, recovery-like sessions with food predominant responding occurred in the presence of only the low-cost food stimulus. During these sessions, rats were exposed to non-reinforced graded stimuli alternation from 8 to 16 kHz alternating with the reinforced low-cost food stimulus. The number of responses on each (food and ethanol) lever before completing 5 responses on either lever was the main measure. Consistent with the earlier procedure, the current procedure showed that graded variation of tone from 8 to 16 kHz produced a graded increase in responding for ethanol compared to responding for food. In addition, longer periods of engaging in recovery-like responding shift the generalization function downwards. This procedure confirms the earlier pattern of stimulus generalization over longer periods of behavior consistent with recovery. This strengthens our hypothesis that shifts in attention to alcohol-related stimuli are important to the development of relapse resistance during recovery.

A rapid procedure to assess shifts in discriminative control over drinking during recovery-like behavior

BACKGROUND

Previously, we reported that recovery-like behavior decreases stimulus control over drinking, and this likely plays a role in the clinical observation that longer recovery increases relapse resistance. Those studies were conducted using a procedure that required repeated assessment, preventing a longitudinal analysis of the changes in stimulus control over time in each individual. Here we recapitulate those results and extend them to female rats using a more efficient procedure that allows repeated assessment of changes in stimulus control over drinking during recovery.

METHODS

Under a multiple concurrent schedule, rats were trained to reliably respond predominantly for ethanol (concurrent Ethanol FR5, Food FR150) in the presence of one stimulus and for food (concurrent Ethanol FR5, Food FR5) in the presence of another stimulus. Stimuli were either lights or tones, depending on the group. After that, a drinking phase in which only the stimulus occasioning ethanol responding was presented (10 or 20 sessions) followed by recovery-like sessions in which only the stimulus occasioning food responding was presented. During these sessions, rats were exposed to the ethanol stimulus under extinction during the first component on sessions 0, 1, 2, 4, 8, and 16. The number of food responses during these stimulus exposures prior to the first five ethanol responses was the primary measure.

RESULTS

Consistent with the earlier procedure, the number of food responses during ethanol tests increased as a function of the number of recovery sessions completed, regardless of whether the stimuli were visual or auditory. However, there were no significant effects of extended alcohol exposure or sex.

CONCLUSIONS

A rapid procedure consistent with the earlier procedure and clinical evidence was developed in which stimulus control over drinking decreased following longer periods of recovery. Under conditions tested, stimulus type, length of drinking history, and sex did not affect this relationship.

Reward Reinforcement Creates Enduring Facilitation of Goal-directed Behavior

Stimulus-response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at the cost of reduced flexibility to adapt behavior when circumstances change. The goal-directed system is thought to counteract the habit system by providing the flexibility to pursue context-appropriate behaviors. The dichotomy between habitual action selection and flexible goal-directed behavior has recently been challenged by findings showing that rewards bias both action and goal selection. Here, we test whether reward reinforcement can give rise to habitual goal selection much as it gives rise to habitual action selection. We designed a rewarded, context-based perceptual discrimination task in which performance on one rule was reinforced. Using drift-diffusion models and psychometric analyses, we found that reward facilitates the initiation and execution of rules. Strikingly, we found that these biases persisted in a test phase in which rewards were no longer available. Although this facilitation is consistent with the habitual goal selection hypothesis, we did not find evidence that reward reinforcement reduced cognitive flexibility to implement alternative rules. Together, the findings suggest that reward creates a lasting impact on the selection and execution of goals but may not lead to the inflexibility characteristic of habits. Our findings demonstrate the role of the reward learning system in influencing how the goal-directed system selects and implements goals.

A dual-pathway architecture enables chronic stress to disrupt agency and promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted systems neuroscience approach in male and female mice, we reveal a dual pathway, amygdala-striatal neuronal circuit architecture by which a recent history of chronic stress disrupts the action-outcome learning underlying adaptive agency and promotes the formation of inflexible habits. We found that the basolateral amygdala projection to the dorsomedial striatum is activated by rewarding events to support the action-outcome learning needed for flexible, goal-directed decision making. Chronic stress attenuates this to disrupt action-outcome learning and, therefore, agency. Conversely, the central amygdala projection to the dorsomedial striatum mediates habit formation. Following stress this pathway is progressively recruited to learning to promote the premature formation of inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to disrupt agency and promote habit. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and mental health conditions.

The Small G-Protein Rac1 in the Dorsomedial Striatum Promotes Alcohol-Dependent Structural Plasticity and Goal-Directed Learning in Mice

The small G-protein Ras-related C3 botulinum toxin substrate 1 (Rac1) promotes the formation of filamentous actin (F-actin). Actin is a major component of dendritic spines, and we previously found that alcohol alters actin composition and dendritic spine structure in the nucleus accumbens (NAc) and the dorsomedial striatum (DMS). To examine if Rac1 contributes to these alcohol-mediated adaptations, we measured the level of GTP-bound active Rac1 in the striatum of mice following 7 weeks of intermittent access to 20% alcohol. We found that chronic alcohol intake activates Rac1 in the DMS of male mice. In contrast, Rac1 is not activated by alcohol in the NAc and DLS of male mice or in the DMS of female mice. Similarly, closely related small G-proteins are not activated by alcohol in the DMS, and Rac1 activity is not increased in the DMS by moderate alcohol or natural reward. To determine the consequences of alcohol-dependent Rac1 activation in the DMS of male mice, we inhibited endogenous Rac1 by infecting the DMS of mice with an adeno-associated virus (AAV) expressing a dominant negative form of the small G-protein (Rac1-DN). We found that overexpression of AAV-Rac1-DN in the DMS inhibits alcohol-mediated Rac1 signaling and attenuates alcohol-mediated F-actin polymerization, which corresponded with a decrease in dendritic arborization and spine maturation. Finally, we provide evidence to suggest that Rac1 in the DMS plays a role in alcohol-associated goal-directed learning. Together, our data suggest that Rac1 in the DMS plays an important role in alcohol-dependent structural plasticity and aberrant learning.

Encoding and context-dependent control of reward consumption within the central nucleus of the amygdala

Dysregulation of the central amygdala is thought to underlie aberrant choice in alcohol use disorder, but the role of central amygdala neural activity during reward choice and consumption is unclear. We recorded central amygdala neurons in male rats as they consumed alcohol or sucrose. We observed activity changes at the time of reward approach, as well as lick-entrained activity during ongoing consumption of both rewards. In choice scenarios where rats could drink sucrose, alcohol, or quinine-adulterated alcohol with or without central amygdala optogenetic stimulation, rats drank more of stimulation-paired options when the two bottles contained identical options. Given a choice among different options, central amygdala stimulation usually enhanced consumption of stimulation-paired rewards. However, optogenetic stimulation during consumption of the less-preferred option, alcohol, was unable to enhance alcohol intake while sucrose was available. These findings indicate that the central amygdala contributes to refining motivated pursuit toward the preferred available option.

Reward, relief, and habit drinking profiles in treatment seeking individuals with an AUD

AIMS

This study aimed to compare reward, relief, and habit treatment-seeking individuals on recent drinking, alcohol use disorder (AUD) phenomenology, and mood. The second aim of the study was to evaluate the predictive validity of reward, relief, and habit profiles.

METHOD

Treatment-seeking individuals with an AUD (n = 169) were recruited to participate in a medication trial for AUD (NCT03594435). Reward, relief, and habit drinking groups were assessed using the UCLA Reward Relief Habit Drinking Scale. Group differences at baseline were evaluated using univariate analyses of variance. A subset of participants were enrolled in a 12-week, double-blind, placebo-controlled medication trial (n = 102), and provided longitudinal drinking and phenomenology data. The predictive validity of group membership was assessed using linear regression analyses.

RESULTS

At baseline, individuals who drink primarily for relief had higher craving and negative mood than those who drink for reward and habit. Prospectively, membership in the relief drinking group predicted greater alcohol use, greater heavy drinking, and fewer days abstinent compared to those in the reward drinking group. Membership in the relief drinking group also predicted greater alcohol craving, more alcohol-related consequences, and more anxiety symptoms over 12 weeks compared to those in the reward drinking group.

CONCLUSIONS

This study provides support for reward and relief drinking motive profiles in treatment-seeking individuals with an AUD. Membership in the relief drinking motive group was predictive of poorer drinking outcomes and more negative symptomology over 12 weeks, indicating that individuals who drink for relief may be a particularly vulnerable sub-population of individuals with AUD.

Shifts in stimulus control over opioid use with increasing periods of recovery

BACKGROUND

Periods of engaging in an alternative behavior diminishes behavioral control by stimuli occasioning alcohol use. This increase in relapse resistance with increasing recovery suggests that changing stimulus control over substance use may be a mechanism responsible for decreased relapse rates with longer recovery. However, the generality of this phenomenon to other drugs of abuse, including opioid self-administration, remains unclear. This study tests the generality of these findings with etonitazene to determine whether the shift in attention represents a behavioral process that generalizes from conditions we previously reported.

METHODS

Five adult male Lewis rats were trained to respond on levers under two stimulus conditions; high-cost food (food FR150 and etonitazene FR5) and low-cost food (both food and etonitazene FR 5). Next, only the high-cost food stimulus (occasioning etonitazene responding) was presented for 20 sessions (Use Phase) followed by 9 sessions in which only the low-cost food stimulus (occasioning food responding) was presented (Recovery Phase). During the Recovery Phase, testing occurred during the first component of sessions 0, 1, 2, 4, and 8 when rats were re-exposed to the high-cost food stimulus. The number of food responses prior to completing the etonitazene response requirement during this stimulus exposure was the primary measure.

RESULTS

Food responses during stimulus re-exposure increased significantly as a function of recovery sessions completed with a slope [95 % CI] of 2.49 responses/recovery session [0.16, 4.81]. The average number of etonitazene deliveries per use session was 32 ± 6.6 or an average daily dose of 48.8 ± 10.1 μg/kg. During Recovery Phase, etonitazene deliveries decreased to 2.4 ± 1 or 3.6 ± 1.5 μg/kg.

CONCLUSION

The decrease in stimulus control observed for ethanol self-administration appears to generalize to opioid self-administration, indicating this change in stimulus control may play a general role in recovery.

Positive correlation between measures of habitual responding and motivated responding in mice

Habit and motivation are thought to be separate processes, with motivated behavior often considered to be goal directed, whereas habits are defined by the absence of goal-directed control over behavior. However, there has been increasing interrogation of the binary nature of habitual versus goal-directed behavior. Furthermore, although drug and alcohol exposure can promote the formation of habits, drug seeking itself can also be highly flexible, pointing toward the need for complex consideration of the parallel processes that drive behavior. The goal of the current study was to determine whether there was a relation between motivation-as measured by progressive ratio-and habit-as measured by contingency degradation-and whether this relation was affected by ethanol exposure history and sex. The results showed that these measures were positively correlated such that greater contingency insensitivity was associated with achieving higher break points on the progressive-ratio task. However, this relation depended on reinforcement schedule history, ethanol exposure history, and sex. These point to potential relations between measures of habit and motivation and stress the importance of carefully parsing behavioral findings and assays. These findings are also expected to inform future substance use research, as drug history may affect these relations.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Associations of screen use with physical activity and social capital amid the COVID-19 pandemic: A network analysis of youths in China

Inconsistent correlations of screen use with physical activity (PA) and social capital (SC) in youths have been observed in existing cross-sectional studies. This study aimed to elucidate associations among variables in screen use, PA, and SC domains during COVID-19, to improve the prediction and prevention of suboptimal health status in youths. An online survey based on the nationwide COVID-19 Impact on Lifestyle Change Survey (COINLICS) was conducted in China, and 10,082 youths reported their screen use, PA, and SC in the months immediately before, during, and after the COVID-19 lockdown. Cross-sectional and longitudinal network models were used to identify associations of variables in domains of screen use with PA and SC. Effect modifications of bridges and predictors in the associations were examined. The network models suggested that individual SC was a bridge that strongly connected other types of SC, and domains of screen use and PA before lockdown, while phone use became such a bridge during and after lockdown. More PC/TV use before lockdown predicted less household-related PA during lockdown (β = -0.142); more phone use during lockdown was a predictor for higher levels of household-related PA (β = 0.106), active transport (β = 0.096), and individual SC (β = 0.072) after lockdown. Phone use was negatively associated with PA through PC/TV use in the more phone use subgroup. Relationships among screen use, PA, and SC dynamically changed during COVID-19, and phone use that was identified as a bridge and a predictor may be the potential action point for health intervention in youths during lockdown.

Effects of early-life stress on probabilistic reversal learning and response perseverance in young adults

Early life stress (ELS), including experiences with abuse and neglect, are related to several negative health outcomes in adulthood. One area that has received attention is the increased rate of substance abuse disorder in individuals who had experienced ELS. Given the critical role habitual behavior in the development of substance abuse, ELS may affect the trajectory of neural development such that habitual responding is more dominant than in individuals who did not experience ELS. Here, we examine learning of a probabilistic classification task (the Weather Prediction Task) in healthy young adults who reported significant ELS and those that did not. This task can be learned in a declarative, model-based manner, or in a more habitual, stimulus-response manner. Participants learned to choose the outcome (sun or rain) that was probabilistically associated with each cue combination through reinforcement on each trial. After 100 trials, the probabilities were reversed, and we conceptualized habitual behavior as perseverating responses based on the old probabilities. We also collected information about subjective socio-economic status (sSES), anxiety, depression, and substance use from participants. Using multiple regression, we found that our measure of habitual responding was correlated with reported alcohol use, suggesting that our measure of habit has validity for health behaviors. Furthermore, we found that some forms of early life stress led to greater response perseverance after contingencies were reversed. Overall, the results suggest that childhood adversity may contribute to the development of habit.

Differential effects of acute and prolonged morphine withdrawal on motivational and goal-directed control over reward-seeking behavior

Opioid addiction is a relapsing disorder marked by uncontrolled drug use and reduced interest in normally rewarding activities. The current study investigated the impact of spontaneous withdrawal from chronic morphine exposure on emotional, motivational, and cognitive processes involved in regulating the pursuit and consumption of natural food rewards in male rats. In Experiment 1, rats experiencing acute morphine withdrawal lost weight and displayed somatic signs of drug dependence. However, hedonically-driven sucrose consumption was significantly elevated, suggesting intact and potentially heightened emotional reward processing. In Experiment 2, rats undergoing acute morphine withdrawal displayed reduced motivation when performing an effortful response for palatable food reward. Subsequent reward devaluation testing revealed that acute withdrawal also disrupted their ability to exert flexible goal-directed control over their reward-seeking behavior. Specifically, morphine-withdrawn rats displayed insensitivity to reward devaluation both when relying on prior action-outcome learning and when given direct feedback about the consequences of their actions. In Experiment 3, rats tested after prolonged morphine withdrawal displayed heightened rather than diminished motivation for food rewards and retained their ability to engage in flexible goal-directed action selection. However, brief re-exposure to morphine was sufficient to impair motivation and disrupt goal-directed action selection, though in this case insensitivity to reward devaluation was only observed in the presence of morphine-paired context cues and in the absence of response-contingent feedback. We suggest that these opioid-withdrawal induced deficits in motivation and goal-directed control may contribute to addiction by interfering with the pursuit of adaptive alternatives to drug use.

Encoding and context-dependent control of reward consumption within the central nucleus of the amygdala

The ability to evaluate and select a preferred option among a variety of available offers is an essential aspect of goal-directed behavior. Dysregulation of this valuation process is characteristic of alcohol use disorder, with the central amygdala being implicated in persistent alcohol pursuit. However, the mechanism by which the central amygdala encodes and promotes the motivation to seek and consume alcohol remains unclear. We recorded single-unit activity in male Long-Evans rats as they consumed 10% ethanol or 14.2% sucrose. We observed significant activity at the time of approach to alcohol or sucrose, as well as lick-entrained activity during the ongoing consumption of both alcohol and sucrose. We then evaluated the ability of central amygdala optogenetic manipulation time-locked to consumption to alter ongoing intake of alcohol or sucrose, a preferred non-drug reward. In closed two-choice scenarios where rats could drink only sucrose, alcohol, or quinine-adulterated alcohol with or without central amygdala stimulation, rats drank more of stimulation-paired options. Microstructural analysis of licking patterns suggests these effects were mediated by changes in motivation, not palatability. Given a choice among different options, central amygdala stimulation enhanced consumption if the stimulation was associated with the preferred reward while closed-loop inhibition only decreased consumption if the options were equally valued. However, optogenetic stimulation during consumption of the less-preferred option, alcohol, was unable to enhance overall alcohol intake while sucrose was available. Collectively, these findings indicate that the central amygdala processes the motivational value of available offers to promote pursuit of the most preferred available option.

GluN2B inhibition confers resilience against long-term cocaine-induced neurocognitive sequelae

Cocaine self-administration can disrupt the capacity of humans and rodents to flexibly modify familiar behavioral routines, even when they become maladaptive or unbeneficial. However, mechanistic factors, particularly those driving long-term behavioral changes, are still being determined. Here, we capitalized on individual differences in oral cocaine self-administration patterns in adolescent mice and revealed that the post-synaptic protein PSD-95 was reduced in the orbitofrontal cortex (OFC) of escalating, but not stable, responders, which corresponded with later deficits in flexible decision-making behavior. Meanwhile, NMDA receptor GluN2B subunit content was lower in the OFC of mice that were resilient to escalatory oral cocaine seeking. This discovery led us to next co-administer the GluN2B-selective antagonist ifenprodil with cocaine, blocking the later emergence of cocaine-induced decision-making abnormalities. GluN2B inhibition also prevented cocaine-induced dysregulation of neuronal structure and function in the OFC, preserving mature, mushroom-shaped dendritic spine densities on deep-layer pyramidal neurons, which were otherwise lower with cocaine, and safeguarding functional BLA→OFC connections necessary for action flexibility. We posit that cocaine potentiates GluN2B-dependent signaling, which triggers a series of durable adaptations that result in the dysregulation of post-synaptic neuronal structure in the OFC and disruption of BLA→OFC connections, ultimately weakening the capacity for flexible choice. And thus, inhibiting GluN2B-NMDARs promotes resilience to long-term cocaine-related sequelae.

Selling visibility-boosts on dating apps: a problematic practice?

Love, sex, and physical intimacy are some of the most desired goods in life and they are increasingly being sought on dating apps such as Tinder, Bumble, and Badoo. For those who want a leg up in the chase for other people's attention, almost all of these apps now offer the option of paying a fee to boost one's visibility for a certain amount of time, which may range from 30 min to a few hours. In this article, I argue that there are strong moral grounds and, in countries with laws against unconscionable contracts, legal ones for thinking that the sale of such visibility boosts should be regulated, if not banned altogether. To do so, I raise two objections against their unfettered sale, namely that it exploits the impaired autonomy of certain users and that it creates socio-economic injustices.

Caloric state modulates locomotion, heart rate and motor neuron responses to acute administration of d-amphetamine in zebrafish larvae

Psychostimulant drugs increase behavioral, cardiac and brain responses in humans and other animals. Acute food deprivation or chronic food restriction potentiates the stimulatory effects of abused drugs and increases the propensity for relapse to drug seeking in drug-experienced animals. The mechanisms by which hunger affects cardiac and behavioral activities are only beginning to be elucidated. Moreover, changes in motor neuron activities at the single neuron level induced by psychostimulants, and their modulation by food restriction, remain unknown. Here we investigated how food deprivation affects responses to d-amphetamine by measuring locomotor activity, cardiac output, and individual motor neuron activity in zebrafish larvae. We used wild-type larval zebrafish to record behavioral and cardiac responses and the larvae of Tg(mnx1:GCaMP5) transgenic zebrafish to record motor neuron responses. Physiological state gated responses to d-amphetamine. That is, d-amphetamine evoked significant increases in motor behavior (swimming distances), heart rate and motor neuron firing frequency in food-deprived but not fed zebrafish larvae. The results extend the finding that signals arising from food deprivation are a key potentiator of the drug responses induced by d-amphetamine to the zebrafish model. The larval zebrafish is an ideal model to further elucidate this interaction and identify key neuronal substrates that may increase vulnerability to drug reinforcement, drug-seeking and relapse.

Large-scale brain correlates of sweet versus cocaine reward in rats

Cocaine induces many supranormal changes in neuronal activity in the brain, notably in learning- and reward-related regions, in comparison with nondrug rewards-a difference that is thought to contribute to its relatively high addictive potential. However, when facing a choice between cocaine and a nondrug reward (e.g., water sweetened with saccharin), most rats do not choose cocaine, as one would expect from the extent and magnitude of its global activation of the brain, but instead choose the nondrug option. We recently showed that cocaine, though larger in magnitude, is also an inherently more delayed reward than sweet water, thereby explaining why it has less value during choice and why rats opt for the more immediate nondrug option. Here, we used a large-scale Fos brain mapping approach to measure brain responses to each option in saccharin-preferring rats, with the hope to identify brain regions whose activity may explain the preference for the nondrug option. In total, Fos expression was measured in 142 brain levels corresponding to 52 brain subregions and composing 5 brain macrosystems. Overall, our findings confirm in rats with a preference for saccharin that cocaine induces more global brain activation than the preferred nondrug option does. Only very few brain regions were uniquely activated by saccharin. They included regions involved in taste processing (i.e., anterior gustatory cortex) and also regions involved in processing reward delay and intertemporal choice (i.e., some components of the septohippocampal system and its connections with the lateral habenula).

Cardiac sensitivity to rewards in cognitively inflexible nonclinical participants

Background

In psychopathologies characterized by compulsive decision-making, core impairments include cognitive inflexibility and excessive sensitivity to rewards. It has been posited that traits shared by nonclinical individuals and psychiatric patients could help explain the pathogenesis of compulsive decision-making.

Methods

To investigate whether cognitive inflexibility predisposes nonclinical individuals to poor choices and hyper-reactivity to reward, we recruited people with high and low scores for cognitive persistence and used the Iowa Gambling Task to assess decision-making and cardiac reactivity to monetary gains/losses.

Results

As is frequently observed in psychophysiological research, the data indicated discrepancies among self-reports, behavior, and physiology. Cognitive inflexibility was not related to worse performance; however, monetary gains, in line with the literature, prompted marked cardiac accelerations. Consistent with our research goal, only inflexible participants showed large cardiac accelerations during the largest monetary wins.

Discussion

Taken together, the data confirm an association between cognitive persistence and physiological reward sensitivity in a nonclinical population. The findings are in line with recent theories on the development of compulsive behaviors that consider cognitive inflexibility as a transdiagnostic impairment and predisposing factor for excessive reactivity to rewards, and might act both as a preexisting individual trait and drug-induced deficit.

Task parameters influence operant response variability in mice

RATIONALE

During operant conditioning, animals associate actions with outcomes. However, patterns and rates of operant responding change over learning, which makes it difficult to distinguish changes in learning from general changes in performance or movement. Thus, understanding how task parameters influence movement execution is essential.

OBJECTIVES

To understand how specific operant task parameters influenced the repetition of future operant responses, we investigated the ability of operant conditioning schedules and contingencies to promote reproducible bouts of five lever presses in mice.

METHODS

Mice were trained on one of the four operant tasks to test three distinct hypotheses: (1) whether a cue presented concurrently with sucrose delivery influenced the pattern of lever pressing; (2) whether requiring animals to collect earned sucrose promoted the organization of responses into bouts; and (3) whether only reinforcing bouts where interresponse time (IRT) variances were below a target promoted reproducible patterns of operant behavior.

RESULTS

(1) Signaling reinforcer delivery with a cue increased learning rates but resulted in mice pressing the lever in fast succession until the cue turned on, rather than executing discrete bouts. (2) Requiring mice to collect the reinforcer between bouts had little effect on behavior. (3) A training strategy that directly reinforced bouts with low variance IRTs was not more effective than a traditional fixed ratio schedule at promoting reproducible action execution.

CONCLUSIONS

Together, our findings provide insights into the parameters of behavioral training that promote reproducible actions and that should be carefully selected when designing operant conditioning experiments.

Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates

We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.

Future Newborns with Opioid-Induced Neonatal Abstinence Syndrome (NAS) Could Be Assessed with the Genetic Addiction Risk Severity (GARS) Test and Potentially Treated Using Precision Amino-Acid Enkephalinase Inhibition Therapy (KB220) as a Frontline Modality Instead of Potent Opioids

In this nonsystematic review and opinion, including articles primarily selected from PubMed, we examine the pharmacological and nonpharmacological treatments of neonatal abstinence syndrome (NAS) in order to craft a reasonable opinion to help forge a paradigm shift in the treatment and prevention of primarily opioid-induced NAS. Newborns of individuals who use illicit and licit substances during pregnancy are at risk for withdrawal, also known as NAS. In the US, the reported prevalence of NAS has increased from 4.0 per 1000 hospital births in 2010 to 7.3 per 1000 hospital births in 2017, which is an 82% increase. The management of NAS is varied and involves a combination of nonpharmacologic and pharmacologic therapy. The preferred first-line pharmacological treatment for NAS is opioid therapy, specifically morphine, and the goal is the short-term improvement in NAS symptomatology. Nonpharmacological therapies are individualized and typically focus on general care measures, the newborn-parent/caregiver relationship, the environment, and feeding. When used appropriately, nonpharmacologic therapies can help newborns with NAS avoid or reduce the amount of pharmacologic therapy required and the length of hospitalization. In addition, genetic polymorphisms of the catechol-o-methyltransferase (COMT) and mu-opioid receptor (OPRM1) genes appear to affect the length of stay and the need for pharmacotherapy in newborns with prenatal opioid exposure. Therefore, based on this extensive literature and additional research, this team of coauthors suggests that, in the future, in addition to the current nonpharmacological therapies, patients with opioid-induced NAS should undergo genetic assessment (i.e., the genetic addiction risk severity (GARS) test), which can subsequently be used to guide DNA-directed precision amino-acid enkephalinase inhibition (KB220) therapy as a frontline modality instead of potent opioids.

The role of reinforcement learning and value-based decision-making frameworks in understanding food choice and eating behaviors

The obesogenic food environment includes easy access to highly-palatable, energy-dense, "ultra-processed" foods that are heavily marketed to consumers; therefore, it is critical to understand the neurocognitive processes the underlie overeating in response to environmental food-cues (e.g., food images, food branding/advertisements). Eating habits are learned through reinforcement, which is the process through which environmental food cues become valued and influence behavior. This process is supported by multiple behavioral control systems (e.g., Pavlovian, Habitual, Goal-Directed). Therefore, using neurocognitive frameworks for reinforcement learning and value-based decision-making can improve our understanding of food-choice and eating behaviors. Specifically, the role of reinforcement learning in eating behaviors was considered using the frameworks of (1) Sign-versus Goal-Tracking Phenotypes; (2) Model-Free versus Model-Based; and (3) the Utility or Value-Based Model. The sign-and goal-tracking phenotypes may contribute a mechanistic insight on the role of food-cue incentive salience in two prevailing models of overconsumption-the Extended Behavioral Susceptibility Theory and the Reactivity to Embedded Food Cues in Advertising Model. Similarly, the model-free versus model-based framework may contribute insight to the Extended Behavioral Susceptibility Theory and the Healthy Food Promotion Model. Finally, the value-based model provides a framework for understanding how all three learning systems are integrated to influence food choice. Together, these frameworks can provide mechanistic insight to existing models of food choice and overconsumption and may contribute to the development of future prevention and treatment efforts.

From concepts to treatment: a dialog between a preclinical researcher and a clinician in addiction medicine

The debate surrounding the brain disease model and the associated questioning of the relevance of animal models is polarizing the field of addiction, and tends to widen the gap between preclinical research and addiction medicine. Here, we aimed at bridging this gap by establishing a dialog between a preclinical researcher and a clinician in addiction medicine. Our objective was to evaluate animal models and the neuroscientific conceptualization of addiction in light of alcohol or drug dependence and treatment in patients struggling with an addiction. We sought to determine how preclinical research influenced addiction medicine over past decades, and reciprocally, what can preclinical researchers learn from addiction medicine that could lead to more effective approaches. In this dialog, we talk about the co-evolution of addiction concepts and treatments from neuroscientific and medical perspectives. This dialog illustrates the reciprocal influences and mutual enrichment between the two disciplines and reveals that, although preclinical research might not produce new pharmacotherapies, it does shape the theoretical conceptualization of addiction and could thereby contribute to the implementation of therapeutic approaches.

Making habits measurable beyond what they are not: A focus on associative dual-process models

Habits are the subject of intense international research. Under the associative dual-process model the outcome devaluation paradigm has been used extensively to classify behaviours as being either goal-directed (sensitive to shifts in the value of associated outcomes) or habitual (triggered by stimuli without anticipation of consequences). This has proven to be a useful framework for studying the neurobiology of habit and relevance of habits in clinical psychopathology. However, in recent years issues have been raised about this rather narrow definition of habits in comparison to habitual behaviour experienced in the real world. Specifically, defining habits as the absence of goal-directed control, the very specific set-ups required to demonstrate habit experimentally and the lack of direct evidence for habits as stimulus-response behaviours are viewed as problematic. In this review paper we address key critiques that have been raised about habit research within the framework of the associative dual-process model. We then highlight novel research approaches studying different features of habits with methods that expand beyond traditional paradigms.

A neuroeconomic signature of opioid craving: How fluctuations in craving bias drug-related and nondrug-related value

How does craving bias decisions to pursue drugs over other valuable, and healthier, alternatives in addiction? To address this question, we measured the in-the-moment economic decisions of people with opioid use disorder as they experienced craving, shortly after receiving their scheduled opioid maintenance medication and ~24 h later. We found that higher cravers had higher drug-related valuation, and that moments of higher craving within-person also led to higher drug-related valuation. When experiencing increased opioid craving, participants were willing to pay more for personalized consumer items and foods more closely related to their drug use, but not for alternative "nondrug-related" but equally desirable options. This selective increase in value with craving was greater when the drug-related options were offered in higher quantities and was separable from the effects of other fluctuating psychological states like negative mood. These findings suggest that craving narrows and focuses economic motivation toward the object of craving by selectively and multiplicatively amplifying perceived value along a "drug relatedness" dimension.

Control of complex behavior by astrocytes and microglia

Evidence that glial cells influence behavior has been gaining a steady foothold in scientific literature. Out of the five main subtypes of glial cells in the brain, astrocytes and microglia have received an outsized share of attention with regard to shaping a wide spectrum of behavioral phenomena and there is growing appreciation that the signals intrinsic to these cells as well as their interactions with surrounding neurons reflect behavioral history in a brain region-specific manner. Considerable regional diversity of glial cell phenotypes is beginning to be recognized and may contribute to behavioral outcomes arising from circuit-specific computations within and across discrete brain nuclei. Here, we summarize current knowledge on the impact of astrocyte and microglia activity on behavioral outcomes, with a specific focus on brain areas relevant to higher cognitive control, reward-seeking, and circadian regulation.

Evaluating habit formation across pairs of female and male selectively bred alcohol-preferring and non-preferring rats

Some individuals with alcohol use disorder (AUD) continue to drink because they have developed a habit where they do not consider the consequences of their actions. Genetically selected lines of alcohol-preferring and non-preferring rats allow for exploration of how specific endophenotypes, such as tendency to form habits, may be risk factors that interact with a genetic predisposition of AUD. While high alcohol drinking (HAD) and alcohol-preferring (P) rats were selectively bred to consume high amounts of freely available ethanol, they exhibit differences in alcohol-seeking behaviors as well as impulsive behaviors, and may represent different behavioral models of AUD. The goal of the current study was to compare the tendency to develop habitual behaviors across female and male HAD1, HAD2, and P rats and their respective alcohol non-preferring counterparts. Alcohol-naïve rats were trained on a variable interval schedule using a non-ethanol reinforcer and were then tested in two extinction sessions, one prior to a reinforcer devaluation (conditioned taste aversion) procedure and one after. There were no differences in total lever presses between P and alcohol non-preferring (NP) rats, but there were differences between HAD and low-alcohol drinking (LAD) rats. All six strains decreased lever pressing after reinforcer devaluation. However, P and NP females did not increase latency to first lever press after devaluation, suggesting some inclination toward habitual behavior that was not apparent in either the HAD or LAD lines. Selective breeding for alcohol preference does not seem to influence the tendency to form habits, whereas background strain and sex may have an influence on this behavior.

Deconstructing and reconstructing behaviour relevant to mental health disorders: The benefits of a psychological approach, with a focus on addiction

RUTHERFORD, L.G. and Milton, A.L. Deconstructing and reconstructing behaviour relevant to mental health disorders: what can psychology offer? NEUROSCI BIOBEHAV REV XX(X)XXX-XXX, 2021. - Current treatments for mental health disorders are successful only for some patients, and there is an unmet clinical need for new treatment development. One challenge for treatment development has been how best to model complex human conditions in animals, where mechanism can be more readily studied with a range of neuroscientific techniques. We suggest that an approach to modelling based on associative animal learning theory provides a good framework for deconstructing complex mental health disorders such that they can be studied in animals. These individual simple models can subsequently be used in combination to 'reconstruct' a more complex model of the mental health disorder of interest. Using examples primarily from the field of drug addiction, we explore the 'psychological approach' and suggest that in addition to facilitating translation and backtranslation of tasks between animal models and patients, it is also highly concordant with the concept of triangulation.

Outcome-selective reinstatement is predominantly context-independent, and associated with c-Fos activation in the posterior dorsomedial striatum

Research from human and animal studies has found that after responding has been successfully reduced following treatment it can return upon exposure to certain contexts. An individual in recovery from alcohol use disorder, for example, might relapse to drinking upon visiting their favourite bar. However, most of these data have been derived from experiments involving a single (active) response, and the context-dependence of returned responding in situations involving choice between multiple actions and outcomes is less well-understood. We thus investigated how outcome-selective reinstatement - a procedure involving choice between two actions and outcomes - was affected by altering the physical context in rats. In Experiment 1, rats were trained over 6 days to press a left lever for one food outcome (pellets or sucrose) and a right lever for the other outcome. Then, rats received an extinction session in either the same context (A) as lever press training, or in a different context (B). Rats were tested immediately (5 min) after extinction in Context A or B such that there were four groups in total: AAA, ABB, ABA, and AAB. Reinstatement testing consisted of one food outcome being delivered 'freely' (i.e. unearned by lever pressing and unsignalled by cues) to the food magazine every 4 min in the following order: Sucrose, Pellet, Pellet, Sucrose. Selective reinstatement was considered intact if pellet delivery increased pressing selectively on the pellet lever, and sucrose delivery selectively increased pressing on the sucrose lever. This result (Reinstated > Nonreinstated) was observed for rats in group AAA and ABB, but not rats in groups ABA and AAB. Experiment 2 was conducted identically, except that rats received two extinction sessions over two days and tested one day later. This time, all groups demonstrated intact outcome-selective reinstatement regardless of context. Analysis of c-Fos expression in several brain regions revealed that only c-Fos expression in the posterior dorsomedial striatum (pDMS) was related to intact reinstatement performance. Overall, these results suggest that outcome-selective reinstatement is predominantly context-independent, and that intact reinstatement is related to neuronal activity in the pDMS.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Context, attention, and the switch between habit and goal-direction in behavior

This article reviews recent findings from the author’s laboratory that may provide new insights into how habits are made and broken. Habits are extensively practiced behaviors that are automatically evoked by antecedent cues and performed without their goal (or reinforcer) “in mind.” Goal-directed actions, in contrast, are instrumental behaviors that are performed because their goal is remembered and valued. New results suggest that actions may transition to habit after extended practice when conditions encourage reduced attention to the behavior. Consistent with theories of attention and learning, a behavior may command less attention (and become habitual) as its reinforcer becomes well-predicted by cues in the environment; habit learning is prevented if presentation of the reinforcer is uncertain. Other results suggest that habits are not permanent, and that goal-direction can be restored by several environmental manipulations, including exposure to unexpected reinforcers or context change. Habits are more context-dependent than goal-directed actions are. Habit learning causes retroactive interference in a way that is reminiscent of extinction: It inhibits, but does not erase, goal-direction in a context-dependent way. The findings have implications for the understanding of habitual and goal-directed control of behavior as well as disordered behaviors like addictions.

Astrocyte-neuron interaction in the dorsal striatum-pallidal circuits and alcohol-seeking behaviors

In the striatum, two main types of GABAergic medium spiny neurons (MSNs), denoted striatonigral (or direct-pathway MSNs, dMSNs) and striatopallidal neurons (indirect-pathway MSNs, iMSNs), form circuits with distinct pallidal nuclei, which sends "GO" or "NO-GO" signals through the thalamus. These striatopallidal circuits evaluate and execute reward-seeking and taking behaviors. Especially, the dorsal striatum can be further divided into the dorsomedial striatum (DMS, equivalent to caudate in primates and humans) and dorsolateral striatum (DLS, equivalent to putamen), which orchestrates goal-directed and habitual reward-seeking and taking behaviors, respectively. Using optogenetics, chemogenetics and in vivo calcium imaging technologies combined with electrophysiology and digitalized behavior phenotyping, recent studies have revealed cell-, circuit- and context-specific functions of these microcircuits in addictive behaviors. Also, region-specific astrocytes regulate the homeostatic activities of the dMSNs and iMSNs as well as the downstream circuits, which determine the net balance of cortico-striato-pallidal activities to the thalamic neurons. This review will summarize the recent progress of striatopallidal circuits focusing on astrocyte-neuron interaction and, reward- and alcohol-seeking behaviors. Our review will also discuss the translational and clinical implications of these microcircuit studies. This article is part of the special Issue on "Neurocircuitry Modulating Drug and Alcohol Abuse".