The neuroscience of cognitive-motivational styles: Sign- and goal-trackers as animal models

Cortico-striatal action control inherent of opponent cognitive-motivational styles

Turning on cue or stopping at a red light requires the detection of such cues to select action sequences, or suppress action, in accordance with cue-associated action rules. Cortico-striatal projections are an essential part of the brain's attention-motor interface. Glutamate-sensing microelectrode arrays were used to measure glutamate transients in the dorsomedial striatum (DMS) of male and female rats walking a treadmill and executing cued turns and stops. Prelimbic-DMS projections were chemogenetically inhibited to determine their behavioral necessity and the cortico-striatal origin of cue-evoked glutamate transients. Furthermore, we investigated rats exhibiting preferably goal-directed (goal trackers, GTs) versus cue-driven attention (sign trackers, STs), to determine the impact of such cognitive-motivational biases on cortico-striatal control. GTs executed more cued turns and initiated such turns more slowly than STs. During turns, but not missed turns or cued stops, cue-evoked glutamate concentrations were higher in GTs than in STs. In conjunction with turn cue-evoked glutamate spike levels, the presence of a single spike rendered GTs to be almost twice as likely to turn than STs. In contrast, multiple glutamate spikes predicted GTs to be less likely to turn than STs. In GTs, but not STs, inhibition of prelimbic-DMS projections attenuated turn rates, turn cue-evoked glutamate peaks, and increased the number of spikes. These findings suggest that turn cue-evoked glutamate release in GTs is tightly controlled by cortico-striatal neuronal activity. In contrast, in STs, glutamate release from DMS glutamatergic terminals may be regulated by other striatal circuitry, preferably mediating cued suppression of action and reward tracking.

Risk-promoting effects of reward-paired cues in human sign- and goal-trackers

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.

Individual differences in late positive potential amplitude and theta power predict cue-induced eating

Cue-induced reward-seeking behaviors are regulated by both the affective and cognitive control systems of the brain. This study aimed at investigating how individual differences in affective and cognitive responses to cues predicting food rewards contribute to the regulation of cue-induced eating. We recorded electroencephalogram (EEG) from 59 adults while they viewed emotional and food-related images that preceded the delivery of food rewards (candies) or non-food objects (beads). We measured the amplitude of the late positive potential (LPP) in response to a variety of motivationally relevant images and power in the theta (4-8 Hz) frequency band after candies or beads were dispensed to the participants. We found that individuals with larger LPP responses to food images than to pleasant images (C>P group) ate significantly more during the experiment than those with the opposite response pattern (P>C group, p < 0.001). Furthermore, we found that individuals with higher theta power after dispensation of the candy than of the bead (θCA>θBE) ate significantly more than those with the opposite response pattern (θBE>θCA, p < 0.001). Finally, we found that the crossed P>C and θBE>θCA group ate less (p < 0.001) than did the other three groups formed by crossing the LPP and theta group assignments, who exhibited similar eating behavior on average (p = 0.662). These findings demonstrate that individual differences in both affective and cognitive responses to reward-related cues underlie vulnerability to cue-induced behaviors, underscoring the need for individualized treatments to mitigate maladaptive behaviors.

Motor impulsivity but not risk-related impulsive choice is associated to drug intake and drug-primed relapse

Introduction

Motor impulsivity and risk-related impulsive choice have been proposed as vulnerability factors for drug abuse, due to their high prevalence in drug abusers. However, how these two facets of impulsivity are associated to drug abuse remains unclear. Here, we investigated the predictive value of both motor impulsivity and risk-related impulsive choice on characteristics of drug abuse including initiation and maintenance of drug use, motivation for the drug, extinction of drug-seeking behavior following drug discontinuation and, finally, propensity to relapse.

Methods

We used the Roman High- (RHA) and Low- Avoidance (RLA) rat lines, which display innate phenotypical differences in motor impulsivity, risk-related impulsive choice, and propensity to self-administer drugs. Individual levels of motor impulsivity and risk-related impulsive choice were measured using the rat Gambling task. Then, rats were allowed to self-administer cocaine (0.3 mg/kg/infusion; 14 days) to evaluate acquisition and maintenance of cocaine self-administration, after which motivation for cocaine was assessed using a progressive ratio schedule of reinforcement. Subsequently, rats were tested for their resistance to extinction, followed by cue-induced and drug-primed reinstatement sessions to evaluate relapse. Finally, we evaluated the effect of the dopamine stabilizer aripiprazole on reinstatement of drug-seeking behaviors.

Results

We found that motor impulsivity and risk-related impulsive choice were positively correlated at baseline. Furthermore, innate high levels of motor impulsivity were associated with higher drug use and increased vulnerability to cocaine-primed reinstatement of drug-seeking. However, no relationships were observed between motor impulsivity and the motivation for the drug, extinction or cue-induced reinstatement of drug-seeking. High levels of risk-related impulsive choice were not associated to any aspects of drug abuse measured in our study. Additionally, aripiprazole similarly blocked cocaine-primed reinstatement of drug-seeking in both high- and low-impulsive animals, suggesting that aripiprazole acts as a D_2/3R antagonist to prevent relapse independently of the levels of impulsivity and propensity to self-administer drugs.

Discussion

Altogether, our study highlights motor impulsivity as an important predictive factor for drug abuse and drug-primed relapse. On the other hand, the involvement of risk-related impulsive choice as a risk factor for drug abuse appears to be limited.

Genetic Disruption of System xc-Mediated Glutamate Release from Astrocytes Increases Negative-Outcome Behaviors While Preserving Basic Brain Function in Rat

The importance of neuronal glutamate to synaptic transmission throughout the brain illustrates the immense therapeutic potential and safety risks of targeting this system. Astrocytes also release glutamate, the clinical relevance of which is unknown as the range of brain functions reliant on signaling from these cells hasn't been fully established. Here, we investigated system xc- (Sxc), which is a glutamate release mechanism with an in vivo rodent expression pattern that is restricted to astrocytes. As most animals do not express Sxc, we first compared the expression and sequence of the obligatory Sxc subunit xCT among major classes of vertebrate species. We found xCT to be ubiquitously expressed and under significant negative selective pressure. Hence, Sxc likely confers important advantages to vertebrate brain function that may promote biological fitness. Next, we assessed brain function in male genetically modified rats (MSxc) created to eliminate Sxc activity. Unlike other glutamatergic mechanisms, eliminating Sxc activity was not lethal and didn't alter growth patterns, telemetry measures of basic health, locomotor activity, or behaviors reliant on simple learning. However, MSxc rats exhibited deficits in tasks used to assess cognitive behavioral control. In a pavlovian conditioned approach, MSxc rats approached a food-predicted cue more frequently than WT rats, even when this response was punished. In attentional set shifting, MSxc rats displayed cognitive inflexibility because of an increased frequency of perseverative errors. MSxc rats also displayed heightened cocaine-primed drug seeking. Hence, a loss of Sxc-activity appears to weaken control over nonreinforced or negative-outcome behaviors without altering basic brain function.SIGNIFICANCE STATEMENT Glutamate is essential to synaptic activity throughout the brain, which illustrates immense therapeutic potential and risk. Notably, glutamatergic mechanisms are expressed by most types of brain cells. Hence, glutamate likely encodes multiple forms of intercellular signaling. Here, we hypothesized that the selective manipulation of astrocyte to neuron signaling would alter cognition without producing widespread brain impairments. First, we eliminated activity of the astrocytic glutamate release mechanism, Sxc, in rat. This impaired cognitive flexibility and increased expression of perseverative, maladaptive behaviors. Notably, eliminating Sxc activity did not alter metrics of health or noncognitive brain function. These data add to recent evidence that the brain expresses cognition-specific molecular mechanisms that could lead to highly precise, safe medications for impaired cognition.

The propensity to sign-track is associated with externalizing behavior and distinct patterns of reward-related brain activation in youth

Externalizing behaviors in childhood often predict impulse control disorders in adulthood; however, the underlying bio-behavioral risk factors are incompletely understood. In animals, the propensity to sign-track, or the degree to which incentive motivational value is attributed to reward cues, is associated with externalizing-type behaviors and deficits in executive control. Using a Pavlovian conditioned approach paradigm, we quantified sign-tracking in 40 healthy 9-12-year-olds. We also measured parent-reported externalizing behaviors and anticipatory neural activations to outcome-predicting cues using the monetary incentive delay fMRI task. Sign-tracking was associated with attentional and inhibitory control deficits and the degree of amygdala, but not cortical, activation during reward anticipation. These findings support the hypothesis that youth with a propensity to sign-track are prone to externalizing tendencies, with an over-reliance on subcortical cue-reactive brain systems. This research highlights sign-tracking as a promising experimental approach delineating the behavioral and neural circuitry of individuals at risk for externalizing disorders.

Flexible control of Pavlovian-instrumental transfer based on expected reward value

The Pavlovian-instrumental transfer (PIT) paradigm is widely used to assay the motivational influence of reward-predictive cues, reflected by their ability to invigorate instrumental behavior. Leading theories assume that a cue's motivational properties are tied to predicted reward value. We outline an alternative view that recognizes that reward-predictive cues may suppress rather than motivate instrumental behavior under certain conditions, an effect termed positive conditioned suppression. We posit that cues signaling imminent reward delivery tend to inhibit instrumental behavior, which is exploratory by nature, in order to facilitate efficient retrieval of the expected reward. According to this view, the motivation to engage in instrumental behavior during a cue should be inversely related to the value of the predicted reward, since there is more to lose by failing to secure a high-value reward than a low-value reward. We tested this hypothesis in rats using a PIT protocol known to induce positive conditioned suppression. In Experiment 1, cues signaling different reward magnitudes elicited distinct response patterns. Whereas the one-pellet cue increased instrumental behavior, cues signaling three or nine pellets suppressed instrumental behavior and elicited high levels of food-port activity. Experiment 2 found that reward-predictive cues suppressed instrumental behavior and increased food-port activity in a flexible manner that was disrupted by post-training reward devaluation. Further analyses suggest that these findings were not driven by overt competition between the instrumental and food-port responses. We discuss how the PIT task may provide a useful tool for studying cognitive control over cue-motivated behavior in rodents. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Estradiol and progesterone in female reward-learning, addiction, and therapeutic interventions

Sex steroid hormones like estradiol (E2) and progesterone (P4) guide the sexual organization and activation of the developing brain and control female reproductive behavior throughout the lifecycle; importantly, these hormones modulate functional activity of not just the endocrine system, but most of the nervous system including the brain reward system. The effects of E2 and P4 can be seen in the processing of and memory for rewarding stimuli and in the development of compulsive reward-seeking behaviors like those seen in substance use disorders. Women are at increased risk of developing substance use disorders; however, the origins of this sex difference are not well understood and therapeutic interventions targeting ovarian hormones have produced conflicting results. This article reviews the contribution of the E2 and P4 in females to functional modulation of the brain reward system, their possible roles in origins of addiction vulnerability, and the development and treatment of compulsive reward-seeking behaviors.

Basal Forebrain Chemogenetic Inhibition Converts the Attentional Control Mode of Goal-Trackers to That of Sign-Trackers

Sign tracking versus goal tracking in rats indicate vulnerability and resistance, respectively, to Pavlovian cue-evoked addictive drug taking and relapse. Here, we tested hypotheses predicting that the opponent cognitive-behavioral styles indexed by sign tracking versus goal tracking include variations in attentional performance which differentially depend on basal forebrain projection systems. Pavlovian Conditioned Approach (PCA) testing was used to identify male and female sign-trackers (STs) and goal-trackers (GTs), as well as rats with an intermediate phenotype (INTs). Upon reaching asymptotic performance in an operant task requiring the detection of visual signals (hits) as well as the reporting of signal absence for 40 min per session, GTs scored more hits than STs, and hit rates across all phenotypes correlated with PCA scores. STs missed relatively more signals than GTs specifically during the last 15 min of a session. Chemogenetic inhibition of the basal forebrain decreased hit rates in GTs but was without effect in STs. Moreover, the decrease in hits in GTs manifested solely during the last 15 min of a session. Transfection efficacy in the horizontal limb of the diagonal band (HDB), but not substantia innominate (SI) or nucleus basalis of Meynert (nbM), predicted the behavioral efficacy of chemogenetic inhibition in GTs. Furthermore, the total subregional transfection space, not transfection of just cholinergic neurons, correlated with performance effects. These results indicate that the cognitive-behavioral phenotype indexed by goal tracking, but not sign tracking, depends on activation of the basal forebrain-frontal cortical projection system and associated biases toward top-down or model-based performance.

The role of reinforcement learning and value-based decision-making frameworks in understanding food choice and eating behaviors

The obesogenic food environment includes easy access to highly-palatable, energy-dense, "ultra-processed" foods that are heavily marketed to consumers; therefore, it is critical to understand the neurocognitive processes the underlie overeating in response to environmental food-cues (e.g., food images, food branding/advertisements). Eating habits are learned through reinforcement, which is the process through which environmental food cues become valued and influence behavior. This process is supported by multiple behavioral control systems (e.g., Pavlovian, Habitual, Goal-Directed). Therefore, using neurocognitive frameworks for reinforcement learning and value-based decision-making can improve our understanding of food-choice and eating behaviors. Specifically, the role of reinforcement learning in eating behaviors was considered using the frameworks of (1) Sign-versus Goal-Tracking Phenotypes; (2) Model-Free versus Model-Based; and (3) the Utility or Value-Based Model. The sign-and goal-tracking phenotypes may contribute a mechanistic insight on the role of food-cue incentive salience in two prevailing models of overconsumption-the Extended Behavioral Susceptibility Theory and the Reactivity to Embedded Food Cues in Advertising Model. Similarly, the model-free versus model-based framework may contribute insight to the Extended Behavioral Susceptibility Theory and the Healthy Food Promotion Model. Finally, the value-based model provides a framework for understanding how all three learning systems are integrated to influence food choice. Together, these frameworks can provide mechanistic insight to existing models of food choice and overconsumption and may contribute to the development of future prevention and treatment efforts.

Appetitive 50 kHz calls in a pavlovian conditioned approach task in Cacna1c haploinsufficient rats

We have previously shown that rats emit high-frequency 50 kHz ultrasonic vocalizations (USV) during sign- and goal-tracking in a common Pavlovian conditioned approach task. Such 50 kHz calls are probably related to positive affect and are associated with meso-limbic dopamine function. In humans, the CACNA1C gene, encoding for the α_1C subunit of the L-type voltage-gated calcium channel Ca_V1.2, is implicated in several mental disorders, including mood disorders associated with altered dopamine signaling. In the present study, we investigated sign- and goal-tracking behavior and the emission of 50 kHz USV in Cacna1c haploinsufficent rats in a task where food pellet delivery is signaled by an appearance of an otherwise inoperable lever. Over the course of this Pavlovian training, these rats not only increased their approach to the reward site, but also their rates of pressing the inoperable lever. During subsequent extinction tests, where reward delivery was omitted, extinction patterns differed between reward site (i.e. magazine entries) and lever, since magazine entries quickly declined whereas behavior towards the lever transiently increased. Based on established criteria to define sign- or goal-tracking individuals, no CACNA1C rat met a sign-tracking criterion, since around 42% of rats tested where goal-trackers and the other 58% fell into an intermediate range. Regarding USV, we found that the CACNA1C rats emitted 50 kHz calls with a clear subject-dependent pattern; also, most of them were of a flat subtype and occurred mainly during initial habituation phases without cues or rewards. Compared, to previously published wildtype controls, Cacna1c haploinsufficent rats displayed reduced numbers of appetitive 50 kHz calls. Moreover, similar to wildtype littermate controls, 50 kHz call emission in Cacna1c haploinsufficent rats was intra-individually stable over training days and was negatively associated with goal-tracking. Together, these findings provide evidence in support of 50 kHz calls as trait marker. The finding that Cacna1c haploinsufficent rats show reductions of 50 kHz calls accompanied with more goal-tracking, is consistent with the assumption of altered dopamine signaling in these rats, a finding which supports their applicability in models of mental disorders.

Disrupted Choline Clearance and Sustained Acetylcholine Release In Vivo by a Common Choline Transporter Coding Variant Associated with Poor Attentional Control in Humans

Transport of choline via the neuronal high-affinity choline transporter (CHT; SLC5A7) is essential for cholinergic terminals to synthesize and release acetylcholine (ACh). In humans, we previously demonstrated an association between a common CHT coding substitution (rs1013940; Ile89Val) and reduced attentional control as well as attenuated frontal cortex activation. Here, we used a CRISPR/Cas9 approach to generate mice expressing the I89V substitution and assessed, in vivo, CHT-mediated choline transport, and ACh release. Relative to wild-type (WT) mice, CHT-mediated clearance of choline in male and female mice expressing one or two Val89 alleles was reduced by over 80% in cortex and over 50% in striatum. Choline clearance in CHT Val89 mice was further reduced by neuronal inactivation. Deficits in ACh release, 5 and 10 min after repeated depolarization at a low, behaviorally relevant frequency, support an attenuated reloading capacity of cholinergic neurons in mutant mice. The density of CHTs in total synaptosomal lysates and neuronal plasma-membrane-enriched fractions was not impacted by the Val89 variant, indicating a selective impact on CHT function. When challenged with a visual disruptor to reveal attentional control mechanisms, Val89 mice failed to adopt a more conservative response bias. Structural modeling revealed that Val89 may attenuate choline transport by altering conformational changes of CHT that support normal transport rates. Our findings support the view that diminished sustained cholinergic signaling capacity underlies perturbed attentional performance in individuals expressing CHT Val89. The CHT Val89 mouse serves as a valuable model to study heritable risk for cognitive disorders arising from cholinergic dysfunction.SIGNIFICANCE STATEMENT Acetylcholine (ACh) signaling depends on the functional capacity of the neuronal choline transporter (CHT). Previous research demonstrated that humans expressing the common CHT coding variant Val89 exhibit attentional vulnerabilities and attenuated fronto-cortical activation during attention. Here, we find that mice engineered to express the Val89 variant exhibit reduced CHT-mediated choline clearance and a diminished capacity to sustain ACh release. Additionally, Val89 mice lack cognitive flexibility in response to an attentional challenge. These findings provide a mechanistic and cognitive framework for interpreting the attentional phenotype associated with the human Val89 variant and establish a model that permits a more invasive interrogation of CNS effects as well as the development of therapeutic strategies for those, including Val89 carriers, with presynaptic cholinergic perturbations.

Inhibition of a cortico-thalamic circuit attenuates cue-induced reinstatement of drug-seeking behavior in "relapse prone" male rats

RATIONALE

Relapse often occurs when individuals are exposed to stimuli or cues previously associated with the drug-taking experience. The ability of drug cues to trigger relapse is believed to be a consequence of incentive salience attribution, a process by which the incentive value of reward is transferred to the reward-paired cue. Sign-tracker (ST) rats that attribute enhanced incentive value to reward cues are more prone to relapse compared to goal-tracker (GT) rats that primarily attribute predictive value to such cues.

OBJECTIVES

The neurobiological mechanisms underlying this individual variation in relapse propensity remains largely unexplored. The paraventricular nucleus of the thalamus (PVT) has been identified as a critical node in the regulation of cue-elicited behaviors in STs and GTs, including cue-induced reinstatement of drug-seeking behavior. Here we used a chemogenetic approach to assess whether "top-down" cortical input from the prelimbic cortex (PrL) to the PVT plays a role in mediating individual differences in relapse propensity.

RESULTS

Chemogenetic inhibition of the PrL-PVT pathway selectively decreased cue-induced reinstatement of drug-seeking behavior in STs, without affecting behavior in GTs. In contrast, cocaine-primed drug-seeking behavior was not affected in either phenotype. Furthermore, when rats were characterized based on a different behavioral phenotype-locomotor response to novelty-inhibition of the PrL-PVT pathway had no effect on either cue- or drug-induced reinstatement.

CONCLUSIONS

These results highlight an important role for the PrL-PVT pathway in vulnerability to relapse that is consequent to individual differences in the propensity to attribute incentive salience to discrete reward cues.

Quantifying the instrumental and noninstrumental underpinnings of Pavlovian responding with the Price equation

The Price equation is a mathematical expression of selectionist and non-selectionist pressures on biological, cultural, and behavioral change. We use it here to specify instrumental and noninstrumental behaviors as they arise within the context of the Pavlovian autoshaping procedure, for rats trained under reward certainty and reward uncertainty. The point of departure for this endeavor is that some portion of autoshaped behavior referred to as goal-tracking appears instrumental-a function of resource attainment (the individual approaches the location where the unconditioned stimulus is to be delivered). By contrast, some other portion of autoshaped behavior referred to as sign-tracking is noninstrumental-irrelevant to making contact with the to-be-delivered unconditioned stimulus. A Price equation model is proposed that unifies our understanding of Pavlovian autoshaping behavior by isolating operant and respondent influences on goal-tracking (instrumental) and sign-tracking (noninstrumental) behavior.

Nicotine Enhances Goal-Tracking in Ethanol and Food Pavlovian Conditioned Approach Paradigms

Rationale

Nicotine promotes alcohol intake through pharmacological and behavioral interactions. As an example of the latter, nicotine can facilitate approach toward food- and alcohol-associated stimuli ("sign-tracking") in lever-Pavlovian conditioned approach (PavCA) paradigms. However, we recently reported that nicotine can also enhance approach toward locations of reward delivery ("goal-tracking") triggered by ethanol-predictive stimuli when the location of ethanol delivery is non-static (i.e., a retractable sipper bottle).

Objective

To determine whether the non-static nature of the reward location could have biased the development of goal-tracking in our previous study (Loney et al., 2019); we assessed the effect of nicotine in a lever-PavCA paradigm wherein the location of ethanol delivery was static (i.e., a stationary liquid receptacle). Then, to determine whether nicotine's enhancement of goal-tracking is unique to ethanol-predictive stimuli, we assessed the effect of systemic nicotine on approach triggered by food-predictive stimuli in a lever-PavCA paradigm.

Methods

Long-Evans rats were used in two PavCA experiments wherein a lever predicted the receipt of ethanol (15% vol/vol; experiment 1) or food (experiment 2) into a stationary receptacle. Prior to testing, rats were administered nicotine (0.4 mg/kg subcutaneously) or saline systemically.

Results

In both experiments, nicotine increased measures of goal-tracking, but not sign-tracking.

Conclusion

Nicotine can facilitate approach to reward locations without facilitating approach to reward-predictive stimuli. As such, conceptualization of the mechanisms by which nicotine affects behavior must be expanded to explain an enhancement of goal-tracking by nicotine.

Situating desire: Situational cues affect desire for food through eating simulations

How do situations influence food desire? Although eating typically occurs in rich background situations, research on food desire often focuses on the properties of foods and consumers, rather than on the situations in which eating takes place. Here, we take a grounded cognition perspective and suggest that a situation that is congruent with consuming a food increases simulations of eating it, which, in turn, affect desire, and the expected and actual liking of the food. We tested this idea in four pre-registered experiments (N = 524). Participants processed an image of a food presented in a congruent situation, an incongruent situation, or no background situation. Compared to the incongruent situation, the congruent situation increased expected liking of the food and desire, and this was partially or fully mediated by eating simulations. The congruent situation also increased salivation, a physiological indicator of preparing to eat. However, there was only weak and indirect evidence for congruence effects on actual liking of the food when tasted. These findings show that situational cues can affect desire for food through eating simulations. Thus, background situations play an important but understudied role in human food desires. We address implications for research using food images, and for applications to promote healthy and sustainable eating behaviour.

Sign- and goal-tracking score does not correlate with addiction-like behavior following prolonged cocaine self-administration

RATIONALE

In classical conditioning, sign-tracking reflects behavior directed toward a conditioned stimulus (CS) in expectation of a reward (unconditioned stimulus, US); in contrast, goal-tracking describes behavior directed toward the location of delivery of a US. As cues previously paired with drugs of abuse promote drug-seeking and drug-taking behavior in both animals and humans and thus contribute to the severity of substance abuse, sign-tracking may represent a maladaptive cue-focused behavior that may increase addiction vulnerability as compared to goal-tracking. Recent studies do, in fact, support this possibility. Previous work in this area has focused primarily on paradigms using relatively limited exposure to drug rather than extended drug intake.

OBJECTIVES

Here, we used the DSM-IV-based 3-criteria (3-CRIT) model and examined whether a relationship exists between sign- or goal-tracking phenotypes and the prevalence of criteria associated with addiction-like behavior following extended cocaine self-administration as measured in this model.

METHODS

Forty-six male Sprague Dawley rats underwent a Pavlovian conditioned approach (PCA) procedure and were characterized along a continuum as goal-trackers (GTs), intermediates (INTs), or sign-trackers (STs). The animals were subsequently trained to intravenous self-administer cocaine during 45 self-administration (SA) sessions and characterized for the 3 criteria outlined in the model: persistence of drug-seeking, motivation for cocaine-taking, and resistance to punishment.

RESULTS

We performed correlational analyses on the traits measured, finding no relationships between PCA score and addiction-like characteristics measured using the 3-CRIT model of addiction. However, STs showed significantly greater resistance to punishment than GTs.

CONCLUSIONS

Phenotyping along a continuum of PCA scores may not be a valid predictor for identifying vulnerability to the addiction-like behaviors examined using the 3-CRIT model. However, PCA phenotype may predict a single feature of the 3-CRIT model, resistance to punishment, among those rats classified as either STs or GTs.

Male Goal-Tracker and Sign-Tracker Rats Do Not Differ in Neuroendocrine or Behavioral Measures of Stress Reactivity

Environmental cues attain the ability to guide behavior via learned associations. As predictors, cues can elicit adaptive behavior and lead to valuable resources (e.g., food). For some individuals, however, cues are transformed into incentive stimuli and elicit motivational states that can be maladaptive. The goal-tracker (GT)/sign-tracker (ST) animal model captures individual differences in cue-motivated behaviors, with reward-associated cues serving as predictors of reward for both phenotypes but becoming incentive stimuli to a greater degree for STs. While these distinct phenotypes are characterized based on Pavlovian conditioned approach (PavCA) behavior, they exhibit differences on a number of behaviors relevant to psychopathology. To further characterize the neurobehavioral endophenotype associated with individual differences in cue-reward learning, neuroendocrine and behavioral profiles associated with stress and anxiety were investigated in male GT, ST, and intermediate responder (IR) rats. It was revealed that baseline corticosterone (CORT) increases with Pavlovian learning, but to the same degree, regardless of phenotype. No significant differences in behavior were observed between GTs and STs during an elevated plus maze (EPM) or open field test (OFT), nor were there differences in CORT response to the OFT or physiological restraint. Upon examination of central markers associated with stress reactivity, we found that STs have greater glucocorticoid receptor (GR) mRNA expression in the ventral hippocampus, with no phenotypic differences in the dorsal hippocampus or prelimbic cortex (PrL). These findings demonstrate that GTs and STs do not differ on stress-related and anxiety-related behaviors, and suggest that differences in neuroendocrine measures between these phenotypes can be attributed to distinct cue-reward learning styles.

A proposed role for glucocorticoids in mediating dopamine-dependent cue-reward learning

Learning to respond appropriately to one's surrounding environment is fundamental to survival. Importantly, however, individuals vary in how they respond to cues in the environment and this variation may be a key determinant of psychopathology. The ability of seemingly neutral cues to promote maladaptive behavior is a hallmark of several psychiatric disorders including, substance use disorder, post-traumatic stress disorder, eating disorders and obsessive-compulsive disorder. Thus, it is important to uncover the neural mechanisms by which such cues are able to attain inordinate control and promote psychopathological behavior. Here, we suggest that glucocorticoids play a critical role in this process. Glucocorticoids are primarily recognized as the main hormone secreted in response to stress but are known to exert their effects across the body and the brain, and to affect learning and memory, cognition and reward-related behaviors, among other things. Here we speculate that glucocorticoids act to facilitate a dopamine-dependent form of cue-reward learning that appears to be relevant to a number of psychiatric conditions. Specifically, we propose to utilize the sign-tracker/goal-tracker animal model as a means to capture individual variation in stimulus-reward learning and to isolate the role of glucocorticoid-dopamine interactions in mediating these individual differences. It is hoped that this framework will lead to the discovery of novel mechanisms that contribute to complex neuropsychiatric disorders and their comorbidity.

Toward Precision Medicine for Smoking Cessation: Developing a Neuroimaging-Based Classification Algorithm to Identify Smokers at Higher Risk for Relapse

INTRODUCTION

By improving our understanding of the neurobiological mechanisms underlying addiction, neuroimaging research is helping to identify new targets for personalized treatment interventions. When trying to quit, smokers with larger electrophysiological responses to cigarette-related, compared with pleasant, stimuli ("C > P") are more likely to relapse than smokers with the opposite brain reactivity profile ("P > C").

AIM AND METHOD

The goal was to (1) build a classification algorithm to identify smokers characterized by P > C or C > P neuroaffective profiles and (2) validate the algorithm's classification outcomes in an independent data set where we assessed both smokers' electrophysiological responses at baseline and smoking abstinence during a quit attempt. We built the classification algorithm applying discriminant function analysis on the event-related potentials evoked by emotional images in 180 smokers.

RESULTS

The predictive validity of the classifier showed promise in an independent data set that included new data from 177 smokers interested in quitting; the algorithm classified 111 smokers as P > C and 66 as C > P. The overall abstinence rate was low; 15 individuals (8.5% of the sample) achieved CO-verified 12-month abstinence. Although individuals classified as P > C were nearly 2.5 times more likely to be abstinent than smokers classified as C > P (12 vs. 3, or 11% vs. 4.5%), this result was nonsignificant, preliminary, and in need of confirmation in larger trials.

CONCLUSION

These results suggest that psychophysiological techniques have the potential to advance our knowledge of the neurobiological underpinnings of nicotine addiction and improve clinical applications. However, larger sample sizes are necessary to reliably assess the predictive ability of our algorithm.

IMPLICATIONS

We assessed the clinical relevance of a neuroimaging-based classification algorithm on an independent sample of smokers enrolled in a smoking cessation trial and found those with the tendency to attribute more relevance to rewards than cues were nearly 2.5 times more likely to be abstinent than smokers with the opposite brain reactivity profile (11% vs. 4.5%). Although this result was not statistically significant, it suggests our neuroimaging-based classification algorithm can potentially contribute to the development of new precision medicine interventions aimed at treating substance use disorders. Regardless, these findings are still preliminary and in need of confirmation in larger trials.

The lateral hypothalamus and orexinergic transmission in the paraventricular thalamus promote the attribution of incentive salience to reward-associated cues

RATIONALE

Prior research suggests that the neural pathway from the lateral hypothalamic area (LHA) to the paraventricular nucleus of the thalamus (PVT) mediates the attribution of incentive salience to Pavlovian reward cues. However, a causal role for the LHA and the neurotransmitters involved have not been demonstrated in this regard.

OBJECTIVES

To examine (1) the role of LHA in the acquisition of Pavlovian conditioned approach (PavCA) behaviors, and (2) the role of PVT orexin 1 receptors (OX1r) and orexin 2 receptors (OX2r) in the expression of PavCA behaviors and conditioned reinforcement.

METHODS

Rats received excitotoxic lesions of the LHA prior to Pavlovian training. A separate cohort of rats characterized as sign-trackers (STs) or goal-trackers (GTs) received the OX1r antagonist SB-334867, or the OX2r antagonist TCS-OX2-29, into the PVT, to assess their effects on the expression of PavCA behavior and on the conditioned reinforcing properties of a Pavlovian reward cue.

RESULTS

LHA lesions attenuated the development of sign-tracking behavior. Administration of either the OX1r or OX2r antagonist into the PVT reduced sign-tracking behavior in STs. Further, OX2r antagonism reduced the conditioned reinforcing properties of a Pavlovian reward cue in STs.

CONCLUSIONS

The LHA is necessary for the development of sign-tracking behavior; and blockade of orexin signaling in the PVT attenuates the expression of sign-tracking behavior and the conditioned reinforcing properties of a Pavlovian reward cue. Together, these data suggest that LHA orexin inputs to the PVT are a key component of the circuitry that encodes the incentive motivational value of reward cues.

Effects of partial reinforcement on autoshaping in inbred Roman high- and low-avoidance rats

Individuals trained under partial reinforcement (PR) typically show a greater resistance to extinction than individuals exposed to continuous reinforcement (CR). This phenomenon is referred to as the PR extinction effect (PREE) and is interpreted as a consequence of uncertainty-induced frustration counterconditioning. In this study, we assessed the effects of PR and CR in acquisition and extinction in two strains of rats, the inbred Roman high- and low-avoidance (RHA and RLA, respectively) rats. These two strains mainly differ in the expression of anxiety, the RLA rats showing more anxiety-related behaviors (hence, more sensitive to frustration) than the RHA rats. At a neurobiological level, mild stress is known to elevate corticosterone in RLA rats and dopamine in RHA rats. We tested four groups of rats (RHA/CR, RHA/PR, RLA/CR, and RLA/PR) in two successive acquisition-extinction phases to try to consolidate the behavioral effects. Animals received training in a Pavlovian autoshaping procedure with retractable levers as the conditioned stimulus, food pellets as the unconditioned stimulus, and lever presses as the conditioned response. In Phase 1, we observed a PREE in lever pressing in both strains, but this effect was larger and longer lasting in RHA/PR than in RLA/PR rats. In Phase 2, reacquisition was fast and the PREE persisted in both strains, although the two PR groups no longer differed in lever pressing. The results are discussed in terms of frustration theory and of uncertainty-induced sensitization of dopaminergic neurons.

Ultrasonic vocalizations and individual differences in rats performing a Pavlovian conditioned approach task

Rats emit distinct types of ultrasonic vocalizations (USV), including high-frequency 50-kHz USV, which occur in appetitive situations. Such 50-kHz USV are thought to reflect positive affective states, for example in case of reward anticipation, and are linked to dopamine signaling. The present study was conducted to investigate whether rats emit 50-kHz USV during a Pavlovian conditioned approach task and whether trait-like differences in 50-kHz USV emission are associated with sign- versus goal-tracking. We hypothesize that individuals engaging more with a cue predicting a food reward will also elicit more 50-kHz USV. In order to test this, we investigated 34 female rats and gauged USV while they underwent a Pavlovian conditioned approach training and extinction paradigm. For one, we found a high subject-dependent variability in the emission of 50-kHz calls. These were not largely affected by state differences, since these 50-kHz USV were observed throughout the task. During task progress and in most subjects, there was a rather complete shift toward goal-tracking, but subjects engaging more with the cue predicting a reward also emitted higher numbers of appetitive 50-kHz calls. This supports the hypothesis that sign-tracking is positively associated with the emission of 50-kHz USV. The high subject-dependent variability in the emission of 50-kHz calls warrants special attention in future appetitive studies.

Modeling neuroaffective biomarkers of drug addiction: A Bayesian nonparametric approach using dirichlet process mixtures

BACKGROUND

The properties of neurophysiological processes related to addiction have received much attention in the literature. However, empirical evidence of meaningful and useful characterization of these processes is limited. Recent studies have found that electrophysiological responses to emotional and drug-related cues can be used to create profiles that reliably predict smoking relapse.

NEW METHOD

This paper evaluates the validity of classifying electrophysiological responses into distinct profiles using a Bayesian dirichlet process mixture (DPM) model. The DPM is a Bayesian nonparametric (BNP) method to modeling unknown number of profiles characterized by uncertainty in cluster membership and in cluster number.

RESULTS

The DPM model confirmed previously identified neuroaffective reactivity profiles, but also revealed a finer level of granularity in the clustering. Specifically, in addition to the two clusters previously identified in the literature, the BNP methods identified a cluster of individuals showing similar responses to smoking, pleasant, neutral and unpleasant cues.

COMPARISON WITH EXISTING METHODS

BNP models provide an alternative to the k-mean clustering approach to modeling EEG-based neuroaffective profiles. Unlike k-means clustering, BNP models compute the probability that a subject belongs to a cluster while taking into consideration uncertainty in the number of clusters.

CONCLUSIONS

Our results confirm the reliability of the two clusters previously identified in these data, but also provide new insights by revealing a cluster that presented similar responses to stimuli with different contents. This finding may be related to the uncertainty in classification or overlapping brain-reactivity profiles.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

Addiction vulnerability and the processing of significant cues: Sign-, but not goal-, tracker perceptual sensitivity relies on cue salience

The identification of broadly defined psychological traits that bestow vulnerability for the manifestation of addiction-like behaviors can guide the discovery of the neuronal mechanisms underlying the propensity for drug taking. Sign-tracking behavior in rats (STs) signifies the presence of a trait that predicts a relatively greater behavioral control of Pavlovian drug and reward cues than in rats that exhibit goal-tracking behavior (GTs). We previously demonstrated that relatively poor cholinergic-attentional control in STs is an essential component of the trait indexed by sign-tracking and that this trait aspect contributes to the relatively greater power of drug cues to control the behavior of STs. Here we addressed the possibility that STs and GTs employ fundamentally different psychological mechanisms for the detection of cues in attention-demanding contexts. Rats were trained to perform an operant Sustained Attention Task. As task training advanced to the stage that taxed attentional control, the relative brightness of visual target signals significantly influenced detection performance in STs but not GTs. This finding suggests that STs, but not GTs, rely on bottom-up, cue salience-driven mechanisms to detect cues. GTs may be able to resist behavioral control by Pavlovian drug cues by utilizing goal-directed decisional processes that minimize the influence of the salience of drug cues. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Dissociable dopaminergic and pavlovian influences in goal-trackers and sign-trackers on a model of compulsive checking in OCD

RATIONALE

Checking is a functional behaviour that provides information to guide behaviour. However, in obsessive-compulsive disorder (OCD), checking may escalate to dysfunctional levels. The processes underpinning the transition from functional to dysfunctional checking are unclear but may be associated with individual differences that support the development of maladaptive behaviour. We examined one such predisposition, sign-tracking to a pavlovian conditioned stimulus, which we previously found associated with dysfunctional checking. How sign-tracking interacts with another treatment with emerging translational validity for OCD-like checking, chronic administration of the dopamine D₂ receptor agonist quinpirole, is unknown.

OBJECTIVES

We tested how functional and dysfunctional checking in the rat observing response task (ORT) was affected by chronic quinpirole administration in non-autoshaped controls and autoshaped animals classified as sign-trackers or goal-trackers.

METHODS

Sign-trackers or goal-trackers were trained on the ORT before the effects of chronic quinpirole administration on checking were assessed. Subsequently, the effects on checking of different behavioural challenges, including reward omission and the use of unpredictable reinforcement schedules, were tested.

RESULTS

Prior autoshaping increased checking. Sign-trackers and goal-trackers responded differently to quinpirole sensitization, reward omission and reinforcement uncertainty. Sign-trackers showed greater elevations in dysfunctional checking, particularly during uncertainty. By contrast, goal-trackers predominantly increased functional checking responses, possibly in response to reduced discrimination accuracy in the absence of cues signalling which lever was currently active.

CONCLUSIONS

The results are discussed in terms of how pavlovian associations influence behaviour that becomes compulsive in OCD and how this may be dependent on striatal dopamine D₂ receptors.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Sign and goal tracker rats process differently the incentive salience of a conditioned stimulus

Sign and goal tracker animals show different behavioral patterns in response to conditioned stimuli, which may be driven by different neural circuits involved in processing stimuli. Here, we explored whether sign and goal-tracker profiles implicated different brain regions and responses to incentive salience of stimuli. We performed three experiments using male Wistar rats. Experiment 1 showed that lesioning the medial prefrontal cortex increased the prevalence of the goal-tracker phenotype. Experiment 2 assessed the developmental trajectory of the salience incentive attribution to a conditioned stimulus, showing that increased incentive salience of stimuli increased the prevalence of the sign-tracker phenotype in mature, but not preadolescent rats. In experiment 3, the functional impact of the medial prefrontal cortex circuits was analyzed with a latent inhibition procedure. Sign tracker rats showed a reduced latent inhibition to stimuli previously exposed when compared to goal tracker or intermediate rats. The overall results of this study highlight a key role of the medial prefrontal cortex for sign tracking behavior. The expression of sign and goal tracker phenotypes changed after lesion to the medial prefrontal cortex (experiment 1), differed across development (experiment 2), and showed differences in the attentional processes to previously exposed stimuli, as preexposure to CS was ineffective in sign tracker animals (experiment 3). These data indicate that the responses to the incentive salience of stimuli in sign tracker and goal tracker profiles are likely driven by different neural circuitry, with a different role of prefrontal cortical function.

Sign- and goal-tracking rats show differences in various executive functions: Authors

Sign tracking (ST) is a complex Pavlovian trait that is known to impact instrumental behaviour. Recent work suggests that this trait also correlates with altered top-down executive control relative to goal tracking (GT) rats. This raises the question as to the extent to which both phenotypes differ in executive functions. Moreover, it is unclear which cognitive processes might cause potential differences between ST and GT rats. We therefore compared the behaviour of ST and GT rats in several assays, such as outcome devaluation, attentional set shifting and reversal learning, conditional responding, as well as delayed alternation to measure different aspects of executive functioning. Goal-directed behaviour per se was not different between ST and GT rats in the outcome devaluation task. ST rats performed slightly better than GT rats in one condition of the set shifting task (place->cue shift) and the delayed alternation task, but did not perform as well in the conditional responding task. Thus, differential behavioural performance between ST and GT rats was dependent on the specific task context. Further, we found evidence that the differences in executive functions are likely related to increased incentive salience attribution and impulsive action in ST rats.

The transition to cocaine addiction: the importance of pharmacokinetics for preclinical models

A key question in addiction research concerns how, in some individuals, initial recreational or casual patterns of drug use may change brain and psychological function in ways that promote a transition to the problematic patterns of use that define substance use disorders (addiction). In preclinical studies, this is modeled using self-administration procedures. However, most cocaine self-administration procedures produce continuously high brain concentrations of drug, whereas in people, bouts of use are thought to be more intermittent. Here, we ask whether such temporal pharmacokinetic factors matter, by comparing and contrasting the neuropsychological consequences of intermittent vs. long access cocaine self-administration experience. It turns out, the temporal pattern of cocaine use has profound effects on a number of outcomes. First, despite much less total drug consumption, intermittent access to cocaine is more effective in producing addiction-like behavior. Second, intermittent and long access cocaine self-administration change the brain in very different ways to influence motivated behavior. We argue that intermittent access self-administration procedures might be better suited than traditional self-administration procedures for isolating drug-induced changes in neuropsychological function that contribute to the transition to cocaine addiction.

The reality of "food porn": Larger brain responses to food-related cues than to erotic images predict cue-induced eating

While some individuals can defy the lure of temptation, many others find appetizing food irresistible. The goal of this study was to investigate the neuropsychological mechanisms that increase individuals' vulnerability to cue-induced eating. Using ERPs, a direct measure of brain activity, we showed that individuals with larger late positive potentials in response to food-related cues than to erotic images are more susceptible to cue-induced eating and, in the presence of a palatable food option, eat more than twice as much as individuals with the opposite brain reactivity profile. By highlighting the presence of individual brain reactivity profiles associated with susceptibility to cue-induced eating, these findings contribute to the understanding of the neurobiological basis of vulnerability to obesity.

Basal forebrain chemogenetic inhibition disrupts the superior complex movement control of goal-tracking rats

Sign- and goal-tracking behavior signifies the influence of opposed cognitive-motivational styles, with the former being characterized by a tendency for approaching and contacting reward cues, including a readiness for attending, bottom-up, to salient cues, and a relatively greater vulnerability for developing and maintaining addiction-like behaviors. We previously demonstrated that these styles also impact the cognitive-motor interactions that are taxed during traversal of dynamic surfaces, with goal-trackers (GTs) making less movement errors and falling less frequently than sign-trackers (STs). The present experiment tested the hypothesis that complex movement control in GTs, but not STs, depends on activation of the basal forebrain projection system to telencephalic regions. Chemogenetic inhibition of the basal forebrain increased movement errors and falls in GTs during traversal of a rotating zigzag rod but had no significant effect on the relatively lower performance of STs. Neurochemical evidence confirmed the efficacy of the inhibitory designer receptor exclusively activated by designer drug (DREADD). Administration of clozapine-N-oxide (CNO) had no significant effect in GTs not expressing the DREADD. These results indicate that GTs, but not STs, activate the basal forebrain projection system to mediate their relatively superior ability for complex movement control. STs may also serve as an animal model in research on the role of basal forebrain systems in aging- and Parkinson's disease-associated falls. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Animal models in addiction research: A dimensional approach

Drug addiction affects approximately 10% of the population and these numbers are rising. Treatment and prevention of addiction are impeded by current diagnostic systems, such as DSM-5, which are based on outcomes rather than processes. Here, we review the importance of adopting a dimensional framework, specifically the Research Domain Criteria (RDoC), to identify protective and vulnerability mechanisms in addiction. We discuss how preclinical researchers should work within this framework to develop animal models based on domains of function. We highlight RDoC paradigms related to addiction and discuss how these can be used to investigate the biological underpinnings of an addiction cycle (i.e., binge/intoxication, negative affect, and craving). Using this information, we then outline the critical role of animal research in ongoing revisions to the RDoC matrix (specifically the functional significance of domains, constructs and subconstructs) and its contribution to the development and refinement of addiction theories. We conclude with an overview of the contribution that animal research has made to the development of pharmacological and behavioural treatments for addiction.

Precrastination: The fierce urgency of now

Procrastination is a familiar and widely discussed proclivity: postponing tasks that can be done earlier. Precrastination is a lesser known and explored tendency: completing tasks quickly just to get them done sooner. Recent research suggests that precrastination may represent an important penchant that can be observed in both people and animals. This paper reviews evidence concerned with precrastination and connects that evidence with a long history of interest in anticipatory learning, distance reception, and brain evolution. Discussion unfolds to encompass several related topics including impulsivity, planning, and self-control. Precrastination may be a new term in the psychological lexicon, but it may be a predisposition with an extended evolutionary history. Placing precrastination within the general rubric of anticipatory action may yield important insights into both adaptive and maladaptive behavior.

Addiction vulnerability trait impacts complex movement control: Evidence from sign-trackers

Cognitive-motivational vulnerability traits are associated with increased risk for substance addiction and relapse. Sign-tracking (ST) behavior in rats is associated with poor attentional control, mediated by an unresponsive basal forebrain cholinergic system, and an increased risk for substance addiction/relapse. A separate literature links poor attentional control and cholinergic losses to increased fall risk in Parkinson's disease. Here we tested the hypothesis that the relatively inferior attentional control of STs extends to complex movement control and a propensity for falls. STs were found to fall more often than goal-trackers (GTs) while traversing a straight rotating rod and, similar to human fallers, when taxed by a secondary task. Furthermore, STs fell more often while traversing a rotating zig-zag rod. GTs exhibited fewer falls from this rod by avoiding entry to the rotating zig-zag sections when in, or rotating toward, a difficult traversal state. Goal-tracking rats approached risky movement situations using strategies indicative of superior top-down control. These results suggest that the impact of opponent cognitive-cholinergic traits extends to complex movement control, and that impairments in the cognitive-motor interface are likely to be comorbid with addiction vulnerability. Sign-tracking indexes an endophenotype that may increase the risk for a wide range of neurobehavioral disorders.

The hot 'n' cold of cue-induced drug relapse

Environmental cues associated with rewards can acquire motivational properties. However, there is considerable variation in the extent to which a reward cue gains motivational control over behavior, depending on the individual and the form of the cue. When a discrete cue is paired with food reward, it acquires greater control over motivated behavior in some rats (sign-trackers, STs) than others (goal-trackers, GTs) as indicated by the propensity to approach the cue, the willingness to work to obtain it, and its ability to reinstate reward-seeking behavior. Here, we review studies that employ this ST/GT animal model to investigate characteristics of individuals that are especially susceptible to reward cue-elicited behavior and the involvement of dopamine and acetylcholine neuromodulator systems in the susceptibility to cue-induced drug relapse. First, we discuss individual differences in the attribution of incentive salience to different forms of reward cues and the involvement of the mesolimbic dopamine system. We then discuss individual differences in cognitive/attentional control and the contributions of the cholinergic system in processing reward cues. It is suggested that in STs a propensity to attribute motivational properties to a drug cue is combined with poor attentional control in the face of these cues, making them particularly vulnerable to transition from casual/experimental patterns of drug use to addiction and to cue-induced relapse.