Genomic Loci Influencing Cue-Reactivity in Heterogeneous Stock Rats

Addiction vulnerability is associated with the tendency to attribute incentive salience to reward predictive cues; both addiction and the attribution of incentive salience are influenced by environmental and genetic factors. To characterize the genetic contributions to incentive salience attribution, we performed a genome-wide association study (GWAS) in a cohort of 1,645 genetically diverse heterogeneous stock (HS) rats. We tested HS rats in a Pavlovian conditioned approach task, in which we characterized the individual responses to food-associated stimuli ("cues"). Rats exhibited either cue-directed "sign-tracking" behavior or food-cup directed "goal-tracking" behavior. We then used the conditioned reinforcement procedure to determine whether rats would perform a novel operant response for unrewarded presentations of the cue. We found that these measures were moderately heritable (SNP heritability, h2 = .189-.215). GWAS identified 14 quantitative trait loci (QTLs) for 11 of the 12 traits we examined. Interval sizes of these QTLs varied widely. 7 traits shared a QTL on chromosome 1 that contained a few genes (e.g. Tenm4, Mir708) that have been associated with substance use disorders and other mental health traits in humans. Other candidate genes (e.g. Wnt11, Pak1) in this region had coding variants and expression-QTLs in mesocorticolimbic regions of the brain. We also conducted a Phenome-Wide Association Study (PheWAS) on other behavioral measures in HS rats and found that regions containing QTLs on chromosome 1 were also associated with nicotine self-administration in a separate cohort of HS rats. These results provide a starting point for the molecular genetic dissection of incentive salience and provide further support for a relationship between attribution of incentive salience and drug abuse-related traits.

Genome-wide association studies of human and rat BMI converge on synapse, epigenome, and hormone signaling networks

A vexing observation in genome-wide association studies (GWASs) is that parallel analyses in different species may not identify orthologous genes. Here, we demonstrate that cross-species translation of GWASs can be greatly improved by an analysis of co-localization within molecular networks. Using body mass index (BMI) as an example, we show that the genes associated with BMI in humans lack significant agreement with those identified in rats. However, the networks interconnecting these genes show substantial overlap, highlighting common mechanisms including synaptic signaling, epigenetic modification, and hormonal regulation. Genetic perturbations within these networks cause abnormal BMI phenotypes in mice, too, supporting their broad conservation across mammals. Other mechanisms appear species specific, including carbohydrate biosynthesis (humans) and glycerolipid metabolism (rodents). Finally, network co-localization also identifies cross-species convergence for height/body length. This study advances a general paradigm for determining whether and how phenotypes measured in model species recapitulate human biology.

Cocaine-induced sensitization and glutamate plasticity in the nucleus accumbens core: effects of sex

BACKGROUND

The development and persistence of addiction is mediated in part by drug-induced alterations in nucleus accumbens (NAc) function. AMPA-type glutamate receptors (AMPARs) provide the main source of excitatory drive to the NAc and enhancements in transmission of calcium-permeable AMPARs (CP-AMPARs) mediate increased cue-triggered drug-seeking following prolonged withdrawal. Cocaine treatment regimens that result in psychomotor sensitization enhance subsequent drug-seeking and drug-taking behaviors. Furthermore, cocaine-induced locomotor sensitization followed by 14 days of withdrawal results in an increase in glutamatergic synaptic transmission. However, very few studies have examined cocaine-induced alterations in synaptic transmission of females or potential effects of experimenter-administered cocaine on NAc CP-AMPAR-mediated transmission in either sex.

METHODS

Male and female rats were given repeated systemic cocaine injections to induce psychomotor sensitization (15 mg/kg, i.p. 1 injection/day, 8 days). Controls received repeated saline (1 mL/kg, i.p). After 14-16 days of withdrawal brain slices were prepared and whole-cell patch-clamp approaches in the NAc core were used to measure spontaneous excitatory post-synaptic currents (sEPSC), paired pulse ratio, and CP-AMPAR transmission. Additional female rats from this same cohort were also given a challenge injection of cocaine at withdrawal day 14 to assess the expression of sensitization.

RESULTS

Repeated cocaine produced psychomotor sensitization in both sexes. In males this was accompanied by an increase in sEPSC frequency, but not amplitude, and there was no effect on the paired pulse ratio. Males treated with cocaine and saline had similar sensitivity to Naspm. In contrast, in females there were no significant differences between cocaine and saline groups on any measure, despite females showing robust psychomotor sensitization both during the induction and expression phase.

CONCLUSIONS

Overall, these data reveal striking sex differences in cocaine-induced NAc glutamate plasticity that accompany the induction of psychomotor sensitization. This suggests that the neural adaptations that contribute to sensitization vary by sex.

An exponential increase in QTL detection with an increased sample size

Power analyses are often used to determine the number of animals required for a genome-wide association study (GWAS). These analyses are typically intended to estimate the sample size needed for at least 1 locus to exceed a genome-wide significance threshold. A related question that is less commonly considered is the number of significant loci that will be discovered with a given sample size. We used simulations based on a real data set that consisted of 3,173 male and female adult N/NIH heterogeneous stock rats to explore the relationship between sample size and the number of significant loci discovered. Our simulations examined the number of loci identified in subsamples of the full data set. The subsampling analysis was conducted for 4 traits with low (0.15 ± 0.03), medium (0.31 ± 0.03 and 0.36 ± 0.03), and high (0.46 ± 0.03) SNP-based heritabilities. For each trait, we subsampled the data 100 times at different sample sizes (500, 1,000, 1,500, 2,000, and 2,500). We observed an exponential increase in the number of significant loci with larger sample sizes. Our results are consistent with similar observations in human GWAS and imply that future rodent GWAS should use sample sizes that are significantly larger than those needed to obtain a single significant result.

MDCT-based longitudinal automated airway and air trapping analysis in school-age children with mild cystic fibrosis lung disease

OBJECTIVES

Quantitative computed tomography (QCT) offers some promising markers to quantify cystic fibrosis (CF)-lung disease. Air trapping may precede irreversible bronchiectasis; therefore, the temporal interdependencies of functional and structural lung disease need to be further investigated. We aim to quantify airway dimensions and air trapping on chest CT of school-age children with mild CF-lung disease over two years.

METHODS

Fully-automatic software analyzed 144 serial spirometer-controlled chest CT scans of 36 children (median 12.1 (10.2-13.8) years) with mild CF-lung disease (median ppFEV1 98.5 (90.8-103.3) %) at baseline, 3, 12 and 24 months. The airway wall percentage (WP_5-10), bronchiectasis index (BEI), as well as severe air trapping (A3) were calculated for the total lung and separately for all lobes. Mixed linear models were calculated, considering the lobar distribution of WP_5-10, BEI and A3 cross-sectionally and longitudinally.

RESULTS

WP_5-10 remained stable (P = 0.248), and BEI changed from 0.41 (0.28-0.7) to 0.54 (0.36-0.88) (P = 0.156) and A3 from 2.26% to 4.35% (P = 0.086) showing variability over two years. ppFEV1 was also stable (P = 0.276). A robust mixed linear model showed a cross-sectional, regional association between WP_5-10 and A3 at each timepoint (P < 0.001). Further, BEI showed no cross-sectional, but another mixed model showed short-term longitudinal interdependencies with air trapping (P = 0.003).

CONCLUSIONS

Robust linear/beta mixed models can still reveal interdependencies in medical data with high variability that remain hidden with simpler statistical methods. We could demonstrate cross-sectional, regional interdependencies between wall thickening and air trapping. Further, we show short-term regional interdependencies between air trapping and an increase in bronchiectasis. The data indicate that regional air trapping may precede the development of bronchiectasis. Quantitative CT may capture subtle disease progression and identify regional and temporal interdependencies of distinct manifestations of CF-lung disease.

A calibration CT mini-lung-phantom created by 3-D printing and subtractive manufacturing

We describe the creation and characterization of a calibration CT mini‐lung‐phantom incorporating simulated airways and ground‐glass densities. Ten duplicate mini‐lung‐phantoms with Three‐Dimensional (3‐D) printed tubes simulating airways and gradated density polyurethane foam blocks were designed and built. Dimensional accuracy and CT numbers were measured using micro‐CT and clinical CT scanners. Micro‐CT images of airway tubes demonstrated an average dimensional variation of 0.038 mm from nominal values. The five different densities of incorporated foam blocks, simulating ground‐glass, showed mean CT numbers (±standard deviation) of −897.0 ± 1.5, −844.1 ± 1.5, −774.1 ± 2.6, −695.3 ± 1.6, and −351.0 ± 3.7 HU, respectively. Three‐Dimensional printing and subtractive manufacturing enabled rapid, cost‐effective production of ground‐truth calibration mini‐lung‐phantoms with low inter‐sample variation that can be scanned simultaneously with the patient undergoing lung quantitative CT.

Improved detection of air trapping on expiratory computed tomography using deep learning

BACKGROUND

Radiologic evidence of air trapping (AT) on expiratory computed tomography (CT) scans is associated with early pulmonary dysfunction in patients with cystic fibrosis (CF). However, standard techniques for quantitative assessment of AT are highly variable, resulting in limited efficacy for monitoring disease progression.

OBJECTIVE

To investigate the effectiveness of a convolutional neural network (CNN) model for quantifying and monitoring AT, and to compare it with other quantitative AT measures obtained from threshold-based techniques.

MATERIALS AND METHODS

Paired volumetric whole lung inspiratory and expiratory CT scans were obtained at four time points (0, 3, 12 and 24 months) on 36 subjects with mild CF lung disease. A densely connected CNN (DN) was trained using AT segmentation maps generated from a personalized threshold-based method (PTM). Quantitative AT (QAT) values, presented as the relative volume of AT over the lungs, from the DN approach were compared to QAT values from the PTM method. Radiographic assessment, spirometric measures, and clinical scores were correlated to the DN QAT values using a linear mixed effects model.

RESULTS

QAT values from the DN were found to increase from 8.65% ± 1.38% to 21.38% ± 1.82%, respectively, over a two-year period. Comparison of CNN model results to intensity-based measures demonstrated a systematic drop in the Dice coefficient over time (decreased from 0.86 ± 0.03 to 0.45 ± 0.04). The trends observed in DN QAT values were consistent with clinical scores for AT, bronchiectasis, and mucus plugging. In addition, the DN approach was found to be less susceptible to variations in expiratory deflation levels than the threshold-based approach.

CONCLUSION

The CNN model effectively delineated AT on expiratory CT scans, which provides an automated and objective approach for assessing and monitoring AT in CF patients.

Sensitivity to food and cocaine cues are independent traits in a large sample of heterogeneous stock rats

Sensitivity to cocaine and its associated stimuli ("cues") are important factors in the development and maintenance of addiction. Rodent studies suggest that this sensitivity is related, in part, to the propensity to attribute incentive salience to food cues, which, in turn, contributes to the maintenance of cocaine self-administration, and cue-induced relapse of drug-seeking. Whereas each of these traits has established links to drug use, the relatedness between the individual traits themselves has not been well characterized in preclinical models. To this end, the propensity to attribute incentive salience to a food cue was first assessed in two distinct cohorts of 2716 outbred heterogeneous stock rats (HS; formerly N:NIH). We then determined whether each cohort was associated with performance in one of two paradigms (cocaine conditioned cue preference and cocaine contextual conditioning). These measure the unconditioned locomotor effects of cocaine, as well as conditioned approach and the locomotor response to a cocaine-paired floor or context. There was large individual variability and sex differences among all traits, but they were largely independent of one another in both males and females. These findings suggest that these traits may contribute to drug-use via independent underlying neuropsychological processes.

Genome-Wide Association Study in 3,173 Outbred Rats Identifies Multiple Loci for Body Weight, Adiposity, and Fasting Glucose

OBJECTIVE

Obesity is influenced by genetic and environmental factors. Despite the success of human genome-wide association studies, the specific genes that confer obesity remain largely unknown. The objective of this study was to use outbred rats to identify the genetic loci underlying obesity and related morphometric and metabolic traits.

METHODS

This study measured obesity-relevant traits, including body weight, body length, BMI, fasting glucose, and retroperitoneal, epididymal, and parametrial fat pad weight in 3,173 male and female adult N/NIH heterogeneous stock (HS) rats across three institutions, providing data for the largest rat genome-wide association study to date. Genetic loci were identified using a linear mixed model to account for the complex family relationships of the HS and using covariates to account for differences among the three phenotyping centers.

RESULTS

This study identified 32 independent loci, several of which contained only a single gene (e.g., Epha5, Nrg1, Klhl14) or obvious candidate genes (e.g., Adcy3, Prlhr). There were strong phenotypic and genetic correlations among obesity-related traits, and there was extensive pleiotropy at individual loci.

CONCLUSIONS

This study demonstrates the utility of HS rats for investigating the genetics of obesity-related traits across institutions and identify several candidate genes for future functional testing.

Mucus plugging, air trapping, and bronchiectasis are important outcome measures in assessing progressive childhood cystic fibrosis lung disease

OBJECTIVE

To determine which outcome measures could detect early progression of disease in school-age children with mild cystic fibrosis (CF) lung disease over a two-year time interval utilizing chest computed tomography (CT) scores, quantitative CT air trapping (QAT), and spirometric measurements.

METHODS

Thirty-six school-age children with mild CF lung disease (median [interquartile range] age 12 [3.7] years; percent predicted forced expiratory volume in 1 second (ppFEV₁ ) 99 [12.5]) were evaluated by serial spirometer-controlled chest CT scans and spirometry at baseline, 3-month, 1- and 2-years.

RESULTS

No significant changes were noted at 3-month for any variable except for decreased ppFEV₁ . Mucus plugging score (MPS) and QAT_A1andA2 increased at 1- and 2-years. The bronchiectasis score (BS), and total score (TS) were increased at 2-year. All variables tested with the exception of bronchial wall thickness score, parenchymal score (PS), and ppFEV₁ , were consistent with longitudinal worsening of lung disease. Multivariate analysis revealed baseline PS, baseline TS, and 1-year changes in BS and air trapping score were predictive of 2-year changes in BS.

CONCLUSIONS

MPS and QAT_A1-A2 were the most sensitive indicators of progressive childhood CF lung disease. The 1-year change in the bronchiectasis score had the most positive predictive power for 2-year change in bronchiectasis.

Approaching Clinical Trials in Childhood Interstitial Lung Disease and Pediatric Pulmonary Fibrosis

Childhood interstitial lung disease (chILD) comprises a spectrum of rare diffuse lung disorders. chILD is heterogeneous in origin, with different disease manifestations occurring in the context of ongoing lung development. The large number of disorders in chILD, in combination with the rarity of each diagnosis, has hampered scientific and clinical progress within the field. Epidemiologic and natural history data are limited. The prognosis varies depending on the etiology, with some forms progressing to lung transplant or death. There are limited treatment options for patients with chILD. Although U.S. Food and Drug Administration-approved treatments are now available for adult patients with idiopathic pulmonary fibrosis, no clinical trials have been conducted in a pediatric population using agents designed to treat lung fibrosis. This review will focus on progressive chILD disorders and on the urgent need for meaningful objective outcome measures to define, detect, and monitor fibrosis in children.

Influence of Inspiratory/Expiratory CT Registration on Quantitative Air Trapping

RATIONALE AND OBJECTIVES

The aim of this study was to assess variability in quantitative air trapping (QAT) measurements derived from spatially aligned expiration CT scans.

MATERIALS AND METHODS

Sixty-four paired CT examinations, from 16 school-age cystic fibrosis subjects examined at four separate time intervals, were used in this study. For each pair, visually inspected lobe segmentation maps were generated and expiration CT data were registered to the inspiration CT frame. Measurements of QAT, the percentage of voxels on the expiration CT scan below a set threshold were calculated for each lobe and whole-lung from the registered expiration CT and compared to the true values from the unregistered data.

RESULTS

A mathematical model, which simulates the effect of variable regions of lung deformation on QAT values calculated from aligned to those from unaligned data, showed the potential for large bias. Assessment of experimental QAT measurements using Bland-Altman plots corroborated the model simulations, demonstrating biases greater than 5% when QAT was approximately 40% of lung volume. These biases were removed when calculating QAT from aligned expiration CT data using the determinant of the Jacobian matrix. We found, by Dice coefficient analysis, good agreement between aligned expiration and inspiration segmentation maps for the whole-lung and all but one lobe (Dice coefficient > 0.9), with only the lingula generating a value below 0.9 (mean and standard deviation of 0.85 ± 0.06).

CONCLUSION

The subtle and predictable variability in corrected QAT observed in this study suggests that image registration is reliable in preserving the accuracy of the quantitative metrics.

Incentive and dopamine sensitization produced by intermittent but not long access cocaine self-administration

The temporal pattern of drug use (pharmacokinetics) has a profound effect on the ability of self-administered cocaine to produce addiction-like behavior in rodents, and to change the brain. To further address this issue, we compared the effects of long access (LgA) cocaine self-administration, which is widely used to model the transition to addiction, with intermittent access (IntA), which is thought to better reflect the pattern of drug use in humans, on the ability of a single, self-administered injection of cocaine to increase dopamine (DA) overflow in the core of the nucleus accumbens (using in vivo microdialysis), and to produce addiction-like behavior. IntA experience was more effective than LgA in producing addiction-like behavior-a drug experience-dependent increase in motivation for cocaine assessed using behavioral economic procedures, and cue-induced reinstatement-despite much less total drug consumption. There were no group differences in basal levels of DA in dialysate [DA], but a single self-administered IV injection of cocaine increased [DA] in the core of the nucleus accumbens to a greater extent in rats with prior IntA experience than those with LgA or limited access experience, and the latter two groups did not differ. Furthermore, high motivation for cocaine was associated with a high [DA] response. Thus, IntA, but not LgA, produced both incentive and DA sensitization. This is consistent with the notion that a hyper-responsive dopaminergic system may contribute to the transition from casual patterns of drug use to the problematic patterns that define addiction.

Incentive salience attribution, "sensation-seeking" and "novelty-seeking" are independent traits in a large sample of male and female heterogeneous stock rats

There are a number of traits that are thought to increase susceptibility to addiction, and some of these are modeled in preclinical studies. For example, "sensation-seeking" is predictive of the initial propensity to take drugs; whereas "novelty-seeking" predicts compulsive drug-seeking behavior. In addition, the propensity to attribute incentive salience to reward cues can predict the propensity to approach drug cues, and reinstatement or relapse, even after relatively brief periods of drug exposure. The question addressed here is the extent to which these three 'vulnerability factors' are related; that is, predictive of one another. Some relationships have been reported in small samples, but here a large sample of 1,598 outbred male and female heterogeneous stock rats were screened for Pavlovian conditioned approach behavior (to obtain an index of incentive salience attribution; 'sign-tracking'), and subsequently tested for sensation-seeking and novelty-seeking. Despite the large N there were no significant correlations between these traits, in either males or females. There were, however, novel relationships between multiple measures of incentive salience attribution and, based on these findings, we generated a new metric that captures "incentive value". Furthermore, there were sex differences on measures of incentive salience attribution and sensation-seeking behavior that were not previously apparent.

Disrupting reconsolidation: memory erasure or blunting of emotional/motivational value?

When memories are retrieved they become labile, and subject to alteration by a process known as reconsolidation. Disruption of memory reconsolidation decreases the performance of learned responses, which is often attributed to erasure of the memory; in the case of Pavlovian learning, to a loss of the association between a conditioned stimulus (CS) and unconditioned stimulus (US). However, an alternative interpretation is that disrupting reconsolidation does not erase memories, but blunts their emotional/motivational impact. It is difficult to parse the predictive vs. emotional/motivational value of CSs in non-human animals, but studies on variation in the form of conditioned responses (CRs) in a Pavlovian conditioned approach task suggest a way to do this. In this task a lever-CS paired with a food reward (US) acquires predictive value in all rats, but is attributed with emotional/motivational value to a greater extent in some rats (sign-trackers) than others (goal-trackers). We report that the post-retrieval administration of propranolol selectively attenuates a sign-tracking CR, and the associated neural activation of brain "motive circuits", while having no effect on conditioned orienting behavior in sign-trackers, or on goal-tracking CRs evoked by either a lever-CS or a tone-CS. We conclude that the disruption of reconsolidation by post-retrieval propranolol degrades the emotional/motivational impact of the CS, required for sign-tracking, but leaves the CS-US association intact. The possibility that post-retrieval interventions can reduce the emotional/motivational aspects of memories, without actually erasing them, has important implications for treating maladaptive memories that contribute to some psychiatric disorders.

The hot 'n' cold of cue-induced drug relapse

Environmental cues associated with rewards can acquire motivational properties. However, there is considerable variation in the extent to which a reward cue gains motivational control over behavior, depending on the individual and the form of the cue. When a discrete cue is paired with food reward, it acquires greater control over motivated behavior in some rats (sign-trackers, STs) than others (goal-trackers, GTs) as indicated by the propensity to approach the cue, the willingness to work to obtain it, and its ability to reinstate reward-seeking behavior. Here, we review studies that employ this ST/GT animal model to investigate characteristics of individuals that are especially susceptible to reward cue-elicited behavior and the involvement of dopamine and acetylcholine neuromodulator systems in the susceptibility to cue-induced drug relapse. First, we discuss individual differences in the attribution of incentive salience to different forms of reward cues and the involvement of the mesolimbic dopamine system. We then discuss individual differences in cognitive/attentional control and the contributions of the cholinergic system in processing reward cues. It is suggested that in STs a propensity to attribute motivational properties to a drug cue is combined with poor attentional control in the face of these cues, making them particularly vulnerable to transition from casual/experimental patterns of drug use to addiction and to cue-induced relapse.

Single prolonged stress decreases sign-tracking and cue-induced reinstatement of cocaine-seeking

Exposure to prolonged, uncontrollable stress reduces reward-seeking behavior, resulting in anhedonia in neuropsychiatric disorders, such as posttraumatic stress disorder. However, it is unclear to what degree stressed subjects lose interest in rewards themselves or in reward-related cues that instigate reward-seeking behavior. In the present study, we investigated the effects of single prolonged stress (SPS) on cue-directed behavior in two different procedures: Pavlovian conditioned approach (PCA) and cue-induced reinstatement of cocaine-seeking. In Experiment 1, rats were exposed to SPS and tested for the acquisition of sign-tracking (cue-directed) and goal-tracking (reward-directed) behaviors during a PCA procedure. In Experiment 2, rats were exposed to SPS and tested for the expression of sign- and goal-tracking as well as cue-induced reinstatement of cocaine-seeking. Because dopaminergic activity in the nucleus accumbens is known to play a central role in many cue-directed behaviors, including both sign-tracking and cue-induced reinstatement, Experiment 3 used in vivo microdialysis to measure the effect of SPS on baseline and evoked dopamine levels in the nucleus accumbens. SPS decreased sign-tracking and increased goal-tracking during the acquisition of PCA behavior without affecting reward consumption. In addition, SPS decreased cue-induced reinstatement without affecting cocaine self-administration. Finally, SPS decreased evoked but not baseline levels of dopamine in the nucleus accumbens. These results suggest that SPS decreases the motivational, but not consummatory, aspects of reward-seeking behavior, which may result from long-term, SPS-induced reductions in dopamine release in the nucleus accumbens.

Addiction research and theory: a commentary on the Surgeon General's Report on alcohol, drugs, and health

The Office of the Surgeon General recently produced its first Report on the consequences of alcohol and drug abuse on health, making several very laudable policy recommendations. The Report also emphasizes the importance of adequate funding for biomedical research, which is good news for both researchers and patients. However, the Report is marred by a biased viewpoint on the psychology and neurobiology of drug addiction. We highlight here four controversial issues that were depicted as facts in the Report, thereby potentially misleading non-expert readers about the current state-of-the-art understanding of the psychology and neurobiology of drug addiction. It will be important to recognize a fuller range of scientific viewpoints in addiction neuroscience to avoid amplifying this bias in the coming years.

'Hot' vs. 'cold' behavioural-cognitive styles: motivational-dopaminergic vs. cognitive-cholinergic processing of a Pavlovian cocaine cue in sign- and goal-tracking rats

Discrete Pavlovian reward cues acquire more potent incentive motivational properties (incentive salience) in some animals (sign-trackers; STs) compared to others (goal-trackers; GTs). Conversely, GTs appear to be better than STs in processing more complex contextual cues, perhaps reflecting their relatively greater bias for goal-directed cue processing. Here, we investigated the activity of two major prefrontal neuromodulatory input systems, dopamine (DA) and acetylcholine (ACh), in response to a discrete Pavlovian cue that was previously paired with cocaine administration in STs and GTs. Rats underwent Pavlovian training in which light cue presentations were either paired or unpaired with an intravenous cocaine infusion. Following a 10-day abstinence period, prefrontal dialysates were collected in STs and GTs during cue presentations in the absence of cocaine. In STs, the cue previously paired with cocaine significantly increased prefrontal DA levels. DA levels remained elevated over baseline across multiple cue presentation blocks, and DA levels and approaches to the cue were significantly correlated. In STs, ACh levels were unaffected by cue presentations. In contrast, in GTs, presentations of the cocaine cue increased prefrontal ACh, but not DA, levels. GTs oriented towards the cue at rates similar to STs, but they did not approach it and elevated ACh levels did not correlate with conditioned orientation. The results indicate a double dissociation between the role of prefrontal DA and ACh in STs and GTs, and suggest that these phenotypes will be useful for studying the role of neuromodulator systems in mediating opponent behavioural-cognitive styles.

Diverse Roads to Relapse: A Discriminative Cue Signaling Cocaine Availability Is More Effective in Renewing Cocaine Seeking in Goal Trackers Than Sign Trackers and Depends on Basal Forebrain Cholinergic Activity

Stimuli associated with taking drugs are notorious instigators of relapse. There is, however, considerable variation in the motivational properties of such stimuli, both as a function of the individual and the nature of the stimulus. The behavior of some individuals (sign trackers, STs) is especially influenced by cues paired with reward delivery, perhaps because they are prone to process information via dopamine-dependent, cue-driven, incentive salience systems. Other individuals (goal trackers, GTs) are better able to incorporate higher-order contextual information, perhaps because of better executive/attentional control over behavior, which requires frontal cortical cholinergic activity. We hypothesized, therefore, that a cue that "sets the occasion" for drug taking (a discriminative stimulus, DS) would reinstate cocaine seeking more readily in GTs than STs and that this would require intact cholinergic neurotransmission. To test this, male STs and GTs were trained to self-administer cocaine using an intermittent access schedule with periods of cocaine availability and unavailability signaled by a DS+ and a DS-, respectively. Thereafter, half of the rats received an immunotoxic lesion that destroyed 40-50% of basal forebrain cholinergic neurons and later, after extinction training, were tested for the ability of noncontingent presentations of the DS+ to reinstate cocaine seeking behavior. The DS+ was much more effective in reinstating cocaine seeking in GTs than STs and this effect was abolished by cholinergic losses despite the fact that all rats continued to orient to the DS+ We conclude that vulnerability to relapse involves interactions between individual cognitive-motivational biases and the form of the drug cue encountered.SIGNIFICANCE STATEMENT The most predictable outcome of a diagnosis of addiction is a high chance for relapse. When addicts encounter cues previously associated with drug, their attention may be unduly attracted to such cues and these cues can evoke motivational states that instigate and maintain drug-seeking behavior. Although sign-tracking rats were previously demonstrated to exhibit greater relapse vulnerability to Pavlovian drug cues paired with drug delivery, here, we demonstrate that their counterparts, the goal trackers, are more vulnerable if the drug cue acts to signal drug availability and that the forebrain cholinergic system mediates such vulnerability. Given the importance of contextual cues for triggering relapse and the human cognitive-cholinergic capacity for the processing of such cues, goal trackers model essential aspects of relapse vulnerability.

Liking, wanting, and the incentive-sensitization theory of addiction

Rewards are both "liked" and "wanted," and those 2 words seem almost interchangeable. However, the brain circuitry that mediates the psychological process of "wanting" a particular reward is dissociable from circuitry that mediates the degree to which it is "liked." Incentive salience or "wanting," a form of motivation, is generated by large and robust neural systems that include mesolimbic dopamine. By comparison, "liking," or the actual pleasurable impact of reward consumption, is mediated by smaller and fragile neural systems, and is not dependent on dopamine. The incentive-sensitization theory posits the essence of drug addiction to be excessive amplification specifically of psychological "wanting," especially triggered by cues, without necessarily an amplification of "liking." This is because of long-lasting changes in dopamine-related motivation systems of susceptible individuals, called "neural sensitization." A quarter-century after its proposal, evidence has continued to grow in support the incentive-sensitization theory. Further, its scope is now expanding to include diverse behavioral addictions and other psychopathologies. (PsycINFO Database Record

Rapid induction of dopamine sensitization in the nucleus accumbens shell induced by a single injection of cocaine

Repeated intermittent exposure to cocaine results in the neurochemical sensitization of dopamine (DA) transmission within the nucleus accumbens (NAc). Indeed, the excitability of DA neurons in the ventral tegmental area (VTA) is enhanced within hours of initial psychostimulant exposure. However, it is not known if this is accompanied by a comparably rapid change in the ability of cocaine to increase extracellular DA concentrations in the ventral striatum. To address this question we used fast-scan cyclic voltammetry (FSCV) in awake-behaving rats to measure DA responses in the NAc shell following an initial intravenous cocaine injection, and then again 2-h later. Both injections quickly elevated DA levels in the NAc shell, but the second cocaine infusion produced a greater effect than the first, indicating sensitization. This suggests that a single injection of cocaine induces sensitization-related plasticity very rapidly within the mesolimbic DA system.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.

The ability for cocaine and cocaine-associated cues to compete for attention

In humans, reward cues, including drug cues in individuals experiencing addiction, are especially effective in biasing attention towards them, so much so they can disrupt ongoing task performance. It is not known, however, whether this happens in rats. To address this question, we developed a behavioral paradigm to assess the capacity of an auditory drug (cocaine) cue to evoke cocaine-seeking behavior, thus distracting thirsty rats from performing a well-learned sustained attention task (SAT) to obtain a water reward. First, it was determined that an auditory cocaine cue (tone-CS) reinstated drug-seeking equally in sign-trackers (STs) and goal-trackers (GTs), which otherwise vary in the propensity to attribute incentive salience to a localizable drug cue. Next, we tested the ability of an auditory cocaine cue to disrupt performance on the SAT in STs and GTs. Rats were trained to self-administer cocaine intravenously using an Intermittent Access self-administration procedure known to produce a progressive increase in motivation for cocaine, escalation of intake, and strong discriminative stimulus control over drug-seeking behavior. When presented alone, the auditory discriminative stimulus elicited cocaine-seeking behavior while rats were performing the SAT, but it was not sufficiently disruptive to impair SAT performance. In contrast, if cocaine was available in the presence of the cue, or when administered non-contingently, SAT performance was severely disrupted. We suggest that performance on a relatively automatic, stimulus-driven task, such as the basic version of the SAT used here, may be difficult to disrupt with a drug cue alone. A task that requires more top-down cognitive control may be needed.

The sensory features of a food cue influence its ability to act as an incentive stimulus and evoke dopamine release in the nucleus accumbens core

The sensory properties of a reward-paired cue (a conditioned stimulus; CS) may impact the motivational value attributed to the cue, and in turn influence the form of the conditioned response (CR) that develops. A cue with multiple sensory qualities, such as a moving lever-CS, may activate numerous neural pathways that process auditory and visual information, resulting in CRs that vary both within and between individuals. For example, CRs include approach to the lever-CS itself (rats that “sign-track”; ST), approach to the location of reward delivery (rats that “goal-track”; GT), or an “intermediate” combination of these behaviors. We found that the multimodal sensory features of the lever-CS were important to the development and expression of sign-tracking. When the lever-CS was covered, and thus could only be heard moving, STs not only continued to approach the lever location but also started to approach the food cup during the CS period. While still predictive of reward, the auditory component of the lever-CS was a much weaker conditioned reinforcer than the visible lever-CS. This plasticity in behavioral responding observed in STs closely resembled behaviors normally seen in rats classified as “intermediates.” Furthermore, the ability of both the lever-CS and the reward-delivery to evoke dopamine release in the nucleus accumbens was also altered by covering the lever—dopamine signaling in STs resembled neurotransmission observed in rats that normally only GT. These data suggest that while the visible lever-CS was attractive, wanted, and had incentive value for STs, when presented in isolation, the auditory component of the cue was simply predictive of reward, lacking incentive salience. Therefore, the specific sensory features of cues may differentially contribute to responding and ensure behavioral flexibility.

Less is more: prolonged intermittent access cocaine self-administration produces incentive-sensitization and addiction-like behavior

RATIONALE

Contemporary animal models of cocaine addiction focus on increasing the amount of drug consumption to produce addiction-like behavior. However, another critical factor is the temporal pattern of consumption, which in humans is characterized by intermittency, both within and between bouts of use.

OBJECTIVE

To model this, we combined prolonged access to cocaine (∼70 days in total) with an intermittent access (IntA) self-administration procedure and used behavioral economic indicators to quantify changes in motivation for cocaine.

RESULTS

IntA produced escalation of intake, a progressive increase in cocaine demand (incentive-sensitization), and robust drug- and cue-induced reinstatement of drug-seeking behavior. We also asked whether rats that vary in their propensity to attribute incentive salience to reward cues (sign-trackers [STs] vs. goal-trackers [GTs]) vary in the development of addiction-like behavior. Although STs were more motivated to take cocaine after limited drug experience, after IntA, STs and GTs no longer differed on any measure of addiction-like behavior.

CONCLUSIONS

Exposure to large quantities of cocaine is not necessary for escalation of intake, incentive-sensitization, or other addiction-like behaviors (IntA results in far less total cocaine consumption than 'long access' procedures). Also, the ST phenotype may increase susceptibility to addiction, not because STs are inherently susceptible to incentive-sensitization (perhaps all individuals are at risk), but because this phenotype promotes continued drug use, subjecting them to incentive-sensitization. Thus, the pharmacokinetics associated with the IntA procedure are especially effective in producing a number of addiction-like behaviors and may be valuable for studying associated neuroadaptations and for assessing individual variation in vulnerability.

Neural Activity in the Ventral Pallidum Encodes Variation in the Incentive Value of a Reward Cue

There is considerable individual variation in the extent to which reward cues are attributed with incentive salience. For example, a food-predictive conditioned stimulus (CS; an illuminated lever) becomes attractive, eliciting approach toward it only in some rats ("sign trackers," STs), whereas others ("goal trackers," GTs) approach the food cup during the CS period. The purpose of this study was to determine how individual differences in Pavlovian approach responses are represented in neural firing patterns in the major output structure of the mesolimbic system, the ventral pallidum (VP). Single-unit in vivo electrophysiology was used to record neural activity in the caudal VP during the performance of ST and GT conditioned responses. All rats showed neural responses to both cue onset and reward delivery but, during the CS period, STs showed greater neural activity than GTs both in terms of the percentage of responsive neurons and the magnitude of the change in neural activity. Furthermore, neural activity was positively correlated with the degree of attraction to the cue. Given that the CS had equal predictive value in STs and GTs, we conclude that neural activity in the VP largely reflects the degree to which the CS was attributed with incentive salience.

SIGNIFICANCE STATEMENT

Cues associated with reward can acquire motivational properties (i.e., incentive salience) that cause them to have a powerful influence on desire and motivated behavior. There are individual differences in sensitivity to reward-paired cues, with some individuals attaching greater motivational value to cues than others. Here, we investigated the neural activity associated with these individual differences in incentive salience. We found that cue-evoked neural firing in the ventral pallidum (VP) reflected the strength of incentive motivation, with the greatest neural responses occurring in individuals that demonstrated the strongest attraction to the cue. This suggests that the VP plays an important role in the process by which cues gain control over motivation and behavior.

Brain Plasticity and Behavior

Although the brain was once seen as a rather static organ, it is now clear that the organization of brain circuitry is constantly changing as a function of experience. These changes are referred to as brain plasticity, and they are associated with functional changes that include phenomena such as memory, addiction, and recovery of function. Recent research has shown that brain plasticity and behavior can be influenced by a myriad of factors, including both pre- and postnatal experience, drugs, hormones, maturation, aging, diet, disease, and stress. Understanding how these factors influence brain organization and function is important not only for understanding both normal and abnormal behavior, but also for designing treatments for behavioral and psychological disorders ranging from addiction to stroke.

Drugs, Environment, Brain, and Behavior

The effects of psychoactive drugs are not just a function of their pharmacological actions, but are due to complex interactions among pharmacological, psychological, and environmental factors. We discuss here how drug-environment interactions determine the likelihood that addictive drugs produce a persistent form of neurobehavioral plasticity (sensitization) thought to be involved in the pathophysiology of addiction and relapse.

Individual variation in incentive salience attribution and accumbens dopamine transporter expression and function

Cues (conditioned stimuli; CSs) associated with rewards can come to motivate behavior, but there is considerable individual variation in their ability to do so. For example, a lever-CS that predicts food reward becomes attractive and wanted, and elicits reward-seeking behavior, to a greater extent in some rats ('sign-trackers'; STs) than others ('goal-trackers'; GTs). Variation in dopamine (DA) neurotransmission in the nucleus accumbens (NAc) core is thought to contribute to such individual variation. Given that the DA transporter (DAT) exerts powerful regulation over DA signaling, we characterized the expression and function of the DAT in the accumbens of STs and GTs. STs showed greater DAT surface expression in ventral striatal synaptosomes than GTs, and ex vivo fast-scan cyclic voltammetry recordings of electrically evoked DA release confirmed enhanced DAT function in STs, as indicated by faster DA uptake, specifically in the NAc core. Consistent with this, systemic amphetamine (AMPH) produced greater inhibition of DA uptake in STs than in GTs. Furthermore, injection of AMPH directly into the NAc core enhanced lever-directed approach in STs, presumably by amplifying the incentive value of the CS, but had no effect on goal-tracking behavior. On the other hand, there were no differences between STs and GTs in electrically-evoked DA release in slices, or in total ventral striatal DA content. We conclude that greater DAT surface expression may facilitate the attribution of incentive salience to discrete reward cues. Investigating this variability in animal sub-populations may help explain why some people abuse drugs while others do not.

Ethnicity and risk of lower limb amputation in people with Type 2 diabetes: a prospective cohort study

AIM

Lower limb amputation is a serious complication of diabetic foot disease and there are unexplained ethnic variations in incidence. This study investigates the risk of amputation among different ethnic groups after adjusting for demographic, socio-economic status and clinical variables.

METHODS

We used primary care data from a large national multi-ethnic cohort of patients with Type 2 diabetes in New Zealand and linked hospital records. The primary outcome was time from initial data collection to first lower limb amputation. Demographic variables included age of onset and duration since diabetes diagnosis, gender, ethnicity and socio-economic status. Clinical variables included smoking status, height and weight, blood pressure, HbA1c , total cholesterol/HDL ratio and albuminuria. Cox proportional hazards models were used.

RESULTS

There were 892 lower limb amputations recorded among 62 002 patients (2.11 amputations per 1000 person-years), followed for a median of 7.14 years (422 357 person-years). After adjusting for demographic and socio-economic variables and compared with Europeans, Māori had the highest risk [hazard ratio (HR) 1.84 (95%CI:1.54-2.19)], whereas East Asians [HR 0.18, (0.08-0.44)] and South Asians [HR 0.39 (0.22-0.67)] had the lowest risk. Adjusting for available clinical variables reduced the differences but they remained substantial [HR 1.61 (1.35-1.93), 0.23 (0.10-0.56) and 0.48 (0.27-0.83), respectively].

CONCLUSIONS

Ethnic groups had significantly different risk of lower limb amputation, even after adjusting for demographic and some major clinical risk factors. Barriers to care should be addressed and intensive prevention strategies known to reduce the incidence of lower limb amputations could be prioritized to those at greatest risk.

Influence of radiation dose and reconstruction algorithm in MDCT assessment of airway wall thickness: A phantom study

PURPOSE

Wall thickness (WT) is an airway feature of great interest for the assessment of morphological changes in the lung parenchyma. Multidetector computed tomography (MDCT) has recently been used to evaluate airway WT, but the potential risk of radiation-induced carcinogenesis-particularly in younger patients-might limit a wider use of this imaging method in clinical practice. The recent commercial implementation of the statistical model-based iterative reconstruction (MBIR) algorithm, instead of the conventional filtered back projection (FBP) algorithm, has enabled considerable radiation dose reduction in many other clinical applications of MDCT. The purpose of this work was to study the impact of radiation dose and MBIR in the MDCT assessment of airway WT.

METHODS

An airway phantom was scanned using a clinical MDCT system (Discovery CT750 HD, GE Healthcare) at 4 kV levels and 5 mAs levels. Both FBP and a commercial implementation of MBIR (Veo(TM), GE Healthcare) were used to reconstruct CT images of the airways. For each kV-mAs combination and each reconstruction algorithm, the contrast-to-noise ratio (CNR) of the airways was measured, and the WT of each airway was measured and compared with the nominal value; the relative bias and the angular standard deviation in the measured WT were calculated. For each airway and reconstruction algorithm, the overall performance of WT quantification across all of the 20 kV-mAs combinations was quantified by the sum of squares (SSQs) of the difference between the measured and nominal WT values. Finally, the particular kV-mAs combination and reconstruction algorithm that minimized radiation dose while still achieving a reference WT quantification accuracy level was chosen as the optimal acquisition and reconstruction settings.

RESULTS

The wall thicknesses of seven airways of different sizes were analyzed in the study. Compared with FBP, MBIR improved the CNR of the airways, particularly at low radiation dose levels. For FBP, the relative bias and the angular standard deviation of the measured WT increased steeply with decreasing radiation dose. Except for the smallest airway, MBIR enabled significant reduction in both the relative bias and angular standard deviation of the WT, particularly at low radiation dose levels; the SSQ was reduced by 50%-96% by using MBIR. The optimal reconstruction algorithm was found to be MBIR for the seven airways being assessed, and the combined use of MBIR and optimal kV-mAs selection resulted in a radiation dose reduction of 37%-83% compared with a reference scan protocol with a dose level of 1 mGy.

CONCLUSIONS

The quantification accuracy of airway WT is strongly influenced by radiation dose and reconstruction algorithm. The MBIR algorithm potentially allows the desired WT quantification accuracy to be achieved with reduced radiation dose, which may enable a wider clinical use of MDCT for the assessment of airway WT, particularly for younger patients who may be more sensitive to exposures with ionizing radiation.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers

RATIONALE

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs).

OBJECTIVES

We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer.

RESULTS

In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs.

CONCLUSIONS

We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Sign-tracking to an appetitive cue predicts incubation of conditioned fear in rats

Although post-traumatic stress disorder (PTSD) and addiction are very different disorders, both are characterized by hyperreactivity to trauma- or drug-related cues, respectively. We investigated whether an appetitive conditioning task, Pavlovian conditioned approach, which predicts vulnerability to reinstatement of cocaine-seeking, also predicts fear incubation, which may be a marker for vulnerability to PTSD. We classified rats based on whether they learned to approach and interact with a food predictive cue (sign-trackers), or, whether upon cue presentation they went to the location of impending food delivery (goal-trackers). Rats were then exposed to extensive Pavlovian tone-shock pairings, which causes the fear response to increase or "incubate" over time. We found that the fear incubation effect was only present in sign-trackers. The behavior of goal-trackers was more consistent with a normal fear response-it was most robust immediately after training and decayed slowly over time. Sign-trackers also had lower levels of brain-derived neurotrophic factor (BDNF) protein in the prefrontal cortex than goal-trackers. These results indicate that, while many factors likely contribute to the disproportionate co-occurrence of PTSD and substance abuse, one such factor may be a core psychological trait that biases some individuals to attribute excessive motivational significance to predictive cues, regardless of the emotional valence of those cues. High levels of BDNF in the prefrontal cortex may be protective against developing excessive emotional and motivational responses to salient cues.

Individual variation in the propensity to attribute incentive salience to a food cue: influence of sex

There is considerable individual variation in the propensity of animals to attribute incentive salience to discrete reward cues, but to date most of this research has been conducted in male rats. The purpose of this study was to determine whether sex influences the propensity to attribute incentive salience to a food cue, using rats from two different outbred strains (Sprague-Dawley [SD] and Heterogeneous Stock [HS]). The motivational value of a food cue was assessed in two ways: (i) by the ability of the cue to elicit approach toward it and (ii) by its ability to act as a conditioned reinforcer. We found that female SD rats acquired Pavlovian conditioned approach behavior slightly faster than males, but no sex difference was detected in HS rats, and neither strain showed a sex difference in asymptotic performance of approach behavior. Moreover, female approach behavior did not differ across estrous cycle. Compared to males, females made more active responses during the test for conditioned reinforcement, although they made more inactive responses as well. We conclude that although there are small sex differences in performance on these tasks, these are probably not due to a notable sex difference in the propensity to attribute incentive salience to a food cue.

The form of a conditioned stimulus can influence the degree to which it acquires incentive motivational properties

There is considerable individual variation in the extent to which food- and drug-associated cues (conditioned stimuli, CSs) acquire incentive salience, as indicated by whether they elicit approach towards them, and/or act as conditioned reinforcers. Here we asked whether this variation is influenced by properties of the CS itself. In rats, we assessed both the attractiveness and conditioned reinforcing properties of two CSs: a manipulable lever CS versus an auditory (tone) CS. There was considerable individual variation in the extent to which a lever CS acquired incentive motivational properties, as indicated by whether it became attractive (evoked a sign-tracking or goal-tracking conditioned response) or acted as a conditioned reinforcer. However, with a tone CS all rats learned a goal-tracking response, and the tone CS was an equally effective conditioned reinforcer in sign-trackers and goal-trackers. Even when presented in compound (a lever-tone CS), the two elements of the compound differentially acquired motivational properties. In contrast, amphetamine and stress potentiated the conditioned reinforcing properties of both visual and auditory CSs similarly in rats that primarily sign-tracked or goal-tracked. We conclude that variation in the to the ability of CSs to acquire incentive salience, and thus their ability to act as incentive stimuli capable of motivating behavior, is determined in part by properties of the CS itself.

Modelling individual differences in the form of Pavlovian conditioned approach responses: a dual learning systems approach with factored representations

Reinforcement Learning has greatly influenced models of conditioning, providing powerful explanations of acquired behaviour and underlying physiological observations. However, in recent autoshaping experiments in rats, variation in the form of Pavlovian conditioned responses (CRs) and associated dopamine activity, have questioned the classical hypothesis that phasic dopamine activity corresponds to a reward prediction error-like signal arising from a classical Model-Free system, necessary for Pavlovian conditioning. Over the course of Pavlovian conditioning using food as the unconditioned stimulus (US), some rats (sign-trackers) come to approach and engage the conditioned stimulus (CS) itself - a lever - more and more avidly, whereas other rats (goal-trackers) learn to approach the location of food delivery upon CS presentation. Importantly, although both sign-trackers and goal-trackers learn the CS-US association equally well, only in sign-trackers does phasic dopamine activity show classical reward prediction error-like bursts. Furthermore, neither the acquisition nor the expression of a goal-tracking CR is dopamine-dependent. Here we present a computational model that can account for such individual variations. We show that a combination of a Model-Based system and a revised Model-Free system can account for the development of distinct CRs in rats. Moreover, we show that revising a classical Model-Free system to individually process stimuli by using factored representations can explain why classical dopaminergic patterns may be observed for some rats and not for others depending on the CR they develop. In addition, the model can account for other behavioural and pharmacological results obtained using the same, or similar, autoshaping procedures. Finally, the model makes it possible to draw a set of experimental predictions that may be verified in a modified experimental protocol. We suggest that further investigation of factored representations in computational neuroscience studies may be useful.

Individual variation in resisting temptation: implications for addiction

When exposed to the sights, sounds, smells and/or places that have been associated with rewards, such as food or drugs, some individuals have difficulty resisting the temptation to seek out and consume them. Others have less difficulty restraining themselves. Thus, Pavlovian reward cues may motivate maladaptive patterns of behavior to a greater extent in some individuals than in others. We are just beginning to understand the factors underlying individual differences in the extent to which reward cues acquire powerful motivational properties, and therefore, the ability to act as incentive stimuli. Here we review converging evidence from studies in both human and non-human animals suggesting that a subset of individuals are more "cue reactive", in that certain reward cues are more likely to attract these individuals to them and motivate actions to get them. We suggest that those individuals for whom Pavlovian reward cues become especially powerful incentives may be more vulnerable to impulse control disorders, such as binge eating and addiction.

Variation in the form of Pavlovian conditioned approach behavior among outbred male Sprague-Dawley rats from different vendors and colonies: sign-tracking vs. goal-tracking

Even when trained under exactly the same conditions outbred male Sprague-Dawley (SD) rats vary in the form of the Pavlovian conditioned approach response (CR) they acquire. The form of the CR (i.e. sign-tracking vs. goal-tracking) predicts to what degree individuals attribute incentive salience to cues associated with food or drugs. However, we have noticed variation in the incidence of these two phenotypes in rats obtained from different vendors. In this study, we quantified sign- and goal-tracking behavior in a reasonably large sample of SD rats obtained from two vendors (Harlan or Charles River), as well as from individual colonies operated by both vendors. Our sample of rats acquired from Harlan had, on average, more sign-trackers than goal-trackers, and vice versa for our sample of rats acquired from Charles River. Furthermore, there were significant differences among colonies of the same vendor. Although it is impossible to rule out environmental variables, SD rats at different vendors and barriers may have reduced phenotypic heterogeneity as a result of genetic variables, such as random genetic drift or population bottlenecks. Consistent with this hypothesis, we identified marked population structure among colonies from Harlan. Therefore, despite sharing the same name, investigators should be aware that important genetic and phenotypic differences exist among SD rats from different vendors or even from different colonies of the same vendor. If used judiciously this can be an asset to experimental design, but it can also be a pitfall for those unaware of the issue.

Cue-evoked cocaine "craving": role of dopamine in the accumbens core

Drug-associated cues can acquire powerful motivational control over the behavior of addicts, and can contribute to relapse via multiple, dissociable mechanisms. Most preclinical models of relapse focus on only one of these mechanisms: the ability of drug cues to reinforce drug-seeking actions following a period of extinction training. However, in addicts, drug cues typically do not follow seeking actions; they precede them. They often produce relapse by evoking a conditioned motivational state ("wanting" or "craving") that instigates and/or invigorates drug-seeking behavior. Here we used a conflict-based relapse model to ask whether individual variation in the propensity to attribute incentive salience to reward cues predicts variation in the ability of a cocaine cue to produce conditioned motivation (craving) for cocaine. Following self-administration training, responding was curtailed by requiring rats to cross an electrified floor to take cocaine. The subsequent response-independent presentation of a cocaine-associated cue was sufficient to reinstate drug-seeking behavior, despite the continued presence of the adverse consequence. Importantly, there were large individual differences in the motivational properties of the cocaine cue, which were predicted by variation in the propensity to attribute incentive salience to a food cue. Finally, a dopamine antagonist injected into the nucleus accumbens core attenuated, and amphetamine facilitated, cue-evoked cocaine seeking, implicating dopamine signaling in cocaine cue-evoked craving. These data provide a promising preclinical approach for studying sources of individual variation in susceptibility to relapse due to conditioned craving and implicate mesolimbic dopamine in this process.

Rats are the smart choice: Rationale for a renewed focus on rats in behavioral genetics

Due in part to their rich behavioral repertoire rats have been widely used in behavioral studies of drug abuse-related traits for decades. However, the mouse became the model of choice for researchers exploring the genetic underpinnings of addiction after the first mouse study was published demonstrating the capability of engineering the mouse genome through embryonic stem cell technology. The sequencing of the mouse genome and more recent re-sequencing of numerous inbred mouse strains have further cemented the status of mice as the premier mammalian organism for genetic studies. As a result, many of the behavioral paradigms initially developed and optimized for rats have been adapted to mice. However, numerous complex and interesting drug abuse-related behaviors that can be studied in rats are very difficult or impossible to adapt for use in mice, impeding the genetic dissection of those traits. Now, technological advances have removed many of the historical limitations of genetic studies in rats. For instance, the rat genome has been sequenced and many inbred rat strains are now being re-sequenced and outbred rat stocks are being used to fine-map QTLs. In addition, it is now possible to create "knockout" rats using zinc finger nucleases (ZFN), transcription activator-like effector nucleases (TALENs) and related techniques. Thus, rats can now be used to perform quantitative genetic studies of sophisticated behaviors that have been difficult or impossible to study in mice. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

On the motivational properties of reward cues: Individual differences

Cues associated with rewards, such as food or drugs of abuse, can themselves acquire motivational properties. Acting as incentive stimuli, such cues can exert powerful control over motivated behavior, and in the case of cues associated with drugs, they can goad continued drug-seeking behavior and relapse. However, recent studies reviewed here suggest that there are large individual differences in the extent to which food and drug cues are attributed with incentive salience. Rats prone to approach reward cues (sign-trackers) attribute greater motivational value to discrete localizable cues and interoceptive cues than do rats less prone to approach reward cues (goal-trackers). In contrast, contextual cues appear to exert greater control over motivated behavior in goal-trackers than sign-trackers. It is possible to predict, therefore, before any experience with drugs, in which animals specific classes of drug cues will most likely reinstate drug-seeking behavior. The finding that different individuals may be sensitive to different triggers capable of motivating behavior and producing relapse suggests there may be different pathways to addiction, and has implications for thinking about individualized treatment. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue

RATIONALE

Cues associated with rewards bias attention towards them and can motivate drug-seeking and drug-taking behavior. There is, however, considerable individual variation in the extent to which cues associated with rewards acquire motivational properties. For example, only in some rats does a localizable food cue become attractive, eliciting approach towards it, and "wanted", in the sense that it serves as an effective conditioned reinforcer.

OBJECTIVES

We asked whether the propensity of animals to attribute incentive salience to a food cue predicts the extent to which a classically conditioned cocaine cue acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats prone to attribute incentive salience to a food cue. We then measured the extent to which a classically conditioned cocaine cue acquired two properties of an incentive stimulus: (1) the ability to elicit approach towards it, and (2) the ability to reinstate drug-seeking behavior, using an extinction-reinstatement procedure (i.e., to act as a conditioned reinforcer).

RESULTS

We found that a classically conditioned cocaine cue became more attractive, in that it elicited greater approach toward it, and more desired, in that it supported more drug-seeking behavior under extinction conditions, in individuals prone to attribute incentive salience to a food cue.

CONCLUSIONS

We conclude that rats vary in their propensity to attribute incentive salience to both food and cocaine cues, and it is possible to predict, prior to any drug experience, in which rats a cocaine cue will acquire the strongest motivational control over behavior.