Reported maternal tendencies predict the reward value of infant facial cuteness, but not cuteness detection

The factors that contribute to individual differences in the reward value of cute infant facial characteristics are poorly understood. Here we show that the effect of cuteness on a behavioural measure of the reward value of infant faces is greater among women reporting strong maternal tendencies. By contrast, maternal tendencies did not predict women's subjective ratings of the cuteness of these infant faces. These results show, for the first time, that the reward value of infant facial cuteness is greater among women who report being more interested in interacting with infants, implicating maternal tendencies in individual differences in the reward value of infant cuteness. Moreover, our results indicate that the relationship between maternal tendencies and the reward value of infant facial cuteness is not due to individual differences in women's ability to detect infant cuteness. This latter result suggests that individual differences in the reward value of infant cuteness are not simply a by-product of low-cost, functionless biases in the visual system.

Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation

Mesolimbic dopamine (DA) is phasically released during appetitive behaviors, though there is substantive disagreement about the specific purpose of these DA signals. For example, prediction error (PE) models suggest a role of learning, while incentive salience (IS) models argue that the DA signal imbues stimuli with value and thereby stimulates motivated behavior. However, within the nucleus accumbens (NAc) patterns of DA release can strikingly differ between subregions, and as such, it is possible that these patterns differentially contribute to aspects of PE and IS. To assess this, we measured DA release in subregions of the NAc during a behavioral task that spatiotemporally separated sequential goal-directed stimuli. Electrochemical methods were used to measure subsecond NAc dopamine release in the core and shell during a well learned instrumental chain schedule in which rats were trained to press one lever (seeking; SL) to gain access to a second lever (taking; TL) linked with food delivery, and again during extinction. In the core, phasic DA release was greatest following initial SL presentation, but minimal for the subsequent TL and reward events. In contrast, phasic shell DA showed robust release at all task events. Signaling decreased between the beginning and end of sessions in the shell, but not core. During extinction, peak DA release in the core showed a graded decrease for the SL and pauses in release during omitted expected rewards, whereas shell DA release decreased predominantly during the TL. These release dynamics suggest parallel DA signals capable of supporting distinct theories of appetitive behavior.

SIGNIFICANCE STATEMENT

Dopamine signaling in the brain is important for a variety of cognitive functions, such as learning and motivation. Typically, it is assumed that a single dopamine signal is sufficient to support these cognitive functions, though competing theories disagree on how dopamine contributes to reward-based behaviors. Here, we have found that real-time dopamine release within the nucleus accumbens (a primary target of midbrain dopamine neurons) strikingly varies between core and shell subregions. In the core, dopamine dynamics are consistent with learning-based theories (such as reward prediction error) whereas in the shell, dopamine is consistent with motivation-based theories (e.g., incentive salience). These findings demonstrate that dopamine plays multiple and complementary roles based on discrete circuits that help animals optimize rewarding behaviors.

Dopamine, reward learning, and active inference

Temporal difference learning models propose phasic dopamine signaling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behavior. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.

Marijuana's acute effects on cognitive bias for affective and marijuana cues

Marijuana produces acute increases in positive subjective effects and decreased reactivity to negative affective stimuli, though may also acutely induce anxiety. Implicit attentional and evaluative processes may explicate marijuana's ability to acutely increase positive and negative emotions. This within-subjects study examined whether smoked marijuana with 2.7-3.0% delta-9-tetrahydrocannabinol (THC), relative to placebo, acutely changed attentional processing of rewarding and negative affective stimuli as well as marijuana-specific stimuli. On 2 separate days, regular marijuana users (N = 89) smoked placebo or active THC cigarette and completed subjective ratings of mood, intoxication, urge to smoke marijuana, and 2 experimental tasks: pleasantness rating (response latency and perceived pleasantness of affective and marijuana-related stimuli) and emotional Stroop (attentional bias to affective stimuli). On the pleasantness rating task, active marijuana increased response latency to negatively valenced and marijuana-related (vs. neutral) visual stimuli, beyond a general slowing of response. Active marijuana also increased pleasantness ratings of marijuana images, although to a lesser extent than placebo due to reduced marijuana urge after smoking. Overall, active marijuana did not acutely change processing of positive emotional stimuli. There was no evidence of attentional bias to affective word stimuli on the emotional Stroop task with the exception of attentional bias to positive word stimuli in the subgroup of marijuana users with cannabis dependence. Marijuana may increase allocation of attentional resources toward marijuana-specific and negatively valenced visual stimuli without altering processing of positively valenced stimuli. Marijuana-specific cues may be more attractive with higher levels of marijuana craving and less wanted with low craving levels.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers

RATIONALE

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs).

OBJECTIVES

We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer.

RESULTS

In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs.

CONCLUSIONS

We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Lesions of the paraventricular nucleus of the thalamus differentially affect sign- and goal-tracking conditioned responses

Recently, evidence has emerged suggesting a role for the paraventricular nucleus of the thalamus (PVT) in the processing of reward-associated cues. However, the specific role of the PVT in these processes has yet to be elucidated. Here we use an animal model that captures individual variation in response to discrete reward-associated cues to further assess the role of the PVT in stimulus-reward learning. When rats are exposed to a Pavlovian conditioning paradigm, wherein a discrete cue predicts food reward, two distinct conditioned responses emerge. Some rats, termed sign-trackers, approach and manipulate the cue, whereas others, termed goal-trackers, approach the location of reward delivery upon cue presentation. For both sign- and goal-trackers the cue is a predictor, but only for sign-trackers is it also an incentive stimulus. We investigated the role of the PVT in the acquisition and expression of these conditioned responses using an excitotoxic lesion. Results indicate that PVT lesions prior to acquisition amplify the differences between phenotypes - increasing sign-tracking and attenuating goal-tracking behavior. Lesions of the PVT after rats had acquired their respective conditioned responses also attenuated the expression of the goal-tracking response, and increased the sign-tracking response, but did so selectively in goal-trackers. These results suggest that the PVT acts to suppress the attribution of incentive salience to reward cues, as disruption of the functional activity within this structure enhances the tendency to sign-track.

Distinct effects of ventral tegmental area NMDA and acetylcholine receptor blockade on conditioned reinforcement produced by food-associated cues

Stimuli paired with rewards acquire reinforcing properties to promote reward-seeking behavior. Previous work supports the role of ventral tegmental area (VTA) nicotinic acetylcholine receptors (nAChRs) in mediating conditioned reinforcement elicited by drug-associated cues. However, it is not known whether these cholinergic mechanisms are specific to drug-associated cues or whether VTA cholinergic mechanisms also underlie the ability of cues paired with natural rewards to act as conditioned reinforcers. Burst firing of VTA dopamine (DA) neurons and the subsequent phasic DA release in the nucleus accumbens (NAc) plays an important role in cue-mediated behavior and in the ability of cues to acquire reinforcing properties. In the VTA, both AChRs and N-methyl-d-aspartate receptors (NMDARs) regulate DA burst firing and phasic DA release. Here, we tested the role of VTA nAChRs, muscarinic AChRs (mAChRs), and NMDARs in the conditioned reinforcement elicited by a food-associated, natural reward cue. Subjects received 10 consecutive days of Pavlovian conditioning training where lever extension served as a predictive cue for food availability. On day 11, rats received bilateral VTA infusion of saline, AP-5 (0.1 or 1μg), mecamylamine (MEC: 3 or 30μg) or scopolamine (SCOP: 3 or 66.7μg) immediately prior to the conditioned reinforcement test. During the test, nosepoking into the active (conditioned reinforced, CR) noseport produced a lever cue while nosepoking on the inactive (non-conditioned reinforced, NCR) noseport had no consequence. AP-5 robustly attenuated conditioned reinforcement and blocked discrimination between CR and NCR noseports at the 1-μg dose. MEC infusion decreased responding for both CR and NCR while 66.7-μg SCOP disrupted the subject's ability to discriminate between CR and NCR. Together, our data suggest that VTA NMDARs and mAChRs, but not nAChRs, play a role in the ability of natural reward-associated cues to act as conditioned reinforcers.

Facial beauty affects implicit and explicit learning of men and women differently

The present work explores the unconscious and/or conscious nature of learning attractive faces of same and opposite sex, that is, of stimuli that experimental and neuroimaging research has shown to be rewarding and thus highly motivating. To this end, we examined performance of men and women while classifying strings of average and attractive faces for grammaticality in the experimental task of artificial grammar learning (AGL), which reflects both conscious and unconscious processes. Subjective measures were used to assess participants' conscious and unconscious knowledge. It was found that female attractiveness impaired performance in male participants. In particular, male participants demonstrated the lowest accuracy while classifying beautiful faces of women. Conversely, female attractiveness facilitated performance in female participants. The pattern was similar for conscious and unconscious knowledge. Presumably, objects with high incentive salience, as are beautiful faces, captured resources, which were used in task relevant versus task irrelevant ways by women versus men. The present findings shed light on the relation of conscious and unconscious processing with affective and reward-related stimuli, as well as on gender differences underlying this relation.

Sex ratio influences the motivational salience of facial attractiveness

The sex ratio of the local population influences mating-related behaviours in many species. Recent experiments show that male-biased sex ratios increase the amount of financial resources men will invest in potential mates, suggesting that sex ratios influence allocation of mating effort in humans. To investigate this issue further, we tested for effects of cues to the sex ratio of the local population on the motivational salience of attractiveness in own-sex and opposite-sex faces. We did this using an effort-based key-press task, in which the motivational salience of facial attractiveness was assessed in samples of faces in which the ratio of male to female images was manipulated. The motivational salience of attractive opposite-sex, but not own-sex, faces was greater in the own-sex-biased (high competition for mates) than in the opposite-sex-biased (low competition for mates) condition. Moreover, this effect was not modulated by participant sex. These results present new evidence that sex ratio influences human mating-related behaviours. They also present the first evidence that the perceived sex ratio of the local population may modulate allocation of mating effort in women, as well as men.

Exposure to Kynurenic Acid during Adolescence Increases Sign-Tracking and Impairs Long-Term Potentiation in Adulthood

Changes in brain reward systems are thought to contribute significantly to the cognitive and behavioral impairments of schizophrenia, as well as the propensity to develop co-occurring substance abuse disorders. Presently, there are few treatments for persons with a dual diagnosis and little is known about the neural substrates that underlie co-occurring schizophrenia and substance abuse. One goal of the present study was to determine if a change in the concentration of kynurenic acid (KYNA), a tryptophan metabolite that is increased in the brains of people with schizophrenia, affects reward-related behavior. KYNA is an endogenous antagonist of NMDA glutamate receptors and α7 nicotinic acetylcholine receptors, both of which are critically involved in neurodevelopment, plasticity, and behavior. In Experiment 1, rats were treated throughout adolescence with L-kynurenine (L-KYN), the precursor of KYNA. As adults, the rats were tested drug-free in an autoshaping procedure in which a lever was paired with food. Rats treated with L-KYN during adolescence exhibited increased sign-tracking behavior (lever pressing) when they were tested as adults. Sign-tracking is thought to reflect the lever acquiring incentive salience (motivational value) as a result of its pairing with reward. Thus, KYNA exposure may increase the incentive salience of cues associated with reward, perhaps contributing to an increase in sensitivity to drug-related cues in persons with schizophrenia. In Experiment 2, we tested the effects of exposure to KYNA during adolescence on hippocampal long-term potentiation (LTP). Rats treated with L-KYN exhibited no LTP after a burst of high-frequency stimulation that was sufficient to produce robust LTP in vehicle-treated rats. This finding represents the first demonstrated consequence of elevated KYNA concentration during development and provides insight into the basis for cognitive and behavioral deficits that result from exposure to KYNA during adolescence.

Dopamine ups and downs in vulnerability to addictions: a neurodevelopmental model

Addictions are commonly presaged by problems in childhood and adolescence. For many individuals this starts with the early expression of impulsive risk-taking, social gregariousness, and oppositional behaviors. Here we propose that these early diverse manifestations reflect a heightened ability of emotionally salient stimuli to activate dopamine pathways that foster behavioral approach. If substance use is initiated, these at-risk youth can also develop heightened responses to drug-paired cues. Through conditioning and drug-induced sensitization, these effects strengthen and accumulate, leading to responses that exceed those elicited by other rewards. At the same time, cues not paired with drug become associated with comparatively lower dopamine release, accentuating further the difference between drug and non-drug rewards. Together, these enhancing and inhibiting processes steer a pre-existing vulnerability toward a disproportionate concern for drugs and drug-related stimuli. Implications for prevention and treatment are discussed.

A selective role for dopamine D₄ receptors in modulating reward expectancy in a rodent slot machine task

BACKGROUND

Cognitive distortions regarding gambling outcomes confer vulnerability to pathological gambling. Using a rat slot machine task (rSMT), we previously demonstrated that the nonspecific D₂ agonist quinpirole enhances erroneous expectations of reward on near-miss trials, suggesting a pivotal role for the D₂ receptor family in mediating the near-miss effect. Identifying which receptor subtype is involved could facilitate treatment development for compulsive slot machine play.

METHODS

Thirty-two male Long Evans rats learned the rSMT. Three flashing lights could be set to on or off. A win was signaled if all three lights were set to on, whereas any other light pattern indicated a loss. Rats then chose between responding on the collect lever, which delivered 10 sugar pellets on win trials but a 10-second time penalty on loss trials, or to start a new trial instead. Performance was assessed following systemic administration of selective D₂, D₃, and D₄ receptor ligands.

RESULTS

The selective D₂ antagonist L-741,626, the D₃ antagonist SB-277011-A, and the D₃ agonist PD128,907 had no effect. In contrast, the selective D₄ agonist PD168077 partially mimicked quinpirole's effects, increasing erroneous collect responses on nonwin trials, whereas the D₄ antagonist L-745,870 improved the error rate. L-745,870 was also the only antagonist that could attenuate the deleterious effects of quinpirole.

CONCLUSIONS

The dopamine D₄ receptor is critically involved in signaling reward expectancy in the rSMT. The ability of L-745,870 to reduce the classification of losses as wins suggests that D₄ antagonists could be effective in treating problematic slot machine play.

Sweet reward increases implicit discrimination of similar odors

Stimuli associated with emotional events signal the presence of potentially relevant situations, thus learning to rapidly identify this kind of stimuli can be highly beneficial. It has been demonstrated that individuals acquire a better perceptual representation of stimuli associated with negative and threatening emotional events. Here we investigated whether the same process occurs for stimuli associated with positive and rewarding emotional events. We used an appetitive Pavlovian conditioning paradigm during which one of two perceptually non-distinguishable odors was associated with a rewarding taste (i.e., chocolate). We investigated whether appetitive conditioning could improve the recognition of the odor associated with the reward, rendering it discriminable from its similar version that was never associated with the reward. Results revealed a dissociation between explicit perception and physiological reactions. Although participants were not able to explicitly perceive a difference, they reacted faster, inhaled more and had higher skin conductance responses when confronted with the reward-associated odor compared to its similar version that was never associated with the reward. Our findings have demonstrated that positive emotional associations can improve the implicit perceptual representation of odors, by triggering different physiological responses to odors that do not seem to be otherwise distinguishable.

Reward and reinforcement activity in the nucleus accumbens during learning

The nucleus accumbens core (NAcc) has been implicated in learning associations between sensory cues and profitable motor responses. However, the precise mechanisms that underlie these functions remain unclear. We recorded single-neuron activity from the NAcc of primates trained to perform a visual-motor associative learning task. During learning, we found two distinct classes of NAcc neurons. The first class demonstrated progressive increases in firing rates at the go-cue, feedback/tone and reward epochs of the task, as novel associations were learned. This suggests that these neurons may play a role in the exploitation of rewarding behaviors. In contrast, the second class exhibited attenuated firing rates, but only at the reward epoch of the task. These findings suggest that some NAcc neurons play a role in reward-based reinforcement during learning.

Neurobiological underpinnings of reward anticipation and outcome evaluation in gambling disorder

Gambling disorder is characterized by persistent and recurrent maladaptive gambling behavior, which leads to clinically significant impairment or distress. The disorder is associated with dysfunctions in the dopamine system. The dopamine system codes reward anticipation and outcome evaluation. Reward anticipation refers to dopaminergic activation prior to reward, while outcome evaluation refers to dopaminergic activation after reward. This article reviews evidence of dopaminergic dysfunctions in reward anticipation and outcome evaluation in gambling disorder from two vantage points: a model of reward prediction and reward prediction error by Wolfram Schultz et al. and a model of “wanting” and “liking” by Terry E. Robinson and Kent C. Berridge. Both models offer important insights on the study of dopaminergic dysfunctions in addiction, and implications for the study of dopaminergic dysfunctions in gambling disorder are suggested.

A potential role for the paraventricular nucleus of the thalamus in mediating individual variation in Pavlovian conditioned responses

There is ample evidence to suggest that the paraventricular nucleus of the thalamus (PVT) mediates cue-reward learning, especially as it relates to drug-seeking behavior. However, its exact role in these complex processes remains unknown. Here we will present and discuss data from our own laboratory which suggests that the PVT plays a role in multiple forms of stimulus-reward learning, and does so via distinct neurobiological systems. Using an animal model that captures individual variation in response to reward-associated cues, we are able to parse the incentive from the predictive properties of reward cues and to elucidate the neural circuitry underlying these different forms of cue-reward learning. When rats are exposed to a classical Pavlovian conditioning paradigm, wherein a cue predicts food reward, some rats, termed sign-trackers, approach and manipulate the cue upon its presentation. This behavior is indicative of attributing incentive salience to the cue. That is, the cue gains excessive control over behavior for sign-trackers. In contrast, other rats, termed goal-trackers, treat the cue as a mere predictor, and upon its presentation go to the location of reward delivery. Based on our own data utilizing this model, we hypothesize that the PVT represents a common node, but differentially regulates the sign- vs. goal-tracking response. We postulate that the PVT regulates sign-tracking behavior, or the attribution of incentive salience, via subcortical, dopamine-dependent mechanisms. In contrast, we propose that goal-tracking behavior, or the attribution of predictive value, is the product of “top-down” glutamatergic processing between the prelimbic cortex (PrL) and the PVT. Together, data from our laboratory and others support a role for the PVT in cue-motivated behaviors and suggest that it may be an important locus within the neural circuitry that goes awry in addiction and related disorders.

Dopamine, urges to smoke, and the relative salience of drug versus non-drug reward

When addicted individuals are exposed to drug-related stimuli, dopamine release is thought to mediate incentive salience attribution, increasing attentional bias, craving and drug seeking. It is unclear whether dopamine acts specifically on drug cues versus other rewards, and if these effects correspond with craving and other forms of cognitive bias. Here, we administered the dopamine D2/D3 agonist pramipexole (0.5 mg) to 16 tobacco smokers in a double-blind placebo-controlled crossover design. Visual fixations on smoking and money images were recorded alongside smoking urges and fluency tasks. Pramipexole attenuated a marked bias in initial orienting towards smoking relative to money but did not alter a maintained attentional bias towards smoking. Pramipexole decreased urges to smoke retrospectively after the task but not on a state scale. Fewer smoking words were generated after pramipexole but phonological and semantic fluency were preserved. Although these treatment effects did not correlate with each other, changes in initial orienting towards smoking and money were inversely related to baseline scores. In conclusion, pramipexole can reduce the salience of an addictive drug compared with other rewards and elicit corresponding changes in smoking urges and cognitive bias. These reward-specific and baseline-dependent effects support an 'inverted-U' shaped profile of dopamine in addiction.

The Addict in Us all

In this paper, we contend that the psychology of addiction is similar to the psychology of ordinary, non-addictive temptation in important respects, and explore the ways in which these parallels can illuminate both addiction and ordinary action. The incentive salience account of addiction proposed by Robinson and Berridge (1-3) entails that addictive desires are not in their nature different from many of the desires had by non-addicts; what is different is rather the way that addictive desires are acquired, which in turn affects their strength. We examine these "incentive salience" desires, both in addicts and non-addicts, contrasting them with more cognitive desires. On this account, the self-control challenge faced by addicted agents is not different in kind from that faced by non-addicted agents - though the two may, of course, differ greatly in degree of difficulty. We explore a general model of self-control for both the addict and the non-addict, stressing that self-control may be employed at three different stages, and examining the ways in which it might be strengthened. This helps elucidate a general model of intentional action.

Effects of ethanol on social approach and 50 kHz ultrasonic vocalization production in adolescent male Sprague-Dawley rats

Low doses of ethanol have been shown to facilitate social behavior in adolescent rats. The present study sought to investigate whether this ethanol effect is associated with increases in the incentive salience of social stimuli when assessed via approach behavior toward a peer (separated from the experimental animal by a mesh barrier) and 50 kHz ultrasonic vocalization (USV) production in that context. A 0.5 g/kg ethanol dose was found to increase social approach/investigation of adolescent male Sprague-Dawley rats during the first 5 min of the 10 min test whereas 50 kHz USV production was elevated by 0.25 g/kg during the last 5 min of testing. 50 kHz USV production and social approach were generally not correlated, indicating a clear dissociation between these measures. This is the first study to demonstrate that ethanol-induced social facilitation in adolescents is associated with an ethanol-induced increase in the incentive salience of social stimuli.

Increasing dopamine D2 receptor expression in the adult nucleus accumbens enhances motivation

A decrease in dopamine D2 receptor (D2R) binding in the striatum is one of the most common findings in disorders that involve a dysregulation of motivation, including obesity, addiction and attention deficit hyperactivity disorder. As disruption of D2R signaling in the ventral striatum--including the nucleus accumbens (NAc)--impairs motivation, we sought to determine whether potentiating postsynaptic D2R-dependent signaling in the NAc would improve motivation. In this study, we used a viral vector strategy to overexpress postsynaptic D2Rs in either the NAc or the dorsal striatum. We investigated the effects of D2R overexpression on instrumental learning, willingness to work, use of reward value representations and modulation of motivation by reward associated cues. Overexpression of postsynaptic D2R in the NAc selectively increased motivation without altering consummatory behavior, the representation of the value of the reinforcer, or the capacity to use reward associated cues in flexible ways. In contrast, D2R overexpression in the dorsal striatum did not alter performance on any of the tasks. Thus, consistent with numerous studies showing that reduced D2R signaling impairs motivated behavior, our data show that postsynaptic D2R overexpression in the NAc specifically increases an animal's willingness to expend effort to obtain a goal. Taken together, these results provide insight into the potential impact of future therapeutic strategies that enhance D2R signaling in the NAc.

Reward predictions bias attentional selection

Attention selects stimuli for perceptual and cognitive processing according to an adaptive selection schedule. It has long been known that attention selects stimuli that are task relevant or perceptually salient. Recent evidence has shown that stimuli previously associated with reward persistently capture attention involuntarily, even when they are no longer associated with reward. Here we examine whether the capture of attention by previously reward-associated stimuli is modulated by the processing of current but unrelated rewards. Participants learned to associate two color stimuli with different amounts of reward during a training phase. In a subsequent test phase, these previously rewarded color stimuli were occasionally presented as to-be-ignored distractors while participants performed visual search for each of two differentially rewarded shape-defined targets. The results reveal that attentional capture by formerly rewarded distractors was the largest when both recently received and currently expected reward were the highest in the test phase, even though such rewards were unrelated to the color distractors. Our findings support a model in which value-driven attentional biases acquired through reward learning are maintained via the cognitive mechanisms involved in predicting future rewards.

Mindfulness training for smoking cessation: moderation of the relationship between craving and cigarette use

BACKGROUND

Smoking is the leading cause of preventable death in the US, while abstinence rates remain modest. Smoking has been shown to be perpetuated by operant conditioning, notably negative reinforcement (e.g., smoking to relieve negative affective states). Mindfulness training (MT) shows promise for smoking cessation, by potentially altering an individual's tendency to smoke in response to craving. The purpose of this study was to examine the effects of MT and mindfulness practice on the relationship between smoking and craving after receiving four weeks of MT.

METHODS

33 adults received MT as part of a randomized trial for smoking cessation. Individuals in the MT condition recorded formal and informal mindfulness practice during treatment using daily diaries.

RESULTS

Analyses showed that strong correlations between craving and smoking at baseline (r=0.582) were attenuated at the end of treatment (r=0.126). Mindfulness home practice significantly predicted cigarette use (formal: B=-1.21, p=0.007; informal: B=-1.52, p<0.0001) and informal practice moderated the relationship between craving and smoking at the end of treatment (B=0.52, p=0.03).

CONCLUSIONS

These findings suggest that MT may be effective as a treatment for smoking cessation and that informal mindfulness practice predicts a decoupling of the association between craving and smoking.

A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue

RATIONALE

Cues associated with rewards bias attention towards them and can motivate drug-seeking and drug-taking behavior. There is, however, considerable individual variation in the extent to which cues associated with rewards acquire motivational properties. For example, only in some rats does a localizable food cue become attractive, eliciting approach towards it, and "wanted", in the sense that it serves as an effective conditioned reinforcer.

OBJECTIVES

We asked whether the propensity of animals to attribute incentive salience to a food cue predicts the extent to which a classically conditioned cocaine cue acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats prone to attribute incentive salience to a food cue. We then measured the extent to which a classically conditioned cocaine cue acquired two properties of an incentive stimulus: (1) the ability to elicit approach towards it, and (2) the ability to reinstate drug-seeking behavior, using an extinction-reinstatement procedure (i.e., to act as a conditioned reinforcer).

RESULTS

We found that a classically conditioned cocaine cue became more attractive, in that it elicited greater approach toward it, and more desired, in that it supported more drug-seeking behavior under extinction conditions, in individuals prone to attribute incentive salience to a food cue.

CONCLUSIONS

We conclude that rats vary in their propensity to attribute incentive salience to both food and cocaine cues, and it is possible to predict, prior to any drug experience, in which rats a cocaine cue will acquire the strongest motivational control over behavior.

Hot or not: response inhibition reduces the hedonic value and motivational incentive of sexual stimuli

The motivational incentive of reward-related stimuli can become so salient that it drives behavior at the cost of other needs. Here we show that response inhibition applied during a Go/No-go task not only impacts hedonic evaluations but also reduces the behavioral incentive of motivationally relevant stimuli. We first examined the impact of response inhibition on the hedonic value of sex stimuli associated with strong behavioral-approach responses (Experiment 1). Sexually appealing and non-appealing images were both rated as less attractive when previously encountered as No-go (inhibited) than as Go (non-inhibited) items. We then discovered that inhibition reduces the motivational incentive of sexual appealing stimuli (Experiment 2). Prior Go/No-go status affected the number of key-presses by heterosexual males to view erotic-female (sexually appealing) but not erotic-male or scrambled-control (non-appealing) images. These findings may provide a foundation for developing inhibition-based interventions to reduce the hedonic value and motivational incentive of stimuli associated with disorders of self-control.

Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking

Pavlovian cues that have been paired with reward can gain incentive salience. Drug addicts find drug cues motivationally attractive and binge eaters are attracted by food cues. But the level of incentive salience elicited by a cue re-encounter still varies across time and brain states. In an animal model, cues become attractive and 'wanted' in an 'autoshaping' paradigm, where different targets of incentive salience emerge for different individuals. Some individuals (sign-trackers) find a predictive discrete cue attractive while others find a reward contiguous goal cue more attractive (location where reward arrives: goal-trackers). Here we assessed whether central amygdala mu opioid receptor stimulation enhances the phasic incentive salience of the goal-cue for goal-trackers during moments of predictive cue presence (expressed in both approach and consummatory behaviors to goal cue), just as it enhances the attractiveness of the predictive cue target for sign-trackers. Using detailed video analysis we measured the approaches, nibbles, sniffs, and bites directed at their preferred target for both sign-trackers and goal-trackers. We report that DAMGO microinjections in central amygdala made goal-trackers, like sign-trackers, show phasic increases in appetitive nibbles and sniffs directed at the goal-cue expressed selectively whenever the predictive cue was present. This indicates enhancement of incentive salience attributed by both goal trackers and sign-trackers, but attributed in different directions: each to their own target cue. For both phenotypes, amygdala opioid stimulation makes the individual's prepotent cue into a stronger motivational magnet at phasic moments triggered by a CS that predicts the reward UCS.

Approach motivation as incentive salience: perceptual sources of evidence in relation to positive word primes

Four experiments (total N = 391) examined predictions derived from a biologically based incentive salience theory of approach motivation. In all experiments, judgments indicative of enhanced perceptual salience were exaggerated in the context of positive, relative to neutral or negative, stimuli. In Experiments 1 and 2, positive words were judged to be of a larger size (Experiment 1) and led individuals to judge subsequently presented neutral objects as larger in size (Experiment 2). In Experiment 3, similar effects were observed in a mock subliminal presentation paradigm. In Experiment 4, positive word primes were perceived to have been presented for a longer duration of time, again relative to both neutral and negative word primes. Results are discussed in relation to theories of approach motivation, affective priming, and the motivation-perception interface.

Reward and attentional control in visual search

It has long been known that the control of attention in visual search depends both on voluntary, top-down deployment according to context-specific goals, and on involuntary, stimulus-driven capture based on the physical conspicuity of perceptual objects. Recent evidence suggests that pairing target stimuli with reward can modulate the voluntary deployment of attention, but there is little evidence that reward modulates the involuntary deployment of attention to task-irrelevant distractors. We report several experiments that investigate the role of reward learning on attentional control. Each experiment involved a training phase and a test phase. In the training phase, different colors were associated with different amounts of monetary reward. In the test phase, color was not task-relevant and participants searched for a shape singleton; in most experiments no reward was delivered in the test phase. We first show that attentional capture by physically salient distractors is magnified by a previous association with reward. In subsequent experiments we demonstrate that physically inconspicuous stimuli previously associated with reward capture attention persistently during extinction--even several days after training. Furthermore, vulnerability to attentional capture by high-value stimuli is negatively correlated across individuals with working memory capacity and positively correlated with trait impulsivity. An analysis of intertrial effects reveals that value-driven attentional capture is spatially specific. Finally, when reward is delivered at test contingent on the task-relevant shape feature, recent reward history modulates value-driven attentional capture by the irrelevant color feature. The influence of learned value on attention may provide a useful model of clinical syndromes characterized by similar failures of cognitive control, including addiction, attention-deficit/hyperactivity disorder, and obesity.

A food predictive cue must be attributed with incentive salience for it to induce c-fos mRNA expression in cortico-striatal-thalamic brain regions

Cues associated with rewards acquire the ability to engage the same brain systems as rewards themselves. However, reward cues have multiple properties. For example, they not only act as predictors of reward capable of evoking conditional responses (CRs), but they may also acquire incentive motivational properties. As incentive stimuli they can evoke complex emotional and motivational states. Here we sought to determine whether the predictive value of a reward cue is sufficient to engage brain reward systems, or whether the cue must also be attributed with incentive salience. We took advantage of the fact that there are large individual differences in the extent to which reward cues are attributed with incentive salience. When a cue (conditional stimulus, CS) is paired with delivery of food (unconditional stimulus, US), the cue acquires the ability to evoke a CR in all rats; that is, it is equally predictive and supports learning the CS-US association in all. However, only in a subset of rats is the cue attributed with incentive salience, becoming an attractive and desirable incentive stimulus. We used in situ hybridization histochemistry to quantify the ability of a food cue to induce c-fos mRNA expression in rats that varied in the extent to which they attributed incentive salience to the cue. We found that a food cue induced c-fos mRNA in the orbitofrontal cortex, striatum (caudate and nucleus accumbens), thalamus (paraventricular, intermediodorsal and central medial nuclei), and lateral habenula, only in rats that attributed incentive salience to the cue. Furthermore, patterns of "connectivity" between these brain regions differed markedly between rats that did or did not attribute incentive salience to the food cue. These data suggest that the predictive value of a reward cue is not sufficient to engage brain reward systems-the cue must also be attributed with incentive salience.

Individual variation in the motivational properties of cocaine

Cues in the environment associated with drug use draw the attention of addicts, elicit approach, and motivate drug-seeking and drug-taking behavior, making abstinence difficult. However, preclinical studies have identified large individual differences in the extent to which reward cues acquire these incentive motivational properties. For example, only in some rats does a spatially discrete food cue become attractive, eliciting approach and engagement with it, and acts as an effective conditioned reinforcer. Moreover, a discrete cocaine cue also acquires greater motivational control over behavior in rats prone to attribute incentive salience to a food cue. In this study, we asked whether there is similar individual variation in the extent to which interoceptive cues produced by cocaine itself instigate cocaine-seeking behavior. After quantifying individual variation in the propensity to attribute incentive salience to a food cue, rats were trained to self-administer cocaine in the absence of an explicit conditional stimulus. We then assessed motivation for cocaine by: (1) performance on a progressive ratio schedule, and (2) the degree to which a cocaine 'prime' reinstated cocaine-seeking following extinction of self-administration behavior. We found that rats prone to attribute incentive salience to a food cue worked harder for cocaine, and showed more robust cocaine-induced reinstatement. We conclude that there is considerable individual variation in the motivational properties of cocaine itself, and this can be predicted by the propensity to attribute incentive salience to reward cues.

A cocaine cue acts as an incentive stimulus in some but not others: implications for addiction

BACKGROUND

In addicts drug cues attract attention, elicit approach, and motivate drug-seeking and drug-taking behavior, and addicts find it difficult to resist such cues. In preclinical studies we have found, however, that food cues acquire incentive motivational properties only in a subset of individuals. For example, a food cue becomes attractive, eliciting approach and engagement with it, and acts as an effective conditional reinforcer in some rats but not others. We asked, therefore, whether rats that have a propensity to attribute incentive salience to a food cue are the same ones that attribute incentive value to a drug (cocaine) cue.

METHODS

We first used a Pavlovian conditioned approach procedure to determine which individual rats attributed incentive salience to a food cue. A second cue was then associated with the IV self-administration of cocaine. Later, the ability of the cocaine cue to maintain self-administration behavior and to reinstate self-administration after extinction was assessed.

RESULTS

We report that in individuals that had a propensity to attribute incentive salience to a food cue, a cocaine cue spurred motivation to take drugs (its removal greatly diminished self-administration) and reinstated robust drug-seeking after extinction. However, in those individuals that failed to attribute incentive salience to a food cue, the cocaine cue was relatively devoid of incentive motivational properties.

CONCLUSIONS

We conclude that it is possible to determine, before any drug experience, which individuals will most likely have difficulty resisting drug cues, a trait that might confer susceptibility to addiction.

Neural mechanisms of grief regulation

BACKGROUND

The death of an attachment figure triggers intrusive thoughts of the deceased, sadness, and yearning for reunion. Recovery requires reduction of symptoms. We hypothesized that symptoms might correlate with a capacity to regulate attention toward reminders of the deceased, and activity in, and functional connectivity between, prefrontal regulatory regions and the amygdala.

METHODS

Twenty recently bereaved subjects rated intrusive thoughts of the deceased versus a capacity to avoid thoughts (grief style). Reaction time was measured while subjects completed an Emotional Stroop (ES) task contrasting deceased-related with control words during functional magnetic resonance imaging (fMRI). Subjects subsequently visualized the death of the deceased and rated induced emotions.

RESULTS

Subjects demonstrated attentional bias toward deceased-related words. Bias magnitude correlated with amygdala, insula, dorsolateral prefrontal cortex (DLPFC) activity. Amygdala activity predicted induced sadness intensity. A double dissociation between grief style and both prefrontal and amygdala subregion activity was found. Intrusiveness correlated with activation of ventral amygdala and rostral anterior cingulate (rACC); avoidance correlated with deactivation of dorsal amygdala and DLPFC. A double dissociation between regulatory region and task-dependent functional connectivity (FC) was found. High DLPFC-amygdala FC correlated with reduced attentional bias, while low rACC-amygdala FC predicted sadness intensity.

CONCLUSIONS

Results are consistent with a model in which activity in and functional connectivity between the amygdala and prefrontal regulatory regions indexes differences in mourners' regulation of attention and sadness during pangs of grief, and may be used to distinguish between clinically relevant differences in grief style.

Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences

BACKGROUND

If presentation of a stimulus (conditional stimulus, CS) reliably predicts delivery of a reward, the CS will come to evoke a conditional response (CR) through Pavlovian learning, and the CS may also acquire incentive motivational properties. Thus, CSs can have both predictive and incentive properties. We ask here whether it is possible to dissociate the predictive versus incentive properties of a CS in rats by considering individual differences in the nature of the CR.

METHODS

We used Pavlovian procedures to study the ability of a localizable CS (an illuminated lever) to acquire two properties of an incentive stimulus-the ability to attract and the ability to act as a conditional reinforcer.

RESULTS

For some rats, the CS evoked a "sign-tracking" CR, consisting of approach toward and engagement with the CS itself. For other rats, the CS instead produced a "goal-tracking" CR: approach was directed away from the CS toward the site of food delivery. For sign-trackers (but not goal-trackers) the CS also acted as an effective conditional reinforcer.

CONCLUSIONS

The predictive and incentive properties of a CS can be dissociated by considering individual differences in the CR. In a given animal, a cue that is predictive of reward, supporting Pavlovian learning, may or may not be attributed with incentive salience. This procedure may provide a powerful means to test hypotheses regarding the role of neural systems in learning versus incentive motivational functions and to study individual variation in the extent to which reward-associated stimuli act as incentive stimuli.

Effects of prior amphetamine exposure on approach strategy in appetitive Pavlovian conditioning in rats

RATIONALE

Pavlovian conditioning with a discrete reward-predictive visual cue can elicit two classes of behaviors: "sign-tracking" (approach toward and contact with the cue) and "goal-tracking" (approach toward the site of reward delivery). Sign-tracking has been proposed to be linked to behavioral disorders involving compulsive reward-seeking, such as addiction. Prior exposure to psychostimulant drugs of abuse can facilitate reward-seeking behaviors through enhancements in incentive salience attribution. Thus, it was predicted that a sensitizing regimen of amphetamine exposure would increase sign-tracking behavior.

OBJECTIVE

The purpose of these experiments was to determine how a regimen of exposure to amphetamine affects subsequent sign-tracking behavior.

MATERIALS AND METHODS

Male Long-Evans rats were given daily injections of d-amphetamine (2.0 mg/kg) or saline for 5 days, then given a 7-day drug-free period followed by testing in a Pavlovian conditioning task. In experiment 1, rats were presented with a visual cue (simultaneous illumination of a light and extension of a lever) located either to the left or right of a centrally located food trough. One cue (CS+) was always followed by food delivery, whereas the other (CS-) was not. In experiment 2, rats were tested in a nondiscriminative (CS+ only) version of the task.

RESULTS

In both experiments, amphetamine-exposed rats showed less sign-tracking and more goal-tracking compared to saline controls.

CONCLUSIONS

Contrary to predictions, prior amphetamine exposure decreased sign-tracking and increased goal-tracking behavior. However, these results do support the hypothesis that psychostimulant exposure and incentive sensitization enhance behavior directed toward reward-proximal cues at the expense of reward-distal cues.

Decision Utility, Incentive Salience, and Cue-Triggered "Wanting"

This chapter examines brain mechanisms of reward utility operating at particular decision moments in life-moments such as when one encounters an image, sound, scent, or other cue associated in the past with a particular reward or perhaps just when one vividly imagines that cue. Such a cue can often trigger a sudden motivational urge to pursue its reward and sometimes a decision to do so. Drawing on a utility taxonomy that distinguishes among subtypes of reward utility-predicted utility, decision utility, experienced utility, and remembered utility-it is shown how cue-triggered cravings, such as an addict's surrender to relapse, can hang on special transformations by brain mesolimbic systems of one utility subtype, namely, decision utility. The chapter focuses on a particular form of decision utility called incentive salience, a type of "wanting" for rewards that is amplified by brain mesolimbic systems. Sudden peaks of intensity of incentive salience, caused by neurobiological mechanisms, can elevate the decision utility of a particular reward at the moment its cue occurs. An understanding of what happens at such moments leads to a better understanding of the mechanisms at work in decision making in general.

Subliminal processing of smoking-related and affective stimuli in tobacco addiction

Cognitive processing biases toward smoking-related and affective cues may play a role in tobacco dependence. Because processing biases may occur outside conscious awareness, the current study examined processing of smoking-related and affective stimuli presented at subliminal conditions. A pictorial subliminal repetition priming task was administered to three groups: (1) Nonsmokers (n = 56); (2) Smokers (> or =10 cigarettes/day) who had been deprived from smoking for 12 h (n = 47); and (3) Nondeprived smokers (n = 66). Prime stimuli were presented briefly (17 ms) and were followed by a mask (to render them unavailable to conscious awareness) and then a target. Participants were required to make a speeded classification to the target. A posttask awareness check was administered to ensure that participants could not consciously perceive the briefly presented primes (i.e., smoking paraphernalia, neutral office supplies, and happy, angry, and neutral facial expressions). The groups differed in the degree to which they exhibited a processing bias for smoking-related stimuli, F(2, 166) = 4.99, p = .008. Deprived smokers exhibited a bias toward processing smoking (vs. neutral office supply) stimuli, F(1, 46) = 5.67, p = .02, whereas nondeprived smokers and nonsmokers did not (ps > .22). The three groups did not differ in the degree to which they exhibited a subliminal processing bias for affective stimuli. Tobacco deprivation appears to increase smokers' subliminal processing of smoking-related (vs. neutral) stimuli but does not influence subliminal processing of affective stimuli. Future research should investigate whether subliminal biases toward smoking-related stimuli influence relapse.

Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction

Drugs of abuse acquire different degrees of control over thoughts and actions based not only on the effects of drugs themselves, but also on predispositions of the individual. Those individuals who become addicted are unable to shift their thoughts and actions away from drugs and drug-associated stimuli. Thus in addicts, exposure to places or things (cues) that has been previously associated with drug-taking often instigates renewed drug-taking. We and others have postulated that drug-associated cues acquire the ability to maintain and instigate drug-taking behavior in part because they acquire incentive motivational properties through Pavlovian (stimulus-stimulus) learning. In the case of compulsive behavioral disorders, including addiction, such cues may be attributed with pathological incentive value ("incentive salience"). For this reason, we have recently begun to explore individual differences in the tendency to attribute incentive salience to cues that predict rewards. When discrete cues are associated with the non-contingent delivery of food or drug rewards some animals come to quickly approach and engage the cue even if it is located at a distance from where the reward will be delivered. In these animals the reward-predictive cue itself becomes attractive, eliciting approach towards it, presumably because it is attributed with incentive salience. Animals that develop this type of conditional response are called "sign-trackers". Other animals, "goal-trackers", do not approach the reward-predictive cue, but upon cue presentation they immediately go to the location where food will be delivered (the "goal"). For goal-trackers the reward-predictive cue is not attractive, presumably because it is not attributed with incentive salience. We review here preliminary data suggesting that these individual differences in the tendency to attribute incentive salience to cues predictive of reward may confer vulnerability or resistance to compulsive behavioral disorders, including addiction. It will be important, therefore, to study how environmental, neurobiological and genetic interactions determine the extent to which individuals attribute incentive value to reward-predictive stimuli.

Substantia nigra/ventral tegmental reward prediction error disruption in psychosis

While dopamine systems have been implicated in the pathophysiology of schizophrenia and psychosis for many years, how dopamine dysfunction generates psychotic symptoms remains unknown. Recent theoretical interest has been directed at relating the known role of midbrain dopamine neurons in reinforcement learning, motivational salience and prediction error to explain the abnormal mental experience of psychosis. However, this theoretical model has yet to be explored empirically. To examine a link between psychotic experience, reward learning and dysfunction of the dopaminergic midbrain and associated target regions, we asked a group of first episode psychosis patients suffering from active positive symptoms and a group of healthy control participants to perform an instrumental reward conditioning experiment. We characterized neural responses using functional magnetic resonance imaging. We observed that patients with psychosis exhibit abnormal physiological responses associated with reward prediction error in the dopaminergic midbrain, striatum and limbic system, and we demonstrated subtle abnormalities in the ability of psychosis patients to discriminate between motivationally salient and neutral stimuli. This study provides the first evidence linking abnormal mesolimbic activity, reward learning and psychosis.

Hyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards

What is the role of dopamine in natural rewards? A genetic mutant approach was taken to examine the consequences of elevated synaptic dopamine on (1) spontaneous food and water intake, (2) incentive motivation and learning to obtain a palatable sweet reward in a runway task, and (3) affective "liking" reactions elicited by the taste of sucrose. A dopamine transporter (DAT) knockdown mutation that preserves only 10% of normal DAT, and therefore causes mutant mice to have 70% elevated levels of synaptic dopamine, was used to identify dopamine effects on food intake and reward. We found that hyperdopaminergic DAT knockdown mutant mice have higher food and water intake. In a runway task, they demonstrated enhanced acquisition and greater incentive performance for a sweet reward. Hyperdopaminergic mutant mice leave the start box more quickly than wild-type mice, require fewer trials to learn, pause less often in the runway, resist distractions better, and proceed more directly to the goal. Those observations suggest that hyperdopaminergic mutant mice attribute greater incentive salience ("wanting") to a sweet reward in the runway test. But sucrose taste fails to elicit higher orofacial "liking" reactions from mutant mice in an affective taste reactivity test. These results indicate that chronically elevated extracellular dopamine facilitates "wanting" and learning of an incentive motivation task for a sweet reward, but elevated dopamine does not increase "liking" reactions to the hedonic impact of sweet tastes.

Incentive sensitization by previous amphetamine exposure: increased cue-triggered "wanting" for sucrose reward

We reported previously that an amphetamine microinjection into the nucleus accumbens enables Pavlovian reward cues in a conditioned incentive paradigm to trigger excessive instrumental pursuit. Here we show that sensitization caused by previous amphetamine administration also causes reward cues to trigger excessive pursuit of their associated reward, even when sensitized rats are tested in a drug-free state. Rats learned to lever press for sucrose pellets, and they separately learned to associate sucrose pellets with Pavlovian cues (30 sec auditory cues). Amphetamine sensitization was induced by six daily injections of amphetamine (3 mg/kg, i.p.; controls received saline). Rats were tested for lever pressing under extinction conditions 10 d later, after a bilateral microinjection of intra-accumbens vehicle or amphetamine (5 microg/0.5 microl per side). Cue-triggered pursuit of sucrose reward was assessed by increases in pressing on the sucrose-associated lever during intermittent presentations of a free conditioned stimulus (CS+) sucrose cue. Sensitized rats pressed at normal levels during baseline and during the CS-, but the CS+ triggered 100% greater increases in pressing from sensitized rats than from control rats after vehicle microinjection. Sensitization therefore enhanced the incentive salience attributed to the CS+ even when rats were tested while drug-free. For control rats, a microinjection of intra-accumbens amphetamine was needed to produce the same enhancement of cue-triggered reward "wanting." The amphetamine microinjection also interacted synergistically in sensitized rats to produce intrusive cue-triggered pursuit behaviors (e.g., investigatory sniffing) that interfered with goal-directed lever pressing. These results support the incentive-sensitization theory postulate that sensitization causes excessive cue-triggered "wanting" for an associated reward.

The role of dopamine in the nucleus accumbens and striatum during sexual behavior in the female rat

Dopamine in dialysate from the nucleus accumbens (NAcc) increases during sexual and feeding behavior and after administration of drugs of abuse, even those that do not directly activate dopaminergic systems (e.g., morphine or nicotine). These findings and others have led to hypotheses that propose that dopamine is rewarding, predicts that reinforcement will occur, or attributes incentive salience. Examining increases in dopamine in NAcc or striatum during sexual behavior in female rats provides a unique situation to study these relations. This is because, for the female rat, sexual behavior is associated with an increase in NAcc dopamine and conditioned place preference only under certain testing conditions. This experiment was conducted to determine what factors are important for the increase in dopamine in dialysate from NAcc and striatum during sexual behavior in female rats. The factors considered were the number of contacts by the male, the timing of contacts by the male, or the ability of the female to control contacts by the male. The results indicate that increased NAcc dopamine is dependent on the timing of copulatory stimuli, independent of whether the female rat is actively engaged in regulating this timing. For the striatum, the timing of copulatory behavior influences the magnitude of the increase in dopamine in dialysate, but other factors are also involved. We conclude that increased extracellular dopamine in the NAcc and striatum conveys qualitative or interpretive information about the rewarding value of stimuli. Sexual behavior in the female rat is proposed as a model to determine the role of dopamine in motivated behavior.

Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement

Amphetamine microinjection into the nucleus accumbens shell enhanced the ability of a Pavlovian reward cue to trigger increased instrumental performance for sucrose reward in a pure conditioned incentive paradigm. Rats were first trained to press one of two levers to obtain sucrose pellets. They were separately conditioned to associate a Pavlovian cue (30 sec light) with free sucrose pellets. On test days, the rats received bilateral microinjection of intra-accumbens vehicle or amphetamine (0.0, 2.0, 10.0, or 20.0 microgram/0.5 microliter), and lever pressing was tested in the absence of any reinforcement contingency, while the Pavlovian cue alone was freely presented at intervals throughout the session. Amphetamine microinjection selectively potentiated the cue-elicited increase in sucrose-associated lever pressing, although instrumental responding was not reinforced by either sucrose or the cue during the test. Intra-accumbens amphetamine can therefore potentiate cue-triggered incentive motivation for reward in the absence of primary or secondary reinforcement. Using the taste reactivity measure of hedonic impact, it was shown that intra-accumbens amphetamine failed to increase positive hedonic reaction patterns elicited by sucrose (i.e., sucrose "liking") at doses that effectively increase sucrose "wanting." We conclude that nucleus accumbens dopamine specifically mediates the ability of reward cues to trigger "wanting" (incentive salience) for their associated rewards, independent of both hedonic impact and response reinforcement.