Lesions of the paraventricular nucleus of the thalamus differentially affect sign- and goal-tracking conditioned responses

Acute MK-801 increases measures of both sign-tracking and goal-tracking in male Sprague-Dawley rats

Sign-tracking is a Pavlovian conditioned approach behavior thought to be important in understanding cue-driven relapse to drug use, and strategies for reducing sign-tracking may have some benefit in preventing relapse. A previous study successfully employed the NMDA receptor antagonist MK-801 in preventing the development of sign-tracking (but not goal-tracking) in a conditioned approach task. In this study, we focused on whether MK-801 would have similar effects on previously established sign-tracking behavior. MK-801 was administered after training in a standard sign-/goal-tracking task using a retractable lever as a conditioned stimulus and a sucrose pellet as unconditioned stimulus. It was found that MK-801 increased measures of both sign- and goal-tracking in subjects who had previously learned the task. The NMDA receptor appears to play a complex role in governing behavior related to sign-tracking.

The Paraventricular Thalamic Nucleus and Its Projections in Regulating Reward and Context Associations

The paraventricular thalamic nucleus (PVT) is a brain region that mediates aversive and reward-related behaviors as shown in animals exposed to fear conditioning, natural rewards, or drugs of abuse. However, it is unknown whether manipulations of the PVT, in the absence of external factors or stimuli (e.g., fear, natural rewards, or drugs of abuse), are sufficient to drive reward-related behaviors. Additionally, it is unknown whether drugs of abuse administered directly into the PVT are sufficient to drive reward-related behaviors. Here, using behavioral as well as pathway and cell-type specific approaches, we manipulate PVT activity as well as the PVT-to-nucleus accumbens shell (NAcSh) neurocircuit to explore reward phenotypes. First, we show that bath perfusion of morphine (10 µM) caused hyperpolarization of the resting membrane potential, increased rheobase, and decreased intrinsic membrane excitability in PVT neurons that project to the NAcSh. Additionally, we found that direct injections of morphine (50 ng) in the PVT of mice were sufficient to generate conditioned place preference (CPP) for the morphine-paired chamber. Mimicking the inhibitory effect of morphine, we employed a chemogenetic approach to inhibit PVT neurons that projected to the NAcSh and found that pairing the inhibition of these PVT neurons with a specific context evoked the acquisition of CPP. Lastly, using brain slice electrophysiology, we found that bath-perfused morphine (10 µM) significantly reduced PVT excitatory synaptic transmission on both dopamine D1 and D2 receptor-expressing medium spiny neurons in the NAcSh, but that inhibiting PVT afferents in the NAcSh was not sufficient to evoke CPP.

Separating desire from prediction of outcome value

Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.

Perioperative sleep deprivation activates the paraventricular thalamic nucleus resulting in persistent postoperative incisional pain in mice

Background

The duration of postsurgical pain is closely correlated with perioperative stress. Most patients suffer short-term sleep disorder/deprivation before and/or after surgery, which leads to extended postsurgical pain by an undetermined mechanism. The paraventricular thalamus (PVT) is a critical area that contributes to the regulation of feeding, awakening, and emotional states. However, whether the middle PVT is involved in postoperative pain or the extension of postoperative pain caused by perioperative sleep deprivation has not yet been investigated.

Methods

We established a model of postoperative pain by plantar incision with perioperative rapid eye movement sleep deprivation (REMSD) 6 h/day for 3 consecutive days in mice. The excitability of the CaMKIIα⁺ neurons in the middle PVT (mPVT^CaMKIIα) was detected by immunofluorescence and fiber photometry. The activation/inhibition of mPVT^CaMKIIα neurons was conducted by chemogenetics.

Results

REMSD prolonged the duration of postsurgical pain and increased the excitability of mPVT^CaMKIIα neurons. In addition, mPVT^CaMKIIα neurons showed increased excitability in response to nociceptive stimuli or painful conditions. However, REMSD did not delay postsurgical pain recovery following the ablation of CaMKIIα neurons in the mPVT. The activation of mPVT^CaMKIIα neurons prolonged the duration of postsurgical pain and elicited anxiety-like behaviors. In contrast, inhibition of mPVT^CaMKIIα neurons reduced the postsurgical pain after REMSD.

Conclusion

Our data revealed that the CaMKIIα neurons in the mPVT are involved in the extension of the postsurgical pain duration induced by REMSD, and represented a novel potential target to treat postoperative pain induced by REMSD.

Neuropeptide S Encodes Stimulus Salience in the Paraventricular Thalamus

Evaluation of stimulus salience is critical for any higher organism, as it allows for prioritizing of vital information, preparation of responses, and formation of valuable memory. The paraventricular nucleus of the thalamus (PVT) has recently been identified as an integrator of stimulus salience but the neurochemical basis and afferent input regarding salience signaling have remained elusive. Here we report that neuropeptide S (NPS) signaling in the PVT is necessary for stimulus salience encoding, including aversive, neutral and reinforcing sensory input. Taking advantage of a striking deficit of both NPS receptor (NPSR1) and NPS precursor knockout mice in fear extinction or novel object memory formation, we demonstrate that intra-PVT injections of NPS can rescue the phenotype in NPS precursor knockout mice by increasing the salience of otherwise low-intensity stimuli, while intra-PVT injections of NPSR1 antagonist in wild type mice partially replicates the knockout phenotype. The PVT appears to provide stimulus salience encoding in a dose- and NPS-dependent manner. PVT NPSR1 neurons recruit the nucleus accumbens shell and structures in the prefrontal cortex and amygdala, which were previously linked to the brain salience network. Overall, these results demonstrate that stimulus salience encoding is critically associated with NPS activity in the PVT.

Dextromethorphan Reduces Sign-Tracking but Not Goal-Tracking in Male Sprague-Dawley Rats

Sign-tracking is a well-known phenomenon in appetitive Pavlovian conditioning in which subjects approach the site of a conditioned stimulus (CS) associated with an appetitive unconditioned stimulus (US) even when the two are located separately. Control of sign-tracking may be important in rehabilitation from drug dependence to help ward off relapse. Recent studies have found success in using ketamine to reduce sign-tracking. In this study, we employed a similar but unscheduled drug, dextromethorphan (DXM), which affects many of the same molecular targets as ketamine, in an attempt to reduce sign-tracking in a standard paradigm. DXM was found to reduce sign-tracking at the doses examined in this study, while goal-tracking (approaching the site of the US rather than CS) was relatively unaffected. DXM offers advantages over ketamine in terms of use with patients and may have some utility in rehabilitation.

Inhibition of a cortico-thalamic circuit attenuates cue-induced reinstatement of drug-seeking behavior in "relapse prone" male rats

RATIONALE

Relapse often occurs when individuals are exposed to stimuli or cues previously associated with the drug-taking experience. The ability of drug cues to trigger relapse is believed to be a consequence of incentive salience attribution, a process by which the incentive value of reward is transferred to the reward-paired cue. Sign-tracker (ST) rats that attribute enhanced incentive value to reward cues are more prone to relapse compared to goal-tracker (GT) rats that primarily attribute predictive value to such cues.

OBJECTIVES

The neurobiological mechanisms underlying this individual variation in relapse propensity remains largely unexplored. The paraventricular nucleus of the thalamus (PVT) has been identified as a critical node in the regulation of cue-elicited behaviors in STs and GTs, including cue-induced reinstatement of drug-seeking behavior. Here we used a chemogenetic approach to assess whether "top-down" cortical input from the prelimbic cortex (PrL) to the PVT plays a role in mediating individual differences in relapse propensity.

RESULTS

Chemogenetic inhibition of the PrL-PVT pathway selectively decreased cue-induced reinstatement of drug-seeking behavior in STs, without affecting behavior in GTs. In contrast, cocaine-primed drug-seeking behavior was not affected in either phenotype. Furthermore, when rats were characterized based on a different behavioral phenotype-locomotor response to novelty-inhibition of the PrL-PVT pathway had no effect on either cue- or drug-induced reinstatement.

CONCLUSIONS

These results highlight an important role for the PrL-PVT pathway in vulnerability to relapse that is consequent to individual differences in the propensity to attribute incentive salience to discrete reward cues.

Thalamo-Nucleus Accumbens Projections in Motivated Behaviors and Addiction

The ventral striatum, also called nucleus accumbens (NAc), has long been known to integrate information from cortical, thalamic, midbrain and limbic nuclei to mediate goal-directed behaviors. Until recently thalamic afferents have been overlooked when studying the functions and connectivity of the NAc. However, findings from recent studies have shed light on the importance and roles of precise Thalamus to NAc connections in motivated behaviors and in addiction. In this review, we summarize studies using techniques such as chemo- and optogenetics, electrophysiology and in vivo calcium imaging to elucidate the complex functioning of the thalamo-NAc afferents, with a particular highlight on the projections from the Paraventricular Thalamus (PVT) to the NAc. We will focus on the recent advances in the understanding of the roles of these neuronal connections in motivated behaviors, with a special emphasis on their implications in addiction, from cue-reward association to the mechanisms driving relapse.

The Paraventricular Thalamus as a Critical Node of Motivated Behavior via the Hypothalamic-Thalamic-Striatal Circuit

In this review, we highlight evidence that supports a role for the paraventricular nucleus of the thalamus (PVT) in motivated behavior. We include a neuroanatomical and neurochemical overview, outlining what is known of the cellular makeup of the region and its most prominent afferent and efferent connections. We discuss how these connections and distinctions across the anterior-posterior axis correspond to the perceived function of the PVT. We then focus on the hypothalamic-thalamic-striatal circuit and the neuroanatomical and functional placement of the PVT within this circuit. In this regard, the PVT is ideally positioned to integrate information regarding internal states and the external environment and translate it into motivated actions. Based on data that has emerged in recent years, including that from our laboratory, we posit that orexinergic (OX) innervation from the lateral hypothalamus (LH) to the PVT encodes the incentive motivational value of reward cues and thereby alters the signaling of the glutamatergic neurons projecting from the PVT to the shell of the nucleus accumbens (NAcSh). The PVT-NAcSh pathway then modulates dopamine activity and resultant cue-motivated behaviors. As we and others apply novel tools and approaches to studying the PVT we will continue to refine the anatomical, cellular, and functional definitions currently ascribed to this nucleus and further elucidate its role in motivated behaviors.

A hypothalamic-thalamostriatal circuit that controls approach-avoidance conflict in rats

Survival depends on a balance between seeking rewards and avoiding potential threats, but the neural circuits that regulate this motivational conflict remain largely unknown. Using an approach-food vs. avoid-predator threat conflict test in rats, we identified a subpopulation of neurons in the anterior portion of the paraventricular thalamic nucleus (aPVT) which express corticotrophin-releasing factor (CRF) and are preferentially recruited during conflict. Inactivation of aPVT^CRF neurons during conflict biases animal's response toward food, whereas activation of these cells recapitulates the food-seeking suppression observed during conflict. aPVT^CRF neurons project densely to the nucleus accumbens (NAc), and activity in this pathway reduces food seeking and increases avoidance. In addition, we identified the ventromedial hypothalamus (VMH) as a critical input to aPVT^CRF neurons, and demonstrated that VMH-aPVT neurons mediate defensive behaviors exclusively during conflict. Together, our findings describe a hypothalamic-thalamostriatal circuit that suppresses reward-seeking behavior under the competing demands of avoiding threats.

Prelimbic prefrontal cortical encoding of reward predictive cues

Animals appoint incentive value and learn to approach otherwise behaviorally inert stimuli if these stimuli come to predict the delivery of reward. Interestingly, this adaptive Pavlovian learning process has been implicated in behavioral control disorders, such as drug addiction. One brain region implicated in directing conditioned approach behavior is the prelimbic region of the prefrontal cortex. The present study employed in vivo electrophysiology in the prelimbic cortex to characterize the distribution of neural responses to the presence of a cue that had acquired incentive value after being associated with a primary reward. Male rats were trained in a Pavlovian autoshaping task in which a lever was presented prior to reward delivery. Following repeated pairings of lever availability and reward delivery, rats pressed the lever even though reward delivery was not contingent on any interaction with the lever. Neurons in the prelimbic cortex selectively encoded the presentation of the reward-predicting lever. Although the response was heterogeneous, most responsive neurons decreased their firing rate in response to the presence of the lever. These findings characterize the varied responses of prelimbic cortical neurons to reward cues and are consistent with evidence that the role of the prelimbic cortex in reward learning depends on the downstream target.

The Function of Paraventricular Thalamic Circuitry in Adaptive Control of Feeding Behavior

The paraventricular nucleus of the thalamus (PVT) is a complex area that is uniquely embedded across the core feeding, reward, arousal, and stress circuits. The PVT role in the control of feeding behavior is discussed here within a framework of adaptive behavioral guidance based on the body’s energy state and competing drives. The survival of an organism depends on bodily energy resources and promotion of feeding over other behaviors is adaptive except when in danger or sated. The PVT is structurally set up to respond to homeostatic and hedonic needs to feed, and to integrate those signals with physiological and environmental stress, as well as anticipatory needs and other cognitive inputs. It can regulate both food foraging (seeking) and consumption and may balance their expression. The PVT is proposed to accomplish these functions through a network of connections with the brainstem, hypothalamic, striatal, and cortical areas. The connectivity of the PVT further indicates that it could broadcast the information about energy use/gain and behavioral choice to impact cognitive processes—learning, memory, and decision-making—through connections with the medial and lateral prefrontal cortical areas, the hippocampal formation, and the amygdala. The PVT is structurally complex and recent evidence for specific PVT pathways in different aspects of feeding behavior will be discussed.

Central Thalamic-Medial Prefrontal Control of Adaptive Responding in the Rat: Many Players in the Chamber

The medial prefrontal cortex (mPFC) has robust afferent and efferent connections with multiple nuclei clustered in the central thalamus. These nuclei are elements in large-scale networks linking mPFC with the hippocampus, basal ganglia, amygdala, other cortical areas, and visceral and arousal systems in the brainstem that give rise to adaptive goal-directed behavior. Lesions of the mediodorsal nucleus (MD), the main source of thalamic input to middle layers of PFC, have limited effects on delayed conditional discriminations, like DMTP and DNMTP, that depend on mPFC. Recent evidence suggests that MD sustains and amplifies neuronal responses in mPFC that represent salient task-related information and is important for detecting and encoding contingencies between actions and their consequences. Lesions of rostral intralaminar (rIL) and ventromedial (VM) nuclei produce delay-independent impairments of egocentric DMTP and DNMTP that resemble effects of mPFC lesions on response speed and accuracy: results consistent with projections of rIL to striatum and VM to motor cortices. The ventral midline and anterior thalamic nuclei affect allocentric spatial cognition and memory consistent with their connections to mPFC and hippocampus. The dorsal midline nuclei spare DMTP and DNMTP. They have been implicated in behavioral-state control and response to salient stimuli in associative learning. mPFC functions are served during DNMTP by discrete populations of neurons with responses related to motor preparation, movements, lever press responses, reinforcement anticipation, reinforcement delivery, and memory delay. Population analyses show that different responses are timed so that they effectively tile the temporal interval from when DNMTP trials are initiated until the end. Event-related responses of MD neurons during DNMTP are predominantly related to movement and reinforcement, information important for DNMTP choice. These responses closely mirror the activity of mPFC neurons with similar responses. Pharmacological inactivation of MD and adjacent rIL affects the expression of diverse action- and outcome-related responses of mPFC neurons. Lesions of MD before training are associated with a shift away from movement-related responses in mPFC important for DNMTP choice. These results suggest that MD has short-term effects on the expression of event-related activity in mPFC and long-term effects that tune mPFC neurons to respond to task-specific information.

Motivational competition and the paraventricular thalamus

Although significant progress has been made in understanding the behavioral and brain mechanisms for motivational systems, much less is known about competition between motivational states or motivational conflict (e.g., approach - avoidance conflict). Despite being produced under diverse conditions, behavior during motivational competition has two signatures: bistability and metastability. These signatures reveal the operation of positive feedback mechanisms in behavioral selection. Different neuronal architectures can instantiate this selection to achieve bistability and metastability in behavior, but each relies on circuit-level inhibition to achieve rapid and stable selection between competing tendencies. Paraventricular thalamus (PVT) is identified as critical to this circuit level inhibition, resolving motivational competition via its extensive projections to local inhibitory networks in the ventral striatum and extended amygdala, enabling adaptive responding under motivational conflict.

A thalamic bridge from sensory perception to cognition

The ability to adapt to dynamic environments requires tracking multiple signals with variable sensory salience and fluctuating behavioral relevance. This complex process requires integrative crosstalk between sensory and cognitive brain circuits. Functional interactions between cortical and thalamic regions are now considered essential for both sensory perception and cognition but a clear account of the functional link between sensory and cognitive circuits is currently lacking. This review aims to document how thalamic nuclei may effectively act as a bridge allowing to fuse perceptual and cognitive events into meaningful experiences. After highlighting key aspects of thalamocortical circuits such as the classic first-order/higher-order dichotomy, we consider the role of the thalamic reticular nucleus from directed attention to cognition. We next summarize research relying on Pavlovian learning paradigms, showing that both first-order and higher-order thalamic nuclei contribute to associative learning. Finally, we propose that modulator inputs reaching all thalamic nuclei may be critical for integrative purposes when environmental signals are computed. Altogether, the thalamus appears as the bridge linking perception, cognition and possibly affect.

The neurobiology of abstinence-induced reward-seeking in males and females

Drugs of abuse and highly palatable foods (e.g. high fat or sweet foods) have powerful reinforcing effects, which can lead to compulsive and addictive drives to ingest these substances to the point of psychopathology and self-harm--specifically the development of Substance Use Disorder (SUD) and obesity. Both SUD and binge-like overeating can be defined as disorders in which the salience of the reward (food or drug) becomes exaggerated relative to, and at the expense of, other rewards that promote well-being. A major roadblock in the treatment of these disorders is high rates of relapse after periods of abstinence. It is common, although not universal, for cue-induced craving to increase over time with abstinence, often triggered by cues previously paired with the reinforcing substance. Accumulating evidence suggests that similar neural circuits and cellular mechanisms contribute to abstinence-induced and cue-triggered seeking of drugs and palatable food. Although much research has focused on the important role of corticolimbic circuitry in drug-seeking, our goal is to expand focus to the more recently explored hypothalamic-thalamic-striatal circuitry. Specifically, we review how connections, and neurotransmitters therein, among the lateral hypothalamus, paraventricular nucleus of the thalamus, and the nucleus accumbens contribute to abstinence-induced opioid- and (high fat or sweet) food-seeking. Given that biological sex and gonadal hormones have been implicated in addictive behavior across species, another layer to this review is to compare behaviors and neural circuit-based mechanisms of abstinence-induced opioid- or food-seeking between males and females when such data is available.

Psychostimulant-Induced Adaptations in Nucleus Accumbens Glutamatergic Transmission

Carrying different aspects of emotional and motivational signals, glutamatergic synaptic projections from multiple limbic and paralimbic brain regions converge to the nucleus accumbens (NAc), in which these arousing signals are processed and prioritized for behavioral output. In animal models of drug addiction, some key drug-induced alterations at NAc glutamatergic synapses underlie important cellular and circuit mechanisms that promote subsequent drug taking, seeking, and relapse. With the focus of cocaine, we review changes at NAc glutamatergic synapses that occur after different drug procedures and abstinence durations, and the behavioral impact of these changes.

The lateral hypothalamus and orexinergic transmission in the paraventricular thalamus promote the attribution of incentive salience to reward-associated cues

RATIONALE

Prior research suggests that the neural pathway from the lateral hypothalamic area (LHA) to the paraventricular nucleus of the thalamus (PVT) mediates the attribution of incentive salience to Pavlovian reward cues. However, a causal role for the LHA and the neurotransmitters involved have not been demonstrated in this regard.

OBJECTIVES

To examine (1) the role of LHA in the acquisition of Pavlovian conditioned approach (PavCA) behaviors, and (2) the role of PVT orexin 1 receptors (OX1r) and orexin 2 receptors (OX2r) in the expression of PavCA behaviors and conditioned reinforcement.

METHODS

Rats received excitotoxic lesions of the LHA prior to Pavlovian training. A separate cohort of rats characterized as sign-trackers (STs) or goal-trackers (GTs) received the OX1r antagonist SB-334867, or the OX2r antagonist TCS-OX2-29, into the PVT, to assess their effects on the expression of PavCA behavior and on the conditioned reinforcing properties of a Pavlovian reward cue.

RESULTS

LHA lesions attenuated the development of sign-tracking behavior. Administration of either the OX1r or OX2r antagonist into the PVT reduced sign-tracking behavior in STs. Further, OX2r antagonism reduced the conditioned reinforcing properties of a Pavlovian reward cue in STs.

CONCLUSIONS

The LHA is necessary for the development of sign-tracking behavior; and blockade of orexin signaling in the PVT attenuates the expression of sign-tracking behavior and the conditioned reinforcing properties of a Pavlovian reward cue. Together, these data suggest that LHA orexin inputs to the PVT are a key component of the circuitry that encodes the incentive motivational value of reward cues.

A systems-neuroscience model of phasic dopamine

We describe a neurobiologically informed computational model of phasic dopamine signaling to account for a wide range of findings, including many considered inconsistent with the simple reward prediction error (RPE) formalism. The central feature of this PVLV framework is a distinction between a primary value (PV) system for anticipating primary rewards (Unconditioned Stimuli [USs]), and a learned value (LV) system for learning about stimuli associated with such rewards (CSs). The LV system represents the amygdala, which drives phasic bursting in midbrain dopamine areas, while the PV system represents the ventral striatum, which drives shunting inhibition of dopamine for expected USs (via direct inhibitory projections) and phasic pausing for expected USs (via the lateral habenula). Our model accounts for data supporting the separability of these systems, including individual differences in CS-based (sign-tracking) versus US-based learning (goal-tracking). Both systems use competing opponent-processing pathways representing evidence for and against specific USs, which can explain data dissociating the processes involved in acquisition versus extinction conditioning. Further, opponent processing proved critical in accounting for the full range of conditioned inhibition phenomena, and the closely related paradigm of second-order conditioning. Finally, we show how additional separable pathways representing aversive USs, largely mirroring those for appetitive USs, also have important differences from the positive valence case, allowing the model to account for several important phenomena in aversive conditioning. Overall, accounting for all of these phenomena strongly constrains the model, thus providing a well-validated framework for understanding phasic dopamine signaling. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Heterogeneity in the Paraventricular Thalamus: The Traffic Light of Motivated Behaviors

The paraventricular thalamic nucleus (PVT) is highly interconnected with brain areas that control reward-seeking behavior. Despite this known connectivity, broad manipulations of PVT often lead to mixed, and even opposing, behavioral effects, clouding our understanding of how PVT precisely contributes to reward processing. Although the function of PVT in influencing reward-seeking is poorly understood, recent studies show that forebrain and hypothalamic inputs to, and nucleus accumbens (NAc) and amygdalar outputs from, PVT are strongly implicated in PVT responses to conditioned and appetitive or aversive stimuli that determine whether an animal will approach or avoid specific rewards. These studies, which have used an array of chemogenetic, optogenetic, and calcium imaging technologies, have shown that activity in PVT input and output circuits is highly heterogeneous, with mixed activity patterns that contribute to behavior in highly distinct manners. Thus, it is important to perform experiments in precisely defined cell types to elucidate how the PVT network contributes to reward-seeking behaviors. In this review, we describe the complex heterogeneity within PVT circuitry that appears to influence the decision to seek or avoid a reward and point out gaps in our understanding that should be investigated in future studies.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

The role of the paraventricular nucleus of the thalamus in the augmentation of heroin seeking induced by chronic food restriction

Drug addiction is a chronic disorder that is characterized by compulsive drug seeking and involves cycling between periods of compulsive drug use, abstinence, and relapse. In both human addicts and animal models of addiction, chronic food restriction has been shown to increase rates of relapse. Previously, our laboratory has demonstrated a robust increase in drug seeking following a period of withdrawal in chronically food-restricted rats compared with sated rats. To date, the neural mechanisms that mediate the effect of chronic food restriction on drug seeking have not been elucidated. However, the paraventricular nucleus of the thalamus (PVT) appears to be a promising target to investigate. The objective of the current study was to examine the role of the PVT in the augmentation of heroin seeking induced by chronic food restriction. Male Long-Evans rats were trained to self-administer heroin for 10 days. Rats were then removed from the training chambers and experienced a 14-day withdrawal period with either unrestricted (sated) or mildly restricted (FDR) access to food. On day 14, rats underwent a 1-hour heroin-seeking test under extinction conditions, during which neural activity in the PVT was either inhibited or increased using pharmacological or chemogenetic approaches. Unexpectedly, inhibition of the PVT did not alter heroin seeking in food-restricted or sated rats, while enhancing neural activity in the PVT-attenuated heroin seeking in food-restricted rats. These results indicate that PVT activity can modulate heroin seeking induced by chronic food restriction.

Timing of Morphine Administration Differentially Alters Paraventricular Thalamic Neuron Activity

The paraventricular thalamic nucleus (PVT) is a brain region involved in regulating arousal, goal-oriented behaviors, and drug seeking, all key factors playing a role in substance use disorder. Given this, we investigated the temporal effects of administering morphine, an opioid with strongly addictive properties, on PVT neuronal function in mice using acute brain slices. Here, we show that morphine administration and electrophysiological recordings that occur during periods of animal inactivity (light cycle) elicit increases in PVT neuronal function during a 24-h abstinence time point. Furthermore, we show that morphine-induced increases in PVT neuronal activity at 24-h abstinence are occluded when morphine administration and recordings are performed during an animals' active state (dark cycle). Based on our electrophysiological results combined with previous findings demonstrating that PVT neuronal activity regulates drug-seeking behaviors, we investigated whether timing morphine administration with periods of vigilance (dark cycle) would decrease drug-seeking behaviors in an animal model of substance use disorder. We found that context-induced morphine-seeking behaviors were intact regardless of the time morphine was administered (e.g., light cycle or dark cycle). Our electrophysiological results suggest that timing morphine with various states of arousal may impact the firing of PVT neurons during abstinence. Although, this may not impact context-induced drug-seeking behaviors.

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

The paraventricular thalamus is a critical mediator of top-down control of cue-motivated behavior in rats

Cues in the environment can elicit complex emotional states, and thereby maladaptive behavior, as a function of their ascribed value. Here we capture individual variation in the propensity to attribute motivational value to reward-cues using the sign-tracker/goal-tracker animal model. Goal-trackers attribute predictive value to reward-cues, and sign-trackers attribute both predictive and incentive value. Using chemogenetics and microdialysis, we show that, in sign-trackers, stimulation of the neuronal pathway from the prelimbic cortex (PrL) to the paraventricular nucleus of the thalamus (PVT) decreases the incentive value of a reward-cue. In contrast, in goal-trackers, inhibition of the PrL-PVT pathway increases both the incentive value and dopamine levels in the nucleus accumbens shell. The PrL-PVT pathway, therefore, exerts top-down control over the dopamine-dependent process of incentive salience attribution. These results highlight PrL-PVT pathway as a potential target for treating psychopathologies associated with the attribution of excessive incentive value to reward-cues, including addiction.

Occasion setting

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Paraventricular Thalamus Projection Neurons Integrate Cortical and Hypothalamic Signals for Cue-Reward Processing

The paraventricular thalamus (PVT) is an interface for brain reward circuits, with input signals arising from structures, such as prefrontal cortex and hypothalamus, that are broadcast to downstream limbic targets. However, the precise synaptic connectivity, activity, and function of PVT circuitry for reward processing are unclear. Here, using in vivo two-photon calcium imaging, we find that PVT neurons projecting to the nucleus accumbens (PVT-NAc) develop inhibitory responses to reward-predictive cues coding for both cue-reward associative information and behavior. The multiplexed activity in PVT-NAc neurons is directed by opposing activity patterns in prefrontal and lateral hypothalamic afferent axons. Further, we find that prefrontal cue encoding may maintain accurate cue-reward processing, as optogenetic disruption of this encoding induced long-lasting effects on downstream PVT-NAc cue responses and behavioral cue discrimination. Together, these data reveal that PVT-NAc neurons act as an interface for reward processing by integrating relevant inputs to accurately inform reward-seeking behavior.

Transient inactivation of the paraventricular nucleus of the thalamus enhances cue-induced reinstatement in goal-trackers, but not sign-trackers

RATIONALE

The paraventricular nucleus of the thalamus (PVT) has been shown to mediate cue-motivated behaviors, such as sign- and goal-tracking, as well as reinstatement of drug-seeking behavior. However, the role of the PVT in mediating individual variation in cue-induced drug-seeking behavior remains unknown.

OBJECTIVES

This study aimed to determine if inactivation of the PVT differentially mediates cue-induced drug-seeking behavior in sign-trackers and goal-trackers.

METHODS

Rats were characterized as sign-trackers (STs) or goal-trackers (GTs) based on their Pavlovian conditioned approach behavior. Rats were then exposed to 15 days of cocaine self-administration, followed by a 2-week forced abstinence period and then extinction training. Rats then underwent tests for cue-induced reinstatement and general locomotor activity, prior to which they received an infusion of either saline (control) or baclofen/muscimol (B/M) to inactivate the PVT.

RESULTS

Relative to control animals of the same phenotype, GTs show a robust increase in cue-induced drug-seeking behavior following PVT inactivation, whereas the behavior of STs was not affected. PVT inactivation did not affect locomotor activity in either phenotype.

CONCLUSION

In GTs, the PVT appears to inhibit the expression of drug-seeking, presumably by attenuating the incentive value of the drug cue. Thus, inactivation of the PVT releases this inhibition in GTs, resulting in an increase in cue-induced drug-seeking behavior. PVT inactivation did not affect cue-induced drug-seeking behavior in STs, suggesting that the role of the PVT in encoding the incentive motivational value of drug cues differs between STs and GTs.

Disconnection of basolateral amygdala and insular cortex disrupts conditioned approach in Pavlovian lever autoshaping

Previously established individual differences in appetitive approach and devaluation sensitivity observed in goal- and sign-trackers may be attributed to differences in the acquisition, modification, or use of associative information in basolateral amygdala (BLA) pathways. Here, we sought to determine the extent to which communication of associative information between BLA and anterior portions of insular cortex (IC) supports ongoing Pavlovian conditioned approach behaviors in sign- and goal-tracking rats, in the absence of manipulations to outcome value. We hypothesized that the BLA mediates goal-, but not sign- tracking approach through interactions with the IC, a brain region involved in supporting flexible behavior. We first trained rats in Pavlovian lever autoshaping to determine their sign- or goal-tracking tendency. During alternating test sessions, we gave unilateral intracranial injections of vehicle or a cocktail of gamma-aminobutyric acid (GABA) receptor agonists, baclofen and muscimol, unilaterally into the BLA and contralaterally or ipsilaterally into the IC prior to reinforced lever autoshaping sessions. Consistent with our hypothesis we found that contralateral inactivation of BLA and IC increased the latency to approach the food cup and decreased the number of food cup contacts in goal-trackers. While contralateral inactivation of BLA and IC did not affect the total number of lever contacts in sign-trackers, this manipulation increased the latency to approach the lever. Ipsilateral inactivation of BLA and IC did not impact approach behaviors in Pavlovian lever autoshaping. These findings, contrary to our hypothesis, suggest that communication between BLA and IC maintains a representation of initially learned appetitive associations that commonly support the initiation of Pavlovian conditioned approach behavior regardless of whether it is directed at the cue or the location of reward delivery.

Boosting of Thalamic D2 Dopaminergic Transmission: A Potential Strategy for Drug-Seeking Attenuation

This commentary focuses on novel findings by Clark et al. (2017) published in eNeuro, which show that dopamine D2 receptors (D2Rs) in the paraventricular nucleus of the thalamus (PVT) are involved in cocaine sensitization. We extend the discussion on how their findings contribute to our understanding of the role of the PVT in drug seeking by providing new insight on the role of the PVT in the regulation of food-seeking and fear responses. We also consider the significance of the neuroanatomical findings reported by Clark et al., that the PVT is reciprocally connected with areas of the brain involved in addiction and discuss the implications associated with the source and type of dopaminergic fibers innervating this area of the thalamus.

Thalamic mast cell activity is associated with sign-tracking behavior in rats

Mast cells are resident immune cells in the thalamus that can degranulate and release hundreds of signaling molecules (i.e., monoamines, growth factors, and cytokines) both basally and in response to environmental stimuli. Interestingly, mast cell numbers in the brain show immense individual variation in both rodents and humans. We used a Pavlovian conditioned approach (PCA) procedure to examine whether mast cells are associated with individual variation in the attribution of incentive-motivational value to reward-related cues. During the PCA procedure, a lever response-independently predicts the delivery of a food pellet into a magazine, and over training sessions three conditioned responses (CRs) develop: sign-tracking (lever-directed CRs), goal-tracking (magazine-directed CRs), and an intermediate response (both CRs). In Experiment 1, we measured thalamic mast cell number/activation using toluidine blue and demonstrated that sign-trackers have increased degranulated (activated) but not granulated (inactive) mast cells. In Experiment 2, we infused the mast cell inhibitor, cromolyn (200µg/rat; i.c.v.), immediately before five daily PCA training sessions and demonstrated that mast cell inhibition selectively impairs the acquisition of sign-tracking behavior. Taken together, these results demonstrate that thalamic mast cells contribute to the attribution of incentive-motivational value to reward-related cues and suggest that mast cell inhibition may be a novel target for addiction treatment.

Long-lasting contribution of dopamine in the nucleus accumbens core, but not dorsal lateral striatum, to sign-tracking

The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core (NAcC). These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined whether the diminishing dopamine signal in the NAcC has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol, or the GABA agonists baclofen and muscimol into the NAcC or the dorsal lateral striatum (DLS). Dopamine antagonism within the NAcC attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the DLS affected sign-tracking behavior. Critically, extended training did not alter these effects. Although extended experience with an incentive stimulus may reduce cue-evoked dopamine in the NAcC, this does not remove the dependence on dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.

Chemogenetic inhibition reveals midline thalamic nuclei and thalamo-accumbens projections mediate cocaine-seeking in rats

Drug addiction is a chronic disease that is shaped by alterations in neuronal function within the cortical-basal ganglia-thalamic circuit. However, our understanding of how this circuit regulates drug-seeking remains incomplete, and relapse rates remain high. The midline thalamic nuclei are an integral component of the cortical-basal ganglia-thalamic circuit and are poised to mediate addiction behaviors, including relapse. It is surprising that little research has examined the contribution of midline thalamic nuclei and their efferent projections in relapse. To address this, we expressed inhibitory, G_i/o -coupled DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) in a subset of the midline thalamic nuclei or in midline thalamic nuclei neurons projecting to either the nucleus accumbens or the amygdala. We examined the effect of transiently decreasing activity of these neuronal populations on cue-induced and cocaine-primed reinstatement of cocaine-seeking. Reducing activity of midline thalamic nuclei neurons attenuated both cue-induced and cocaine-primed reinstatement, but had no effect on cue-induced reinstatement of sucrose-seeking or locomotor activity. Interestingly, attenuating activity of efferent projections from the anterior portion of midline thalamic nuclei to the nucleus accumbens blocked cocaine-primed reinstatement but enhanced cue-induced reinstatement. Decreasing activity of efferent projections from either the posterior midline thalamic nuclei to the nucleus accumbens or the midline thalamic nuclei to amygdala had no effect. These results reveal a novel contribution of subsets of midline thalamic nuclei neurons in drug-seeking behaviors and suggest that modulation of midline thalamic nuclei activity may be a promising therapeutic target for preventing relapse.

Thalamic Regulation of Sucrose Seeking during Unexpected Reward Omission

The paraventricular nucleus of the thalamus (PVT) is thought to regulate behavioral responses under emotionally arousing conditions. Reward-associated cues activate PVT neurons; however, the specific PVT efferents regulating reward seeking remain elusive. Using a cued sucrose-seeking task, we manipulated PVT activity under two emotionally distinct conditions: (1) when reward was available during the cue as expected or (2) when reward was unexpectedly omitted during the cue. Pharmacological inactivation of the anterior PVT (aPVT), but not the posterior PVT, increased sucrose seeking only when reward was omitted. Consistent with this, photoactivation of aPVT neurons abolished sucrose seeking, and the firing of aPVT neurons differentiated reward availability. Photoinhibition of aPVT projections to the nucleus accumbens or to the amygdala increased or decreased, respectively, sucrose seeking only when reward was omitted. Our findings suggest that PVT bidirectionally modulates sucrose seeking under the negative (frustrative) conditions of reward omission.

Adolescent cocaine exposure enhances goal-tracking behavior and impairs hippocampal cell genesis selectively in adult bred low-responder rats

RATIONALE

Environmental challenges during adolescence, such as drug exposure, can cause enduring behavioral and molecular changes that contribute to life-long maladaptive behaviors, including addiction. Selectively bred high-responder (bHR) and low-responder (bLR) rats represent a unique model for assessing the long-term impact of adolescent environmental manipulations, as they inherently differ on a number of addiction-related traits. bHR rats are considered "addiction-prone," whereas bLR rats are "addiction-resilient," at least under baseline conditions. Moreover, relative to bLRs, bHR rats are more likely to attribute incentive motivational value to reward cues, or to "sign-track."

OBJECTIVES

We utilized bHR and bLR rats to determine whether adolescent cocaine exposure can alter their inborn behavioral and neurobiological profiles, with a specific focus on Pavlovian conditioned approach behavior (i.e., sign- vs. goal-tracking) and hippocampal neurogenesis.

METHODS

bHR and bLR rats were administered cocaine (15 mg/kg) or saline for 7 days during adolescence (postnatal day, PND 33-39) and subsequently tested for Pavlovian conditioned approach behavior in adulthood (PND 62-75), wherein an illuminated lever (conditioned stimulus) was followed by the response-independent delivery of a food pellet (unconditioned stimulus). Behaviors directed toward the lever and the food cup were recorded as sign- and goal-tracking, respectively. Hippocampal cell genesis was evaluated on PND 77 by immunohistochemistry.

RESULTS

Adolescent cocaine exposure impaired hippocampal cell genesis (proliferation and survival) and enhanced the inherent propensity to goal-track in adult bLR, but not bHR, rats.

CONCLUSIONS

Adolescent cocaine exposure elicits long-lasting changes in stimulus-reward learning and enduring deficits in hippocampal neurogenesis selectively in adult bLR rats.

Paraventricular Thalamus Balances Danger and Reward

Foraging animals balance the need to seek food and energy against the accompanying dangers of injury and predation. To do so, they rely on learning systems encoding reward and danger. Whereas much is known about these separate learning systems, little is known about how they interact to shape and guide behavior. Here we show a key role for the rat paraventricular nucleus of the thalamus (PVT), a nucleus of the dorsal midline thalamus, in this interaction. First, we show behavioral competition between reward and danger: the opportunity to seek food reward negatively modulates expression of species-typical defensive behavior. Then, using a chemogenetic approach expressing the inhibitory hM4Di designer receptor exclusively activated by a designer drug in PVT neurons, we show that the PVT is central to this behavioral competition. Chemogenetic PVT silencing biases behavior toward either defense or reward depending on the experimental conditions, but does not consistently favor expression of one over the other. This bias could not be attributed to changes in fear memory retrieval, learned safety, or memory interference. Rather, our results demonstrate that the PVT is essential for balancing conflicting behavioral tendencies toward danger and reward, enabling adaptive responding under this basic selection pressure.SIGNIFICANCE STATEMENT Among the most basic survival problems faced by animals is balancing the need to seek food and energy against the accompanying dangers of injury and predation. Although much is known about the brain mechanisms that underpin learning about reward and danger, little is known about how these interact to solve basic survival problems. Here we show competition between defensive (to avoid predatory detection) and approach (to obtain food) behavior. We show that the paraventricular thalamus, a nucleus of the dorsal midline thalamus, is integral to this behavioral competition. The paraventricular thalamus balances the competing behavioral demands of danger and reward, enabling adaptive responding under this selection pressure.

Thalamic cholinergic innervation makes a specific bottom-up contribution to signal detection: Evidence from Parkinson's disease patients with defined cholinergic losses

Successful behavior depends on the ability to detect and respond to relevant cues, especially under challenging conditions. This essential component of attention has been hypothesized to be mediated by multiple neuromodulator systems, but the contributions of individual systems (e.g., cholinergic, dopaminergic) have remained unclear. The present study addresses this issue by leveraging individual variation in regionally-specific cholinergic denervation in Parkinson's disease (PD) patients, while controlling for variation in dopaminergic denervation. Patients whose dopaminergic and cholinergic nerve terminal integrity had been previously assessed using Positron Emission Tomography (Bohnen et al., 2012) and controls were tested in a signal detection task that manipulates attentional-perceptual challenge and has been used extensively in both rodents and humans to investigate the cholinergic system's role in responding to such challenges (Demeter et al., 2008; McGaughy and Sarter, 1995; see Hasselmo and Sarter 2011 for review). In simple correlation analyses, measures of midbrain dopaminergic, and both cortical and thalamic cholinergic innervation all predicted preserved signal detection under challenge. However, regression analyses also controlling for age, disease severity, and other variables showed that the only significant independent neurotransmitter-related predictor over and above the other variables in the model was thalamic cholinergic integrity. Furthermore, thalamic cholinergic innervation exclusively predicted hits, not correct rejections, indicating a specific contribution to bottom-up salience processing. These results help define regionally-specific contributions of cholinergic function to different aspects of attention and behavior.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.

Sleep & metabolism: The multitasking ability of lateral hypothalamic inhibitory circuitries

The anatomical and functional mapping of lateral hypothalamic circuits has been limited by the numerous cell types and complex, yet unclear, connectivity. Recent advances in functional dissection of input-output neurons in the lateral hypothalamus have identified subset of inhibitory cells as crucial modulators of both sleep-wake states and metabolism. Here, we summarize these recent studies and discuss the multi-tasking functions of hypothalamic circuitries in integrating sleep and metabolism in the mammalian brain.

Homeostasis Meets Motivation in the Battle to Control Food Intake

Signals of energy homeostasis interact closely with neural circuits of motivation to control food intake. An emerging hypothesis is that the transition to maladaptive feeding behavior seen in eating disorders or obesity may arise from dysregulation of these interactions. Focusing on key brain regions involved in the control of food intake (ventral tegmental area, striatum, hypothalamus, and thalamus), we describe how activity of specific cell types embedded within these regions can influence distinct components of motivated feeding behavior. We review how signals of energy homeostasis interact with these regions to influence motivated behavioral output and present evidence that experience-dependent neural adaptations in key feeding circuits may represent cellular correlates of impaired food intake control. Future research into mechanisms that restore the balance of control between signals of homeostasis and motivated feeding behavior may inspire new treatment options for eating disorders and obesity.

A food-predictive cue attributed with incentive salience engages subcortical afferents and efferents of the paraventricular nucleus of the thalamus

The paraventricular nucleus of the thalamus (PVT) has been implicated in behavioral responses to reward-associated cues. However, the precise role of the PVT in these behaviors has been difficult to ascertain since Pavlovian-conditioned cues can act as both predictive and incentive stimuli. The "sign-tracker/goal-tracker" rat model has allowed us to further elucidate the role of the PVT in cue-motivated behaviors, identifying this structure as a critical component of the neural circuitry underlying individual variation in the propensity to attribute incentive salience to reward cues. The current study assessed differences in the engagement of specific PVT afferents and efferents in response to presentation of a food-cue that had been attributed with only predictive value or with both predictive and incentive value. The retrograde tracer fluorogold (FG) was injected into the PVT or the nucleus accumbens (NAc) of rats, and cue-induced c-Fos in FG-labeled cells was quantified. Presentation of a predictive stimulus that had been attributed with incentive value elicited c-Fos in PVT afferents from the lateral hypothalamus, medial amygdala (MeA), and the prelimbic cortex (PrL), as well as posterior PVT efferents to the NAc. PVT afferents from the PrL also showed elevated c-Fos levels following presentation of a predictive stimulus alone. Thus, presentation of an incentive stimulus results in engagement of subcortical brain regions; supporting a role for the hypothalamic-thalamic-striatal axis, as well as the MeA, in mediating responses to incentive stimuli; whereas activity in the PrL to PVT pathway appears to play a role in processing the predictive qualities of reward-paired stimuli.

How contexts promote and prevent relapse to drug seeking

The contexts where drugs are self-administered play an important role in regulating persistent drug taking and in relapse to such taking after periods of abstinence. Here, we review the behavioral and brain mechanisms enabling contexts to promote and prevent relapse to drug seeking. We review the key brain structures, their neuropharmacology and their connectivity. We discuss the similarities and differences between the mechanisms for context-induced reinstatement of drug seeking vs. other forms of relapse to drug seeking in animal models and we highlight the numerous deficits in our understanding. We emphasize that current understanding, although significant, defies explanations in terms of models at the level of brain structures and their connectivity. Rather, we show that there is significant functional compartmentalization and segregation within these structures during reinstatement and extinction of drug seeking that parallels their anatomical segregation into circuits and channels. A key challenge is to recognize this complexity, understand how these circuits and channels are organized, as well as understand how different modes of activity of ensembles of neurons within them promote abstinence or relapse to drug seeking.

Lesions of the ventral hippocampus attenuate the acquisition but not expression of sign-tracking behavior in rats

Individual variation in the attribution of motivational salience to reward-related cues is believed to underlie addiction vulnerability. Pavlovian conditioned approach measures individual variation in motivational salience by identifying rats that are attracted to and motivated by reward cues (sign-trackers) or motivationally fixed on the reward itself (goal-trackers). Previously, it has been demonstrated that sign-trackers are more vulnerable to addiction-like behavior. Moreover, sign-trackers release more dopamine in the nucleus accumbens than goal-trackers in response to reward-related cues, and sign- but not goal-tracking behavior is dopamine-dependent. In the present study, we investigated whether the ventral hippocampus, a potent driver of dopaminergic activity in the nucleus accumbens, modulates the acquisition and expression of Pavlovian conditioned approach behavior. In Experiment 1, lesions of the ventral, but not dorsal or total hippocampus, decreased sign-tracking behavior. In Experiment 2, lesions of the ventral hippocampus did not affect the expression of sign- or goal-tracking behaviors nor conditioned reinforcement. In addition, temporary inactivation of the ventral subiculum, the main output pathway of the ventral hippocampus, did not affect the expression of sign- or goal-tracking behaviors. High-pressure liquid chromatography of nucleus accumbens tissue punches revealed that ventral hippocampal lesions decreased levels of homovanillic acid and the homovanillic acid/dopamine ratio (a marker of dopamine release and metabolism) in only sign-trackers, and decreased accumbal norepinephrine levels in both sign- and goal-trackers. These results suggest that the ventral hippocampus is important for the acquisition but not expression of sign-tracking behavior, possibly as a result of altered dopamine and norepinephrine in the nucleus accumbens. © 2016 Wiley Periodicals, Inc.

Neural Activity in the Ventral Pallidum Encodes Variation in the Incentive Value of a Reward Cue

There is considerable individual variation in the extent to which reward cues are attributed with incentive salience. For example, a food-predictive conditioned stimulus (CS; an illuminated lever) becomes attractive, eliciting approach toward it only in some rats ("sign trackers," STs), whereas others ("goal trackers," GTs) approach the food cup during the CS period. The purpose of this study was to determine how individual differences in Pavlovian approach responses are represented in neural firing patterns in the major output structure of the mesolimbic system, the ventral pallidum (VP). Single-unit in vivo electrophysiology was used to record neural activity in the caudal VP during the performance of ST and GT conditioned responses. All rats showed neural responses to both cue onset and reward delivery but, during the CS period, STs showed greater neural activity than GTs both in terms of the percentage of responsive neurons and the magnitude of the change in neural activity. Furthermore, neural activity was positively correlated with the degree of attraction to the cue. Given that the CS had equal predictive value in STs and GTs, we conclude that neural activity in the VP largely reflects the degree to which the CS was attributed with incentive salience.

SIGNIFICANCE STATEMENT

Cues associated with reward can acquire motivational properties (i.e., incentive salience) that cause them to have a powerful influence on desire and motivated behavior. There are individual differences in sensitivity to reward-paired cues, with some individuals attaching greater motivational value to cues than others. Here, we investigated the neural activity associated with these individual differences in incentive salience. We found that cue-evoked neural firing in the ventral pallidum (VP) reflected the strength of incentive motivation, with the greatest neural responses occurring in individuals that demonstrated the strongest attraction to the cue. This suggests that the VP plays an important role in the process by which cues gain control over motivation and behavior.

Examining the role of dopamine D2 and D3 receptors in Pavlovian conditioned approach behaviors

Elucidating the neurobiological mechanisms underlying individual differences in the extent to which reward cues acquire the ability to act as incentive stimuli may contribute to the development of successful treatments for addiction and related disorders. We used the sign-tracker/goal-tracker animal model to examine the role of dopamine D2 and D3 receptors in the propensity to attribute incentive salience to reward cues. Following Pavlovian training, wherein a discrete lever-cue was paired with food reward, rats were classified as sign- or goal-trackers based on the resultant conditioned response. We examined the effects of D2/D3 agonists, 7-OH-DPAT (0.01-0.32mg/kg) or pramipexole (0.032-0.32mg/kg), the D2/D3 antagonist raclopride (0.1mg/kg), and the selective D3 antagonist, SB-277011A (6 or 24mg/kg), on the expression of sign- and goal-tracking conditioned responses. The lever-cue acquired predictive value and elicited a conditioned response for sign- and goal-trackers, but only for sign-trackers did it also acquire incentive value. Following administration of either 7-OH-DPAT, pramipexole, or raclopride, the performance of the previously acquired conditioned response was attenuated for both sign- and goal-trackers. For sign-trackers, the D2/D3 agonist, 7-OH-DPAT, also attenuated the conditioned reinforcing properties of the lever-cue. The selective D3 antagonist did not affect either conditioned response. Alterations in D2/D3 receptor signaling, but not D3 signaling alone, transiently attenuate a previously acquired Pavlovian conditioned response, regardless of whether the response is a result of incentive motivational processes. These findings suggest activity at the dopamine D2 receptor is critical for a reward cue to maintain either its incentive or predictive qualities.