Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues

Stimulant medications in children with ADHD normalize the structure of brain regions associated with attention and reward

Children with ADHD show abnormal brain function and structure. Neuroimaging studies found that stimulant medications may improve brain structural abnormalities in children with ADHD. However, prior studies on this topic were conducted with relatively small sample sizes and wide age ranges and showed inconsistent results. In this cross-sectional study, we employed latent class analysis and linear mixed-effects models to estimate the impact of stimulant medications using demographic, clinical measures, and brain structure in a large and diverse sample of children aged 9-11 from the Adolescent Brain and Cognitive Development Study. We studied 273 children with low ADHD symptoms and received stimulant medication (Stim Low-ADHD), 1002 children with high ADHD symptoms and received no medications (No-Med ADHD), and 5378 typically developing controls (TDC). After controlling for the covariates, compared to Stim Low-ADHD and TDC, No-Med ADHD showed lower cortical thickness in the right insula (INS, d = 0.340, PFDR = 0.003) and subcortical volume in the left nucleus accumbens (NAc, d = 0.371, PFDR = 0.003), indicating that high ADHD symptoms were associated with structural abnormalities in these brain regions. In addition, there was no difference in brain structural measures between Stim Low-ADHD and TDC children, suggesting that the stimulant effects improved both ADHD symptoms and ADHD-associated brain structural abnormalities. These findings together suggested that children with ADHD appear to have structural abnormalities in brain regions associated with saliency and reward processing, and treatment with stimulant medications not only improve the ADHD symptoms but also normalized these brain structural abnormalities.

A novel perspective on the role of nucleus accumbens neurons in encoding associative learning

The nucleus accumbens (NAc) has been considered a key brain region for encoding reward/aversion and cue-outcome associations. These processes are encoded by medium spiny neurons that express either dopamine receptor D1 (D1-MSNs) or D2 (D2-MSNs). Despite the well-established role of NAc neurons in encoding reward/aversion, the underlying processing by D1-/D2-MSNs remains largely unknown. Recent electrophysiological, optogenetic and calcium imaging studies provided insight on the complex role of D1- and D2-MSNs in these behaviours and helped to clarify their involvement in associative learning. Here, we critically discuss findings supporting an intricate and complementary role of NAc D1- and D2-MSNs in associative learning, emphasizing the need for additional studies in order to fully understand the role of these neurons in behaviour.

Corticostriatal Suppression of Appetitive Pavlovian Conditioned Responding

The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.

Rapid fluctuations in brain oxygenation during glucose-drinking behavior in trained rats

Proper inflow of oxygen into brain tissue is essential for maintaining normal neural functions. Although oxygen levels in the brain's extracellular space depend upon a balance between its delivery from arterial blood and its metabolic consumption, the use of high-speed electrochemical detection revealed rapid increases in brain oxygen levels elicited by various salient sensory stimuli. These stimuli also increase intrabrain heat production, an index of metabolic neural activation, but these changes are slower and more prolonged than changes in oxygen levels. Therefore, under physiological conditions, the oxygen inflow into brain tissue exceeds its loss due to consumption, thus preventing any metabolic deficit. Here, we used oxygen sensors coupled with amperometry to examine the pattern of real-time oxygen fluctuations in the nucleus accumbens during glucose-drinking behavior in trained rats. Following the exposure to a glucose-containing cup, oxygen levels rapidly increased, peaked when the rat initiated drinking, and relatively decreased during consumption. Similar oxygen changes but more episodic drinking occurred when Stevia, a calorie-free sweet substance, was substituted for glucose. When water was substituted for glucose, rats tested the water but refused to consume all of it. Although the basic pattern of oxygen changes during this water test was similar to that with glucose drinking, the increases were larger. Finally, oxygen increases were significantly larger when rats were exposed to concealed glucose and made multiple unsuccessful attempts to obtain and consume it. Based on these data, we discuss the mechanisms underlying behavior-related brain oxygen fluctuations and their functional significance.NEW & NOTEWORTHY Oxygen sensors coupled with high-speed amperometry were used to examine brain oxygen fluctuations during glucose-drinking behavior in trained rats. Oxygen levels rapidly increased following presentation of a glucose-contained cup, peaking at the initiation of glucose drinking, and relatively decreasing during drinking. Oxygen increases were larger when rats were exposed to concealed glucose and made multiple attempts to obtain it. We discuss the mechanisms underlying behavior-related brain oxygen fluctuations and their functional significance.

Circuit Investigation of Social Interaction and Substance Use Disorder Using Miniscopes

Substance use disorder (SUD) is comorbid with devastating health issues, social withdrawal, and isolation. Successful clinical treatments for SUD have used social interventions. Neurons can encode drug cues, and drug cues can trigger relapse. It is important to study how the activity in circuits and embedded cell types that encode drug cues develop in SUD. Exploring shared neurobiology between social interaction (SI) and SUD may explain why humans with access to social treatments still experience relapse. However, circuitry remains poorly characterized due to technical challenges in studying the complicated nature of SI and SUD. To understand the neural correlates of SI and SUD, it is important to: (1) identify cell types and circuits associated with SI and SUD, (2) record and manipulate neural activity encoding drug and social rewards over time, (3) monitor unrestrained animal behavior that allows reliable drug self-administration (SA) and SI. Miniaturized fluorescence microscopes (miniscopes) are ideally suited to meet these requirements. They can be used with gradient index (GRIN) lenses to image from deep brain structures implicated in SUD. Miniscopes can be combined with genetically encoded reporters to extract cell-type specific information. In this mini-review, we explore how miniscopes can be leveraged to uncover neural components of SI and SUD and advance potential therapeutic interventions.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABA_A + GABA_B receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Vigor Encoding in the Ventral Pallidum

The ventral pallidum (VP) is the major downstream nucleus of the nucleus accumbens (NAc). Both VP and NAc neurons are responsive to reward-predictive stimuli and are critical drivers of reward-seeking behavior. The cue-evoked excitations and inhibitions of NAc neurons predict the vigor (latency and speed) of the cue-elicited locomotor approach response and encode the animal’s proximity to the movement target, but do not encode more specific movement features such as turn direction. VP neurons also encode certain vigor parameters, but it remains unknown whether they also encode more specific movement features, and whether such encoding could account for vigor encoding. To address these questions, we recorded the firing of neurons in the VP of freely moving male rats performing a discriminative stimulus (DS) task. Similar to NAc neurons, VP neurons’ cue-evoked excitations were correlated with the speed of the upcoming approach movement and the animal’s proximity to the movement target at cue onset. Unlike NAc neurons, VP neurons’ firing reflected the efficiency of the approach movement path but not the latency to initiate locomotion. VP cue-evoked excitations are unlikely to be directly influenced by NAc cue-evoked excitations because unilateral treatment of the NAc with a dopamine D1 receptor antagonist, a manipulation that reduces NAc neurons’ cue-evoked excitations, did not alter ipsilateral VP cue-evoked excitations. These observations suggest that the two structures receive simultaneous activation by inputs conveying similar but not identical information, and work in parallel to set the vigor of the behavioral response.

The tubular striatum and nucleus accumbens distinctly represent reward-taking and reward-seeking

The ventral striatum regulates motivated behaviors that are essential for survival. The ventral striatum contains both the nucleus accumbens (NAc), which is well established to contribute to motivated behavior, and the adjacent tubular striatum (TuS), which is poorly understood in this context. We reasoned that these ventral striatal subregions may be uniquely specialized in their neural representation of goal-directed behavior. To test this, we simultaneously examined TuS and NAc single-unit activity as male mice engaged in a sucrose self-administration task, which included extinction and cue-induced reinstatement sessions. Although background levels of activity were comparable between regions, more TuS neurons were recruited upon reward-taking, and among recruited neurons, TuS neurons displayed greater changes in their firing during reward-taking and extinction than those in the NAc. Conversely, NAc neurons displayed greater changes in their firing during cue-reinstated reward-seeking. Interestingly, at least in the context of this behavioral paradigm, TuS neural activity predicted reward-seeking, whereas NAc activity did not. Together, by directly comparing their dynamics in several behavioral contexts, this work reveals that the NAc and TuS ventral striatum subregions distinctly represent reward-taking and reward-seeking.NEW & NOTEWORTHY The ventral striatum, considered the reward circuitry "hub," is composed of two regions: the NAc, which is well established for its role in reward processing, and the TuS, which has been largely excluded from such studies. This study provides a first step in directly contextualizing the TuS's activity in relation to that in the NAc and, by doing so, establishes a critical framework for future research seeking to better understand the brain basis for drug addiction.

Hippocampal Input to the Nucleus Accumbens Shell Enhances Food Palatability

BACKGROUND

Insight into the neural basis of hedonic processing has come from studies of food palatability in rodents. Pharmacological manipulations of the nucleus accumbens shell (NAcSh) have repeatedly been demonstrated to increase hedonic taste reactivity, yet the contribution of specific NAcSh circuit components is unknown.

METHODS

Bidirectional optogenetic manipulations were targeted to the principal NAcSh projection neurons and afferent pathways in mice during free feeding assays. Number of licks per bout of consumption was used as a measure of food palatability as it was confirmed to track sucrose concentration and subjective flavor preferences.

RESULTS

Photoinhibition of NAcSh neurons, whether general or cell-type specific, was found to alter consumption without affecting its hedonic impact. Among the principal excitatory afferent pathways, we showed that ventral hippocampal (vHipp) input alone enhances palatability upon low-frequency photostimulation time-locked to consumption. This enhancement in palatability was independent of opioid signaling and not recapitulated by NAcSh or dopamine neuron photostimulation. We further demonstrated that vHipp input photostimulation is sufficient to condition a flavor preference, while its inhibition impedes sucrose-driven flavor preference conditioning.

CONCLUSIONS

These results demonstrate a novel contribution of vHipp-NAcSh pathway activity to palatability that may relate to its innervation of a particular region or neuronal ensemble in the NAcSh. These findings are consistent with the evidence that vHipp-NAcSh activity is relevant to the pathophysiology of anhedonia and depression as well as the increasing appreciation of hippocampal involvement in people's food pleasantness ratings, hunger, and weight.

The Nucleus Accumbens Core Is Necessary for Responding to Incentive But Not Instructive Stimuli

An abundant literature has highlighted the importance of the nucleus accumbens core (NAcC) in behavioral tasks dependent on external stimuli. Yet, some studies have also reported the absence of involvement of the NAcC in stimuli processing. We aimed at comparing, in male rats, the underlying neuronal determinants of incentive and instructive stimuli in the same task. We developed a variant of a GO/NOGO task that reveals important differences in these two types of stimuli. The incentive stimulus invites the rat to engage in the task sequence. Once the rat has decided to initiate a trial, it remains engaged in the task until the end of the trial. This task revealed the differential contribution of the NAcC to responding to different types of stimuli: responding to the incentive stimulus depended on NAcC AMPA/NMDA and dopamine D1 receptors, but the retrieval of the response associated with the instructive stimuli (lever pressing on GO, withholding on NOGO) did not. Our electrophysiological study showed that more NAcC neurons responded more strongly to the incentive than the instructive stimuli. Furthermore, when animals did not respond to the incentive stimulus, the induced excitation was suppressed for most projection neurons, whereas interneurons were strongly activated at a latency preceding that found in projection neurons. This work provides insight on the underlying neuronal processes explaining the preferential implication of the NAcC in deciding whether and when to engage in reward-seeking rather than to decide which action to perform.SIGNIFICANCE STATEMENT The nucleus accumbens core (NAcC) is essential to process information carried by reward-predicting stimuli. Yet, stimuli have distinct properties: incentive stimuli orient the attention toward reward-seeking, whereas instructive stimuli inform about the action to perform. Our study shows that, in male rats, NAcC perturbation with glutamate or dopamine antagonists impeded responses to the incentive but not to the instructive stimulus. NAcC neuronal recordings revealed a stronger representation of incentive than instructive stimuli. Furthermore, we found that interneurons are recruited when rats fail to respond to incentive stimuli. This work provides insight on the underlying neuronal processes explaining the preferential implication of the NAcC in deciding whether and when to engage in reward-seeking rather than to decide which action to perform.

NMDA receptor-dependent plasticity in the nucleus accumbens connects reward-predictive cues to approach responses

Learning associations between environmental cues and rewards is a fundamental adaptive function. Via such learning, reward-predictive cues come to activate approach to locations where reward is available. The nucleus accumbens (NAc) is essential for cued approach behavior in trained subjects, and cue-evoked excitations in NAc neurons are critical for the expression of this behavior. Excitatory synapses within the NAc undergo synaptic plasticity that presumably contributes to cued approach acquisition, but a direct link between synaptic plasticity within the NAc and the development of cue-evoked neural activity during learning has not been established. Here we show that, with repeated cue-reward pairings, cue-evoked excitations in the NAc emerge and grow in the trials prior to the detectable expression of cued approach behavior. We demonstrate that the growth of these signals requires NMDA receptor-dependent plasticity within the NAc, revealing a neural mechanism by which the NAc participates in learning of conditioned reward-seeking behaviors.

Conditioned stimuli elicit phasic changes in nucleus accumbens (NAc) firing that invigorate approach responses to predicted rewards. Here the authors show that NAc neurons acquire cue-evoked responses during learning as a result of excitatory plasticity within the NAc.

Altered gating of Kv1.4 in the nucleus accumbens suppresses motivation for reward

Deficient motivation contributes to numerous psychiatric disorders, including withdrawal from drug use, depression, schizophrenia, and others. Nucleus accumbens (NAc) has been implicated in motivated behavior, but it remains unclear whether motivational drive is linked to discrete neurobiological mechanisms within the NAc. To examine this, we profiled cohorts of Sprague-Dawley rats in a test of motivation to consume sucrose. We found that substantial variability in willingness to exert effort for reward was not associated with operant responding under low-effort conditions or stress levels. Instead, effort-based motivation was mirrored by a divergent NAc shell transcriptome with differential regulation at potassium and dopamine signaling genes. Functionally, motivation was inversely related to excitability of NAc principal neurons. Furthermore, neuronal and behavioral outputs associated with low motivation were linked to faster inactivation of a voltage-gated potassium channel, Kv1.4. These results raise the prospect of targeting Kv1.4 gating in psychiatric conditions associated with motivational dysfunction.

Central GLP-1 receptors: Novel molecular targets for cocaine use disorder

Given that the search for effective pharmacotherapies for cocaine use disorder has, thus far, been fruitless, there remains a critical need for conceptually innovative approaches toward identifying new medications to treat this disease. A better understanding of the neurocircuits and neurobiological mechanisms underlying cocaine taking and seeking may identify molecular substrates that could serve as targets for novel pharmacotherapies to treat cocaine use disorder. Recent preclinical evidence suggests that glucagon-like peptide-1 (GLP-1) receptor agonists could be re-purposed to treat cocaine craving-induced relapse. This review endeavors to comprehensively summarize the current literature investigating the efficacy of GLP-1 receptor agonists in reducing the rewarding and reinforcing effects of cocaine in animal models of cocaine use disorder. The role of central endogenous GLP-1 circuits in voluntary cocaine taking and seeking is also discussed. Behavioral, neurochemical, electrophysiological and molecular biology studies indicate that central GLP-1 receptor activation functionally modulates the mesolimbic reward system and decreases addiction-like phenotypes in rodents. Overall, an emerging preclinical literature provides compelling evidence to advance GLP-1 receptor agonists into clinical trials testing the efficacy of these medications in preventing cocaine craving-induced relapse.

Sign Tracking and Goal Tracking Are Characterized by Distinct Patterns of Nucleus Accumbens Activity

During Pavlovian conditioning, if a cue (e.g., lever extension) predicts reward delivery in a different location (e.g., a food magazine), some individuals will come to approach and interact with the cue, a behavior known as sign tracking (ST), and others will approach the site of reward, a behavior known as goal tracking (GT). In rats, the acquisition of ST versus GT behavior is associated with distinct profiles of dopamine release in the nucleus accumbens (NAc), but it is unknown whether it is associated with different patterns of accumbens neural activity. Therefore, we recorded from individual neurons in the NAc core during the acquisition, maintenance, and extinction of ST and GT behavior. Even though NAc dopamine is specifically important for the acquisition and expression of ST, we found that cue-evoked excitatory responses encode the vigor of both ST and GT behavior. In contrast, among sign trackers only, there was a prominent decrease in reward-related activity over the course of training, which may reflect the decreasing reward prediction error encoded by phasic dopamine. Finally, both behavior and cue-evoked activity were relatively resistant to extinction in sign trackers, as compared with goal trackers, although a subset of neurons in both groups retained their cue-evoked responses. Overall, the results point to the convergence of multiple forms of reward learning in the NAc.

Activation of glucagon-like peptide-1 receptors in the nucleus accumbens attenuates cocaine seeking in rats

Recent evidence indicates that activation of glucagon-like peptide-1 (GLP-1) receptors reduces cocaine-mediated behaviors and cocaine-evoked dopamine release in the nucleus accumbens (NAc). However, no studies have examined the role of NAc GLP-1 receptors in the reinstatement of cocaine-seeking behavior, an animal model of relapse. Here, we show that systemic infusion of a behaviorally relevant dose of the GLP-1 receptor agonist exendin-4 penetrated the brain and localized with neurons and astrocytes in the NAc. Administration of exendin-4 directly into the NAc core and shell subregions significantly attenuated cocaine priming-induced reinstatement of drug-seeking behavior. These effects were not due to deficits in operant responding or suppression of locomotor activity as intra-accumbal exendin-4 administration had no effect on sucrose-seeking behavior. To determine the effects of GLP-1 receptor activation on neuronal excitability, exendin-4 was bath applied to ex vivo NAc slices from cocaine-experienced and saline-experienced rats following extinction of cocaine-taking behavior. Exendin-4 increased the frequency of action potential firing of NAc core and shell medium spiny neurons in cocaine-experienced rats while no effect was observed in saline controls. In contrast, exendin-4 did not affect the frequency or amplitude of spontaneous excitatory postsynaptic currents or alter the paired-pulse ratios of evoked excitatory postsynaptic currents. These effects were not associated with altered expression of GLP-1 receptors in the NAc following cocaine self-administration. Taken together, these findings indicate that increased activation of GLP-1 receptors in the NAc during cocaine abstinence increases intrinsic, but not synaptic, excitability of medium spiny neurons and is sufficient to reduce cocaine-seeking behavior.

Synchronization in the prefrontal-striatal circuit tracks behavioural choice in a go-no-go task in rats

Rodent striatum is involved in sensory-motor transformations and reward-related learning. Lesion studies suggest dorsolateral striatum, dorsomedial striatum and nucleus accumbens underlie stimulus-response transformations, goal-directed behaviour and reward expectation, respectively. In addition, prefrontal inputs likely control these functions. Here, we set out to study how reward-driven behaviour is mediated by the coordinated activity of these structures in the intact brain. We implemented a discrimination task requiring rats to either respond or suppress responding on a lever after the presentation of auditory cues in order to obtain rewards. Single unit activity in the striatal subregions and pre-limbic cortex was recorded using tetrode arrays. Striatal units showed strong onset responses to auditory cues paired with an opportunity to obtain reward. Cue-onset responses in both striatum and cortex were significantly modulated by previous errors suggesting a role of these structures in maintaining appropriate motivation or action selection during ongoing behaviour. Furthermore, failure to respond to the reward-paired tones was associated with higher pre-trial coherence among striatal subregions and between cortex and striatum suggesting a task-negative corticostriatal network whose activity may be suppressed to enable processing of reward-predictive cues. Our findings highlight that coordinated activity in a distributed network including both pre-limbic cortex and multiple striatal regions underlies reward-related decisions.

Endogenous opioids in the nucleus accumbens promote approach to high-fat food in the absence of caloric need

When relatively sated, people (and rodents) are still easily tempted to consume calorie-dense foods, particularly those containing fat and sugar. Consumption of such foods while calorically replete likely contributes to obesity. The nucleus accumbens (NAc) opioid system has long been viewed as a critical substrate for this behavior, mainly via contributions to the neural control of consumption and palatability. Here, we test the hypothesis that endogenous NAc opioids also promote appetitive approach to calorie-dense food in states of relatively high satiety. We simultaneously recorded NAc neuronal firing and infused a µ-opioid receptor antagonist into the NAc while rats performed a cued approach task in which appetitive and consummatory phases were well separated. The results reveal elements of a neural mechanism by which NAc opioids promote approach to high-fat food despite the lack of caloric need, demonstrating a potential means by which the brain is biased towards overconsumption of palatable food.

Imagine that you have just finished Thanksgiving dinner. You are completely full, having eaten large portions of turkey, green beans and mashed potatoes. Yet, despite feeling full, you still find yourself tempted by a slice of pie for dessert, maybe even with ice cream on top. Why is it that in such a state of fullness, you desire a slice of pie but not, say, another helping of green beans?

The answer may lie in the way the brain responds to food when we do not need any more calories. At such times, your brain drives you to continue eating only those foods that are tasty and calorie-dense. This preference for fatty and sweet foods may have been helpful in the past when we could not be certain where our next meal would come from. But in modern times, the widespread availability of food makes this preference potentially harmful. For example, the drive to consume fatty and sweet foods even when not hungry may now be contributing to soaring levels of obesity and type 2 diabetes.

What exactly is happening inside the brain to produce this behavior? Previous work has implicated a structure called the nucleus accumbens. When scientists activated proteins called mu opioid receptors within the nucleus accumbens, animals ate more of the foods that they find tasty. However, they were not as interested in eating more of the foods that they are more ambivalent towards.

Caref and Nicola now show that preventing opioid binding makes rats unwilling to respond to a cue to obtain cream, an appetizing, high-fat reward. It also abolishes the brain activity that drives the rats to respond the cue. Crucially, however, this effect only occurs in rats that are not hungry.

It therefore appears that opioid binding in the nucleus accumbens drives animals to approach and eat high-fat foods, but only when they do not need the calories. That is, it increases fat consumption in animals that are not actually hungry. A drug that selectively blocks mu opioid receptors in the nucleus accumbens may reduce this behavior. Such a drug could potentially help to prevent obesity and the health problems associated with it.

Coordinated Ramping of Dorsal Striatal Pathways preceding Food Approach and Consumption

The striatum controls food-related actions and consumption and is linked to feeding disorders, including obesity and anorexia nervosa. Two populations of neurons project from the striatum: direct pathway medium spiny neurons and indirect pathway medium spiny neurons. The selective contribution of direct pathway medium spiny neurons and indirect pathway medium spiny neurons to food-related actions and consumption remains unknown. Here, we used in vivo electrophysiology and fiber photometry in mice (of both sexes) to record both spiking activity and pathway-specific calcium activity of dorsal striatal neurons during approach to and consumption of food pellets. While electrophysiology revealed complex task-related dynamics across neurons, population calcium was enhanced during approach and inhibited during consumption in both pathways. We also observed ramping changes in activity that preceded both pellet-directed actions and spontaneous movements. These signals were heterogeneous in the spiking units, with neurons exhibiting either increasing or decreasing ramps. In contrast, the population calcium signals were homogeneous, with both pathways having increasing ramps of activity for several seconds before actions were initiated. An analysis comparing population firing rates to population calcium signals also revealed stronger ramping dynamics in the calcium signals than in the spiking data. In a second experiment, we trained the mice to perform an action sequence to evaluate when the ramping signals terminated. We found that the ramping signals terminated at the beginning of the action sequence, suggesting they may reflect upcoming actions and not preconsumption activity. Plasticity of such mechanisms may underlie disorders that alter action selection, such as drug addiction or obesity.SIGNIFICANCE STATEMENT Alterations in striatal function have been linked to pathological consumption in disorders, such as obesity and drug addiction. We recorded spiking and population calcium activity from the dorsal striatum during ad libitum feeding and an operant task that resulted in mice obtaining food pellets. Dorsal striatal neurons exhibited long ramps in activity that preceded actions by several seconds, and may reflect upcoming actions. Understanding how the striatum controls the preparation and generation of actions may lead to improved therapies for disorders, such as drug addiction or obesity.

Optogenetic activation of amygdala projections to nucleus accumbens can arrest conditioned and unconditioned alcohol consummatory behavior

Following a Pavlovian pairing procedure, alcohol-paired cues come to elicit behavioral responses that lead to alcohol consumption. Here we used an optogenetic approach to activate basolateral amygdala (BLA) axonal terminals targeting the shell of nucleus accumbens (AcbSh) and investigated a possible influence over cue-conditioned alcohol seeking and alcohol drinking, based on the demonstrated roles of these areas in behavioral responding to Pavlovian cues and in feeding behavior. Rats were trained to anticipate alcohol or sucrose following the onset of a discrete conditioned stimulus (CS). Channelrhodopsin-mediated activation of the BLA-to-AcbSh pathway concurrent with each CS disrupted cued alcohol seeking. Activation of the same pathway caused rapid cessation of alcohol drinking from a sipper tube. Neither effect was accompanied by an overall change in locomotion. Finally, the suppressive effect of photoactivation on cued-triggered seeking was also evidenced in animals trained with sucrose. Together these findings suggest that photoactivation of BLA terminals in the AcbSh can override the conditioned motivational properties of reward-predictive cues as well as unconditioned consummatory responses necessary for alcohol drinking. The findings provide evidence for a limbic-striatal influence over motivated behavior for orally consumed rewards, including alcohol.

Bi-directional cannabinoid signalling in the basolateral amygdala controls rewarding and aversive emotional processing via functional regulation of the nucleus accumbens

Functional connections between the basolateral amygdala (BLA) and nucleus accumbens (NAc) are involved critically in opiate-reward processing. In the BLA, inhibitory GABAergic substrates are inhibited by cannabinoid CB1 receptor (CB1R) activation and can modulate BLA projections to various limbic regions, including the NAc. However, the potential role of CB1R transmission in the regulation of opiate-related memory formation via the BLA → NAc circuit is not understood. Using an unbiased conditioned place preference paradigm in rats, we examined the effects of intra-BLA CB1R modulation by either direct pharmacological activation or blockade of CB1R transmission. We report that intra-BLA CB1R activation switches normally rewarding effects of morphine into strongly aversive effects. In contrast, CB1R blockade strongly potentiates normally subreward threshold effects of morphine. Next, using targeted microinfusions of an NMDA receptor antagonist to either the core or shell (NASh) subdivisions of the NAc, we found that selective blockade of NMDA transmission in the NA shell, but not core, prevented both intra-BLA CB1 blockade-mediated opiate reward potentiation and CB1 activation-mediated aversion effects. Finally, using multi-unit, in vivo electrophysiological recordings in the NASh, we report that the ability of intra-BLA CB1R modulation to control opiate reward salience and motivational valence is associated with distinct reward or aversion neuronal activity patterns and bi-directional regulation of intra-NASh fast-spiking interneurons versus medium spiny neurons. These findings identify a unique mechanism whereby bi-directional BLA CB1R transmission can regulate opiate-related motivational processing and control affective states through functional modulation of mesolimbic neuronal activity.

Limbic-motor integration by neural excitations and inhibitions in the nucleus accumbens

The nucleus accumbens (NAc) has often been described as a "limbic-motor interface," implying that the NAc integrates the value of expected rewards with the motor planning required to obtain them. However, there is little direct evidence that the signaling of individual NAc neurons combines information about predicted reward and behavioral response. We report that cue-evoked neural responses in the NAc form a likely physiological substrate for its limbic-motor integration function. Across task contexts, individual NAc neurons in behaving rats robustly encode the reward-predictive qualities of a cue, as well as the probability of behavioral response to the cue, as coexisting components of the neural signal. In addition, cue-evoked activity encodes spatial and locomotor aspects of the behavioral response, including proximity to a reward-associated target and the latency and speed of approach to the target. Notably, there are important limits to the ability of NAc neurons to integrate motivational information into behavior: in particular, updating of predicted reward value appears to occur on a relatively long timescale, since NAc neurons fail to discriminate between cues with reward associations that change frequently. Overall, these findings suggest that NAc cue-evoked signals, including inhibition of firing (as noted here for the first time), provide a mechanism for linking reward prediction and other motivationally relevant factors, such as spatial proximity, to the probability and vigor of a reward-seeking behavioral response.NEW & NOTEWORTHY The nucleus accumbens (NAc) is thought to link expected rewards and action planning, but evidence for this idea remains sparse. We show that, across contexts, both excitatory and inhibitory cue-evoked activity in the NAc jointly encode reward prediction and probability of behavioral responding to the cue, as well as spatial and locomotor properties of the response. Interestingly, although spatial information in the NAc is updated quickly, fine-grained updating of reward value occurs over a longer timescale.

Reward magnitude tracking by neural populations in ventral striatum

Evaluation of the magnitudes of intrinsically rewarding stimuli is essential for assigning value and guiding behavior. By combining parametric manipulation of a primary reward, medial forebrain bundle (MFB) microstimulation, with functional magnetic imaging (fMRI) in rodents, we delineated a broad network of structures activated by behaviorally characterized levels of rewarding stimulation. Correlation of psychometric behavioral measurements with fMRI response magnitudes revealed regions whose activity corresponded closely to the subjective magnitude of rewards. The largest and most reliable focus of reward magnitude tracking was observed in the shell region of the nucleus accumbens (NAc). Although the nonlinear nature of neurovascular coupling complicates interpretation of fMRI findings in precise neurophysiological terms, reward magnitude tracking was not observed in vascular compartments and could not be explained by saturation of region-specific hemodynamic responses. In addition, local pharmacological inactivation of NAc changed the profile of animals' responses to rewards of different magnitudes without altering mean reward response rates, further supporting a hypothesis that neural population activity in this region contributes to assessment of reward magnitudes.

Amygdala-ventral striatum circuit activation decreases long-term fear

In humans, activation of the ventral striatum, a region associated with reward processing, is associated with the extinction of fear, a goal in the treatment of fear-related disorders. This evidence suggests that extinction of aversive memories engages reward-related circuits, but a causal relationship between activity in a reward circuit and fear extinction has not been demonstrated. Here, we identify a basolateral amygdala (BLA)-ventral striatum (NAc) pathway that is activated by extinction training. Enhanced recruitment of this circuit during extinction learning, either by pairing reward with fear extinction training or by optogenetic stimulation of this circuit during fear extinction, reduces the return of fear that normally follows extinction training. Our findings thus identify a specific BLA-NAc reward circuit that can regulate the persistence of fear extinction and point toward a potential therapeutic target for disorders in which the return of fear following extinction therapy is an obstacle to treatment.

Reappraising striatal D1- and D2-neurons in reward and aversion

The striatum has been involved in complex behaviors such as motor control, learning, decision-making, reward and aversion. The striatum is mainly composed of medium spiny neurons (MSNs), typically divided into those expressing dopamine receptor D1, forming the so-called direct pathway, and those expressing D2 receptor (indirect pathway). For decades it has been proposed that these two populations exhibit opposing control over motor output, and recently, the same dichotomy has been proposed for valenced behaviors. Whereas D1-MSNs mediate reinforcement and reward, D2-MSNs have been associated with punishment and aversion. In this review we will discuss pharmacological, genetic and optogenetic studies that indicate that there is still controversy to what concerns the role of striatal D1- and D2-MSNs in this type of behaviors, highlighting the need to reconsider the early view that they mediate solely opposing aspects of valenced behaviour.

Acute ethanol effects on neural encoding of reward size and delay in the nucleus accumbens

Acute ethanol administration can cause impulsivity, resulting in increased preference for immediately available rewards over delayed but more valuable alternatives. The manner in which reward size and delay are represented in neural firing is not fully understood, and very little is known about ethanol effects on this encoding. To address this issue, we used in vivo electrophysiology to characterize neural firing in the core of the nucleus accumbens (NAcc) in rats responding for rewards that varied in size or delay after vehicle or ethanol administration. The NAcc is a central element in the circuit that governs decision-making and importantly, promotes choice of delayed rewards. We found that NAcc firing in response to reward-predictive cues encoded anticipated reward value after vehicle administration, but ethanol administration disrupted this encoding, resulting in a loss of discrimination between immediate and delayed rewards in cue-evoked neural responses. In addition, NAcc firing occurring at the time of the operant response (lever pressing) was inversely correlated with behavioral response latency, such that increased firing rates were associated with decreased latencies to lever press. Ethanol administration selectively attenuated this lever press-evoked firing when delayed but not immediate rewards were expected. These effects on neural firing were accompanied by increased behavioral latencies to respond for delayed rewards. Our results suggest that ethanol effects on NAcc cue- and lever press-evoked encoding may contribute to ethanol-induced impulsivity.

Ventral pallidal coding of a learned taste aversion

The hedonic value of a sweet food reward, or how much a taste is 'liked', has been suggested to be encoded by neuronal firing in the posterior ventral pallidum (VP). Hedonic impact can be altered by psychological manipulations, such as taste aversion conditioning, which can make an initially pleasant sweet taste become perceived as disgusting. Pairing nausea-inducing LiCl injection as a Pavlovian unconditioned stimulus (UCS) with a novel taste that is normally palatable as the predictive conditioned stimulus (CS+) suffices to induce a learned taste aversion that changes orofacial 'liking' responses to that sweet taste (e.g., lateral tongue protrusions) to 'disgust' reactions (e.g., gapes) in rats. We used two different sweet tastes of similar initial palatability (a sucrose solution and a polycose/saccharin solution, CS ± assignment was counterbalanced across groups) to produce a discriminative conditioned aversion. Only one of those tastes (arbitrarily assigned and designated as CS+) was associatively paired with LiCl injections as UCS to form a conditioned aversion. The other taste (CS-) was paired with mere vehicle injections to remain relatively palatable as a control sweet taste. We recorded the neural activity in VP in response to each taste, before and after aversion training. We found that the safe and positively hedonic taste always elicited excitatory increases in firing rate of VP neurons. By contrast, aversion learning reversed the VP response to the 'disgusting' CS+ taste from initial excitation into a conditioned decrease in neuronal firing rate after training. Such neuronal coding of hedonic impact by VP circuitry may contribute both to normal pleasure and disgust, and disruptions of VP coding could result in affective disorders, addictions and eating disorders.

Behavior-associated and post-consumption glucose entry into the nucleus accumbens extracellular space during glucose free-drinking in trained rats

Glucose is the primary energetic substrate for the metabolic activity of brain cells and its proper delivery from the arterial blood is essential for neural activity and normal brain functions. Glucose is also a unique natural reinforcer, supporting glucose-drinking behavior without food or water deprivation. While it is known that glucose enters brain tissue via gradient-dependent facilitated diffusion, it remains unclear how glucose levels are changed during natural behavior and whether the direct central action of ingested glucose can be involved in regulating glucose-drinking behavior. Here, we used glucose biosensors with high-speed amperometry to examine the pattern of phasic and tonic changes in extracellular glucose in the nucleus accumbens (NAc) during unrestricted glucose-drinking in well-trained rats. We found that the drinking behavior is highly cyclic and is associated with relatively large and prolonged increases in extracellular glucose levels. These increases had two distinct components: a highly phasic but relatively small behavior-related rise and a larger tonic elevation that results from the arrival of consumed glucose into the brain's extracellular space. The large post-ingestion increases in NAc glucose began minutes after the cessation of drinking and were consistently associated with periods of non-drinking, suggesting that the central action of ingested glucose could inhibit drinking behavior by inducing a pause in activity between repeated drinking bouts. Finally, the difference in NAc glucose responses found between active, behavior-mediated and passive glucose delivery via an intra-gastric catheter confirms that motivated behavior is also associated with metabolic glucose use by brain cells.

Intermittent-access binge consumption of sweet high-fat liquid does not require opioid or dopamine receptors in the nucleus accumbens

Binge eating disorders are characterized by episodes of intense consumption of high-calorie food. In recently developed animal models of binge eating, rats given intermittent access to such food escalate their consumption over time. Consumption of calorie-dense food is associated with neurochemical changes in the nucleus accumbens, including dopamine release and alterations in dopamine and opioid receptor expression. Therefore, we hypothesized that binge-like consumption on intermittent access schedules is dependent on opioid and/or dopamine neurotransmission in the accumbens. To test this hypothesis, we asked whether injection of dopamine and opioid receptor antagonists into the core and shell of the accumbens reduced consumption of a sweet high-fat liquid in rats with and without a history of intermittent binge access to the liquid. Although injection of a μ opioid agonist increased consumption, none of the antagonists (including μ opioid, δ opioid, κ opioid, D1 dopamine and D2 dopamine receptor antagonists, as well as the broad-spectrum opioid receptor antagonist naltrexone) reduced consumption, and this was the case whether or not the animals had a prior history of intermittent access. These results suggest that consumption of sweet, fatty food does not require opioid or dopamine receptor activation in the accumbens even under intermittent access conditions that resemble human binge episodes.

Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry

The study of the neural bases of eating behavior, hunger, and reward has consistently implicated the lateral hypothalamus (LH) and its interactions with mesocorticolimbic circuitry, such as mesolimbic dopamine projections to nucleus accumbens (NAc) and ventral pallidum (VP), in controlling motivation to eat. The NAc and VP play special roles in mediating the hedonic impact (“liking”) and motivational incentive salience (“wanting”) of food rewards, and their interactions with LH help permit regulatory hunger/satiety modulation of food motivation and reward. Here, we review some progress that has been made regarding this circuitry and its functions: the identification of localized anatomical hedonic hotspots within NAc and VP for enhancing hedonic impact; interactions of NAc/VP hedonic hotspots with specific LH signals such as orexin; an anterior-posterior gradient of sites in NAc shell for producing intense appetitive eating vs. intense fearful reactions; and anatomically distributed appetitive functions of dopamine and mu opioid signals in NAc shell and related structures. Such findings help improve our understanding of NAc, VP, and LH interactions in mediating affective and motivation functions, including “liking” and “wanting” for food rewards.

Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.

Dopamine invigorates reward seeking by promoting cue-evoked excitation in the nucleus accumbens

Approach to reward is a fundamental adaptive behavior, disruption of which is a core symptom of addiction and depression. Nucleus accumbens (NAc) dopamine is required for reward-predictive cues to activate vigorous reward seeking, but the underlying neural mechanism is unknown. Reward-predictive cues elicit both dopamine release in the NAc and excitations and inhibitions in NAc neurons. However, a direct link has not been established between dopamine receptor activation, NAc cue-evoked neuronal activity, and reward-seeking behavior. Here, we use a novel microelectrode array that enables simultaneous recording of neuronal firing and local dopamine receptor antagonist injection. We demonstrate that, in the NAc of rats performing a discriminative stimulus task for sucrose reward, blockade of either D1 or D2 receptors selectively attenuates excitation, but not inhibition, evoked by reward-predictive cues. Furthermore, we establish that this dopamine-dependent signal is necessary for reward-seeking behavior. These results demonstrate a neural mechanism by which NAc dopamine invigorates environmentally cued reward-seeking behavior.

Fluctuations in nucleus accumbens extracellular glutamate and glucose during motivated glucose-drinking behavior: dissecting the neurochemistry of reward

While motivated behavior involves multiple neurochemical systems, few studies have focused on the role of glutamate, the brain's excitatory neurotransmitter, and glucose, the energetic substrate of neural activity in reward-related neural processes. Here, we used high-speed amperometry with enzyme-based substrate-sensitive and control, enzyme-free biosensors to examine second-scale fluctuations in the extracellular levels of these substances in the nucleus accumbens shell during glucose-drinking behavior in trained rats. Glutamate rose rapidly after the presentation of a glucose-containing cup and before the initiation of drinking (reward seeking), decreased more slowly to levels below baseline during consumption (sensory reward), and returned to baseline when the ingested glucose reached the brain (metabolic reward). When water was substituted for glucose, glutamate rapidly increased with cup presentation and in contrast to glucose drinking, increased above baseline after rats tasted the water and refused to drink further. Therefore, extracellular glutamate show distinct changes associated with key events of motivated drinking behavior and opposite dynamics during sensory and metabolic components of reward. In contrast to glutamate, glucose increased at each stimulus and behavioral event, showing a sustained elevation during the entire behavior and a robust post-ingestion rise that correlated with the gradual return of glutamate levels to their baseline. By comparing active drinking with passive intra-gastric glucose delivery, we revealed that fluctuations in extracellular glucose are highly dynamic, reflecting a balance between rapid delivery because of neural activity, intense metabolism, and the influence of ingested glucose reaching the brain.

Orbitofrontal cortical neurons encode expectation-driven initiation of reward-seeking

Adaptive execution and inhibition of behavior are guided by the activity of neuronal populations across multiple frontal cortical areas. The rodent medial prefrontal cortex has been well studied with respect to these behaviors, influencing behavioral execution/inhibition based on context. Other frontal regions, in particular the orbitofrontal cortex (OFC), are critical in directing behavior to obtain rewards, but the relationship between OFC neuronal activity and response execution or inhibition has been poorly characterized. In particular, little is known about OFC with respect to extinction learning, an important example of context-guided response inhibition. Here, we recorded the activity of OFC neurons while rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task followed by multiple days of extinction of the DS. OFC neuronal activity was maximally responsive (1) to reward-predicting stimuli (RS) that triggered a lever press (i.e., lever-response initiation) and (2) during reward-well approach in pursuit of sucrose (i.e., well-response initiation). RS presentation that was not followed by a lever press or RS presentation during extinction produced weak activation, as did nonrewarded stimulus (NS) presentation regardless of response (press or withhold) or session (DS-sucrose or extinction). Activity related to nonrewarded well entry was minor, and activity was significantly inhibited during reward consumption. Finally, OFC neuronal activity switched selectivity to track rewarded behaviors when the RS/NS contingencies were reversed. Thus, rather than signaling variables related to extinction or response inhibition, activity in OFC was strongest at the initiation of multiple components of reward-seeking behavior, most prominently when valid reward-predicting cues drove these behaviors.

Homeostatic regulation of memory systems and adaptive decisions

While it is clear that many brain areas process mnemonic information, understanding how their interactions result in continuously adaptive behaviors has been a challenge. A homeostatic-regulated prediction model of memory is presented that considers the existence of a single memory system that is based on a multilevel coordinated and integrated network (from cells to neural systems) that determines the extent to which events and outcomes occur as predicted. The “multiple memory systems of the brain” have in common output that signals errors in the prediction of events and/or their outcomes, although these signals differ in terms of what the error signal represents (e.g., hippocampus: context prediction errors vs. midbrain/striatum: reward prediction errors). The prefrontal cortex likely plays a pivotal role in the coordination of prediction analysis within and across prediction brain areas. By virtue of its widespread control and influence, and intrinsic working memory mechanisms. Thus, the prefrontal cortex supports the flexible processing needed to generate adaptive behaviors and predict future outcomes. It is proposed that prefrontal cortex continually and automatically produces adaptive responses according to homeostatic regulatory principles: prefrontal cortex may serve as a controller that is intrinsically driven to maintain in prediction areas an experience-dependent firing rate set point that ensures adaptive temporally and spatially resolved neural responses to future prediction errors. This same drive by prefrontal cortex may also restore set point firing rates after deviations (i.e. prediction errors) are detected. In this way, prefrontal cortex contributes to reducing uncertainty in prediction systems. An emergent outcome of this homeostatic view may be the flexible and adaptive control that prefrontal cortex is known to implement (i.e. working memory) in the most challenging of situations. Compromise to any of the prediction circuits should result in rigid and suboptimal decision making and memory as seen in addiction and neurological disease. © 2013 The Authors. Hippocampus Published by Wiley Periodicals, Inc.

Nucleus accumbens neurons track behavioral preferences and reward outcomes during risky decision making

BACKGROUND

To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.

METHODS

Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.

RESULTS

At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.

CONCLUSIONS

Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.

Competitor suppresses neuronal representation of food reward in the nucleus accumbens/medial striatum of domestic chicks

To investigate the role of social contexts in controlling the neuronal representation of food reward, we recorded single neuron activity in the medial striatum/nucleus accumbens of domestic chicks and examined whether activities differed between two blocks with different contexts. Chicks were trained in an operant task to associate light-emitting diode color cues with three trial types that differed in the type of food reward: no reward (S-), a small reward/short-delay option (SS), and a large reward/long-delay alternative (LL). Amount and duration of reward were set such that both of SS and LL were chosen roughly equally. Neurons showing distinct cue-period activity in rewarding trials (SS and LL) were identified during an isolation block, and activity patterns were compared with those recorded from the same neuron during a subsequent pseudo-competition block in which another chick was allowed to forage in the same area, but was separated by a transparent window. In some neurons, cue-period activity was lower in the pseudo-competition block, and the difference was not ascribed to the number of repeated trials. Comparison at neuronal population level revealed statistically significant suppression in the pseudo-competition block in both SS and LL trials, suggesting that perceived competition generally suppressed the representation of cue-associated food reward. The delay- and reward-period activities, however, did not significantly different between blocks. These results demonstrate that visual perception of a competitive forager per se weakens the neuronal representation of predicted food reward. Possible functional links to impulse control are discussed.

Differential contributions of infralimbic prefrontal cortex and nucleus accumbens during reward-based learning and extinction

Using environmental cues for the prediction of future events is essential for survival. Such cue-outcome associations are thought to depend on mesolimbic circuitry involving the nucleus accumbens (NAc) and prefrontal cortex (PFC). Several studies have identified roles for both NAc and PFC in the expression of stable goal-directed behaviors, but much remains unknown about their roles during learning of such behaviors. To further address this question, we used in vivo oxygen amperometry, a proxy for blood oxygen level-dependent (BOLD) signal measurement in human functional magnetic resonance imaging, in rats performing a cued lever-pressing task requiring discrimination between a rewarded and nonrewarded cue. Simultaneous oxygen recordings were obtained from infralimbic PFC (IFC) and NAc throughout both acquisition and extinction of this task. Activation of NAc was specifically observed following rewarded cue onset during the entire acquisition phase and also during the first days of extinction. In contrast, IFC activated only during the earliest periods of acquisition and extinction, more specifically to the nonrewarded cue. Thus, in vivo oxygen amperometry permits a novel, stable form of longitudinal analysis of brain activity in behaving animals, allowing dissociation of the roles of different brain regions over time during learning of reward-driven instrumental action. The present results offer a unique temporal perspective on how NAc may promote actions directed toward anticipated positive outcome throughout learning, while IFC might suppress actions that no longer result in reward, but only during critical periods of learning.

New insights into the specificity and plasticity of reward and aversion encoding in the mesolimbic system

The mesocorticolimbic system, consisting, at its core, of the ventral tegmental area, the nucleus accumbens, and medial prefrontal cortex, has historically been investigated primarily for its role in positively motivated behaviors and reinforcement learning, and its dysfunction in addiction, schizophrenia, depression, and other mood disorders. Recently, researchers have undertaken a more comprehensive analysis of this system, including its role in not only reward but also punishment, as well as in both positive and negative reinforcement. This focus has been facilitated by new anatomical, physiological, and behavioral approaches to delineate functional circuits underlying behaviors and to determine how this system flexibly encodes and responds to positive and negative states and events, beyond simple associative learning. This review is a summary of topics covered in a mini-symposium at the 2013 Society for Neuroscience annual meeting.

Differential roles of ventral pallidum subregions during cocaine self-administration behaviors

The ventral pallidum (VP) is necessary for drug-seeking behavior. VP contains ventromedial (VPvm) and dorsolateral (VPdl) subregions, which receive projections from the nucleus accumbens shell and core, respectively. To date no study has investigated the behavioral functions of the VPdl and VPvm subregions. To address this issue, we investigated whether changes in firing rate (FR) differed between VP subregions during four events: approaching toward, responding on, or retreating away from a cocaine-reinforced operandum and a cocaine-associated cue. Baseline FR and waveform characteristics did not differ between subregions. VPdl neurons exhibited a greater change in FR compared with VPvm neurons during approaches toward, as well as responses on, the cocaine-reinforced operandum. VPdl neurons were more likely to exhibit a similar change in FR (direction and magnitude) during approach and response than VPvm neurons. In contrast, VPvm firing patterns were heterogeneous, changing FRs during approach or response alone, or both. VP neurons did not discriminate cued behaviors from uncued behaviors. No differences were found between subregions during the retreat, and no VP neurons exhibited patterned changes in FR in response to the cocaine-associated cue. The stronger, sustained FR changes of VPdl neurons during approach and response may implicate VPdl in the processing of drug-seeking and drug-taking behavior via projections to subthalamic nucleus and substantia nigra pars reticulata. In contrast, the heterogeneous firing patterns of VPvm neurons may implicate VPvm in facilitating mesocortical structures with information related to the sequence of behaviors predicting cocaine self-infusions via projections to mediodorsal thalamus and ventral tegmental area.

Effect of CB1 receptor blockade on food-reinforced responding and associated nucleus accumbens neuronal activity in rats

Studies have shown that disruption of cannabinoid receptor signaling reduces operant responses for rewards; yet it is unknown whether changes in neural activity at dopamine terminal regions such as the nucleus accumbens (NAc) underlie these behavioral effects. To study the neural correlates that accompany the disruption of endogenous cannabinoid (eCB) signaling in a food-motivated task, we recorded the neural activity and local field potentials (LFPs) from the NAc. A within-subject design was used for recordings as rats engaged in lever-pressing behavior for sucrose chocolate-flavored pellets delivered during responding in a progressive ratio (PR) schedule of reinforcement. Rats were food restricted to 85 ± 5% of their free body weight and trained under a PR until a stable breakpoint was observed (12 sessions ± 3). Once performance was stable, recordings were made under baseline, vehicle, and following administration of the cannabinoid inverse agonist rimonabant (150 μg/kg, i.v). NAc neurons encoded reward-predictive cues as well as food reward delivery. Rimonabant administration robustly reduced breakpoints in all rats tested, as previously reported. We found that this reduction is accompanied by a profound attenuation in the strength and coordination of specific event-related spiking activity. Moreover, rimonabant decreased LFP gamma power at 80 Hz (high gamma) at reward delivery and gamma power at 50 Hz (low gamma) at cue onset. Together the present results indicate that the eCB system sculpts neural activity patterns that accompany PR performance and reward consumption.

Effects of muscimol in the nucleus accumbens shell on salt appetite and sucrose intake: a microstructural study with a comment on the sensitization of salt intake

Previous work has demonstrated that injections of the γ-aminobutyric acidA (GABAA) agonist muscimol into the nucleus accumbens shell (AcbSh) induce pronounced increases in the intake of solid foods and sucrose solutions, but do not potentiate water intake. In order to clarify the range of situations in which inactivation of the AcbSh potentiates ingestive behavior, we examined the effects of muscimol injections on the intake of a 3% NaCl solution in sodium-depleted animals. Although sodium-depleted subjects avidly consumed this solution, muscimol injections had no effect either on the volume consumed or on a variety of microstructural licking parameters. In contrast, in these same animals, muscimol injections significantly increased licking of a 10% sucrose solution. These results suggest that inactivation of the AcbSh may selectively increase the intake of foods, but not that of other homeostatically relevant ingestates. Examination of microstructural parameters suggested that the effect of muscimol on sucrose intake was not mediated by alterations in the "palatability" of the sucrose solution. We also observed that sodium-depleted subjects displayed significantly larger salt intakes after their second experience with sodium depletion than their first, and microstructural analysis in this case indicated that this sensitization effect was produced in a manner consistent with the animals showing increased "hedonic responsiveness" to the salt solution.

Transitions between sleep and feeding states in rat ventral striatum neurons

Neurons in the nucleus accumbens (NAc) have been shown to participate in several behavioral states, including feeding and sleep. However, it is not known if the same neuron participates in both states and, if so, how similar are the responses. In addition, since the NAc contains several cell types, it is not known if each type participates in the transitions associated with feeding and sleep. Such knowledge is important for understanding the interaction between two different neural networks. For these reasons we recorded ensembles of NAc neurons while individual rats volitionally transitioned between the following states: awake and goal directed, feeding, quiet-awake, and sleeping. We found that during both feeding and sleep states, the same neurons could increase their activity (be activated) or decrease their activity (be inactivated) by feeding and/or during sleep, thus indicating that the vast majority of NAc neurons integrate sleep and feeding signals arising from spatially distinct neural networks. In contrast, a smaller population was modulated by only one of the states. For the majority of neurons in either state, we found that when one population was excited, the other was inhibited, suggesting that they act as a local circuit. Classification of neurons into putative interneurons [fast-spiking interneurons (pFSI) and choline acetyltransferase interneurons (pChAT)] and projection medium spiny neurons (pMSN) showed that all three types are modulated by transitions to and from feeding and sleep states. These results show, for the first time, that in the NAc, those putative inhibitory interneurons respond similarly to pMSN projection neurons and demonstrate interactions between NAc networks involved in sleep and feeding.

Striatal mechanisms underlying movement, reinforcement, and punishment

Direct and indirect pathway striatal neurons are known to exert opposing control over motor output. In this review, we discuss a hypothetical extension of this framework, in which direct pathway striatal neurons also mediate reinforcement and reward, and indirect pathway neurons mediate punishment and aversion.

Activation of nucleus accumbens NMDA receptors differentially affects appetitive or aversive taste learning and memory

Taste memory depends on motivational and post-ingestional consequences; thus, it can be aversive (e.g., conditioned taste aversion, CTA) if a novel, palatable taste is paired with visceral malaise, or it can be appetitive if no intoxication appears after novel taste consumption, and a taste preference is developed.The nucleus accumbens (NAc) plays a role in hedonic reactivity to taste stimuli, and recent findings suggest that reward and aversion are differentially encoded by the activity of NAc neurons. The present study examined whether the requirement for N-methyl-D-aspartate (NMDA) receptors in the NAc core during rewarding appetitive taste learning differs from that during aversive taste conditioning, as well as during retrieval of appetitive vs. aversive taste memory, using the taste preference or CTA model, respectively. Bilateral infusions of NMDA (1 μg/μl, 0.5 μl) into the NAc core were performed before acquisition or before retrieval of taste preference or CTA. Activation of NMDA receptors before taste preference training or CTA acquisition did not alter memory formation. Furthermore, NMDA injections before aversive taste retrieval had no effect on taste memory; however, 24 h later, CTA extinction was significantly delayed. Also, NMDA injections, made before familiar appetitive memory retrieval, interrupted the development of taste preference and produced a preference delay 24 h later. These results suggest that memory formation for a novel taste produces neurochemical changes in the NAc core that have differential requirements for NMDA receptors during retrieval of appetitive or aversive memory.

Optogenetic investigation of neural circuits underlying brain disease in animal models

Optogenetic tools have provided a new way to establish causal relationships between brain activity and behaviour in health and disease. Although no animal model captures human disease precisely, behaviours that recapitulate disease symptoms may be elicited and modulated by optogenetic methods, including behaviours that are relevant to anxiety, fear, depression, addiction, autism and parkinsonism. The rapid proliferation of optogenetic reagents together with the swift advancement of strategies for implementation has created new opportunities for causal and precise dissection of the circuits underlying brain diseases in animal models.

Heterogeneous processing of amygdala and hippocampal inputs in the rostral and caudal subregions of the nucleus accumbens

The nucleus accumbens (NAc) receives converging input from a number of structures proposed to play a role in affective disorders. In particular, the basolateral amygdala (BLA) provides an affective input that overlaps with context-related information derived from the ventral subiculum of the hippocampus (vSub). We examined how stimulation of the BLA is modulated by, and in turn affects, vSub inputs to this region. In-vivo extracellular recordings were performed in the NAc of anaesthetized rats. The effect of high-frequency (theta-burst) stimulation (HFS) of the BLA on both BLA and vSub-evoked responses was tested. In addition, the involvement of dopamine D2 receptors in BLA-induced plasticity in the NAc was examined by pre-treatment with sulpiride (5 mg/kg i.v.). Finally, tetrodotoxin (TTX) was used to inactivate the vSub and the effect on BLA-evoked responses was assessed. We found that HFS of the BLA causes hetereogeneous patterns of plasticity, depression and potentiation, respectively, in the rostral and caudal subregions of the NAc that are disrupted following D2 receptor antagonist treatment. In addition, inactivating the vSub with TTX attenuates the ability of the BLA to drive spike firing in the NAc. Thus, the vSub is required for activation of the NAc by the BLA. These data support a model whereby the amygdala can coordinate reward-seeking and fear-related behaviours via its differential regulation of NAc output. In addition, the hippocampus inappropriately dominates information processing within this circuit, potentially contributing to the overwhelming focus on internal emotional states in disorders such as depression.