Ventral pallidal representation of pavlovian cues and reward: population and rate codes

Ventral Pallidum and Amygdala Cooperate to Restrain Reward Approach under Threat

Foraging decisions involve assessing potential risks and prioritizing food sources, which can be challenging when confronted with changing and conflicting circumstances. A crucial aspect of this decision-making process is the ability to actively overcome defensive reactions to threats and focus on achieving specific goals. The ventral pallidum (VP) and basolateral amygdala (BLA) are two brain regions that play key roles in regulating behavior motivated by either rewards or threats. However, it is unclear whether these regions are necessary in decision-making processes involving competing motivational drives during conflict. Our aim was to investigate the requirements of the VP and BLA for foraging choices in conflicts involving overcoming defensive responses. Here, we used a novel foraging task and pharmacological techniques to inactivate either the VP or BLA or to disconnect these brain regions before conducting a conflict test in male rats. Our findings showed that BLA is necessary for making risky choices during conflicts, whereas VP is necessary for invigorating the drive to obtain food, regardless of the presence of conflict. Importantly, our research revealed that the connection between VP and BLA is critical in controlling risky food-seeking choices during conflict situations. This study provides a new perspective on the collaborative function of VP and BLA in driving behavior, aimed at achieving goals in the face of dangers.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Pavlovian cue-evoked alcohol seeking is disrupted by ventral pallidal inhibition

Cues paired with alcohol can be potent drivers of craving, alcohol-seeking, consumption, and relapse. While the ventral pallidum is implicated in appetitive and consummatory responses across several reward classes and types of behaviors, its role in behavioral responses to Pavlovian alcohol cues has not previously been established. Here, we tested the impact of optogenetic inhibition of ventral pallidum on Pavlovian-conditioned alcohol-seeking in male Long Evans rats. Rats underwent Pavlovian conditioning with an auditory cue predicting alcohol delivery to a reward port and a control cue predicting no alcohol delivery, until they consistently entered the reward port more during the alcohol cue than the control cue. We then tested the within-session effects of optogenetic inhibition during 50% of cue presentations. We found that optogenetic inhibition of ventral pallidum during the alcohol cue reduced port entry likelihood and time spent in the port, and increased port entry latency. Overall, these results suggest that normal ventral pallidum activity is necessary for Pavlovian alcohol-seeking.

Pallidal circuits drive addiction behavior

Understanding the neural mechanisms that control addiction processes, including drug-seeking and relapse, is key to finding new targets for substance use disorder (SUD) pharmacotherapies and circuit-based therapies. Addictive drugs alter activity in distinct neural circuits that can lead to SUD symptoms, including compulsive drug craving and taking. This includes the pallidum, a region in the basal ganglia that acts as an integrator of associative, sensorimotor, and limbic information to shape motor responses, promote reward-learning, and regulate habit formation. Here, we review key findings that demonstrate the sub-regional and circuit-specific functions of the pallidum that drive addiction-related behaviors in rodents. We also highlight newly discovered mechanisms within distinct cell types and circuits of the pallidum that drive drug-seeking. Overall, this review serves to emphasize the importance of the pallidum in addiction processes and underscore the need for studying circuit-specific mechanisms in SUD research.

Ventral Pallidal GABAergic Neuron Calcium Activity Encodes Cue-Driven Reward Seeking and Persists in the Absence of Reward Delivery

Reward-seeking behavior is often initiated by environmental cues that signal reward availability. This is a necessary behavioral response; however, cue reactivity and reward-seeking behavior can become maladaptive. To better understand how cue-elicited reward seeking becomes maladaptive, it is important to understand the neural circuits involved in assigning appetitive value to rewarding cues and actions. Ventral pallidum (VP) neurons are known to contribute to cue-elicited reward-seeking behavior and have heterogeneous responses in a discriminative stimulus (DS) task. The VP neuronal subtypes and output pathways that encode distinct aspects of the DS task remain unknown. Here, we used an intersectional viral approach with fiber photometry to record bulk calcium activity in VP GABAergic (VP GABA) neurons in male and female rats as they learned and performed the DS task. We found that VP GABA neurons are excited by reward-predictive cues but not neutral cues and that this response develops over time. We also found that this cue-evoked response predicts reward-seeking behavior and that inhibiting this VP GABA activity during cue presentation decreases reward-seeking behavior. Additionally, we found increased VP GABA calcium activity at the time of expected reward delivery, which occurred even on trials when reward was omitted. Together, these findings suggest that VP GABA neurons encode reward expectation, and calcium activity in these neurons encodes the vigor of cue-elicited reward seeking.SIGNIFICANCE STATEMENT VP circuitry is a major driver of cue-evoked behaviors. Previous work has found that VP neurons have heterogenous responses and contributions to reward-seeking behavior. This functional heterogeneity is because of differences of neurochemical subtypes and projections of VP neurons. Understanding the heterogenous responses among and within VP neuronal cell types is a necessary step in further understanding how cue-evoked behavior becomes maladaptive. Our work explores the canonical GABAergic VP neuron and how the calcium activity of these cells encodes components of cue-evoked reward seeking, including the vigor and persistence of reward seeking.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate (Glut) neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the cell-type-specific mechanisms by which VP projections to VTA drive behavior. Here, we found that both VP GABA and Glut neurons were activated during approach to reward or delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine (DA) and glutamate neurons. Remarkably, this cell-type-specific recruitment was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP Glut neurons activated VTA GABA, as well as DA and Glut neurons, despite driving aversion. However, VP Glut neurons evoked DA in reward-associated ventromedial nucleus accumbens (NAc), but reduced DA in aversion-associated dorsomedial NAc. These findings show how heterogeneous VP cell types can engage VTA cell types to shape approach and avoidance behaviors.

Ventral pallidal regulation of motivated behaviors and reinforcement

The interconnected nuclei of the ventral basal ganglia have long been identified as key regulators of motivated behavior, and dysfunction of this circuit is strongly implicated in mood and substance use disorders. The ventral pallidum (VP) is a central node of the ventral basal ganglia, and recent studies have revealed complex VP cellular heterogeneity and cell- and circuit-specific regulation of reward, aversion, motivation, and drug-seeking behaviors. Although the VP is canonically considered a relay and output structure for this circuit, emerging data indicate that the VP is a central hub in an extensive network for reward processing and the regulation of motivation that extends beyond classically defined basal ganglia borders. VP neurons respond temporally faster and show more advanced reward coding and prediction error processing than neurons in the upstream nucleus accumbens, and regulate the activity of the ventral mesencephalon dopamine system. This review will summarize recent findings in the literature and provide an update on the complex cellular heterogeneity and cell- and circuit-specific regulation of motivated behaviors and reinforcement by the VP with a specific focus on mood and substance use disorders. In addition, we will discuss mechanisms by which stress and drug exposure alter the functioning of the VP and produce susceptibility to neuropsychiatric disorders. Lastly, we will outline unanswered questions and identify future directions for studies necessary to further clarify the central role of VP neurons in the regulation of motivated behaviors. Significance: Research in the last decade has revealed a complex cell- and circuit-specific role for the VP in reward processing and the regulation of motivated behaviors. Novel insights obtained using cell- and circuit-specific interrogation strategies have led to a major shift in our understanding of this region. Here, we provide a comprehensive review of the VP in which we integrate novel findings with the existing literature and highlight the emerging role of the VP as a linchpin of the neural systems that regulate motivation, reward, and aversion. In addition, we discuss the dysfunction of the VP in animal models of neuropsychiatric disorders.

Neural circuits provide insights into reward and aversion

Maladaptive changes in the neural circuits associated with reward and aversion result in some common symptoms, such as drug addiction, anxiety, and depression. Historically, the study of these circuits has been hampered by technical limitations. In recent years, however, much progress has been made in understanding the neural mechanisms of reward and aversion owing to the development of technologies such as cell type-specific electrophysiology, neuronal tracing, and behavioral manipulation based on optogenetics. The aim of this paper is to summarize the latest findings on the mechanisms of the neural circuits associated with reward and aversion in a review of previous studies with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), and basal forebrain (BF). These findings may inform efforts to prevent and treat mental illnesses associated with dysfunctions of the brain's reward and aversion system.

Neural Vulnerability Factors That Predict Future Weight Gain

PURPOSE OF REVIEW

The current article discusses five neural vulnerability theories for weight gain and reviews evidence from prospective studies using imaging and behavioral measures reflecting neural function, as well as randomized experiments with humans and animals that are consistent or inconsistent with these theories.

RECENT FINDINGS

Recent prospective imaging studies examining predictors of weight gain and response to obesity treatment, and repeated-measures imaging studies before and after weight gain and loss have advanced knowledge of etiologic processes and neural plasticity resulting from weight change. Overall, data provide strong support for the incentive sensitization theory of obesity and moderate support for the reward surfeit theory, inhibitory control deficit theory, and dynamic vulnerability model of obesity, which attempted to synthesize the former theories into a single etiologic model. Data provide little support for the reward deficit theory. Important directions for future studies are delineated.

Ventral pallidum cellular and pathway specificity in drug seeking

The ventral pallidum (VP) is central to the reinforcing effects across a variety of drugs and relapse to drug seeking. Emerging studies from animal models of reinstatement reveal a complex neurobiology of the VP that contributes to different aspects of relapse to drug seeking. This review builds on classical understanding of the VP as part of the final common pathway of relapse but also discusses the properties of the VP as an independent structure. These include VP neural anatomical subregions, cellular heterogeneity, circuitry, neurotransmitters and peptides. Collectively, this review provides a current understanding of the VP from molecular to circuit level architecture that contributes to both the appetitive and aversive symptoms of drug addiction. We show the complex neurobiology of the VP in drug seeking, emphasizing its critical role in addiction, and review strategic approaches that target the VP to reduce relapse rates.

Mapping excessive "disgust" in the brain: Ventral pallidum inactivation recruits distributed circuitry to make sweetness "disgusting"

The ventral pallidum (VP) is an important structure in processing reward. The VP may be the only brain structure where localized lesions in rats replace normal facial "liking" expressions to sweetness with excessive "disgust" reactions, such as gapes and chin rubs, that are normally reserved for unpalatable tastes. The posterior half of the VP (pVP) contains a hedonic hot spot where opioid or related neurochemical stimulations can amplify positive "liking" reactions to sweet taste. This is the same site where lesions or pharmacological inactivations replace positive hedonic reactions to sucrose with intense negative "disgust." In the present study, we aimed to identify brain networks recruited by pVP inactivation to generate excessive "disgust," using neuronal Fos expression as a marker of neurobiological activation. Microinjections in pVP of inhibitory GABA_A/B agonists (muscimol and baclofen) caused rats to exhibit excessive "disgust" reactions to sucrose. Excessive "disgust" was accompanied by recruitment of neural Fos activation in several subcortical structures, including the posterior medial shell of nucleus accumbens (which also contains another GABAergic "disgust"-inducing "hedonic cold spot"), the bed nucleus of stria terminalis, lateral habenula, hypothalamus, and midbrain ventral tegmentum. Fos suppression was found in cortical limbic regions, including previously identified hedonic hot spots in the anteromedial orbitofrontal cortex and posterior insula. Finally, in addition to inducing excessive "disgust," pVP inactivation abolished motivational "wanting" to eat palatable food, reduced positive social interactions, and reordered sensorimotor relations. Our findings identify potential "disgust" generators in the brain that are released into excitation by pVP inhibition and may serve as targets for future research.

Differential recruitment of ventral pallidal e-types by behaviorally salient stimuli during Pavlovian conditioning

The ventral pallidum (VP) is interfacing striatopallidal and limbic circuits, conveying information about salience and valence crucial to adjusting behavior. However, how VP neuron populations with distinct electrophysiological properties (e-types) represent these variables is not fully understood. Therefore, we trained mice on probabilistic Pavlovian conditioning while recording the activity of VP neurons. Many VP neurons responded to punishment (54%), reward (48%), and outcome-predicting auditory stimuli (32%), increasingly differentiating distinct outcome probabilities through learning. We identified e-types based on the presence of bursts or fast rhythmic discharges and found that non-bursting, non-rhythmic neurons were the most sensitive to reward and punishment. Some neurons exhibited distinct responses of their bursts and single spikes, suggesting a multiplexed coding scheme in the VP. Finally, we demonstrate synchronously firing neuron assemblies, particularly responsive to reinforcing stimuli. These results suggest that electrophysiologically defined e-types of the VP differentially participate in transmitting reinforcement signals during learning.

An Exploration of the Role of Sugar-Sweetened Beverage in Promoting Obesity and Health Disparities

PURPOSE OF REVIEW

The mechanistic role of sugar-sweetened beverage (SSB) in the etiology of obesity is undetermined. We address whether, compared to other foods, does consumption of SSB (1) automatically lead to failure to compensate for the energy it contains? (2) fail to elicit homeostatic hormone responses? (3) promote hedonic eating through activation of the brain's reward pathways? We followed the evidence to address: (4) Would restriction of targeted marketing of SSB and other unhealthy foods to vulnerable populations decrease their prevalence of obesity?

RECENT FINDINGS

The data are lacking to demonstrate that SSB consumption promotes body weight gain compared with isocaloric consumption of other beverages or foods and that this is linked to its failure to elicit adequate homeostatic hormone responses. However, more recent data have linked body weight gain to reward activation in the brain to palatable food cues and suggest that sweet tastes and SSB consumption heightens the reward response to food cues. Studies investigating the specificity of these responses have not been conducted. Nevertheless, the current data provide a biological basis to the body of evidence demonstrating that the targeted marketing (real life palatable food cues) of SSB and other unhealthy foods to vulnerable populations, including children and people of color and low socioeconomic status, is increasing their risk for obesity. While the mechanisms for the association between SSB consumption and body weight gain cannot be identified, current scientific evidence strongly suggests that proactive environmental measures to reduce exposure to palatable food cues in the form of targeting marketing will decrease the risk of obesity in vulnerable populations.

Neural Networks With Motivation

Animals rely on internal motivational states to make decisions. The role of motivational salience in decision making is in early stages of mathematical understanding. Here, we propose a reinforcement learning framework that relies on neural networks to learn optimal ongoing behavior for dynamically changing motivation values. First, we show that neural networks implementing Q-learning with motivational salience can navigate in environment with dynamic rewards without adjustments in synaptic strengths when the needs of an agent shift. In this setting, our networks may display elements of addictive behaviors. Second, we use a similar framework in hierarchical manager-agent system to implement a reinforcement learning algorithm with motivation that both infers motivational states and behaves. Finally, we show that, when trained in the Pavlovian conditioning setting, the responses of the neurons in our model resemble previously published neuronal recordings in the ventral pallidum, a basal ganglia structure involved in motivated behaviors. We conclude that motivation allows Q-learning networks to quickly adapt their behavior to conditions when expected reward is modulated by agent's dynamic needs. Our approach addresses the algorithmic rationale of motivation and makes a step toward better interpretability of behavioral data via inference of motivational dynamics in the brain.

Ventral pallidum neurons dynamically signal relative threat

The ventral pallidum (VP) is anatomically poised to contribute to threat behavior. Recent studies report a VP population that scales firing increases to reward but decreases firing to aversive cues. Here, we tested whether firing decreases in VP neurons serve as a neural signal for relative threat. Single-unit activity was recorded while male rats discriminated cues predicting unique foot shock probabilities. Rats' behavior and VP single-unit firing discriminated danger, uncertainty, and safety cues. Two populations of VP neurons dynamically signaled relative threat, decreasing firing according to foot shock probability during early cue presentation, but disproportionately decreasing firing to uncertain threat as foot shock drew near. One relative threat population increased firing to reward, consistent with a bi-directional signal for general value. The second population was unresponsive to reward, revealing a specific signal for relative threat. The results reinforce anatomy to reveal the VP as a neural source of a dynamic, relative threat signal.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Neurons of the Ventral Tegmental Area Encode Individual Differences in Motivational "Wanting" for Reward Cues

It has been argued that the dopaminergic system is involved in the attribution of motivational value to reward predictive cues as well as prediction error. To evaluate, dopamine neurons were recorded from male rats performing a Pavlovian approach task containing cues that have both "predictive" and "incentive" properties. All animals learned the predictive nature of the cue (illuminated lever entry into cage), but some also found the cue to be attractive and were motivated toward it ("sign-trackers," STs). "Goal-trackers" (GTs) predominantly approached the location of reward receptacle. Rats were implanted with tetrodes for neural electrophysiological recordings in the ventral tegmental area. Cells were characterized by spike waveform shape and firing rate. Firing rates and magnitudes of responses in relation to Pavlovian behaviors, cue presentation, and reward delivery were assessed. We identified 103 dopamine and 141 nondopamine neurons. GTs and STs both showed responses to the initial lever presentation (CS1) and lever retraction (CS2). However, higher firing rates were sustained during the lever interaction period only in STs. Further, dopamine cells of STs showed a significantly higher proportion of cells responding to both CS1 and CS2. These are the first results to show that neurons from the VTA encode both predictive and incentive cues, support an important role for dopamine neurons in the attribution of incentive salience to reward-paired cues, and underscore the consequences of potential differences in motivational behavior between individuals.SIGNIFICANCE STATEMENT This project serves to determine whether dopamine neurons encode differences in cued approach behaviors and incentive salience. How neurons of the VTA affect signaling through the NAcc and subsequent dopamine release is still not well known. All cues that precede a reward are predictive in nature. Some, however, also have incentive value, in that they elicit approach toward them. We quantified the attribution of incentive salience through cue approach behavior and cue interaction, and the corresponding magnitude of VTA neural firing. We found dopamine neurons of the VTA encode strength of incentive salience of reward cues. This suggests that dopamine neurons specifically in the VTA encode motivation.

Reward activity in ventral pallidum tracks satiety-sensitive preference and drives choice behavior

A key function of the nervous system is producing adaptive behavior across changing conditions, like physiological state. Although states like thirst and hunger are known to impact decision-making, the neurobiology of this phenomenon has been studied minimally. Here, we tracked evolving preference for sucrose and water as rats proceeded from a thirsty to sated state. As rats shifted from water choices to sucrose choices across the session, the activity of a majority of neurons in the ventral pallidum, a region crucial for reward-related behaviors, closely matched the evolving behavioral preference. The timing of this signal followed the pattern of a reward prediction error, occurring at the cue or the reward depending on when reward identity was revealed. Additionally, optogenetic stimulation of ventral pallidum neurons at the time of reward was able to reverse behavioral preference. Our results suggest that ventral pallidum neurons guide reward-related decisions across changing physiological states.

Rajyoga meditation induces grey matter volume changes in regions that process reward and happiness

Studies provide evidence that practicing meditation enhances neural plasticity in reward processing areas of brain. No studies till date, provide evidence of such changes in Rajyoga meditation (RM) practitioners. The present study aimed to identify grey matter volume (GMV) changes in reward processing areas of brain and its association with happiness scores in RM practitioners compared to non-meditators. Structural MRI of selected participants matched for age, gender and handedness (n = 40/group) were analyzed using voxel-based morphometric method and Oxford Happiness Questionnaire (OHQ) scores were correlated. Significant increase in OHQ happiness scores were observed in RM practitioners compared to non-meditators. Whereas, a trend towards significance was observed in more experienced RM practitioners, on correlating OHQ scores with hours of meditation experience. Additionally, in RM practitioners, higher GMV were observed in reward processing centers—right superior frontal gyrus, left inferior orbitofrontal cortex (OFC) and bilateral precuneus. Multiple regression analysis showed significant association between OHQ scores of RM practitioners and reward processing regions right superior frontal gyrus, left middle OFC, right insula and left anterior cingulate cortex. Further, with increasing hours of RM practice, a significant positive association was observed in bilateral ventral pallidum. These findings indicate that RM practice enhances GMV in reward processing regions associated with happiness.

A quantitative reward prediction error signal in the ventral pallidum

The nervous system is hypothesized to compute reward prediction errors (RPEs) to promote adaptive behavior. Correlates of RPEs have been observed in the midbrain dopamine system, but the extent to which RPE signals exist in other reward-processing regions is less well understood. In the present study, we quantified outcome history-based RPE signals in the ventral pallidum (VP), a basal ganglia region functionally linked to reward-seeking behavior. We trained rats to respond to reward-predicting cues, and we fit computational models to predict the firing rates of individual neurons at the time of reward delivery. We found that a subset of VP neurons encoded RPEs and did so more robustly than the nucleus accumbens, an input to the VP. VP RPEs predicted changes in task engagement, and optogenetic manipulation of the VP during reward delivery bidirectionally altered rats' subsequent reward-seeking behavior. Our data suggest a pivotal role for the VP in computing teaching signals that influence adaptive reward seeking.

Fronto-striatal activity predicts anhedonia and positive empathy subtypes

The dorsolateral prefrontal cortex, globus pallidus, and nucleus accumbens are important components of the reward circuit in the brain; and prior research suggests individuals with damage to these regions feel less pleasure (i.e., are anhedonic). However, little is known about how these brain regions relate to vicarious pleasure. Pilot fMRI data were collected from 20 participants (M_age = 22, SD = 7.0, 63% female) during a validated empathy induction paradigm that utilized video clips extracted from the television show "Extreme Makeover: Home Edition" to elicit empathic happiness (i.e. vicarious happiness) when targets display positive affect, and either empathic cheerfulness (i.e. the tendency to want to cheer someone up) or empathic concern (i.e. vicarious sadness) when targets display negative affect. Participants also completed the novel "Happy Faces" task-a behavioral measure of anhedonia-while fMRI was collected. fMRI data during task completion were used to predict trait empathy measured via self-report outside of the scanner, and accuracy on the "Happy Faces" task. Results indicate that globus pallidus activity during empathic concern-eliciting video clips significantly predicted self-reported trait empathic cheerfulness (R² = 26%, p = 0.045). Furthermore, greater dorsolateral prefrontal cortex (DLPFC) activity during the Happy Faces task predicted accurate performance on the task (R² = 34%, p < .05); and greater nucleus accumbens shell activity during the Happy Faces task predicted greater trait empathic happiness (R² = 38%, p < .05). These results suggest that fronto-striatal circuitry contributes to our experience of anhedonia, empathic happiness, and empathic cheerfulness.

Discrete Evaluative and Premotor Circuits Enable Vocal Learning in Songbirds

Virtuosic motor performance requires the ability to evaluate and modify individual gestures within a complex motor sequence. Where and how the evaluative and premotor circuits operate within the brain to enable such temporally precise learning is poorly understood. Songbirds can learn to modify individual syllables within their complex vocal sequences, providing a system for elucidating the underlying evaluative and premotor circuits. We combined behavioral and optogenetic methods to identify 2 afferents to the ventral tegmental area (VTA) that serve evaluative roles in syllable-specific learning and to establish that downstream cortico-basal ganglia circuits serve a learning role that is only premotor. Furthermore, song performance-contingent optogenetic stimulation of either VTA afferent was sufficient to drive syllable-specific learning, and these learning effects were of opposite valence. Finally, functional, anatomical, and molecular studies support the idea that these evaluative afferents bidirectionally modulate VTA dopamine neurons to enable temporally precise vocal learning.

A Randomized Trial of Combined tDCS Over Right Inferior Frontal Cortex and Cognitive Bias Modification: Null Effects on Drinking and Alcohol Approach Bias

BACKGROUND

Deriving novel treatments for alcohol use disorders (AUDs) is of critical importance, as existing treatments are only modestly effective for reducing drinking. Two promising strategies for treating AUDs include cognitive bias modification (CBM) and transcranial direct current stimulation (tDCS). While each strategy has shown positive results in reducing drinking or alcohol-related constructs (e.g., craving), initial tests of the combination of CBM and tDCS have shown mixed results. The present study investigated the degree to which combining CBM and tDCS (2.0 mA anodal current over F10) could reduce alcohol approach biases and alcohol consumption.

METHODS

Seventy-nine at-risk drinkers were randomized to 1 of 4 conditions in a 2 × 2 factorial design: verum CBM/verum tDCS, verum CBM/sham tDCS, sham CBM/verum tDCS, or sham CBM/sham tDCS. Participants completed a baseline assessment of alcohol approach bias and drinking quantity/frequency (i.e., drinks per drinking day [DDD] and percent heavy drinking days [PHDD]), 4 sessions of combined CBM and tDCS, and follow-up assessments of approach bias and alcohol consumption.

RESULTS

Results indicated that while participants did demonstrate significant alcohol approach biases at baseline, neither CBM, tDCS, nor the interaction reduced the bias at the follow-up. In addition, there was evidence of a trend toward reducing DDD from baseline to the 1-week/1-month follow-ups, but there was no significant effect of the intervention on either DDD or PHDD.

CONCLUSIONS

These results partially replicated null results presented in similar CBM/tDCS trials and suggest that this combination, at least with anodal stimulation over dorsolateral or inferior frontal sites, may have limited utility to reduce drinking.

Songbird Ventral Pallidum Sends Diverse Performance Error Signals to Dopaminergic Midbrain

Motor skills improve with practice, requiring outcomes to be evaluated against ever-changing performance benchmarks, yet it remains unclear how performance error signals are computed. Here, we show that the songbird ventral pallidum (VP) is required for song learning and sends diverse song timing and performance error signals to the ventral tegmental area (VTA). Viral tracing revealed inputs to VP from auditory and vocal motor thalamus, auditory and vocal motor cortex, and VTA. Our findings show that VP circuits, commonly associated with hedonic functions, signal performance error during motor sequence learning.

Shared Behavioral and Neurocircuitry Disruptions in Drug Addiction, Obesity, and Binge Eating Disorder: Focus on Group I mGluRs in the Mesolimbic Dopamine Pathway

Accumulated data from clinical and preclinical studies suggest that, in drug addiction and states of overeating, such as obesity and binge eating disorder (BED), there is an imbalance in circuits that are critical for motivation, reward saliency, executive function, and self-control. Central to these pathologies and the extensive topic of this Review are the aberrations in dopamine (DA) and glutamate (Glu) within the mesolimbic pathway. Group I metabotropic glutamate receptors (mGlus) are highly expressed in the mesolimbic pathway and are poised in key positions to modulate disruptions in synaptic plasticity and neurotransmitter release observed in drug addiction, obesity, and BED. The use of allosteric modulators of group I mGlus has been studied in drug addiction, as they offer several advantages over traditional orthosteric agents. However, they have yet to be studied in obesity or BED. With the substantial overlap between the neurocircuitry involved in drug addiction and eating disorders, group I mGlus may also provide novel targets for obesity and BED.

Neural vulnerability factors for obesity

Multiple theories identify neural vulnerability factors that may increase risk for overeating and weight gain. Early cross-sectional neuroimaging studies were unable to determine whether aberrant neural responsivity was a risk factor for or a consequence of overeating. More recent obesity risk, prospective, repeated-measures, and experimental neuroimaging studies with humans have advanced knowledge of etiologic processes and neural plasticity resulting from overeating. Herein, we review evidence from these more rigorous human neuroimaging studies, in conjunction with behavioral measures reflecting neural function, as well as experiments with animals that investigated neural vulnerability theories for overeating. Findings provide support for the reward surfeit theory that posits that individuals at risk for obesity initially show hyper-responsivity of reward circuitry to high-calorie food tastes, which theoretically drives elevated intake of such foods. However, findings provide little support for the reward deficit theory that postulates that individuals at risk for obesity show an initial hypo-responsivity of reward circuitry that motives overeating. Further, results provide support for the incentive sensitization and dynamic vulnerability theories that propose that overconsumption of high-calorie foods results in increased reward and attention region responsivity to cues that are associated with hedonic reward from intake of these high-calorie foods via conditioning, as well as a simultaneous decrease in reward region responsivity to high-calorie food tastes. However, there is little evidence that this induced reduction in reward region response to high-calorie food tastes drives an escalation in overeating. Finally, results provide support for the theory that an initial deficit in inhibitory control and a bias for immediate reward contribute to overconsumption of high-calorie foods. Findings imply that interventions that reduce reward and attention region responsivity to food cues and increase inhibitory control should reduce overeating and excessive weight gain, an intervention theory that is receiving support in randomized trials.

Signaling Incentive and Drive in the Primate Ventral Pallidum for Motivational Control of Goal-Directed Action

Processing incentive and drive is essential for control of goal-directed behavior. The limbic part of the basal ganglia has been emphasized in these processes, yet the exact neuronal mechanism has remained elusive. In this study, we examined the neuronal activity of the ventral pallidum (VP) and its upstream area, the rostromedial caudate (rmCD), while two male macaque monkeys performed an instrumental lever release task in which a visual cue indicated the forthcoming reward size. We found that the activity of some neurons in VP and rmCD reflected the expected reward size transiently following the cue. Reward size coding appeared earlier and stronger in VP than in rmCD. We also found that the activity in these areas was modulated by the satiation level of monkeys, which also occurred more frequently in VP than in rmCD. The information regarding reward size and satiation level was independently signaled in the neuronal populations of these areas. The data thus highlighted the neuronal coding of key variables for goal-directed behavior in VP. Furthermore, pharmacological inactivation of VP induced more severe deficit of goal-directed behavior than inactivation of rmCD, which was indicated by abnormal error repetition and diminished satiation effect on the performance. These results suggest that VP encodes incentive value and internal drive and plays a pivotal role in the control of motivation to promote goal-directed behavior.

SIGNIFICANCE STATEMENT The limbic part of the basal ganglia has been implicated in the motivational control of goal-directed action. Here, we investigated how the ventral pallidum (VP) and the rostromedial caudate (rmCD) encode incentive value and internal drive and control goal-directed behavior. Neuronal recording and subsequent pharmacological inactivation revealed that VP had stronger coding of reward size and satiation level than rmCD. Reward size and satiation level were independently encoded in the neuronal population of these areas. Furthermore, VP inactivation impaired goal-directed behavior more severely than rmCD inactivation. These results highlight the central role of VP in the motivational control of goal-directed action.

Pathways and mechanisms linking dietary components to cardiometabolic disease: thinking beyond calories

Calories from any food have the potential to increase risk for obesity and cardiometabolic disease because all calories can directly contribute to positive energy balance and fat gain. However, various dietary components or patterns may promote obesity and cardiometabolic disease by additional mechanisms that are not mediated solely by caloric content. Researchers explored this topic at the 2017 CrossFit Foundation Academic Conference 'Diet and Cardiometabolic Health - Beyond Calories', and this paper summarizes the presentations and follow-up discussions. Regarding the health effects of dietary fat, sugar and non-nutritive sweeteners, it is concluded that food-specific saturated fatty acids and sugar-sweetened beverages promote cardiometabolic diseases by mechanisms that are additional to their contribution of calories to positive energy balance and that aspartame does not promote weight gain. The challenges involved in conducting and interpreting clinical nutritional research, which preclude more extensive conclusions, are detailed. Emerging research is presented exploring the possibility that responses to certain dietary components/patterns are influenced by the metabolic status, developmental period or genotype of the individual; by the responsiveness of brain regions associated with reward to food cues; or by the microbiome. More research regarding these potential 'beyond calories' mechanisms may lead to new strategies for attenuating the obesity crisis.

Opponent control of behavioral reinforcement by inhibitory and excitatory projections from the ventral pallidum

The ventral pallidum (VP) lies at the interface between sensory, motor, and cognitive processing-with a particular role in mounting behavioral responses to rewards. Though the VP is predominantly GABAergic, glutamate neurons were recently identified, though their relative abundances and respective roles are unknown. Here, we show that VP glutamate neurons are concentrated in the rostral ventromedial VP and project to qualitatively similar targets as do VP GABA neurons. At the functional level, we used optogenetics to show that activity in VP GABA neurons can drive positive reinforcement, particularly through projections to the ventral tegmental area (VTA). On the other hand, activation of VP glutamate neurons leads to behavioral avoidance, particularly through projections to the lateral habenula. These findings highlight cell-type and projection-target specific roles for VP neurons in behavioral reinforcement, dysregulation of which could contribute to the emergence of negative symptoms associated with drug addiction and other neuropsychiatric disease.

Chemogenetic manipulation of ventral pallidal neurons impairs acquisition of sign-tracking in rats

Cues associated with rewarding events acquire value themselves as a result of the incentive value of the reward being transferred to the cue. Consequently, presentation of a reward-paired cue can trigger reward-seeking behaviours towards the cue itself (i.e. sign-tracking). The ventral pallidum (VP) has been demonstrated to be involved in a number of motivated behaviours, both conditioned and unconditioned. However, its contribution to the acquisition of incentive value is unknown. Using a discriminative autoshaping procedure with levers, the effects of disrupting VP activity in rats on the emergence of sign-tracking was investigated using chemogenetics, i.e. Designer Receptors Exclusively Activated by Designer Drugs (DREADDs). Transient disruption of VP neurons [activation of the inhibitory hM4D(Gi) DREADD through systemic injections of clozapine N-oxide (CNO) prior to each autoshaping session] impaired acquisition of sign-tracking (lever press rate) without having any effect on approach to the site of reward delivery (i.e. goal-tracking) or on the expression of sign-tracking after it was acquired. In addition, electrophysiological recordings were conducted in freely behaving rats following VP DREADD activation. The majority of VP units that were responsive to CNO injections exhibited rapid inhibition relative to baseline, a subset of CNO-responsive units showed delayed excitation, and a smaller subset displayed a mixed response of inhibition and excitation following CNO injections. It is argued that disruption of VP during autoshaping specifically disrupted the transfer of incentive value that was attributed to the lever cue, suggesting a surprisingly fundamental role for the VP in acquiring, compared with expressing, Pavlovian incentive values.

Deep brain stimulation in the central nucleus of the amygdala decreases 'wanting' and 'liking' of food rewards

We investigated the potential of deep brain stimulation (DBS) in the central nucleus of the amygdala (CeA) in rats to modulate functional reward mechanisms. The CeA is the major output of the amygdala with direct connections to the hypothalamus and gustatory brainstem, and indirect connections with the nucleus accumbens. Further, the CeA has been shown to be involved in learning, emotional integration, reward processing, and regulation of feeding. We hypothesized that DBS, which is used to treat movement disorders and other brain dysfunctions, might block reward motivation. In rats performing a lever-pressing task to obtain sugar pellet rewards, we stimulated the CeA and control structures, and compared stimulation parameters. During CeA stimulation, animals stopped working for rewards and rejected freely available rewards. Taste reactivity testing during DBS exposed aversive reactions to normally liked sucrose tastes and even more aversive taste reactions to normally disliked quinine tastes. Interestingly, given the opportunity, animals implanted in the CeA would self-stimulate with 500 ms trains of stimulation at the same frequency and current parameters as continuous stimulation that would stop reward acquisition. Neural recordings during DBS showed that CeA neurons were still active and uncovered inhibitory-excitatory patterns after each stimulus pulse indicating possible entrainment of the neural firing with DBS. In summary, DBS modulation of CeA may effectively usurp normal neural activity patterns to create an 'information lesion' that not only decreased motivational 'wanting' of food rewards, but also blocked 'liking' of rewards.

Neural vulnerability factors that increase risk for future weight gain

Theorists have proposed several neural vulnerability factors that may increase overeating and consequent weight gain. Early cross-sectional imaging studies could not determine whether aberrant neural responsivity was a precursor or consequence of overeating. However, recent prospective imaging studies examining predictors of future weight gain and response to obesity treatment, and repeated-measures imaging studies before and after weight gain and loss have advanced knowledge of etiologic processes and neural plasticity resulting from weight change. The present article reviews evidence from prospective studies using imaging and behavioral measures reflecting neural function, as well as randomized experiments with humans and animals that are consistent or inconsistent with 5 neural vulnerability theories for excessive weight gain. Extant data provide strong support for the incentive sensitization theory of obesity and moderate support for the reward surfeit theory, inhibitory control deficit theory, and dynamic vulnerability model of obesity, which attempted to synthesize the former theories into a single etiologic model. However, existing data provide only minimal support for the reward deficit theory. Findings are synthesized into a new working etiologic model that is based on current scientific knowledge. Important directions for future studies, which have the potential to support or refute this working etiologic model, are delineated. (PsycINFO Database Record

Applying the Brakes: When to Stop Eating

The nucleus accumbens regulates consummatory behaviors, such as eating. In this issue of Neuron, O'Connor et al. (2015) identify dopamine receptor 1-expressing neurons that project to the lateral hypothalamus as mediating rapid control over feeding behavior.

Ventral pallidal coding of a learned taste aversion

The hedonic value of a sweet food reward, or how much a taste is 'liked', has been suggested to be encoded by neuronal firing in the posterior ventral pallidum (VP). Hedonic impact can be altered by psychological manipulations, such as taste aversion conditioning, which can make an initially pleasant sweet taste become perceived as disgusting. Pairing nausea-inducing LiCl injection as a Pavlovian unconditioned stimulus (UCS) with a novel taste that is normally palatable as the predictive conditioned stimulus (CS+) suffices to induce a learned taste aversion that changes orofacial 'liking' responses to that sweet taste (e.g., lateral tongue protrusions) to 'disgust' reactions (e.g., gapes) in rats. We used two different sweet tastes of similar initial palatability (a sucrose solution and a polycose/saccharin solution, CS ± assignment was counterbalanced across groups) to produce a discriminative conditioned aversion. Only one of those tastes (arbitrarily assigned and designated as CS+) was associatively paired with LiCl injections as UCS to form a conditioned aversion. The other taste (CS-) was paired with mere vehicle injections to remain relatively palatable as a control sweet taste. We recorded the neural activity in VP in response to each taste, before and after aversion training. We found that the safe and positively hedonic taste always elicited excitatory increases in firing rate of VP neurons. By contrast, aversion learning reversed the VP response to the 'disgusting' CS+ taste from initial excitation into a conditioned decrease in neuronal firing rate after training. Such neuronal coding of hedonic impact by VP circuitry may contribute both to normal pleasure and disgust, and disruptions of VP coding could result in affective disorders, addictions and eating disorders.

Controversies in fat perception

Nutritional fat is one of the most controversial topics in nutritional research, particularly against the background of obesity. Studies investigating fat taste perception have revealed several associations with sensory, genetic, and personal factors (e.g. BMI). However, neuronal activation patterns, which are known to be highly sensitive to different tastes as well as to BMI differences, have not yet been included in the scheme of fat taste perception. We will therefore provide a comprehensive survey of the sensory, genetic, and personal factors associated with fat taste perception and highlight the benefits of applying neuroimaging research. We will also give a critical overview of studies investigating sensory fat perception and the challenges resulting from multifaceted methodological approaches. In conclusion, we will discuss a multifactorial approach to fat perception to gain a better understanding of the underlying mechanisms that cause varying fat sensitivity which could be responsible for overeating. Such knowledge might be beneficial in new treatment strategies for obesity and overweight.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Cell assemblies of the basal forebrain

The basal forebrain comprises several heterogeneous neuronal subgroupings having modular projection patterns to discrete sets of cortical subregions. Each cortical region forms recurrent projections, via prefrontal cortex, that reach the specific basal forebrain subgroups from which they receive afferents. This architecture enables the basal forebrain to selectively modulate cortical responsiveness according to current processing demands. Theoretically, optimal functioning of this distributed network would be enhanced by temporal coordination among coactive basal forebrain neurons, or the emergence of "cell assemblies." The present work demonstrates assembly formation in rat basal forebrain neuronal populations during a selective attention task. Neuron pairs exhibited coactivation patterns organized within beta-frequency time windows (55 ms), regardless of their membership within distinct bursting versus nonbursting basal forebrain subpopulations. Thus, the results reveal a specific temporal framework for integration of information within basal forebrain networks and for the modulation of cortical responsiveness.

Direct hypothalamic and indirect trans-pallidal, trans-thalamic, or trans-septal control of accumbens signaling and their roles in food intake

Due in part to the increasing incidence of obesity in developed nations, recent research aims to elucidate neural circuits that motivate humans to overeat. Earlier research has described how the nucleus accumbens shell (AcbSh) motivates organisms to feed by activating neuronal populations in the lateral hypothalamus (LH). However, more recent research suggests that the LH may in turn communicate with the AcbSh, both directly and indirectly, to re-tune the motivation to consume foods with homeostatic and food-related sensory signals. Here, we discuss the functional and anatomical evidence for an LH to AcbSh connection and its role in eating behaviors. The LH appears to modulate Acb activity directly, using neurotransmitters such as hypocretin/orexin or melanin concentrating hormone (MCH). The LH also indirectly regulates AcbSh activity through certain subcortical "relay" regions, such as the lateral septum (LS), ventral pallidum (VP), and paraventricular thalamus, using a variety of neurotransmitters. This review aims to summarize studies on these topics and outline a model by which LH circuits processing energy balance can modulate AcbSh neural activity to regulate feeding behavior.

Excessive disgust caused by brain lesions or temporary inactivations: mapping hotspots of the nucleus accumbens and ventral pallidum

Disgust is a prototypical type of negative affect. In animal models of excessive disgust, only a few brain sites are known in which localized dysfunction (lesions or neural inactivations) can induce intense 'disgust reactions' (e.g. gapes) to a normally pleasant sensation such as sweetness. Here, we aimed to map forebrain candidates more precisely, to identify where either local neuronal damage (excitotoxin lesions) or local pharmacological inactivation (muscimol/baclofen microinjections) caused rats to show excessive sensory disgust reactions to sucrose. Our study compared subregions of the nucleus accumbens shell, ventral pallidum, lateral hypothalamus, and adjacent extended amygdala. The results indicated that the posterior half of the ventral pallidum was the only forebrain site where intense sensory disgust gapes in response to sucrose were induced by both lesions and temporary inactivations (this site was previously identified as a hedonic hotspot for enhancements of sweetness 'liking'). By comparison, for the nucleus accumbens, temporary GABA inactivations in the caudal half of the medial shell also generated sensory disgust, but lesions never did at any site. Furthermore, even inactivations failed to induce disgust in the rostral half of the accumbens shell (which also contains a hedonic hotspot). In other structures, neither lesions nor inactivations induced disgust as long as the posterior ventral pallidum remained spared. We conclude that the posterior ventral pallidum is an especially crucial hotspot for producing excessive sensory disgust by local pharmacological/lesion dysfunction. By comparison, the nucleus accumbens appears to segregate sites for pharmacological disgust induction and hedonic enhancement into separate posterior and rostral halves of the medial shell.

Task-phase-specific dynamics of basal forebrain neuronal ensembles

Cortically projecting basal forebrain neurons play a critical role in learning and attention, and their degeneration accompanies age-related impairments in cognition. Despite the impressive anatomical and cell-type complexity of this system, currently available data suggest that basal forebrain neurons lack complexity in their response fields, with activity primarily reflecting only macro-level brain states such as sleep and wake, onset of relevant stimuli and/or reward obtainment. The current study examined the spiking activity of basal forebrain neuron populations across multiple phases of a selective attention task, addressing, in particular, the issue of complexity in ensemble firing patterns across time. Clustering techniques applied to the full population revealed a large number of distinct categories of task-phase-specific activity patterns. Unique population firing-rate vectors defined each task phase and most categories of task-phase-specific firing had counterparts with opposing firing patterns. An analogous set of task-phase-specific firing patterns was also observed in a population of posterior parietal cortex neurons. Thus, consistent with the known anatomical complexity, basal forebrain population dynamics are capable of differentially modulating their cortical targets according to the unique sets of environmental stimuli, motor requirements, and cognitive processes associated with different task phases.

Greater striatopallidal adaptive coding during cue-reward learning and food reward habituation predict future weight gain

Animal experiments indicate that after repeated pairings of palatable food receipt and cues that predict palatable food receipt, dopamine signaling increases in response to predictive cues, but decreases in response to food receipt. Using functional MRI and mixed effects growth curve models with 35 females (M age=15.5±0.9; M BMI=24.5±5.4) we documented an increase in BOLD response in the caudate (r=.42) during exposure to cues predicting impending milkshake receipt over repeated exposures, demonstrating a direct measure of in vivo cue-reward learning in humans. Further, we observed a simultaneous decrease in putamen (r=-.33) and ventral pallidum (r=-.45) response during milkshake receipt that occurred over repeated exposures, putatively reflecting food reward habitation. We then tested whether cue-reward learning and habituation slopes predicted future weight over 2-year follow-up. Those who exhibited the greatest escalation in ventral pallidum responsivity to cues and the greatest decrease in caudate response to milkshake receipt showed significantly larger increases in BMI (r=.39 and -.69 respectively). Interestingly, cue-reward learning propensity and food reward habituation were not correlated, implying that these factors may constitute qualitatively distinct vulnerability pathways to excess weight gain. These two individual difference factors may provide insight as to why certain people have shown obesity onset in response to the current obesogenic environment in western cultures, whereas others have not.

Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking

The ventral pallidum is centrally positioned within mesocorticolimbic reward circuits, and its dense projection to the ventral tegmental area (VTA) regulates neuronal activity there. However, the ventral pallidum is a heterogeneous structure, and how this complexity affects its role within wider reward circuits is unclear. We found that projections to VTA from the rostral ventral pallidum (RVP), but not the caudal ventral pallidum (CVP), were robustly Fos activated during cue-induced reinstatement of cocaine seeking--a rat model of relapse in addiction. Moreover, designer receptor-mediated transient inactivation of RVP neurons, their terminals in VTA or functional connectivity between RVP and VTA dopamine neurons blocked the ability of drug-associated cues (but not a cocaine prime) to reinstate cocaine seeking. In contrast, CVP neuronal inhibition blocked cocaine-primed, but not cue-induced, reinstatement. This double dissociation in ventral pallidum subregional roles in drug seeking is likely to be important for understanding the mesocorticolimbic circuits underlying reward seeking and addiction.

Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum), as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancelation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens.

The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions

The nucleus accumbens shell (NAc-S) plays an important role in the way stimuli that predict reward affect the performance of, and choice between, goal-directed actions in tests of outcome-specific Pavlovian-instrumental transfer (PIT). The neural processes involved in PIT downstream of the ventral striatum are, however, unknown. The NAc-S projects prominently to the ventral pallidum (VP), and in the current experiments, we assessed the involvement of the NAc-S to VP projection in specific PIT in rats. We first compared expression of the immediate-early gene c-Fos in the medial (VP-m) and lateral (VP-l) regions of the VP and in addition, used the retrograde tracer Fluoro-gold combined with c-Fos to assess the involvement of these pathways during PIT. Although there was no evidence of differential activation in neurons in the VP-l, the VP-m showed a selective increase in activity in rats tested for PIT compared with appropriate controls, as did NAc-S neurons projecting to the VP-m. To confirm that VP-m activity is important for PIT, we inactivated this region before test and found this inactivation blocked the influence of predictive learning on choice. Finally, to confirm the functional importance of the NAc-S to VP-m pathway we used a disconnection procedure, using asymmetrical inactivation of the NAc-S and either the ipsilateral or contralateral VP-m. Specific PIT was blocked but only by inactivation of the NAc-S and VP-m in contralateral hemispheres. These results suggest that the NAc-S and VP-m form part of a circuit mediating the effects of predictive learning on choice.

Effect of SOHAM meditation on human brain: a voxel-based morphometry study

The anatomical correlates of long-term meditators involved in practice of "SOHAM" meditation have been studied using voxel-based morphometry (VBM). The VBM analysis indicates significantly higher gray matter density in brain stem, ventral pallidum, and supplementary motor area in the meditators as compared with age-matched nonmeditators. The observed changes in brain structure are compared with other forms of meditation.

Neural substrates of amphetamine-induced behavioral sensitization: unconditioned (zero context) and conditioned (switch versus same context) components in c-fos overexpression

The neural substrates of the unconditioned and conditioned components of amphetamine (AMPH)-induced behavioral sensitization remain unknown. The present study examines the brain activation of rats in response to an AMPH challenge with augmented locomotion in groups receiving chronic AMPH under chloral hydrate anesthetization (i.e., the 'zero context') or when tested in the 'same context' as a chronic treatment, or when tested in a 'different context'. The neural activations of the three groups reveal fairly consistent patterns: (a) The substantia nigra is activated in the same context condition and the pure AMPH effect (i.e., the zero context with the unconditioned component), but not in the switch context condition. (b) The ventral pallidum showed Fos expression in the switch context and the same context, but not in the zero context condition. (c) The other nuclei, including the medial prefrontal cortex, nucleus accumbens, caudate putamen, medial thalamus, hippocampus, amygdala, and ventral tegmental area, are activated in all contextual conditions and the pure AMPH effect (the zero context). The context exerts definable effects on the mesocorticolimbic dopamine system on AMPH-induced behavioral sensitization. (d) The ventral pallidum and the substantia nigra activations dissociate the unconditioned component from the conditioned component in behavioral sensitization. Further studies are needed to determine how these two nuclei mediate the effect in terms of primary and conditioned rewards.

Opioid modulation of ventral pallidal afferents to ventral tegmental area neurons

Activation of mu opioid receptors within the ventral tegmental area (VTA) can produce reward through the inhibition of GABAergic inputs. GABAergic neurons in the ventral pallidum (VP) provide a major input to VTA neurons. To determine the specific VTA neuronal targets of VP afferents and their sensitivity to mu opioid receptor agonists, we virally expressed channel rhodopsin (ChR2) in rat VP neurons and optogenetically activated their terminals in the VTA. Light activation of VP neuron terminals elicited GABAergic IPSCs in both dopamine (DA) and non-DA VTA neurons, and these IPSCs were inhibited by the mu opioid receptor agonist DAMGO. In addition, using a fluorescent retrograde marker to identify VTA-projecting VP neurons, we found them to be hyperpolarized by DAMGO. Both of these actions decrease GABAergic input onto VTA neurons, revealing two mechanisms by which endogenous or exogenous opioids can activate VTA neurons, including DA neurons.