Involvement of the ventral pallidum in working memory tasks with or without a delay

Ventral Pallidum GABA Neurons Mediate Motivation Underlying Risky Choice

Pursuing rewards while avoiding danger is an essential function of any nervous system. Here, we examine a new mechanism helping rats negotiate the balance between risk and reward when making high-stakes decisions. Specifically, we focus on GABA neurons within an emerging mesolimbic circuit nexus: the ventral pallidum (VP). These neurons play a distinct role from other VP neurons in simple motivated behaviors in mice, but their role in more complex motivated behaviors is unknown. Here, we interrogate the behavioral functions of VPGABA neurons in male and female transgenic GAD1:Cre rats (and WT littermates), using a reversible chemogenetic inhibition approach. Using a behavioral assay of risky decision-making, and of the food-seeking and shock-avoidance components of this task, we show that engaging inhibitory Gi/o signaling specifically in VPGABA neurons suppresses motivation to pursue highly salient palatable foods, and possibly also motivation to avoid being shocked. In contrast, inhibiting these neurons did not affect seeking of low-value food, free consumption of palatable food, or unconditioned affective responses to shock. Accordingly, when rats considered whether to pursue food despite potential for shock in a risky decision-making task, inhibiting VPGABA neurons caused them to more readily select a small but safe reward over a large but dangerous one, an effect not seen in the absence of shock threat. Together, results indicate that VPGABA neurons are critical for high-stakes adaptive responding that is necessary for survival, but which may also malfunction in psychiatric disorders.SIGNIFICANCE STATEMENT In a dynamic world, it is essential to implement appropriate behaviors under circumstances involving rewards, threats, or both. Here, we demonstrate a crucial role for VPGABA neurons in high-stakes motivated behavior of several types. We show that this VPGABA role in motivation impacts decision-making, as inhibiting these neurons yields a conservative, risk-averse strategy not seen when the task is performed without threat of shock. These new roles for VPGABA neurons in behavior may inform future strategies for treating addiction, and other disorders of maladaptive decision-making.

The Lateral Habenula as a Relay of Cortical Information to Process Working Memory

Working memory is a cognitive ability allowing the temporary storage of information to solve problems or adjust behavior. While working memory is known to mainly depend on the medial prefrontal cortex (mPFC), very few is known about how cortical information are relayed subcortically. By its connectivity, the lateral habenula (lHb) might act as a subcortical relay for cortical information. Indeed, the lHb receives inputs from several mPFC subregions, and recent findings suggest a role for the lHb in online processing of spatial information, a fundamental aspect of working memory. In rats, in a delayed non-matching to position paradigm, using focal microinjections of the GABAA agonist muscimol we showed that inactivation of the lHb (16 ng in 0.2 µL per side), as well as disconnection between the prelimbic region of the mPFC (mPFC/PrL, 32 ng in 0.4 µL in one hemisphere) and the lHb (16 ng in 0.2 µL in the lHb in the contralateral hemisphere) impaired working memory. The deficits were unlikely to result from motivational or motor deficits as muscimol did not affect reward collection or cue responding latencies, and did not increase the number of omissions. These results show for the first time the implication of the lHb in mPFC-dependent memory processes, likely as a relay of mPFC/PrL information. They also open new perspectives in the understanding of the top-down processing of high-level cognitive functions.

Optogenetic Inhibition of Ventral Pallidum Neurons Impairs Context-Driven Salt Seeking

Salt appetite, in which animals can immediately seek out salt when under a novel state of sodium deprivation, is a classic example of how homeostatic systems interface with learned associations to produce an on-the-fly updating of motivated behavior. Neural activity in the ventral pallidum (VP) has been shown to encode changes in the value of salt under such conditions, both the value of salt itself (Tindell et al., 2006) and the motivational value of its predictive cues (Tindell et al., 2009; Robinson and Berridge, 2013). However, it is not known whether the VP is necessary for salt appetite in terms of seeking out salt or consuming salt following sodium depletion. Here, we used a conditioned place-preference procedure to investigate the effects of optogenetically inhibiting the VP on context-driven salt seeking and the consumption of salt following deprivation. Male rats learned to associate one context with sucrose and another context with less-desirable salt. Following sodium depletion, and in the absence of either sucrose or salt, we found that inhibiting the VP selectively reduced the elevation in time spent in the salt-paired context. VP inhibition had minimal effects on the consumption of salt once it was made available. To our knowledge, this is the first evidence that the VP or any brain region is necessary for the ability to use contextual cues to guide salt seeking. These results highlight a dissociation between deficit-driven reward seeking and reward consumption to replenish those deficits, with the former process being particularly sensitive to on-line VP activity.SIGNIFICANCE STATEMENT Salt appetite, in which rats will immediately seek out a once-undesirable concentrated salt solution after being depleted of bodily sodium despite never having tasted salt as a positive reward, is a phenomenon showing how animals can update their motivational goals without any new learning or conditioning. This salt-seeking behavior is also observed when the animal is presented with salt-paired cues. The neural circuitry necessary for context-driven salt-seeking behavior is unknown. We used a novel conditioned place preference procedure to show that optogenetic inhibition of the ventral pallidum (VP), a region known for processing reward, impairs context-driven salt seeking and has minimal effects on the consumption of salt itself following sodium depletion. These results highlight the importance of the VP in context-driven reward-seeking behavior.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Animal foraging and the evolution of goal-directed cognition

Foraging- and feeding-related behaviors across eumetazoans share similar molecular mechanisms, suggesting the early evolution of an optimal foraging behavior called area-restricted search (ARS), involving mechanisms of dopamine and glutamate in the modulation of behavioral focus. Similar mechanisms in the vertebrate basal ganglia control motor behavior and cognition and reveal an evolutionary progression toward increasing internal connections between prefrontal cortex and striatum in moving from amphibian to primate. The basal ganglia in higher vertebrates show the ability to transfer dopaminergic activity from unconditioned stimuli to conditioned stimuli. The evolutionary role of dopamine in the modulation of goal-directed behavior and cognition is further supported by pathologies of human goal-directed cognition, which have motor and cognitive dysfunction and organize themselves, with respect to dopaminergic activity, along the gradient described by ARS, from perseverative to unfocused. The evidence strongly supports the evolution of goal-directed cognition out of mechanisms initially in control of spatial foraging but, through increasing cortical connections, eventually used to forage for information.

Psychostimulants act within the prefrontal cortex to improve cognitive function

BACKGROUND

At low and clinically relevant doses, psychostimulants enhance cognitive and behavioral function dependent on the prefrontal cortex (PFC) and extended frontostriatal circuitry. These actions are observed in individuals with attention-deficit/hyperactivity disorder, as well as in normal human and animal subjects. Despite the widespread use of these drugs, the sites of action involved in their cognition-enhancing and therapeutic effects are poorly understood. Indirect and/or correlative evidence suggests the cognition-enhancing/therapeutic effects of psychostimulants may involve actions directly within the PFC or extended frontostriatal circuitry. The current studies examined the degree to which methylphenidate (MPH) (Ritalin) acts within distinct frontostriatal subfields to improve PFC-dependent cognition as measured in a delayed-response test of spatial working memory.

METHODS

Working memory performance was assessed following microinfusion of vehicle or varying doses of MPH (.03-8.0 μg/500 nL) directly into the dorsomedial PFC (dorsal prelimbic and dorsal anterior cingulate cortex), the ventromedial PFC (infralimbic), and the dorsomedial striatum of rats (n = 69).

RESULTS

Methylphenidate infusion into the dorsomedial PFC, but not ventromedial PFC, elicited an inverted U-shaped facilitation of PFC-dependent cognition as measured in this task. The magnitude of this improvement was comparable with that seen with systemic administration. Additional studies demonstrated that although the dorsomedial striatum is necessary for accurate performance in this task, MPH infusion into this region did not affect working memory performance.

CONCLUSIONS

These observations provide the first definitive evidence that the PFC is a site of action in the cognition-enhancing and presumably therapeutic actions of low-dose psychostimulants.

Context dependent effects of ventral tegmental area inactivation on spatial working memory

Rats were tested on a hippocampus dependent win-shift working memory task in familiar or novel environments after receiving bilateral ventral tegmental area infusions of baclofen. Baclofen infusion disrupted working memory performance in both familiar and novel environments. In addition, baclofen infusion selectively disrupted short-term working memory in the novel environment. This experiment confirms selective ventral tegmental area support of accurate performance during a context dependent spatial navigation task.

Ventral pallidum roles in reward and motivation

In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

Forebrain circuitry involved in effort-related choice: Injections of the GABAA agonist muscimol into ventral pallidum alter response allocation in food-seeking behavior

Organisms often make effort-related choices based upon assessments of motivational value and work requirements. Nucleus accumbens dopamine is a critical component of the brain circuitry regulating work output in reinforcement-seeking behavior. Rats with accumbens dopamine depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead they select a less-effortful type of food-seeking behavior. The ventral pallidum is a brain area that receives substantial GABAergic input from nucleus accumbens. It was hypothesized that stimulation of GABA(A) receptors in the ventral pallidum would result in behavioral effects that resemble those produced by interference with accumbens dopamine transmission. The present studies employed a concurrent choice lever pressing/chow intake procedure; with this task, interference with accumbens dopamine transmission shifts choice behavior such that lever pressing for food is decreased but chow intake is increased. In the present experiments, infusions of the GABA(A) agonist muscimol (5.0-10.0 ng) into the ventral pallidum decreased lever pressing for preferred food, but increased consumption of the less preferred chow. In contrast, ventral pallidal infusions of muscimol (10.0 ng) had no significant effect on preference for the palatable food in free-feeding choice tests. Furthermore, injections of muscimol into a control site dorsal to the ventral pallidum produced no significant effects on lever pressing and chow intake. These data indicate that stimulation of GABA receptors in ventral pallidum produces behavioral effects similar to those produced by accumbens dopamine depletions. Ventral pallidum appears to be a component of the brain circuitry regulating response allocation and effort-related choice behavior, and may act to convey information from nucleus accumbens to other parts of this circuitry. This research may have implications for understanding the brain mechanisms involved in energy-related psychiatric dysfunctions such as psychomotor retardation in depression, anergia, and apathy.

Involvement of ventral pallidum in prefrontal cortex-dependent aspects of spatial working memory

Ventral pallidum (VP) is an important source of limbic input to medial thalamus. Three studies examined the role of VP in spatial memory tasks impaired by medial thalamic lesions. In the 1st study, rats with VP lesions were impaired performing delayed matching trained with retractable levers (DMRL), a measure sensitive to prefrontal (but not hippocampal) damage. The 2nd study demonstrated dose-dependent DMRL impairment following microinjection of gamma-aminobutyric acidA, glutamate, or mu-opioid agonists in VP. In the 3rd study, VP lesions had no effect on varying choice radial-maze delayed nonmatching, a measure sensitive to hippocampal (but not prefrontal) lesions. These results suggest a common role in spatial memory for VP and other components of prefrontal-ventral striatopallidothalamic circuits distinct from hippocampal function.

Lesions of Specific and Nonspecific Thalamic Nuclei Affect Prefrontal Cortex-Dependent Aspects of Spatial Working Memory

Three studies compared lesions of specific mediodorsal (MD) and nonspecific midline/intralaminar (M/IL) and ventromedial (VM) thalamic nuclei placed to spare the anterior nuclei. Lesions of MD, M/IL, or VM impaired delayed matching trained with retractable levers, a measure of spatial memory affected by prefrontal cortical lesions. The effects of the MD lesion increased at longer retention intervals and thus appeared delay dependent. The effects of M/IL and VM lesions were delay independent. Even when combined, these lesions had no effect on varying choice radial maze delayed nonmatching, a task sensitive to hippocampal or anterior thalamic (but not prefrontal) lesions. These results demonstrate effects of MD, M/IL, and VM lesions distinct from the contributions of hippocampus or anterior thalamus to spatial memory.

Examination of the role of the pedunculopontine tegmental nucleus in radial maze tasks with or without a delay

Two radial maze tasks, random foraging and delayed spatial win-shift, have been used to investigate, in rats, the functions and inter-relationships of structures connected through the corticostriatal loops, such as the prelimbic cortex, nucleus accumbens, ventral pallidum and mediodorsal thalamus. The random foraging task is designed to investigate animals' ability to use spatial information to guide foraging on-line. The delayed spatial win-shift task requires, in addition, that animals hold spatially relevant information in working memory across a delay period. The pedunculopontine tegmental nucleus receives direct output from ventral striatal systems and might therefore be expected to share functional properties with them. In the present experiments we have examined the performance of rats bearing bilateral excitotoxic lesions of the pedunculopontine tegmental nucleus on both of these tasks. In acquisition tests rats were given bilateral lesions before any training took place, while in retention tests appropriate training to predetermined criterion levels of performance took place before lesions were made. In both tasks, and in both acquisition (no prelesion training) and retention (prelesion training) tests, rats with pedunculopontine lesions made significantly more errors in selecting arms to enter than did control rats. There was no motor impairment present in pedunculopontine tegmental nucleus-lesioned rats - on the contrary, on measures of speed (latency to make first arm choice and the mean time for subsequent choices) pedunculopontine-lesioned rats were slightly faster than control rats. We suggest that the pedunculopontine tegmental nucleus shares functional properties with frontostriatal systems and that it forms part of a brainstem-directed stream of striatal outflow different to the cortical re-entrant system via the thalamus.

A double dissociation within striatum between serial reaction time and radial maze delayed nonmatching performance in rats

Lesions involving the intralaminar thalamic nuclei have been associated with impairments in working memory and intentional motor function in human clinical cases and animal models of amnesia. The intralaminar nuclei have afferent and efferent connections related to striatum. To test whether disruption of striatal function can account for impairments produced by intralaminar lesions, we investigated the effects of striatal lesions on two tasks known to be impaired by intralaminar damage in the rat: radial maze delayed nonmatching (DNM), a measure of spatial working memory, and self-paced serial reaction time (SRT), a measure of intentional response speed. We compared the effects of lesions in four sites: the medial and lateral caudate putamen, nucleus accumbens, and olfactory tubercle. We found that lesions of the medial, accumbens, or tubercle sites impaired DNM performance, and that lesions of the lateral caudate putamen increased choice response time for the SRT task. There was a double dissociation between the effects of the ventral and the lateral lesions on these two tasks. For both tasks, the effects of striatal lesions were qualitatively similar and at least as large as intralaminar lesions in previous studies. These results provide evidence that striatal dysfunction can account for the DNM and SRT impairments produced by intralaminar lesions. The dissociation of functional impairments suggests that lateral sensorimotor areas of caudate putamen are important for responding based on external sensory stimuli and limbic-related areas in ventral striatum are important for responding based on information held in working memory.

Involvement of pallidothalamic circuitry in working memory

This study evaluated the capacity of mu-opioid and glutamate receptor agonists to differentially regulate the involvement of the GABAergic projection from the ventral pallidum to the mediodorsal thalamus in working memory and locomotor activity. Microinjection of either the ionotropic glutamate receptor agonist alpha-amino-3-hydroxy-5-methyl-4-isoxazolepropionate (AMPA) or the mu agonist [D-Ala(2),N-Me-Phe(4),Gly-ol(5)]enkephalin into the ventral pallidum of male Sprague-Dawley rats produced a dose-dependent impairment in working memory, estimated using a forced delayed alternation task in a T-maze. Performance in a spatial discrimination task without delay was also impaired by glutamate, but not by mu receptor, stimulation. Involvement of the GABAergic projection from the ventral pallidum to the mediodorsal thalamus in mu-opioid-induced impairment of working memory was verified by showing that inhibiting GABA(B) receptors in the mediodorsal thalamus blocked the effect of [D-Ala(2),N-Me-Phe(4),Gly-ol(5)]enkephalin in the ventral pallidum. Similarly, either glutamate or mu-opioid receptor stimulation in the ventral pallidum elicited motor activity, and the motor stimulant effect of the mu agonist was blocked, while that of AMPA is not affected by GABA(B) receptor blockade in the mediodorsal thalamus. Distinction between mu and glutamate receptor stimulation was further revealed by the fact that stimulating mu receptors in the ventral pallidum caused a dose-dependent reduction in extracellular GABA levels, while AMPA was without effect on GABA in the ventral pallidum. These data indicate that stimulating mu-opioid receptors reduces GABAergic tone in the ventral pallidum, which increases activity in the GABAergic projection to the mediodorsal thalamus, thereby impairing working memory. Moreover, it is hypothesized that mu receptors in the ventral pallidum gate the recruitment of working memory into ongoing behavioral activity.

Thalamic-cortical-striatal circuitry subserves working memory during delayed responding on a radial arm maze

The medial dorsal nuclei of the thalamus (MDNt), the prefrontal cortex, and the ventral striatum form an interconnected neural circuit that may subserve certain types of working memory. The present series of experiments investigated functional interactions between these brain regions in rats during the performance of delayed and nondelayed spatially cued radial-arm maze tasks. In Experiment 1, transient inactivation of the MDNt by a bilateral injection of lidocaine selectively disrupted performance on a delayed task but not on a nondelayed random foraging version of the radial arm maze task. In Experiment 2, asymmetrical lidocaine injections into the MDNt on one side of the brain and the prefrontal cortex on the other transiently disconnected these two brain regions and significantly impaired foraging during the delayed task. Similarly, disconnections between the prefrontal cortex and the nucleus accumbens also disrupted foraging on this task, whereas disconnections between the MDNt and the nucleus accumbens had no effect. These data suggest that serial transmission of information among the MDNt, the prefrontal cortex, and the nucleus accumbens is required when trial-unique, short-term spatial memory is used to guide prospective search behavior. The results are discussed with respect to a distributed neural network linking limbic, thalamic, cortical, and striatal regions, which mediates executive functions of working memory.