Mesolimbic dopamine projections mediate cue-motivated reward seeking but not reward retrieval in rats

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

RATIONALE

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

OBJECTIVE

We determined how 14 daily THC injections (5 mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

METHODS

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impact probabilistic discounting.

RESULTS

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

CONCLUSIONS

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine neurons or their projections to mPFC.

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

Rationale

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

Objective

We determined how 14 daily THC injections (5mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

Methods

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impacts probabilistic discounting.

Results

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

Conclusions

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine neurons or their projections to mPFC.

Dopamine neuron activity evoked by sucrose and sucrose-predictive cues is augmented by peripheral and central manipulations of glucose availability

Food deprivation drives eating through multiple signals and circuits. Decreased glucose availability (i.e., cytoglucopenia) drives eating and also increases the value of sucrose. Ventral tegmental area (VTA) dopamine neurons (DANs) contribute to the evaluation of taste stimuli, but their role in integrating glucoprivic signals remains unknown. We monitored VTA DAN activity via Cre-dependent expression of a calcium indicator with in vivo fibre photometry. In ad libitum fed rats, intraoral sucrose evoked a phasic increase in DAN activity. To manipulate glucose availability, we administered (intraperitoneal, lateral or fourth ventricular) the antiglycolytic agent 5-thio-D-glucose (5TG), which significantly augmented the phasic DAN activity to sucrose. 5TG failed to alter DAN activity to water or saccharin, suggesting the response was selective for caloric stimuli. 5TG enhancement of sucrose-evoked DAN activity was stronger after fourth ventricular administration, suggesting a critical node of action within the hindbrain. As 5TG also increases blood glucose, in a separate study, we used peripheral insulin, which stimulates eating, to decrease blood glucose-which was associated with increased DAN activity to intraoral sucrose. DAN activity developed to a cue predictive of intraoral sucrose. While 5TG augmented cue-evoked DAN activity, its action was most potent when delivered to the lateral ventricle. Together, the studies point to central glucose availability as a key modulator of phasic DAN activity to food and food-cues. As glucose sensing neurons are known to populate the hypothalamus and brainstem, results suggest differential modulation of cue-evoked and sucrose-evoked DAN activity.

Synaptic pruning during adolescence shapes adult social behavior in both males and females

Evolutionarily conserved, peer-directed social behaviors are essential to participate in many aspects of human society. These behaviors directly impact psychological, physiological, and behavioral maturation. Adolescence is an evolutionarily conserved period during which reward-related behaviors, including social behaviors, develop via developmental plasticity in the mesolimbic dopaminergic "reward" circuitry of the brain. The nucleus accumbens (NAc) is an intermediate reward relay center that develops during adolescence and mediates both social behaviors and dopaminergic signaling. In several developing brain regions, synaptic pruning mediated by microglia, the resident immune cells of the brain, is important for normal behavioral development. We previously demonstrated that during adolescence, in rats, microglial synaptic pruning shapes the development of NAc and social play behavior in males and females. In this report, we hypothesize that interrupting microglial pruning in NAc during adolescence will have persistent effects on male and female social behavior in adulthood. We found that inhibiting microglial pruning in the NAc during adolescence had different effects on social behavior in males and females. In males, inhibiting pruning increased familiar exploration and increased nonsocial contact. In females, inhibiting pruning did not change familiar exploration behavior but increased active social interaction. This leads us to infer that naturally occurring NAc pruning serves to reduce social behaviors toward a familiar conspecific in both males and females.

Acute stress facilitates habitual behavior in female rats

Instrumental behavior can reflect the influence of goal-directed and habitual systems. Contemporary research suggests that stress may facilitate control by the habitual system under conditions where the behavior would otherwise reflect control by the goal-directed system. However, it is unclear how stress modulates the influence of these systems on instrumental responding to achieve this effect, particularly in females. Here, we examine whether a mild psychogenic stressor experienced before acquisition training (Experiment 1), or prior to the test of expression (Experiment 2) would influence goal-directed and habitual control of instrumental responding in female rats. In both experiments, rats acquired an instrumental nose-poke response for a sucrose reward. This was followed by a reinforcer devaluation phase in which half the rats in Stressed and Non-Stressed conditions received pairings of the sucrose pellet with illness induced by lithium chloride until they rejected the pellet when offered. The remaining rats received a control treatment consisting of pellets and illness on separate days (Unpaired). Control by goal-directed and habitual systems was evaluated in a subsequent nonreinforced test of nose poking. The results of Experiment 1 indicated that the Non-Stressed Paired group reduced nose-poking compared to the Unpaired controls, identifying the response as goal directed, whereas the Stressed Paired and Unpaired groups made a similar number of nose pokes identifying the response as habitual despite a similar amount of training. Results from Experiment 2 indicated habitual control of nose-poke responding was present when stress was experienced just prior to the test. Collectively, these data suggest that stress may facilitate habitual control by altering the relative influence of goal-directed and habitual processes underpinning instrumental behavior. These results may be clinically relevant for understanding the contributions of stress to dysregulated instrumental behavior in compulsive pathologies.

The temporal structure of goal-directed and habitual operant behavior

Operant behavior can reflect the influence of goal-directed and habitual processes. These can be distinguished by changes to response rate following devaluation of the reinforcing outcome. Whether a response is goal directed or habitual depends on whether devaluation affects response rate. Response rate can be decomposed into frequencies of bouts and pauses by analyzing the distribution of interresponse times. This study sought to characterize goal-directed and habitual behaviors in terms of bout-initiation rate, within-bout response rate, bout length, and bout duration. Data were taken from three published studies that compared sensitivity to devaluation following brief and extended training with variable-interval schedules. Analyses focused on goal-directed and habitual responding, a comparison of a habitual response to a similarly trained response that had been converted back to goal-directed status after a surprising event, and a demonstration of contextual control of habit and goal direction in the same subjects. Across experiments and despite responses being clearly distinguished as goal directed and habitual by total response rate, analyses of bout-initiation rate, within-bout rate, bout length, and bout duration did not reveal a pattern that distinguished goal-directed from habitual responding.

Differential effects of acute and prolonged morphine withdrawal on motivational and goal-directed control over reward-seeking behavior

Opioid addiction is a relapsing disorder marked by uncontrolled drug use and reduced interest in normally rewarding activities. The current study investigated the impact of spontaneous withdrawal from chronic morphine exposure on emotional, motivational, and cognitive processes involved in regulating the pursuit and consumption of natural food rewards in male rats. In Experiment 1, rats experiencing acute morphine withdrawal lost weight and displayed somatic signs of drug dependence. However, hedonically-driven sucrose consumption was significantly elevated, suggesting intact and potentially heightened emotional reward processing. In Experiment 2, rats undergoing acute morphine withdrawal displayed reduced motivation when performing an effortful response for palatable food reward. Subsequent reward devaluation testing revealed that acute withdrawal also disrupted their ability to exert flexible goal-directed control over their reward-seeking behavior. Specifically, morphine-withdrawn rats displayed insensitivity to reward devaluation both when relying on prior action-outcome learning and when given direct feedback about the consequences of their actions. In Experiment 3, rats tested after prolonged morphine withdrawal displayed heightened rather than diminished motivation for food rewards and retained their ability to engage in flexible goal-directed action selection. However, brief re-exposure to morphine was sufficient to impair motivation and disrupt goal-directed action selection, though in this case insensitivity to reward devaluation was only observed in the presence of morphine-paired context cues and in the absence of response-contingent feedback. We suggest that these opioid-withdrawal induced deficits in motivation and goal-directed control may contribute to addiction by interfering with the pursuit of adaptive alternatives to drug use.

The projection-specific signals that establish functionally segregated dopaminergic synapses

Dopaminergic projections regulate various brain functions and are implicated in many neuropsychiatric disorders. There are two anatomically and functionally distinct dopaminergic projections connecting the midbrain to striatum: nigrostriatal, which controls movement, and mesolimbic, which regulates motivation. However, how these discrete dopaminergic synaptic connections are established is unknown. Through an unbiased search, we identify that two groups of antagonistic TGF-β family members, bone morphogenetic protein (BMP)6/BMP2 and transforming growth factor (TGF)-β2, regulate dopaminergic synapse development of nigrostriatal and mesolimbic neurons, respectively. Projection-preferential expression of their receptors contributes to specific synapse development. Downstream, Smad1 and Smad2 are specifically activated and required for dopaminergic synapse development and function in nigrostriatal vs. mesolimbic projections. Remarkably, Smad1 mutant mice show motor defects, whereas Smad2 mutant mice show lack of motivation. These results uncover the molecular logic underlying the proper establishment of functionally segregated dopaminergic synapses and may provide strategies to treat relevant, projection-specific disease symptoms by targeting specific BMPs/TGF-β and/or Smads.

Impaired microglia-mediated synaptic pruning in the nucleus accumbens during adolescence results in persistent dysregulation of familiar, but not novel social interactions in sex-specific ways

Evolutionarily conserved, peer-directed social behaviors are essential to participate in many aspects of human society. These behaviors directly impact psychological, physiological, and behavioral maturation. Adolescence is an evolutionarily conserved period during which reward-related behaviors, including social behaviors, develop via developmental plasticity in the mesolimbic dopaminergic 'reward' circuitry of the brain. The nucleus accumbens (NAc) is an intermediate reward relay center that develops during adolescence and mediates both social behaviors and dopaminergic signaling. In several developing brain regions, synaptic pruning mediated by microglia, the resident immune cells of the brain, is important for normal behavioral development. In rats, we previously demonstrated that microglial synaptic pruning also mediates NAc and social development during sex-specific adolescent periods and via sex-specific synaptic pruning targets. In this report, we demonstrate that interrupting microglial pruning in NAc during adolescence persistently dysregulates social behavior towards a familiar, but not novel social partner in both sexes, via sex-specific behavioral expression. This leads us to infer that naturally occurring NAc pruning serves to reduce social behaviors primarily directed toward a familiar conspecific in both sexes, but in sex-specific ways.

Long-term effects of THC exposure on reward learning and motivated behavior in adolescent and adult male rats

RATIONALE

The endocannabinoid system makes critical contributions to reward processing, motivation, and behavioral control. Repeated exposure to THC or other cannabinoid drugs can cause persistent adaptions in the endocannabinoid system and associated neural circuitry. It remains unclear how such treatments affect the way rewards are processed and pursued.

OBJECTIVE AND METHODS

We examined if repeated THC exposure (5 mg/kg/day for 14 days) during adolescence or adulthood led to long-term changes in rats' capacity to flexibly encode and use action-outcome associations for goal-directed decision making. Effects on hedonic feeding and progressive ratio responding were also assessed.

RESULTS

THC exposure had no effect on rats' ability to flexibly select actions following reward devaluation. However, instrumental contingency degradation learning, which involves avoiding an action that is unnecessary for reward delivery, was augmented in rats with a history of adult but not adolescent THC exposure. THC-exposed rats also displayed more vigorous instrumental behavior in this study, suggesting a motivational enhancement. A separate experiment found that while THC exposure had no effect on hedonic feeding behavior, it increased rats' willingness to work for food on a progressive ratio schedule, an effect that was more pronounced when THC was administered to adults. Adolescent and adult THC exposure had opposing effects on the CB1 receptor dependence of progressive ratio performance, decreasing and increasing sensitivity to rimonabant-induced behavioral suppression, respectively.

CONCLUSIONS

Our findings reveal that exposure to a translationally relevant THC exposure regimen induces long-lasting, age-dependent alterations in cognitive and motivational processes that regulate the pursuit of rewards.

Cross-talk between the HPA axis and addiction-related regions in stressful situations

Addiction is a worldwide problem that has a negative impact on society by imposing significant costs on health care, public security, and the deactivation of the community economic cycle. Stress is an important risk factor in the development of addiction and relapse vulnerability. Here we review studies that have demonstrated the diverse roles of stress in addiction. Term searches were conducted manually in important reference journals as well as in the Google Scholar and PubMed databases, between 2010 and 2022. In each section of this narrative review, an effort has been made to use pertinent sources. First, we will provide an overview of changes in the Hypothalamus-Pituitary-Adrenal (HPA) axis component following stress, which impact reward-related regions including the ventral tegmental area (VTA) and nucleus accumbens (NAc). Then we will focus on internal factors altered by stress and their effects on drug addiction vulnerability. We conclude that alterations in neuro-inflammatory, neurotrophic, and neurotransmitter factors following stress pathways can impact related mechanisms on craving and relapse susceptibility.

Development, wiring and function of dopamine neuron subtypes

The midbrain dopamine (mDA) system is composed of molecularly and functionally distinct neuron subtypes that mediate specific behaviours and are linked to various brain diseases. Considerable progress has been made in identifying mDA neuron subtypes, and recent work has begun to unveil how these neuronal subtypes develop and organize into functional brain structures. This progress is important for further understanding the disparate physiological functions of mDA neurons and their selective vulnerability in disease, and will ultimately accelerate therapy development. This Review discusses recent advances in our understanding of molecularly defined mDA neuron subtypes and their circuits, ranging from early developmental events, such as neuron migration and axon guidance, to their wiring and function, and future implications for therapeutic strategies.

Flexible control of Pavlovian-instrumental transfer based on expected reward value

The Pavlovian-instrumental transfer (PIT) paradigm is widely used to assay the motivational influence of reward-predictive cues, reflected by their ability to invigorate instrumental behavior. Leading theories assume that a cue's motivational properties are tied to predicted reward value. We outline an alternative view that recognizes that reward-predictive cues may suppress rather than motivate instrumental behavior under certain conditions, an effect termed positive conditioned suppression. We posit that cues signaling imminent reward delivery tend to inhibit instrumental behavior, which is exploratory by nature, in order to facilitate efficient retrieval of the expected reward. According to this view, the motivation to engage in instrumental behavior during a cue should be inversely related to the value of the predicted reward, since there is more to lose by failing to secure a high-value reward than a low-value reward. We tested this hypothesis in rats using a PIT protocol known to induce positive conditioned suppression. In Experiment 1, cues signaling different reward magnitudes elicited distinct response patterns. Whereas the one-pellet cue increased instrumental behavior, cues signaling three or nine pellets suppressed instrumental behavior and elicited high levels of food-port activity. Experiment 2 found that reward-predictive cues suppressed instrumental behavior and increased food-port activity in a flexible manner that was disrupted by post-training reward devaluation. Further analyses suggest that these findings were not driven by overt competition between the instrumental and food-port responses. We discuss how the PIT task may provide a useful tool for studying cognitive control over cue-motivated behavior in rodents. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Cocaine falls into oblivion during volitional initiation of choice trials

When facing a choice, most animals quit drugs in favour of a variety of nondrug alternatives. We recently found, rather unexpectedly, that choice of the nondrug alternative is in fact inflexible and habitual. One possible contributing factor to habitual choice is the intermittency and uncontrollability of choice trials in previous studies. Here, we asked whether and to what extent volitional control over the occurrence of choice trials could change animals' preference by preventing habitual choice. To do so, rats were trained to nosepoke in a hole to trigger the presentation of two operant levers: one associated with cocaine, the other with saccharin. Rats were then free to choose among the two levers to obtain the corresponding reward, after which both levers retracted until rats self-initiated the next choice trial. Overall, we found that volitional control over choice trials did not change preference. Most rats preferred saccharin over cocaine and selected this option almost exclusively. Intriguingly, after repeated choice and consumption of saccharin, rats transiently lost interest in this option (i.e., due to sensory-specific satiety), but they did not switch to cocaine, preferring instead to pause during long periods of time before reinitiating a choice trial for saccharin. This finding suggests that during volitional initiation of a choice trial, rats fail to consider cocaine as an option. We discuss a possible associative mechanism to explain this perplexing behaviour.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Making habits measurable beyond what they are not: A focus on associative dual-process models

Habits are the subject of intense international research. Under the associative dual-process model the outcome devaluation paradigm has been used extensively to classify behaviours as being either goal-directed (sensitive to shifts in the value of associated outcomes) or habitual (triggered by stimuli without anticipation of consequences). This has proven to be a useful framework for studying the neurobiology of habit and relevance of habits in clinical psychopathology. However, in recent years issues have been raised about this rather narrow definition of habits in comparison to habitual behaviour experienced in the real world. Specifically, defining habits as the absence of goal-directed control, the very specific set-ups required to demonstrate habit experimentally and the lack of direct evidence for habits as stimulus-response behaviours are viewed as problematic. In this review paper we address key critiques that have been raised about habit research within the framework of the associative dual-process model. We then highlight novel research approaches studying different features of habits with methods that expand beyond traditional paradigms.

Responses and functions of dopamine in nucleus accumbens core during social behaviors

Social behaviors are among the most important motivated behaviors. How dopamine (DA), a "reward" signal, releases during social behaviors has been a topic of interest for decades. Here, we use a genetically encoded DA sensor, GRABDA2m, to record DA activity in the nucleus accumbens (NAc) core during various social behaviors in male and female mice. We find that DA releases during approach, investigation and consummation phases of social behaviors signal animals' motivation, familiarity of the social target, and valence of the experience, respectively. Positive and negative social experiences evoke opposite DA patterns. Furthermore, DA releases during mating and fighting are sexually dimorphic with a higher level in males than in females. At the functional level, increasing DA in NAc enhances social interest toward a familiar conspecific and alleviates defeat-induced social avoidance. Altogether, our results reveal complex information encoded by NAc DA activity during social behaviors and their multistage functional roles.

Food cue reactivity: Neurobiological and behavioral underpinnings

The modern obesogenic environment contains an abundance of food cues (e.g., sight, smell of food) as well cues that are associated with food through learning and memory processes. Food cue exposure can lead to food seeking and excessive consumption in otherwise food-sated individuals, and a high level of food cue responsivity is a risk factor for overweight and obesity. Similar food cue responses are observed in experimental rodent models, and these models are therefore useful for mechanistically identifying the neural circuits mediating food cue responsivity. This review draws from both experimental rodent models and human data to characterize the behavioral and biological processes through which food-associated stimuli contribute to overeating and weight gain. Two rodent models are emphasized - cue-potentiated feeding and Pavlovian-instrumental transfer - that provide insight in the neural circuits and peptide systems underlying food cue responsivity. Data from humans are highlighted that reveal physiological, psychological, and neural mechanisms that connect food cue responsivity with overeating and weight gain. The collective literature identifies connections between heightened food cue responsivity and obesity in both rodents and humans, and identifies underlying brain regions (nucleus accumbens, amygdala, orbitofrontal cortex, hippocampus) and endocrine systems (ghrelin) that regulate food cue responsivity in both species. These species similarities are encouraging for the possibility of mechanistic rodent model research and further human research leading to novel treatments for excessive food cue responsivity in humans.

Calcium-binding proteins typify the dopaminergic neuronal subtypes in the ventral tegmental area of zebra finch, Taeniopygia guttata

Calcium-binding proteins (CBPs) regulate neuronal function in midbrain dopamine (DA)-ergic neurons in mammals by buffering and sensing the intracellular Ca²⁺ , and vesicular release. In birds, the equivalent set of neurons are important in song learning, directed singing, courtship, and energy balance, yet the status of CBPs in these neurons is unknown. Herein, for the first time, we probe the nature of CBPs, namely, Calbindin-, Calretinin-, Parvalbumin-, and Secretagogin-expressing DA neurons in the ventral tegmental area (VTA) and substantia nigra (SN) in the midbrain of zebra finch, Taeniopygia guttata. qRT-PCR analysis of ventral midbrain tissue fragment revealed higher Calbindin- and Calretinin-mRNA levels compared to Parvalbumin and Secretagogin. Application of immunofluorescence showed CBP-immunoreactive (-i) neurons in VTA (anterior [VTAa], mid [VTAm], caudal [VTAc]), SN (compacta [SNc], and reticulata [SNr]). Compared to VTAa, higher Calbindin- and Parvalbumin-immunoreactivity (-ir), and lower Calretinin-ir were observed in VTAm and VTAc. Secretagogin-ir was highly localized to VTAa. In SN, Calbindin- and Calretinin-ir were higher in SNc, SNr was Parvalbumin enriched, and Secretagogin-ir was not detected. Weak, moderate, and intense tyrosine hydroxylase (TH)-i VTA neurons were demarcated as subtypes 1, 2, and 3, respectively. While subtype 1 TH-i neurons were neither Calbindin- nor Calretinin-i, ∼80 and ∼65% subtype 2 and ∼30 and ∼45% subtype 3 TH-i neurons co-expressed Calbindin and Calretinin, respectively. All TH-i neuronal subtypes co-expressed Parvalbumin with reciprocal relationship with TH-ir. We suggest that the CBPs may determine VTA DA neuronal heterogeneity and differentially regulate their activity in T. guttata.

Pathway-specific inhibition of critical projections from the mediodorsal thalamus to the frontal cortex controls kindled seizures

There is a large unmet need for improved treatment for temporal lobe epilepsy (TLE); circuit-specific manipulation that disrupts the initiation and propagation of seizures is promising in this regard. The midline thalamus, including the mediodorsal nucleus (MD) is a critical distributor of seizure activity, but its afferent and efferent pathways that mediate seizure activity are unknown. Here, we used chemogenetics to silence input and output projections of the MD to discrete regions of the frontal cortex in the kindling model of TLE in rats. Chemogenetic inhibition of the projection from the amygdala to the MD abolished seizures, an effect that was replicated using optogenetic inhibition. Chemogenetic inhibition of projections from the MD to the prelimbic cortex likewise abolished seizures. By contrast, inhibition of projections from the MD to other frontal regions produced partial (orbitofrontal cortex, infralimbic cortex) or no (cingulate, insular cortex) attenuation of behavioral or electrographic seizure activity. These results highlight the particular importance of projections from MD to prelimbic cortex in the propagation of amygdala-kindled seizures.

Animal models of action control and cognitive dysfunction in Parkinson's disease

Parkinson's disease (PD) has historically been considered a motor disorder induced by a loss of dopaminergic neurons in the substantia nigra pars compacta. More recently, it has been recognized to have significant non-motor symptoms, most prominently cognitive symptoms associated with a dysexecutive syndrome. It is common in the literature to see motor and cognitive symptoms treated separately and, indeed, there has been a general call for specialized treatment of the latter, particularly in the more severe cases of PD with mild cognitive impairment and dementia. Animal studies have similarly been developed to model the motor or non-motor symptoms. Nevertheless, considerable research has established that segregating consideration of cognition from the precursors to motor movement, particularly movement associated with goal-directed action, is difficult if not impossible. Indeed, on some contemporary views cognition is embodied in action control, something that is particularly prevalent in theory and evidence relating to the integration of goal-directed and habitual control processes. The current paper addresses these issues within the literature detailing animal models of cognitive dysfunction in PD and their neural and neurochemical bases. Generally, studies using animal models of PD provide some of the clearest evidence for the integration of these action control processes at multiple levels of analysis and imply that consideration of this integrative process may have significant benefits for developing new approaches to the treatment of PD.

Minding my brain: Fourteen neuroscience-based principles to enhance psychotherapy responsiveness

Intersections between psychotherapy and neurosciences are at its dawn. The quest to understand the neural underpinnings of psychological processes has led several generations of scientists to explore neural correlates between mind, brain, and behavior. Neuroscience methods and research has given psychology new perspectives and insights about the structure and function of complex neural pathways, that underly human functioning (cognition, emotion, motivation, and interpersonal behavior). By translating neuroscientific findings into psychotherapeutic principles of change, it is possible to promote responsiveness towards brain dysfunction that underlies patients' psychological malfunctioning. In psychotherapy, responsiveness is a core aspect of the therapeutic change process, especially to adapt psychological interventions to patients' motivational stages and preferences, coping styles, neurobehavioral modes, and emotional needs. Within a transtheoretical and translational approach, contemporary neuroscientific findings are revised, discussed, and used to attempt to build-on fourteen theoretical brain-based principles that may be applied to psychotherapy. Translating these empirical findings into practical principles, clinical strategies and tasks is expected to enhance psychotherapy responsiveness grounded on a science-based knowledge of brain functioning.

Diverse midbrain dopaminergic neuron subtypes and implications for complex clinical symptoms of Parkinson's disease

Parkinson’s disease (PD), the most common degenerative movement disorder, is clinically manifested with various motor and non-motor symptoms. Degeneration of midbrain substantia nigra pas compacta (SNc) dopaminergic neurons (DANs) is generally attributed to the motor syndrome. The underlying neuronal mechanisms of non-motor syndrome are largely unexplored. Besides SNc, midbrain ventral tegmental area (VTA) DANs also produce and release dopamine and modulate movement, reward, motivation, and memory. Degeneration of VTA DANs also occurs in postmortem brains of PD patients, implying an involvement of VTA DANs in PD-associated non-motor symptoms. However, it remains to be established that there is a distinct segregation of different SNc and VTA DAN subtypes in regulating different motor and non-motor functions, and that different DAN subpopulations are differentially affected by normal ageing or PD. Traditionally, the distinction among different DAN subtypes was mainly based on the location of cell bodies and axon terminals. With the recent advance of single cell RNA sequencing technology, DANs can be readily classified based on unique gene expression profiles. A combination of specific anatomic and molecular markers shows great promise to facilitate the identification of DAN subpopulations corresponding to different behavior modules under normal and disease conditions. In this review, we first summarize the recent progress in characterizing genetically, anatomically, and functionally diverse midbrain DAN subtypes. Then, we provide perspectives on how the preclinical research on the connectivity and functionality of DAN subpopulations improves our current understanding of cell-type and circuit specific mechanisms of the disease, which could be critically informative for designing new mechanistic treatments.

Reactivating a positive feedback loop VTA-BLA-NAc circuit associated with positive experience ameliorates the attenuated reward sensitivity induced by chronic stress

Both genetic predisposition and life events, particularly life stress, are thought to increase the risk for depression. Reward sensitivity appears to be attenuated in major depressive disorder (MDD), suggesting deficits in reward processing in these patients. We identified the VTA-BLA-NAc circuit as being activated by sex reward, and the VTA neurons that respond to sex reward are mostly dopaminergic. Acute or chronic reactivation of this circuit ameliorates the reward insensitivity induced by chronic restraint stress. Our histological and electrophysiological results show that the VTA neuron subpopulation responding to restraint stress, predominantly GABAergic neurons, inhibits the responsiveness of VTA dopaminergic neurons to reward stimuli, which is probably the mechanism by which stress modulates the reward processing neural circuits and subsequently disrupts reward-related behaviours. Furthermore, we found that the VTA-BLA-NAc circuit is a positive feedback loop. Blocking the projections from the BLA to the NAc associated with sex reward increases the excitability of VTA GABAergic neurons and decreases the excitability of VTA dopaminergic neurons, while activating this pathway decreases the excitability of VTA GABAergic neurons and increases the excitability of VTA dopaminergic neurons, which may be the cellular mechanism by which the VTA-BLA-NAc circuit associated with sex reward ameliorates the attenuated reward sensitivity induced by chronic stress.

Fluid intake, what's dopamine got to do with it?

Maintaining fluid balance is critical for life. The central components that control fluid intake are only partly understood. This contribution to the collection of papers highlighting work by members of the Society for the Study of Ingestive Behavior focuses on the role that dopamine has on fluid intake and describes the roles that various bioregulators can have on thirst and sodium appetite by influencing dopamine systems in the brain. The goal of the review is to highlight areas in need of more research and to propose a framework to guide that research. We hope that this framework will inspire researchers in the field to investigate these interesting questions in order to form a more complete understanding of how fluid intake is controlled.

Chemogenetic dissection of the primate prefronto-subcortical pathways for working memory and decision-making

The primate prefrontal cortex (PFC) is situated at the core of higher brain functions via neural circuits such as those linking the caudate nucleus and mediodorsal thalamus. However, the distinctive roles of these prefronto-subcortical pathways remain elusive. Combining in vivo neuronal projection mapping with chemogenetic synaptic silencing, we reversibly dissected key pathways from dorsolateral part of the PFC (dlPFC) to the dorsal caudate (dCD) and lateral mediodorsal thalamus (MDl) individually in single monkeys. We found that silencing the bilateral dlPFC-MDl projections, but not the dlPFC-dCD projections, impaired performance in a spatial working memory task. Conversely, silencing the unilateral dlPFC-dCD projection, but not the unilateral dlPFC-MDl projection, altered preference in a decision-making task. These results revealed dissociable roles of the prefronto-subcortical pathways in working memory and decision-making, representing the technical advantage of imaging-guided pathway-selective chemogenetic manipulation for dissecting neural circuits underlying cognitive functions in primates.

Reward Processing and Circuit Dysregulation in Posttraumatic Stress Disorder

Past decades have witnessed substantial progress in understanding of neurobiological mechanisms that contribute to generation of various PTSD symptoms, including intrusive memories, physiological arousal and avoidance of trauma reminders. However, the neurobiology of anhedonia and emotional numbing in PTSD, that have been conceptualized as reward processing deficits - reward wanting (anticipation of reward) and reward liking (satisfaction with reward outcome), respectively, remains largely unexplored. Empirical evidence on reward processing in PTSD is rather limited, and no studies have examined association of reward processing abnormalities and neurocircuitry-based models of PTSD pathophysiology. The manuscript briefly summarizes "state of the science" of both human reward processing, and of PTSD implicated neurocircuitry, as well as empirical evidence of reward processing deficits in PTSD. We then summarize current gaps in the literature and outline key future directions, further illustrating it by the example of two alternative explanations of PTSD pathophysiology potentially affecting reward processing via different neurobiological pathways. Studying reward processing in PTSD will not only advance the understanding of their link, but also could enhance current treatment approaches by specifically targeting anhedonia and emotional symptoms in PTSD patients.

Oxytocin activation of paraventricular thalamic neurons promotes feeding motivation to attenuate stress-induced hypophagia

The neuropeptide oxytocin (OT) regulates important brain functions including feeding through activating OT receptors in multiple brain areas. Both OT fibers and OT receptors have been reported in the paraventricular thalamus (PVT), an area that was revealed to be important for the control of emotion, motivation, and food intake. However, the function and modulation of PVT OT signaling remain unknown. Here, we used a progressive ratio (PR) schedule of reinforcement to examine the role of PVT OT signaling in regulating the motivation for food and patch-clamp electrophysiology to study the modulation of OT on PVT neurons in brain slices. We demonstrate that PVT OT administration increases active lever presses to earn food rewards in both male and female mice under PR trials and OT receptor antagonist atosiban inhibits OT-induced increase in motivated lever presses. However, intra-PVT OT infusion does not affect food intake in normal conditions but attenuates hypophagia induced by stress and anxiety. Using patch-clamp recordings, we find OT induces long-lasting excitatory effects on neurons in all PVT regions, especially the middle to posterior PVT. OT not only evokes tonic inward currents but also increases the frequency of spontaneous excitatory postsynaptic currents on PVT neurons. The excitatory effect of OT on PVT neurons is mimicked by the specific OT receptor agonist [Thr4, Gly7]-oxytocin (TGOT) and blocked by OT receptor antagonist atosiban. Together, our study reveals a critical role of PVT OT signaling in promoting feeding motivation to attenuate stress-induced hypophagia through exciting PVT neurons.

Medial prefrontal cortical control of reward- and aversion-based behavioral output: Bottom-up modulation

How does the brain guide our actions? This is a complex issue, where the medial prefrontal cortex (mPFC) plays a crucial role. The mPFC is essential for cognitive flexibility and decision making. These functions are related to reward- and aversion-based learning, which ultimately drive behavior. Though, cortical projections and modulatory systems that may regulate those processes in the mPFC are less understood. How does the mPFC regulate approach-avoidance behavior in the case of conflicting aversive and appetitive stimuli? This is likely dependent on the bottom-up neuromodulation of the mPFC projection neurons. In this review, we integrate behavioral-, pharmacological-, and viral-based circuit manipulation data showing the involvement of mPFC dopaminergic, noradrenergic, cholinergic, and serotoninergic inputs in reward and aversion processing. Given that an incorrect balance of reward and aversion value could be a key problem in mental diseases such as substance use disorders, we discuss outstanding questions for future research on the role of mPFC modulation in reward and aversion.

Insights into the Neurobiology of Craving in Opioid Use Disorder

Purpose of review

Opioids remain the most potent form of pain relief currently available, yet have a high abuse liability. Here we discuss underlying neurobiological changes in Opioid Use Disorder (OUD) that likely contribute to drug craving, which in turn drives continued drug use and relapse.

Recent findings

Craving has emerged as a strong indicator in drug-seeking and relapse. Studies have demonstrated a number of allostatic changes in circuitry that facilitate learning of drug-stimuli relationships, thereby augmenting cue-triggered drug use and relapse.

Summary

This review will focus on key neurobiological changes in underlying circuitry observed during the initial and continued exposure to opioids that result in an increase in neural-reactivity to drug-related intrinsic and extrinsic drug cues, and to enhanced learning of drug-context correlations. This sensitized learning state may be an indication of the underlying framework that drives craving and ultimately, motivates increased salience of drug cues and drives drug-seeking.

Shifting motivational states: The effects of nucleus accumbens dopamine and opioid receptor activation on a modified effort-based choice task

The nucleus accumbens (NAc) is critical for regulating the appetitive and consummatory phases of motivated behavior. These experiments examined the effects of dopamine and opioid receptor manipulations within the NAc during an effort-based choice task that allowed for simultaneous assessment of both phases of motivation. Male Sprague-Dawley rats received bilateral guide cannulas targeting the NAc core and were tested in 1-hr sessions with free access to rat chow and the choice to work for sugar pellets on a progressive ratio 2 (PR2) reinforcement schedule. Individual groups of rats were tested following stimulation or blockade of NAc D1-like or D2-like receptors, stimulation of μ-, δ-, or κ-opioid receptors, or antagonism of opioid receptors. Behavior was examined under ad libitum conditions and following 23-h food restriction. NAc blockade of the D1-like receptors or stimulation of the D2 receptor reduced break point for earning sugar pellets; D2 receptor stimulation also modestly lowered chow intake. NAc μ-opioid receptor stimulation increased intake of the freely-available chow while simultaneously reducing break point for the sugar pellets. In non-restricted conditions, δ-opioid receptor stimulation increased both food intake and breakpoint. There were no effects of stimulating NAc D1 or κ receptors, nor did blocking D2 or opioid receptors affect task behavior. These data support prior literature linking dopamine to appetitive motivational processes, and suggest that μ- and δ-opioid receptors affect food-directed motivation differentially. Specifically, μ-opioid receptors shifted behavior towards consumption, and δ-opioid receptor enhanced both sugar-seeking and consumption of the pabulum chow when animals were not food restricted.

Reward-predictive cues elicit excessive reward seeking in adolescent rats

Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity.

The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

The ability to establish behaviorally what psychological capacity an animal is deploying-to discern accurately what an animal is doing-is key to functional analyses of the brain. Our current understanding of these capacities suggests, however, that this task is complex; there is evidence that multiple capacities are engaged simultaneously and contribute independently to the control of behavior. As such, establishing the contribution of a cell, circuit, or neural system to any one function requires careful dissection of that role from its influence on other functions and, therefore, the careful selection and design of behavioral tasks fit for that purpose. Here I describe recent research that has sought to utilize behavioral tools to investigate the neural bases of instrumental conditioning, particularly the circuits and systems supporting the capacity for goal-directed action, as opposed to conditioned reflexes and habits, and how these sources of action control interact to generate adaptive behavior.

Opposite Consequences of Tonic and Phasic Increases in Accumbal Dopamine on Alcohol-Seeking Behavior

Despite many years of work on dopaminergic mechanisms of alcohol addiction, much of the evidence remains mostly correlative in nature. Fortunately, recent technological advances have provided the opportunity to explore the causal role of alterations in neurotransmission within circuits involved in addictive behaviors. Here, we address this critical gap in our knowledge by integrating an optogenetic approach and an operant alcohol self-administration paradigm to assess directly how accumbal dopamine (DA) release dynamics influences the appetitive (seeking) component of alcohol-drinking behavior. We show that appetitive reward-seeking behavior in rats trained to self-administer alcohol can be shaped causally by ventral tegmental area-nucleus accumbens (VTA-NAc) DA neurotransmission. Our findings reveal that phasic patterns of DA release within this circuit enhance a discrete measure of alcohol seeking, whereas tonic patterns of stimulation inhibit this behavior. Moreover, we provide mechanistic evidence that tonic-phasic interplay within the VTA-NAc DA circuit underlies these seemingly paradoxical effects.

•

VTA-NAc DA transmission can bidirectionally modulate motivated behavior

•

Optogenetic increases in phasic DA release in the NAc enhance alcohol seeking

•

Optogenetic increases in tonic DA release in the NAc inhibit alcohol seeking

•

Phasic DA release can be decreased by the concurrent tonic activation

Hierarchical Action Control: Adaptive Collaboration Between Actions and Habits

It is now commonly accepted that instrumental actions can reflect goal-directed control; i.e., they can show sensitivity to changes in the relationship to and the value of their consequences. With overtraining, stress, neurodegeneration, psychiatric conditions, or after exposure to various drugs of abuse, goal-directed control declines and instrumental actions are performed independently of their consequences. Although this latter insensitivity has been argued to reflect the development of habitual control, the lack of a positive definition of habits has rendered this conclusion controversial. Here we consider various alternative definitions of habit, including recent suggestions they reflect chunked action sequences, to derive criteria with which to categorize responses as habitual. We consider various theories regarding the interaction between goal-directed and habitual controllers and propose a collaborative model based on their hierarchical integration. We argue that this model is consistent with the available data, can be instantiated both at an associative level and computationally and generates interesting predictions regarding the influence of this collaborative integration on behavior.

Phasic dopamine responses to a food-predictive cue are suppressed by the glucagon-like peptide-1 receptor agonist Exendin-4

Phasic dopamine activity is evoked by reliable predictors of food reward and plays a role in cue-triggered, goal-directed behavior. While this important signal is modulated by physiological state (e.g. hunger, satiety), the mechanisms by which physiological state is integrated by dopamine neurons is only beginning to be elucidated. Activation of central receptors for glucagon-like peptide-1 (GLP-1R) via long-acting agonists (e.g., Exendin-4) suppresses food intake and food-directed motivated behavior, in part, through action in regions with dopamine cell bodies, terminals, and/or neural populations that directly target the mesolimbic dopamine system. However, the effects of GLP-1R activation on cue-evoked, phasic dopamine signaling remain unknown. Here, in vivo fiber photometry was used to capture real-time signaling dynamics selectively from dopamine neurons in the ventral tegmental area of male and female transgenic (tyrosine hydroxylase-Cre; TH:Cre+) rats trained to associate an audio cue with the brief availability of a sucrose solution. Cue presentation evoked a brief spike in dopamine activity. Administration of Exendin-4 (Ex4; 0, 0.05, 0.1 μg) to the lateral ventricle both dose-dependently suppressed sucrose-directed behaviors and the magnitude of cue-evoked dopamine activity. Moreover, the amplitude of cue evoked dopamine activity was significantly correlated with subsequent sucrose-directed behaviors. While female rats exhibited overall reduced dopamine responses to the sucrose-paired cue relative to males, there was no significant interaction with Ex4. Together, these findings support a role for central GLP-1Rs in modulating a form of dopamine signaling that influences approach behavior and provide a potential mechanism whereby GLP-1 suppresses food-directed behaviors.

Learning the structure of the world: The adaptive nature of state-space and action representations in multi-stage decision-making

State-space and action representations form the building blocks of decision-making processes in the brain; states map external cues to the current situation of the agent whereas actions provide the set of motor commands from which the agent can choose to achieve specific goals. Although these factors differ across environments, it is currently unknown whether or how accurately state and action representations are acquired by the agent because previous experiments have typically provided this information a priori through instruction or pre-training. Here we studied how state and action representations adapt to reflect the structure of the world when such a priori knowledge is not available. We used a sequential decision-making task in rats in which they were required to pass through multiple states before reaching the goal, and for which the number of states and how they map onto external cues were unknown a priori. We found that, early in training, animals selected actions as if the task was not sequential and outcomes were the immediate consequence of the most proximal action. During the course of training, however, rats recovered the true structure of the environment and made decisions based on the expanded state-space, reflecting the multiple stages of the task. Similarly, we found that the set of actions expanded with training, although the emergence of new action sequences was sensitive to the experimental parameters and specifics of the training procedure. We conclude that the profile of choices shows a gradual shift from simple representations to more complex structures compatible with the structure of the world.