Decreasing Striatopallidal Pathway Function Enhances Motivation by Energizing the Initiation of Goal-Directed Action

Chemogenetic Attenuation of Acute Nociceptive Signaling Enhances Functional Outcomes Following Spinal Cord Injury

Identifying novel therapeutic approaches to promote recovery of neurological functions following spinal cord injury (SCI) remains a great unmet need. Nociceptive signaling in the acute phase of SCI has been shown to inhibit recovery of locomotor function and promote the development of chronic neuropathic pain. We therefore hypothesized that inhibition of nociceptive signaling in the acute phase of SCI might improve long-term functional outcomes in the chronic phase of injury. To test this hypothesis, we took advantage of a selective strategy utilizing AAV6 to deliver inhibitory (hM4Di) Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) to nociceptors of the L4-L6 dorsal root ganglia to evaluate the effects of transient nociceptor silencing on long-term sensory and motor functional outcomes in a rat thoracic contusion SCI model. Following hM4Di-mediated nociceptor inhibition from 0-14 days post-SCI, we conducted behavioral assessments until 70 days post-SCI, then performed histological assessments of lesion severity and axon plasticity. Our results show highly selective expression of hM4Di within small diameter nociceptors including calcitonin gene-related peptide (CGRP)+ and IB4-binding neurons. Expression of hM4Di in less than 25% of nociceptors was sufficient to increase hindlimb thermal withdrawal latency in naïve rats. Compared with subjects who received AAV-yellow fluorescent protein (YFP; control), subjects who received AAV-hM4Di exhibited attenuated thermal hyperalgesia, greater coordination, and improved hindlimb locomotor function. However, treatment did not impact the development of cold allodynia or mechanical hyperalgesia. Histological assessments of spinal cord tissue suggested trends toward reduced lesion volume, increased neuronal sparing and increased CGRP+ axon sprouting in hM4Di-treated animals. Together, these findings suggest that nociceptor silencing early after SCI may promote beneficial plasticity in the acute phase of injury that can impact long-term functional outcomes, and support previous work highlighting primary nociceptors as possible therapeutic targets for pain management after SCI.

Using caffeine as a chemical means to induce flow states

Flow is an intrinsically rewarding state characterised by positive affect and total task absorption. Because cognitive and physical performance are optimal in flow, chemical means to facilitate this state are appealing. Caffeine, a non-selective adenosine receptor antagonist, has been emphasized as a potential flow-inducer. Thus, we review the psychological and biological effects of caffeine that, conceptually, enhance flow. Caffeine may facilitate flow through various effects, including: i) upregulation of dopamine D1/D2 receptor affinity in reward-associated brain areas, leading to greater energetic arousal and 'wanting'; ii) protection of dopaminergic neurons; iii) increases in norepinephrine release and alertness, which offset sleep-deprivation and hypoarousal; iv) heightening of parasympathetic high frequency heart rate variability, resulting in improved cortical stress appraisal, v) modification of striatal endocannabinoid-CB1 receptor-signalling, leading to enhanced stress tolerance; and vi) changes in brain network activity in favour of executive function and flow. We also discuss the application of caffeine to treat attention deficit hyperactivity disorder and caveats. We hope to inspire studies assessing the use of caffeine to induce flow.

Nucleus accumbens D1- and D2-expressing neurons control the balance between feeding and activity-mediated energy expenditure

Accumulating evidence points to dysregulations of the Nucleus Accumbens (NAc) in eating disorders (ED), however its precise contribution to ED symptomatic dimensions remains unclear. Using chemogenetic manipulations in male mice, we found that activity of dopamine D1 receptor-expressing neurons of the NAc core subregion facilitated effort for a food reward as well as voluntary exercise, but decreased food intake, while D2-expressing neurons have opposite effects. These effects are congruent with D2-neurons being more active than D1-neurons during feeding while it is the opposite during running. Chronic manipulations of each subpopulations had limited effects on energy balance. However, repeated activation of D1-neurons combined with inhibition of D2-neurons biased behavior toward activity-related energy expenditure, whilst the opposite manipulations favored energy intake. Strikingly, concomitant activation of D1-neurons and inhibition of D2-neurons precipitated weight loss in anorexia models. These results suggest that dysregulations of NAc dopaminoceptive neurons might be at the core of EDs.

Neurosecretory Protein GM-Expressing Neurons Participate in Lipid Storage and Inflammation in Newly Developed Cre Driver Male Mice

Obesity induces inflammation in the hypothalamus and adipose tissue, resulting in metabolic disorders. A novel hypothalamic neuropeptide, neurosecretory protein GM (NPGM), was previously identified in the hypothalamus of vertebrates. While NPGM plays an important role in lipid metabolism in chicks, its metabolic regulatory effects in mammals remain unclear. In this study, a novel Cre driver line, NPGM-Cre, was generated for cell-specific manipulation. Cre-dependent overexpression of Npgm led to fat accumulation without increased food consumption in male NPGM-Cre mice. Chemogenetic activation of NPGM neurons in the hypothalamus acutely promoted feeding behavior and chronically resulted in a transient increase in body mass gain. Furthermore, the ablated NPGM neurons exhibited a tendency to be glucose intolerant, with infiltration of proinflammatory macrophages into the adipose tissue. These results suggest that NPGM neurons may regulate lipid storage and inflammatory responses, thereby maintaining glucose homeostasis.

Repeated chemogenetic activation of dopaminergic neurons induces reversible changes in baseline and amphetamine-induced behaviors

RATIONALE

Repeated chemogenetic stimulation is often employed to study circuit function and behavior. Chronic or repeated agonist administration can result in homeostatic changes, but this has not been extensively studied with designer receptors exclusively activated by designer drugs (DREADDs).

OBJECTIVES

We sought to evaluate the impact of repeated DREADD activation of dopaminergic (DA) neurons on basal behavior, amphetamine response, and spike firing. We hypothesized that repeated DREADD activation would mimic compensatory effects that we observed with genetic manipulations of DA neurons.

METHODS

Excitatory hM3D(Gq) DREADDs were virally expressed in adult TH-Cre and WT mice. In a longitudinal design, clozapine N-oxide (CNO, 1.0 mg/kg) was administered repeatedly. We evaluated basal and CNO- or amphetamine (AMPH)-induced locomotion and stereotypy. DA neuronal activity was assessed using in vivo single-unit recordings.

RESULTS

Acute CNO administration increased locomotion, but basal locomotion decreased after repeated CNO exposure in TH-CrehM3Dq mice relative to littermate controls. Further, after repeated CNO administration, AMPH-induced hyperlocomotion and stereotypy were diminished in TH-CrehM3Dq mice relative to controls. Repeated CNO administration reduced DA neuronal firing in TH-CrehM3Dq mice relative to controls. A two-month CNO washout period rescued the decreases in basal locomotion and AMPH response.

CONCLUSIONS

We found that repeated DREADD activation of DA neurons evokes homeostatic changes that should be factored into the interpretation of chronic DREADD applications and their impact on circuit function and behavior. These effects are likely to also be seen in other neuronal systems and underscore the importance of studying neuroadaptive changes with chronic or repeated DREADD activation.

The respective activation and silencing of striatal direct and indirect pathway neurons support behavior encoding

The basal ganglia are known to control actions and modulate movements. Neuronal activity in the two efferent pathways of the dorsal striatum is critical for appropriate behavioral control. Previous evidence has led to divergent conclusions on the respective engagement of both pathways during actions. Using calcium imaging to evaluate how neurons in the direct and indirect pathways encode behaviors during self-paced spontaneous explorations in an open field, we observed that the two striatal pathways exhibit distinct tuning properties. Supervised learning algorithms revealed that direct pathway neurons encode behaviors through their activation, whereas indirect pathway neurons exhibit behavior-specific silencing. These properties remain stable for weeks. Our findings highlight a complementary encoding of behaviors with congruent activations in the direct pathway encoding multiple accessible behaviors in a given context, and in the indirect pathway encoding the suppression of competing behaviors. This model reconciles previous conflicting conclusions on motor encoding in the striatum.

Striatopallidal adenosine A2A receptor modulation of goal-directed behavior: Homeostatic control with cognitive flexibility

Dysfunction of goal-directed behaviors under stressful or pathological conditions results in impaired decision-making and loss of flexibility of thoughts and behaviors, which underlie behavioral deficits ranging from depression, obsessive-compulsive disorders and drug addiction. Tackling the neuromodulators fine-tuning this core behavioral element may facilitate the development of effective strategies to control these deficits present in multiple psychiatric disorders. The current investigation of goal-directed behaviors has concentrated on dopamine and glutamate signaling in the corticostriatal pathway. In accordance with the beneficial effects of caffeine intake on mood and cognitive dysfunction, we now propose that caffeine's main site of action - adenosine A2A receptors (A2AR) - represent a novel target to homeostatically control goal-directed behavior and cognitive flexibility. A2AR are abundantly expressed in striatopallidal neurons and colocalize and interact with dopamine D2, NMDA and metabotropic glutamate 5 receptors to integrate dopamine and glutamate signaling. Specifically, striatopallidal A2AR (i) exert an overall "break" control of a variety of cognitive processes, making A2AR antagonists a novel strategy for improving goal-directed behavior; (ii) confer homeostatic control of goal-directed behavior by acting at multiple sites with often opposite effects, to enhance cognitive flexibility; (iii) integrate dopamine and adenosine signaling through multimeric A2AR-D2R heterocomplexes allowing a temporally precise fine-tuning in response to local signaling changes. As the U.S. Food and Drug Administration recently approved the A2AR antagonist Nourianz® (istradefylline) to treat Parkinson's disease, striatal A2AR-mediated control of goal-directed behavior may offer a new and real opportunity for improving deficits of goal-directed behavior and enhance cognitive flexibility under various neuropsychiatric conditions. This article is part of the Special Issue on "Purinergic Signaling: 50 years".

Ventral pallidal regulation of motivated behaviors and reinforcement

The interconnected nuclei of the ventral basal ganglia have long been identified as key regulators of motivated behavior, and dysfunction of this circuit is strongly implicated in mood and substance use disorders. The ventral pallidum (VP) is a central node of the ventral basal ganglia, and recent studies have revealed complex VP cellular heterogeneity and cell- and circuit-specific regulation of reward, aversion, motivation, and drug-seeking behaviors. Although the VP is canonically considered a relay and output structure for this circuit, emerging data indicate that the VP is a central hub in an extensive network for reward processing and the regulation of motivation that extends beyond classically defined basal ganglia borders. VP neurons respond temporally faster and show more advanced reward coding and prediction error processing than neurons in the upstream nucleus accumbens, and regulate the activity of the ventral mesencephalon dopamine system. This review will summarize recent findings in the literature and provide an update on the complex cellular heterogeneity and cell- and circuit-specific regulation of motivated behaviors and reinforcement by the VP with a specific focus on mood and substance use disorders. In addition, we will discuss mechanisms by which stress and drug exposure alter the functioning of the VP and produce susceptibility to neuropsychiatric disorders. Lastly, we will outline unanswered questions and identify future directions for studies necessary to further clarify the central role of VP neurons in the regulation of motivated behaviors. Significance: Research in the last decade has revealed a complex cell- and circuit-specific role for the VP in reward processing and the regulation of motivated behaviors. Novel insights obtained using cell- and circuit-specific interrogation strategies have led to a major shift in our understanding of this region. Here, we provide a comprehensive review of the VP in which we integrate novel findings with the existing literature and highlight the emerging role of the VP as a linchpin of the neural systems that regulate motivation, reward, and aversion. In addition, we discuss the dysfunction of the VP in animal models of neuropsychiatric disorders.

A neural substrate of sex-dependent modulation of motivation

While there is emerging evidence of sex differences in decision-making behavior, the neural substrates that underlie such differences remain largely unknown. Here we demonstrate that in mice performing a value-based decision-making task, while choices are similar between the sexes, motivation to engage in the task is modulated by action value more strongly in females than in males. Inhibition of activity in anterior cingulate cortex (ACC) neurons that project to the dorsomedial striatum (DMS) preferentially disrupts this relationship between value and motivation in females, without affecting choice in either sex. In line with these effects, in females compared to males, ACC-DMS neurons have stronger representations of negative outcomes and more neurons are active when the value of the chosen option is low. By contrast, the representation of each choice is similar between the sexes. Thus, we identify a neural substrate that contributes to sex-specific modulation of motivation by value.

Accumbal adenosine A2A receptor inactivation biases for large and costly rewards in the effort- but not delay-based decision making

The cost-benefit decision-making (CBDM) is critical to normal human activity and a diminished willingness to expend effort to obtain rewards is a prevalent/noted characteristic of neuropsychiatric disorders such as schizophrenia, Parkinson's disease. Numerous studies have identified nucleus accumbens (NAc) as an important locus for CBDM control but their neuromodulatory and behavioral mechanisms remain largely under-explored. Adenosine A_2A receptors (A_2ARs), which are highly concentrated in the striatopallidal neurons, can integrate glutamate and dopamine signals for controlling effort-related choice behaviors. While the involvement of A_2ARs in effort-based decision making is well documented, the role of other decision variables (reward discrimination) in effort-based decision making and the role of A_2AR in delay-based decision making are less clear. In this study, we have developed a well-controlled CBDM behavioral paradigm to manipulate effort/cost and reward independently or in combination, allowing a dissection of four behavioral elements: effort-based CBDM (E-CBDM), delay-based CBDM (D-CBDM), reward discrimination (RD), effort discrimination (ED), and determined the effect of genetic knockdown (KD) of NAc A_2AR on the four behavioral elements. We found that A_2AR KD in NAc increased the choice for larger, more costly reward in the E-CBDM, but not D-CBDM. Furthermore, this high-effort/high-reward bias was attributable to the increased willingness to engage in effort but not the effect of discrimination of reward magnitude. Our findings substantiate an important role of the NAc A_2AR in control of E-CBDM and support that pharmacologically targeting NAc A_2ARs would be a useful strategy for treating the aberrant effort-based decision making in neuropsychiatric disorders.

Mature parvalbumin interneuron function in prefrontal cortex requires activity during a postnatal sensitive period

In their seminal findings, Hubel and Wiesel identified sensitive periods in which experience can exert lasting effects on adult visual cortical functioning and behavior via transient changes in neuronal activity during development. Whether comparable sensitive periods exist for non-sensory cortices, such as the prefrontal cortex, in which alterations in activity determine adult circuit function and behavior is still an active area of research. Here, using mice we demonstrate that inhibition of prefrontal parvalbumin (PV)-expressing interneurons during the juvenile and adolescent period, results in persistent impairments in adult prefrontal circuit connectivity, in vivo network function, and behavioral flexibility that can be reversed by targeted activation of PV interneurons in adulthood. In contrast, reversible suppression of PV interneuron activity in adulthood produces no lasting effects. These findings identify an activity-dependent sensitive period for prefrontal circuit maturation and highlight how abnormal PV interneuron activity during development alters adult prefrontal circuit function and cognitive behavior.

Astrocytes mediate long-lasting synaptic regulation of ventral tegmental area dopamine neurons

The plasticity of glutamatergic transmission in the ventral tegmental area (VTA) represents a fundamental mechanism in the modulation of dopamine neuron burst firing and phasic dopamine release at target regions. These processes encode basic behavioral responses, including locomotor activity, learning and motivated behaviors. Here we describe a hitherto unidentified mechanism of long-term synaptic plasticity in mouse VTA. We found that the burst firing in individual dopamine neurons induces a long-lasting potentiation of excitatory synapses on adjacent dopamine neurons that crucially depends on Ca²⁺ elevations in astrocytes, mediated by endocannabinoid CB1 and dopamine D2 receptors co-localized at the same astrocytic process, and activation of pre-synaptic metabotropic glutamate receptors. Consistent with these findings, selective in vivo activation of astrocytes increases the burst firing of dopamine neurons in the VTA and induces locomotor hyperactivity. Astrocytes play, therefore, a key role in the modulation of VTA dopamine neuron functional activity.

Dysbindin-1A modulation of astrocytic dopamine and basal ganglia dependent behaviors relevant to schizophrenia

The mechanisms underlying the dichotomic cortical/basal ganglia dopaminergic abnormalities in schizophrenia are unclear. Astrocytes are important non-neuronal modulators of brain circuits, but their role in dopaminergic system remains poorly explored. Microarray analyses, immunohistochemistry, and two-photon laser scanning microscopy revealed that Dys1 hypofunction increases the reactivity of astrocytes, which express only the Dys1A isoform. Notably, behavioral and electrochemical assessments in mice selectively lacking the Dys1A isoform unraveled a more prominent impact of Dys1A in behavioral and dopaminergic/D2 alterations related to basal ganglia, but not cortical functioning. Ex vivo electron microscopy and protein expression analyses indicated that selective Dys1A disruption might alter intracellular trafficking in astrocytes, but not in neurons. In agreement, Dys1A disruption only in astrocytes resulted in decreased motivation and sensorimotor gating deficits, increased astrocytic dopamine D2 receptors and decreased dopaminergic tone within basal ganglia. These processes might have clinical relevance because the caudate, but not the cortex, of patients with schizophrenia shows a reduction of the Dys1A isoform. Therefore, we started to show a hitherto unknown role for the Dys1A isoform in astrocytic-related modulation of basal ganglia behavioral and dopaminergic phenotypes, with relevance to schizophrenia.

Natural locus coeruleus dynamics during feeding

Recent data demonstrate that noradrenergic neurons of the locus coeruleus (LC-NE) are required for fear-induced suppression of feeding, but the role of endogenous LC-NE activity in natural, homeostatic feeding remains unclear. Here, we found that LC-NE activity was suppressed during food consumption, and the magnitude of this neural response was attenuated as mice consumed more pellets throughout the session, suggesting that LC responses to food are modulated by satiety state. Visual-evoked LC-NE activity was also attenuated in sated mice, suggesting that satiety state modulates LC-NE encoding of multiple behavioral states. We also found that food intake could be attenuated by brief or longer durations of LC-NE activation. Last, we found that activation of the LC to the lateral hypothalamus pathway suppresses feeding and enhances avoidance and anxiety-like responding. Our findings suggest that LC-NE neurons modulate feeding by integrating both external cues (e.g., anxiogenic environmental cues) and internal drives (e.g., satiety).

Prior actions influence cost-benefit related decision-making during mouse foraging behaviors

Food foraging is essential for the fitness of animals. Previous studies have suggested that optimal foraging strategies involve a cost-benefit analysis comparing reward versus effort to guide action choices. Little is known how prior experience with different actions to obtain rewards may affect subsequent foraging choices. Here, we report a sunflower seed foraging test to investigate how effort and prior actions influence decision-making in laboratory mice. Sunflower seeds are a natural food favorite for mice, and mice spend effort to peel the hard shells to obtain the seeds. In our test, peeled and unpeeled sunflower seeds were placed at different ends of a Y-maze. Mice were free to explore the maze and make foraging decisions. Naïve mice were more likely to choose peeled seeds requiring low effort versus unpeeled seeds requiring high effort. Furthermore, mice with prior seed peeling experience significantly reduced preference for peeled seeds during the subsequent Y-maze foraging test, compared to mice pre-exposed to peeled seeds only. This experience dependent shift in foraging choice was associated with reduced seed peeling time and improved motor skills with practice, and predictable on a trial-by-trial basis by a probabilistic decision-making model with the amount of peeled and unpeeled seeds consumed as inputs. Together, these results suggest that laboratory mice make rational foraging choices based on effort estimation and moreover, prior actions to obtain reward alter effort estimation and decision-making through motor skill learning. This naturalist behavioral task may be applied to dissect neural mechanisms in adaptive decision-making during foraging.

The DREADDful Hurdles and Opportunities of the Chronic Chemogenetic Toolbox

The chronic character of chemogenetics has been put forward as one of the assets of the technique, particularly in comparison to optogenetics. Yet, the vast majority of chemogenetic studies have focused on acute applications, while repeated, long-term neuromodulation has only been booming in the past few years. Unfortunately, together with the rising number of studies, various hurdles have also been uncovered, especially in relation to its chronic application. It becomes increasingly clear that chronic neuromodulation warrants caution and that the effects of acute neuromodulation cannot be extrapolated towards chronic experiments. Deciphering the underlying cellular and molecular causes of these discrepancies could truly unlock the chronic chemogenetic toolbox and possibly even pave the way for chemogenetics towards clinical application. Indeed, we are only scratching the surface of what is possible with chemogenetic research. For example, most investigations are concentrated on behavioral read-outs, whereas dissecting the underlying molecular signature after (chronic) neuromodulation could reveal novel insights in terms of basic neuroscience and deregulated neural circuits. In this review, we highlight the hurdles associated with the use of chemogenetic experiments, as well as the unexplored research questions for which chemogenetics offers the ideal research platform, with a particular focus on its long-term application.

Distinct role of nucleus accumbens D2-MSN projections to ventral pallidum in different phases of motivated behavior

The nucleus accumbens (NAc) is a key region in motivated behaviors. NAc medium spiny neurons (MSNs) are divided into those expressing dopamine receptor D1 or D2. Classically, D1- and D2-MSNs have been described as having opposing roles in reinforcement, but recent evidence suggests a more complex role for D2-MSNs. Here, we show that optogenetic modulation of D2-MSN to ventral pallidum (VP) projections during different stages of motivated behavior has contrasting effects in motivation. Activation of D2-MSN-VP projections during a reward-predicting cue results in increased motivational drive, whereas activation at reward delivery decreases motivation; optical inhibition triggers the opposite behavioral effect. In addition, in a free-choice instrumental task, animals prefer the lever that originates one pellet in opposition to pellet plus D2-MSN-VP optogenetic activation and vice versa for optogenetic inhibition. In summary, D2-MSN-VP projections play different, and even opposing, roles in distinct phases of motivated behavior.

Changes in Sensorimotor Connectivity to dI3 Interneurons in Relation to the Postnatal Maturation of Grasping

Primitive reflexes are evident shortly after birth. Many of these reflexes disappear during postnatal development as part of the maturation of motor control. This study investigates the changes of connectivity related to sensory integration by spinal dI3 interneurons during the time in which the palmar grasp reflex gradually disappears in postnatal mice pups. Our results reveal an increase in GAD65/67-labeled terminals to perisomatic Vglut1-labeled sensory inputs contacting cervical and lumbar dI3 interneurons between postnatal day 3 and day 25. In contrast, there were no changes in the number of perisomatic Vglut1-labeled sensory inputs to lumbar and cervical dI3 interneurons other than a decrease between postnatal day 15 and day 25. Changes in postsynaptic GAD65/67-labeled inputs to dI3 interneurons were inconsistent with a role in the sustained loss of the grasp reflex. These results suggest a possible link between the maturation of hand grasp during postnatal development and increased presynaptic inhibition of sensory inputs to dI3 interneurons.

Cell-Type-Specific Adaptions in Striatal Medium-Sized Spiny Neurons and Their Roles in Behavioral Responses to Drugs of Abuse

Drug addiction is defined as a compulsive pattern of drug-seeking- and taking- behavior, with recurrent episodes of abstinence and relapse, and a loss of control despite negative consequences. Addictive drugs promote reinforcement by increasing dopamine in the mesocorticolimbic system, which alters excitatory glutamate transmission within the reward circuitry, thereby hijacking reward processing. Within the reward circuitry, the striatum is a key target structure of drugs of abuse since it is at the crossroad of converging glutamate inputs from limbic, thalamic and cortical regions, encoding components of drug-associated stimuli and environment, and dopamine that mediates reward prediction error and incentive values. These signals are integrated by medium-sized spiny neurons (MSN), which receive glutamate and dopamine axons converging onto their dendritic spines. MSN primarily form two mostly distinct populations based on the expression of either DA-D1 (D1R) or DA-D2 (D2R) receptors. While a classical view is that the two MSN populations act in parallel, playing antagonistic functional roles, the picture seems much more complex. Herein, we review recent studies, based on the use of cell-type-specific manipulations, demonstrating that dopamine differentially modulates dendritic spine density and synapse formation, as well as glutamate transmission, at specific inputs projecting onto D1R-MSN and D2R-MSN to shape persistent pathological behavioral in response to drugs of abuse. We also discuss the identification of distinct molecular events underlying the detrimental interplay between dopamine and glutamate signaling in D1R-MSN and D2R-MSN and highlight the relevance of such cell-type-specific molecular studies for the development of innovative strategies with potential therapeutic value for addiction. Because drug addiction is highly prevalent in patients with other psychiatric disorders when compared to the general population, we last discuss the hypothesis that shared cellular and molecular adaptations within common circuits could explain the co-occurrence of addiction and depression. We will therefore conclude this review by examining how the nucleus accumbens (NAc) could constitute a key interface between addiction and depression.

How changes in dopamine D2 receptor levels alter striatal circuit function and motivation

It was first posited, more than five decades ago, that the etiology of schizophrenia involves overstimulation of dopamine receptors. Since then, advanced clinical research methods, including brain imaging, have refined our understanding of the relationship between striatal dopamine and clinical phenotypes as well as disease trajectory. These studies point to striatal dopamine D2 receptors, the main target for all current antipsychotic medications, as being involved in both positive and negative symptoms. Simultaneously, animal models have been central to investigating causal relationships between striatal dopamine D2 receptors and behavioral phenotypes relevant to schizophrenia. We begin this article by reviewing the circuit, cell-type and subcellular locations of dopamine D2 receptors and their downstream signaling pathways. We then summarize results from several mouse models in which D2 receptor levels were altered in various brain regions, cell-types and developmental periods. Behavioral, electrophysiological and anatomical consequences of these D2 receptor perturbations are reviewed with a selective focus on striatal circuit function and alterations in motivated behavior, a core negative symptom of schizophrenia. These studies show that D2 receptors serve distinct physiological roles in different cell types and at different developmental time points, regulating motivated behaviors in sometimes opposing ways. We conclude by considering the clinical implications of this complex regulation of striatal circuit function by D2 receptors.

Thalamostriatal System Controls the Acquisition, Performance, and Flexibility of Learning Behavior

The dorsal striatum (DS) is a key structure of the basal ganglia circuitry, which regulates various types of learning processes and flexible switching of behavior. Intralaminar thalamic nuclei (ILNs) provide the main source of thalamostriatal inputs to the DS and constitute multiple nuclear groups, each of which innervates specific subdivisions of the striatum. Although the anatomical and electrophysiological properties of thalamostriatal neurons have been previously characterized, the behavioral and physiological functions of these neurons remain unclarified. Two representative thalamostriatal cell groups in the parafascicular nucleus (PF) and the central lateral nucleus (CL) are located in the caudal and rostral regions of the ILNs in rodents. Recently, the behavioral roles of these thalamostriatal cell groups have been investigated by the use of genetic and pharmacological manipulation techniques. In the current review, we summarize behavioral studies on thalamostriatal neurons, showing the key roles of these neurons in different learning processes, such as the acquisition, performance, and flexibility of behavior.

Projection from the basolateral amygdala to the anterior cingulate cortex facilitates the consolidation of long-term withdrawal memory

The process through which early memories are transferred to the cerebral cortex to form long-term memories is referred to as memory consolidation, and the basolateral amygdala (BLA) is an important brain region involved in this process. Although functional connections between the BLA and multiple brain regions are critical for the consolidation of withdrawal memory, whether the projection from the BLA to the anterior cingulate cortex (ACC) is involved in the formation or consolidation of withdrawal memory remains unclear. In this paper, we used a chemical genetic method to specifically label the BLA-ACC projection in a combined morphine withdrawal and conditioned place aversion (CPA) animal model. We found that (1) the inhibition of the BLA-ACC projection during conditioning had no effects on the formation of early withdrawal memory; (2) the inhibition of the BLA-ACC projection had no effects on the retrieval of either early or long-term withdrawal memory; and (3) the persistent inhibition of the BLA-ACC projection after early withdrawal memory formation could inhibit the formation of long-term withdrawal memory and decrease Arc protein expression in the ACC. These results suggested that the persistent activation of the BLA-ACC projection after the formation of early withdrawal memory facilitates the formation of long-term withdrawal memory by increasing the plasticity of ACC neurons.

Dietary lipids as regulators of reward processes: multimodal integration matters

The abundance of energy-dense and palatable diets in the modern food environment tightly contributes to the obesity pandemic. The reward circuit participates to the regulation of body homeostasis by integrating energy-related signals with neural substrates encoding cognitive and motivational components of feeding behaviors. Obesity and lipid-rich diets alter dopamine (DA) transmission leading to reward dysfunctions and food overconsumption. Recent reports indicate that dietary lipids can act, directly and indirectly, as functional modulators of the DA circuit. This raises the possibility that nutritional or genetic conditions affecting 'lipid sensing' mechanisms might lead to maladaptations of the DA system. Here, we discuss the most recent findings connecting dietary lipid sensing with DA signaling and its multimodal influence on circuits regulating food-reward processes.

Anhedonia as a central factor in depression: Neural mechanisms revealed from preclinical to clinical evidence

Anhedonia is one of the core symptoms of major depressive disorder (MDD), which is often inadequately treated by traditional antidepressants. The modern framework of anhedonia extends the definition from impaired consummatory pleasure or interest in rewards to a broad spectrum of deficits that impact functions such as reward anticipation, approach motivation, effort expenditure, reward valuation, expectation, and reward-cue association learning. Substantial preclinical and clinical research has explored the neural basis of reward deficits in the context of depression, and has implicated mesocorticolimbic reward circuitry comprising the nucleus accumbens, ventral pallidum, ventral tegmental area, amygdala, hippocampus, anterior cingulate, insula, orbitofrontal cortex, and other prefrontal cortex regions. Dopamine modulates several reward facets including anticipation, motivation, effort, and learning. As well, serotonin, norepinephrine, opioids, glutamate, Gamma aminobutyric acid (GABA), and acetylcholine are also involved in anhedonia, and medications targeting these systems may also potentially normalize reward processing in depression. Unfortunately, whereas reward anticipation and reward outcome are extensively explored by both preclinical and clinical studies, translational gaps remain in reward motivation, effort, valuation, and learning, where clinical neuroimaging studies are in the early stages. This review aims to synthesize the neurobiological mechanisms underlying anhedonia in MDD uncovered by preclinical and clinical research. The translational difficulties in studying the neural basis of reward are also discussed.

Chronic chemogenetic stimulation of the anterior olfactory nucleus reduces newborn neuron survival in the adult mouse olfactory bulb

During adult rodent life, newborn neurons are added to the olfactory bulb (OB) in a tightly controlled manner. Upon arrival in the OB, input synapses from the local bulbar network and the higher olfactory cortex precede the formation of functional output synapses, indicating a possible role for these regions in newborn neuron survival. An interplay between the environment and the piriform cortex in the regulation of newborn neuron survival has been suggested. However, the specific network and the neuronal cell types responsible for this effect have not been elucidated. Furthermore, the role of the other olfactory cortical areas in this process is not known. Here we demonstrate that pyramidal neurons in the mouse anterior olfactory nucleus, the first cortical area for odor processing, have a key role in the survival of newborn neurons. Using DREADD (Designer Receptors Exclusively Activated by Designer Drugs) technology, we applied chronic stimulation to the anterior olfactory nucleus and observed a decrease in newborn neurons in the OB through induction of apoptosis. These findings provide further insight into the network regulating neuronal survival in adult neurogenesis and strengthen the importance of the surrounding network for sustained integration of new neurons.

Dopamine D2 receptor overexpression in the nucleus accumbens core induces robust weight loss during scheduled fasting selectively in female mice

Anorexia nervosa (AN) is an eating disorder observed predominantly in women and girls that is characterized by a low body-mass index, hypophagia, and hyperactivity. Activity-based anorexia (ABA), which refers to the weight loss, hypophagia, and hyperactivity exhibited by rodents exposed to both running wheels and scheduled fasting, provides a model for aspects of AN. Increased dopamine D2/D3 receptor binding in the anteroventral striatum has been reported in AN patients. We virally overexpressed D2Rs on nucleus accumbens core (D2R-OE_NAc) neurons that endogenously express D2Rs, and tested mice of both sexes in the open field test, ABA paradigm, and intraperitoneal glucose tolerance test (IGTT). D2R-OE_NAc did not alter baseline body weight, but increased locomotor activity in the open field across both sexes. During constant access to food and running wheels, D2R-OE_NAc mice of both sexes increased food intake and ran more than controls. However, when food was available only 7 h a day, only female D2R-OE_NAc mice rapidly lost 25% of their initial body weight, reduced food intake, and substantially increased wheel running. Surprisingly, female D2R-OE_NAc mice also rapidly lost 25% of their initial body weight during scheduled fasting without wheel access and showed no changes in food intake. In contrast, male D2R-OE_NAc mice maintained body weight during scheduled fasting. D2R-OE_NAc mice of both sexes also showed glucose intolerance in the IGTT. In conclusion, D2R-OE_NAc alters glucose metabolism in both sexes but drives robust weight loss only in females during scheduled fasting, implicating metabolic mechanisms in this sexually dimorphic effect.

Striatopallidal Pathway Distinctly Modulates Goal-Directed Valuation and Acquisition of Instrumental Behavior via Striatopallidal Output Projections

The striatopallidal pathway is specialized for control of motor and motivational behaviors, but its causal role in striatal control of instrumental learning remains undefined (partly due to the confounding motor effects). Here, we leveraged the transient and "time-locked" optogenetic manipulations with the reward delivery to minimize motor confounding effect, to better define the striatopallidal control of instrumental behaviors. Optogenetic (Arch) silencing of the striatopallidal pathway in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) promoted goal-directed and habitual behaviors, respectively, without affecting acquisition of instrumental behaviors, indicating striatopallidal pathway suppression of instrumental behaviors under physiological condition. Conversely, striatopallidal pathway activation mainly affected the acquisition of instrumental behaviors with the acquisition suppression achieved by either optogenetic (ChR2) or chemicogenetic (hM3q) activation, by strong (10 mW, but not weak 1 mW) optogenetic activation, by the time-locked (but not random) optogenetic activation with the reward and by the DMS (but not DLS) striatopallidal pathway. Lastly, striatopallidal pathway modulated instrumental behaviors through striatopallidal output projections into the external globus pallidus (GPe) since optogenetic activation of the striatopallidal pathway in the DMS and of the striatopallidal output projections in the GPe similarly suppressed goal-directed behavior. Thus, the striatopallidal pathway confers distinctive and inhibitory controls of animal's sensitivity to goal-directed valuation and acquisition of instrumental behaviors under normal and over-activation conditions, through the output projections into GPe.

Dopamine D2R upregulation in ventral striatopallidal neurons does not affect Pavlovian or go/no-go learning

Ventral striatal dopamine is thought to be important for associative learning. Dopamine exerts its role via activation of dopamine D1 and D2 receptors in the ventral striatum. Upregulation of dopamine D2R in ventral striatopallidal neurons impairs incentive motivation via inhibiting synaptic transmission to the ventral pallidum. Here, we determined whether upregulation of D2Rs and the resulting impairment in ventral striatopallidal pathway function modulates associative learning in an auditory Pavlovian reward learning task as well as Go/No-Go learning in an operant based reward driven Go/No-Go task. We found that upregulation of D2Rs did not affect Pavlovian learning or the extinction of Pavlovian responses, and neither did it alter No-Go learning. We however observed a delay in the Go component of the task which may indicate a deficit in learning though it could also be attributed to the established locomotor hyperactivity of the mice. In combination with previously published findings, our data suggest that D2Rs in ventral striatopallidal neurons play a specific role in regulating motivation by balancing cost/benefit computations but do not necessarily affect associative learning. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Behavioral Deficits Induced by Somatostatin-Positive GABA Neuron Silencing Are Rescued by Alpha 5 GABA-A Receptor Potentiation

INTRODUCTION

Deficits in somatostatin-positive gamma-aminobutyric acid interneurons (SST+ GABA cells) are commonly reported in human studies of mood and anxiety disorder patients. A causal link between SST+ cell dysfunction and symptom-related behaviors has been proposed based on rodent studies showing that chronic stress, a major risk factor for mood and anxiety disorders, induces a low SST+ GABA cellular phenotype across corticolimbic brain regions; that lowering Sst, SST+ cell, or GABA functions induces depressive-/anxiety-like behaviors (a rodent behavioral construct collectively defined as "behavioral emotionality"); and that disinhibiting SST+ cells has antidepressant-like effects. Recent studies found that compounds preferentially potentiating receptors mediating SST+ cell functions, α5-GABAA receptor positive allosteric modulators (α5-PAMs), achieved antidepressant-like effects. Together, the evidence suggests that SST+ cells regulate mood and cognitive functions that are disrupted in mood disorders and that rescuing SST+ cell function via α5-PAM may represent a targeted therapeutic strategy.

METHODS

We developed a mouse model allowing chemogenetic manipulation of brain-wide SST+ cells and employed behavioral characterization 30 minutes after repeated acute silencing to identify contributions to symptom-related behaviors. We then assessed whether an α5-PAM, GL-II-73, could rescue behavioral deficits.

RESULTS

Brain-wide SST+ cell silencing induced features of stress-related illnesses, including elevated neuronal activity and plasma corticosterone levels, increased anxiety- and anhedonia-like behaviors, and impaired short-term memory. GL-II-73 led to antidepressant- and anxiolytic-like improvements among behavioral deficits induced by brain-wide SST+ cell silencing.

CONCLUSION

Our data validate SST+ cells as regulators of mood and cognitive functions and demonstrate that bypassing low SST+ cell function via α5-PAM represents a targeted therapeutic strategy.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Striatal direct and indirect pathway neurons differentially control the encoding and updating of goal-directed learning

The posterior dorsomedial striatum (pDMS) is necessary for goal-directed action; however, the role of the direct (dSPN) and indirect (iSPN) spiny projection neurons in the pDMS in such actions remains unclear. In this series of experiments, we examined the role of pDMS SPNs in goal-directed action in rats and found that whereas dSPNs were critical for goal-directed learning and for energizing the learned response, iSPNs were involved in updating that learning to support response flexibility. Instrumental training elevated expression of the plasticity marker Zif268 in dSPNs only, and chemogenetic suppression of dSPN activity during training prevented goal-directed learning. Unilateral optogenetic inhibition of dSPNs induced an ipsilateral response bias in goal-directed action performance. In contrast, although initial goal-directed learning was unaffected by iSPN manipulations, optogenetic inhibition of iSPNs, but not dSPNs, impaired the updating of this learning and attenuated response flexibility after changes in the action-outcome contingency.

Pseudotyped lentiviral vectors for tract-targeting and application for the functional control of selective neural circuits

A lentiviral vector strategy for efficient gene transfer through retrograde axonal transport provides a powerful approach for studying the neural circuit mechanisms that mediate higher level functions of the central nervous system. Pseudotyping of human immunodeficiency virus type-1 with different types of fusion glycoproteins (FuGs), which are composed of segments of rabies virus glycoprotein (RV-G) and vesicular stomatitis virus glycoprotein (VSV-G), enhances the efficiency of retrograde gene transfer in both rodent and non-human primate brains. These pseudotyped lentiviral vectors are classified into two groups, highly efficient retrograde gene transfer (HiRet) and neuron-specific retrograde gene transfer (NeuRet) vectors, based on their properties of gene transduction. Combinatorial use of the pseudotyped vectors with various molecular tools for manipulating neural circuit functions (such as the cell targeting, synaptic silencing, and optogenetic or chemogenetic approaches) enables us to control the function of specific neural circuits, thus leading to a deeper understanding of the mechanism underlying various nervous system functions.

Arrestin recruitment to dopamine D2 receptor mediates locomotion but not incentive motivation

The dopamine (DA) D2 receptor (D2R) is an important target for the treatment of neuropsychiatric disorders such as schizophrenia and Parkinson's disease. However, the development of improved therapeutic strategies has been hampered by our incomplete understanding of this receptor's downstream signaling processes in vivo and how these relate to the desired and undesired effects of drugs. D2R is a G protein-coupled receptor (GPCR) that activates G protein-dependent as well as non-canonical arrestin-dependent signaling pathways. Whether these effector pathways act alone or in concert to facilitate specific D2R-dependent behaviors is unclear. Here, we report on the development of a D2R mutant that recruits arrestin but is devoid of G protein activity. When expressed virally in "indirect pathway" medium spiny neurons (iMSNs) in the ventral striatum of D2R knockout mice, this mutant restored basal locomotor activity and cocaine-induced locomotor activity in a manner indistinguishable from wild-type D2R, indicating that arrestin recruitment can drive locomotion in the absence of D2R-mediated G protein signaling. In contrast, incentive motivation was enhanced only by wild-type D2R, signifying a dissociation in the mechanisms that underlie distinct D2R-dependent behaviors, and opening the door to more targeted therapeutics.

From Signaling Molecules to Circuits and Behaviors: Cell-Type-Specific Adaptations to Psychostimulant Exposure in the Striatum

Addiction is characterized by a compulsive pattern of drug seeking and consumption and a high risk of relapse after withdrawal that are thought to result from persistent adaptations within brain reward circuits. Drugs of abuse increase dopamine (DA) concentration in these brain areas, including the striatum, which shapes an abnormal memory trace of drug consumption that virtually highjacks reward processing. Long-term neuronal adaptations of gamma-aminobutyric acidergic striatal projection neurons (SPNs) evoked by drugs of abuse are critical for the development of addiction. These neurons form two mostly segregated populations, depending on the DA receptor they express and their output projections, constituting the so-called direct (D₁ receptor) and indirect (D₂ receptor) SPN pathways. Both SPN subtypes receive converging glutamate inputs from limbic and cortical regions, encoding contextual and emotional information, together with DA, which mediates reward prediction and incentive values. DA differentially modulates the efficacy of glutamate synapses onto direct and indirect SPN pathways by recruiting distinct striatal signaling pathways, epigenetic and genetic responses likely involved in the transition from casual drug use to addiction. Herein we focus on recent studies that have assessed psychostimulant-induced alterations in a cell-type-specific manner, from remodeling of input projections to the characterization of specific molecular events in each SPN subtype and their impact on long-lasting behavioral adaptations. We discuss recent evidence revealing the complex and concerted action of both SPN populations on drug-induced behavioral responses, as these studies can contribute to the design of future strategies to alleviate specific behavioral components of addiction.

Dynamic Changes in the Bridging Collaterals of the Basal Ganglia Circuitry Control Stress-Related Behaviors in Mice

The basal ganglia network has been implicated in the control of adaptive behavior, possibly by integrating motor learning and motivational processes. Both positive and negative reinforcement appear to shape our behavioral adaptation by modulating the function of the basal ganglia. Here, we examined a transgenic mouse line (G2CT) in which synaptic transmissions onto the medium spiny neurons (MSNs) of the basal ganglia are depressed. We found that the level of collaterals from direct pathway MSNs in the external segment of the globus pallidus (GPe) ('bridging collaterals') was decreased in these mice, and this was accompanied by behavioral inhibition under stress. Furthermore, additional manipulations that could further decrease or restore the level of the bridging collaterals resulted in an increase in behavioral inhibition or active behavior in the G2CT mice, respectively. Collectively, our data indicate that the striatum of the basal ganglia network integrates negative emotions and controls appropriate coping responses in which the bridging collateral connections in the GPe play a critical regulatory role.

Dysregulation of external globus pallidus-subthalamic nucleus network dynamics in parkinsonian mice during cortical slow-wave activity and activation

KEY POINTS

Reciprocally connected GABAergic external globus pallidus (GPe) and glutamatergic subthalamic nucleus (STN) neurons form a key network within the basal ganglia. In Parkinson's disease and its models, abnormal rates and patterns of GPe-STN network activity are linked to motor dysfunction. Using cell class-specific optogenetic identification and inhibition during cortical slow-wave activity and activation, we report that, in dopamine-depleted mice, (1) D2 dopamine receptor expressing striatal projection neurons (D2-SPNs) discharge at higher rates, especially during cortical activation, (2) prototypic parvalbumin-expressing GPe neurons are excessively patterned by D2-SPNs even though their autonomous activity is upregulated, (3) despite being disinhibited, STN neurons are not hyperactive, and (4) STN activity opposes striatopallidal patterning. These data argue that in parkinsonian mice abnormal, temporally offset prototypic GPe and STN neuron firing results in part from increased striatopallidal transmission and that compensatory plasticity limits STN hyperactivity and cortical entrainment.

ABSTRACT

Reciprocally connected GABAergic external globus pallidus (GPe) and glutamatergic subthalamic nucleus (STN) neurons form a key, centrally positioned network within the basal ganglia. In Parkinson's disease and its models, abnormal rates and patterns of GPe-STN network activity are linked to motor dysfunction. Following the loss of dopamine, the activities of GPe and STN neurons become more temporally offset and strongly correlated with cortical oscillations below 40 Hz. Previous studies utilized cortical slow-wave activity and/or cortical activation (ACT) under anaesthesia to probe the mechanisms underlying the normal and pathological patterning of basal ganglia activity. Here, we combined this approach with in vivo optogenetic inhibition to identify and interrupt the activity of D2 dopamine receptor-expressing striatal projection neurons (D2-SPNs), parvalbumin-expressing prototypic GPe (PV GPe) neurons, and STN neurons. We found that, in dopamine-depleted mice, (1) the firing rate of D2-SPNs was elevated, especially during cortical ACT, (2) abnormal phasic suppression of PV GPe neuron activity was ameliorated by optogenetic inhibition of coincident D2-SPN activity, (3) autonomous PV GPe neuron firing ex vivo was upregulated, presumably through homeostatic mechanisms, (4) STN neurons were not hyperactive, despite being disinhibited, (5) optogenetic inhibition of the STN exacerbated abnormal GPe activity, and (6) exaggerated beta band activity was not present in the cortex or GPe-STN network. Together with recent studies, these data suggest that in dopamine-depleted mice abnormally correlated and temporally offset PV GPe and STN neuron activity is generated in part by elevated striatopallidal transmission, while compensatory plasticity prevents STN hyperactivity and limits cortical entrainment.

Circulating Triglycerides Gate Dopamine-Associated Behaviors through DRD2-Expressing Neurons

Energy-dense food alters dopaminergic (DA) transmission in the mesocorticolimbic (MCL) system and can promote reward dysfunctions, compulsive feeding, and weight gain. Yet the mechanisms by which nutrients influence the MCL circuitry remain elusive. Here, we show that nutritional triglycerides (TGs), a conserved post-prandial metabolic signature among mammals, can be metabolized within the MCL system and modulate DA-associated behaviors by gating the activity of dopamine receptor subtype 2 (DRD2)-expressing neurons through a mechanism that involves the action of the lipoprotein lipase (LPL). Further, we show that in humans, post-prandial TG excursions modulate brain responses to food cues in individuals carrying a genetic risk for reduced DRD2 signaling. Collectively, these findings unveil a novel mechanism by which dietary TGs directly alter signaling in the reward circuit to regulate behavior, thereby providing a new mechanistic basis by which energy-rich diets may lead to (mal)adaptations in DA signaling that underlie reward deficit and compulsive behavior.

Causal Link between n-3 Polyunsaturated Fatty Acid Deficiency and Motivation Deficits

Reward-processing impairment is a common symptomatic dimension of several psychiatric disorders. However, whether the underlying pathological mechanisms are common is unknown. Herein, we asked if the decrease in the n-3 polyunsaturated fatty acid (PUFA) lipid species, consistently described in these pathologies, could underlie reward-processing deficits. We show that reduced n-3 PUFA biostatus in mice leads to selective motivational impairments. Electrophysiological recordings revealed increased collateral inhibition of dopamine D2 receptor-expressing medium spiny neurons (D2-MSNs) onto dopamine D1 receptor-expressing MSNs in the nucleus accumbens, a main brain region for the modulation of motivation. Strikingly, transgenically preventing n-3 PUFA deficiency selectively in D2-expressing neurons normalizes MSN collateral inhibition and enhances motivation. These results constitute the first demonstration of a causal link between a behavioral deficit and n-3 PUFA decrease in a discrete neuronal population and suggest that lower n-3 PUFA biostatus in psychopathologies could participate in the etiology of reward-related symptoms.

The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

The ability to establish behaviorally what psychological capacity an animal is deploying-to discern accurately what an animal is doing-is key to functional analyses of the brain. Our current understanding of these capacities suggests, however, that this task is complex; there is evidence that multiple capacities are engaged simultaneously and contribute independently to the control of behavior. As such, establishing the contribution of a cell, circuit, or neural system to any one function requires careful dissection of that role from its influence on other functions and, therefore, the careful selection and design of behavioral tasks fit for that purpose. Here I describe recent research that has sought to utilize behavioral tools to investigate the neural bases of instrumental conditioning, particularly the circuits and systems supporting the capacity for goal-directed action, as opposed to conditioned reflexes and habits, and how these sources of action control interact to generate adaptive behavior.

Striatopallidal adenosine A2A receptors in the nucleus accumbens confer motivational control of goal-directed behavior

The ability to learn the reward-value and action-outcome contingencies in dynamic environment is critical for flexible adaptive behavior and development of effective pharmacological control of goal-directed behaviors represents an important challenge for improving the deficits in goal-directed behavior which may underlie seemingly disparate symptoms across psychiatric disorders. Adenosine A_2A receptor (A_2AR) is emerging as a novel neuromodulatory target for controlling goal-directed behavior for its unique neuromodulatory features: the ability to integrate dopamine and glutamate signaling, the "brake" constraint of various cognitive processes and the balanced control of goal-directed and habit actions. However, the contribution and circuit mechanisms of the striatopallidal A_2ARs in nucleus accumbens (NAc) to control of goal-directed behavior remain to be determined. Here, we employed newly developed opto-A_2AR and the focal A_2AR knockdown strategies to demonstrate the causal role of NAc A_2AR in control of goal-directed behavior. Furthermore, we dissected out multiple distinct behavioral mechanisms underlying which NAc A_2ARs control goal-directed behavior: (i) NAc A_2ARs preferentially control goal-directed behavior at the expense of habit formation. (ii) NAc A_2ARs modify the animals' sensitivity to the value of the reward without affecting the action-outcome contingency. (iii) A_2AR antagonist KW6002 promotes instrumental actions by invigorating motivation. (iv) NAc A_2ARs facilitate Pavlovian incentive value transferring to instrumental action. (v) NAc A_2ARs control goal-directed behavior probably not through NAc-VP pathway. These insights into the behavioral and circuit mechanisms for NAc A_2AR control of goal-directed behavior facilitate translational potential for A_2AR antagonists in reversal of deficits in goal-directed decision-making associated with multiple neuropsychiatric disorders.

Chemogenetic inhibition in the dorsal striatum reveals regional specificity of direct and indirect pathway control of action sequencing

Animals engage in intricate action sequences that are constructed during instrumental learning. There is broad consensus that the basal ganglia play a crucial role in the formation and fluid performance of action sequences. To investigate the role of the basal ganglia direct and indirect pathways in action sequencing, we virally expressed Cre-dependent Gi-DREADDs in either the dorsomedial (DMS) or dorsolateral (DLS) striatum during and/or after action sequence learning in D1 and D2 Cre rats. Action sequence performance in D1 Cre rats was slowed down early in training when DREADDs were activated in the DMS, but sped up when activated in the DLS. Acquisition of the reinforced sequence was hindered when DREADDs were activated in the DLS of D2 Cre rats. Outcome devaluation tests conducted after training revealed that the goal-directed control of action sequence rates was immune to chemogenetic inhibition-rats suppressed the rate of sequence performance when rewards were devalued. Sequence initiation latencies were generally sensitive to outcome devaluation, except in the case where DREADD activation was removed in D2 Cre rats that previously experienced DREADD activation in the DMS during training. Sequence completion latencies were generally not sensitive to outcome devaluation, except in the case where D1 Cre rats experienced DREADD activation in the DMS during training and test. Collectively, these results suggest that the indirect pathway originating from the DLS is part of a circuit involved in the effective reinforcement of action sequences, while the direct and indirect pathways originating from the DMS contribute to the goal-directed control of sequence completion and initiation, respectively.

Cell-type-specific regulation of neuronal intrinsic excitability by macroautophagy

The basal ganglia are a group of subcortical nuclei that contribute to action selection and reinforcement learning. The principal neurons of the striatum, spiny projection neurons of the direct (dSPN) and indirect (iSPN) pathways, maintain low intrinsic excitability, requiring convergent excitatory inputs to fire. Here, we examined the role of autophagy in mouse SPN physiology and animal behavior by generating conditional knockouts of Atg7 in either dSPNs or iSPNs. Loss of autophagy in either SPN population led to changes in motor learning but distinct effects on cellular physiology. dSPNs, but not iSPNs, required autophagy for normal dendritic structure and synaptic input. In contrast, iSPNs, but not dSPNs, were intrinsically hyperexcitable due to reduced function of the inwardly rectifying potassium channel, Kir2. These findings define a novel mechanism by which autophagy regulates neuronal activity: control of intrinsic excitability via the regulation of potassium channel function.

Fast and accurate sCMOS noise correction for fluorescence microscopy

The rapid development of scientific CMOS (sCMOS) technology has greatly advanced optical microscopy for biomedical research with superior sensitivity, resolution, field-of-view, and frame rates. However, for sCMOS sensors, the parallel charge-voltage conversion and different responsivity at each pixel induces extra readout and pattern noise compared to charge-coupled devices (CCD) and electron-multiplying CCD (EM-CCD) sensors. This can produce artifacts, deteriorate imaging capability, and hinder quantification of fluorescent signals, thereby compromising strategies to reduce photo-damage to live samples. Here, we propose a content-adaptive algorithm for the automatic correction of sCMOS-related noise (ACsN) for fluorescence microscopy. ACsN combines camera physics and layered sparse filtering to significantly reduce the most relevant noise sources in a sCMOS sensor while preserving the fine details of the signal. The method improves the camera performance, enabling fast, low-light and quantitative optical microscopy with video-rate denoising for a broad range of imaging conditions and modalities.

Scientific complementary metal-oxide semiconductor (sCMOS) cameras have advanced the imaging field, but they often suffer from additional noise compared to CCD sensors. Here the authors present a content-adaptive algorithm for the automatic correction of sCMOS-related noise for fluorescence microscopy.

MIN1PIPE: A Miniscope 1-Photon-Based Calcium Imaging Signal Extraction Pipeline

In vivo calcium imaging using a 1-photon-based miniscope and a microendoscopic lens enables studies of neural activities in freely behaving animals. However, the high and fluctuating background, the inevitable movements and distortions of imaging field, and the extensive spatial overlaps of fluorescent signals emitted from imaged neurons inherent in this 1-photon imaging method present major challenges for extracting neuronal signals reliably and automatically from the raw imaging data. Here, we develop a unifying algorithm called the miniscope 1-photon imaging pipeline (MIN1PIPE), which contains several stand-alone modules and can handle a wide range of imaging conditions and qualities with minimal parameter tuning and automatically and accurately isolate spatially localized neural signals. We have quantitatively compared MIN1PIPE with other existing partial methods using both synthetic and real datasets obtained from different animal models and show that MIN1PIPE has superior efficiency and precision in analyzing noisy miniscope calcium imaging data.

Pharmacosynthetic Deconstruction of Sleep-Wake Circuits in the Brain

Over the past decade, basic sleep research investigating the circuitry controlling sleep and wakefulness has been boosted by pharmacosynthetic approaches, including chemogenetic techniques using designed receptors exclusively activated by designer drugs (DREADD). DREADD offers a series of tools that selectively control neuronal activity as a way to probe causal relationship between neuronal sub-populations and the regulation of the sleep-wake cycle. Following the path opened by optogenetics, DREADD tools applied to discrete neuronal sub-populations in numerous brain areas quickly made their contribution to the discovery and the expansion of our understanding of critical brain structures involved in a wide variety of behaviors and in the control of vigilance state architecture.

Striatal circuits for reward learning and decision-making

The striatum is essential for learning which actions lead to reward and for implementing those actions. Decades of experimental and theoretical work have led to several influential theories and hypotheses about how the striatal circuit mediates these functions. However, owing to technical limitations, testing these hypotheses rigorously has been difficult. In this Review, we briefly describe some of the classic ideas of striatal function. We then review recent studies in rodents that take advantage of optical and genetic methods to test these classic ideas by recording and manipulating identified cell types within the circuit. This new body of work has provided experimental support of some longstanding ideas about the striatal circuit and has uncovered critical aspects of the classic view that are incorrect or incomplete.

Indirect Medium Spiny Neurons in the Dorsomedial Striatum Regulate Ethanol-Containing Conditioned Reward Seeking

Adenosine 2A receptor (A_2AR)-containing indirect medium spiny neurons (iMSNs) in the dorsomedial striatum (DMS) contribute to reward-seeking behaviors. However, those roles for ethanol-seeking behaviors remain unknown. To investigate ethanol-seeking behaviors, we used an ethanol-containing reward (10% ethanol and 10% sucrose solution; 10E10S). Upon conditioning with 10E10S, mice that initially only preferred 10% sucrose, not 10E10S, showed a stronger preference for 10E10S. Then, we investigated whether the manipulation of the DMS-external globus pallidus (GPe) iMSNs circuit alters the ethanol-containing reward (10E10S) seeking behaviors using the combination of pharmacologic and optogenetic approaches. DMS A_2AR activation dampened operant conditioning-induced ethanol-containing reward, whereas A_2AR antagonist abolished the effects of the A_2AR agonist and restored ethanol-containing reward-seeking. Moreover, pre-ethanol exposure potentiated the A_2AR-dependent reward-seeking. Interestingly, mice exhibiting ethanol-containing reward-seeking showed the reduction of the DMS iMSNs activity, suggesting that disinhibiting iMSNs decreases reward-seeking behaviors. In addition, we found that A_2AR activation reversed iMSNs neural activity in the DMS. Similarly, optogenetic stimulation of the DMS-GPe iMSNs reduced ethanol-containing reward-seeking, whereas optogenetic inhibition of the DMS-GPe iMSNs reversed this change. Together, our study demonstrates that DMS A_2AR and iMSNs regulate ethanol-containing reward-seeking behaviors.SIGNIFICANCE STATEMENT Our findings highlight the mechanisms of how operant conditioning develops the preference of ethanol-containing conditioned reward. Mice exhibiting ethanol-containing reward-seeking showed a reduction of the indirect medium spiny neuronal activity in the dorsomedial striatum. Pharmacological activation of adenosine A_2A receptor (A_2AR) or optogenetic activation of indirect medium spiny neurons dampened operant conditioned ethanol-containing reward-seeking, whereas inhibiting this neuronal activity restored ethanol-containing reward-seeking. Furthermore, repeated intermittent ethanol exposure potentiated A_2AR-dependent reward-seeking. Therefore, our finding suggests that A_2AR-containing indirect medium spiny neuronal activation reduces ethanol-containing reward-seeking, which may provide a potential therapeutic target for alcohol use disorder.

Emerging roles of striatal dopamine D2 receptors in motivated behaviour: Implications for psychiatric disorders

Impaired motivation has been a long recognized negative symptom of schizophrenia, as well as a common feature of non-psychotic psychiatric disorders, responsible for a significant share of functional burden, and with limited treatment options. The striatum and dopamine signalling system play a central role in extracting motivationally relevant information from the environment, selecting which behavioural direction the animal should follow, and the vigour with which to engage it. Much of this function relies on striatal projection neurons, known as medium spiny neurons (MSNs) expressing dopamine D2 receptors (D2Rs), or D2-MSNs. However, determining the precise nature of D2-MSNs in regulating motivated behaviour in both healthy individuals and experimental manipulations of D2-MSN function has at times yielded a somewhat confusing picture since their activity has been linked to either enhancement or dampening of motivation in animal models. In this MiniReview, we describe the latest data from rodent studies that investigated how D2Rs exert their modulatory effect on motivated behaviour by regulating striatal indirect pathway neuronal activity. We will include a discussion about how functional selectivity of D2Rs towards G protein-dependent or β-arrestin-dependent signalling differentially affects motivated behaviour. Lastly, we will describe a recent preclinical attempt to improve motivation by exploiting serotonin receptor-mediated modulation of dopamine transmission in the striatum.

BSSE: An open-source image processing tool for miniaturized microscopy

Single-photon-excitation-based miniaturized microscope, or miniscope, has recently emerged as a powerful tool for imaging neural ensemble activities in freely moving animals. In the meanwhile, this highly flexible and implantable technology promises great potential for studying a broad range of cells, tissues and organs. To date, however, applications have been largely limited by the properties of the imaging modality. It is therefore highly desirable for a method generally applicable for processing miniscopy images, enabling and extending the applications to diverse anatomical and functional traits, spanning various cell types in the brain and other organs. We report an image processing approach, termed BSSE, for background suppression and signal enhancement for miniscope image processing. The BSSE method provides a simple, automatic solution to the intrinsic challenges of overlapping signals, high background and artifacts in miniscopy images. We validated the method by imaging synthetic structures and various biological samples of brain, tumor, and kidney tissues. The work represents a generally applicable tool for miniscopy technology, suggesting broader applications of the miniaturized, implantable and flexible technology for biomedical research.