Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli

Integrated omics analysis reveals the alteration of gut microbiota and fecal metabolites in Cervus elaphus kansuensis

The gut microbiota is the largest and most complex microecosystem in animals. It is influenced by the host's dietary habits and living environment, and its composition and diversity play irreplaceable roles in animal nutrient metabolism, immunity, and adaptation to the environment. Although the gut microbiota of red deer has been studied, the composition and function of the gut microbiota in Gansu red deer (Cervus elaphus kansuensis), an endemic subspecies of red deer in China, has not been reported. In this study, the composition and diversity of the gut microbiome and fecal metabolomics of C. elaphus kansuensis were identified and compared for the first time by using 16S rDNA sequencing, metagenomic sequencing, and LC-MS/MS. There were significant differences in gut microbiota structure and diversity between wild and farmed C. elaphus kansuensis. The 16S rDNA sequencing results showed that the genus UCRD-005 was dominant in both captive red deer (CRD) and wild red deer (WRD). Metagenomic sequencing showed similar results to those of 16S rDNA sequencing for gut microbiota in CRD and WRD at the phylum and genus levels. 16S rDNA and metagenomics sequencing data suggested that Bacteroides and Bacillus might serve as marker genera for CRD and WRD, respectively. Fecal metabolomics results showed that 520 metabolites with significant differences were detected between CRD and WRD and most differential metabolites were involved in lipid metabolism. The results suggested that large differences in gut microbiota composition and fecal metabolites between CRD and WRD, indicating that different dietary habits and living environments over time have led to the development of stable gut microbiome characteristics for CRD and WRD to meet their respective survival and reproduction needs. KEY POINTS: • Environment and food affected the gut microbiota and fecal metabolites in red deer • Genera Bacteroides and Bacillus may play important roles in CRD and WRD, respectively • Flavonoids and ascorbic acid in fecal metabolites may influence health of red deer.

Shifting attention to orient or avoid: a unifying account of the tail of the striatum and its dopaminergic inputs

The tail of the striatum (TS) is increasingly recognized as a unique subdivision of the striatum, characterized by its dense sensory inputs and projections received from a distinct group of dopamine neurons. Separate lines of research have characterized the functional role of TS, and TS-projecting dopamine neurons, in three realms: saccadic eye movement towards valuable visual stimuli; tone-guided choice between two options; and defensive responses to threatening stimuli. We propose a framework for reconciling these diverse roles as varied implementations of a conserved response to salient stimuli, with dopamine in TS providing a teaching signal to promote quick attentional shifts that facilitate stimulus-driven orientation and/or avoidance.

Adaptive circuits for action and value information in rodent operant learning

Operant learning is a behavioral paradigm where animals learn to associate their actions with consequences, adapting their behavior accordingly. This review delves into the neural circuits that underpin operant learning in rodents, emphasizing the dynamic interplay between neural pathways, synaptic plasticity, and gene expression changes. We explore the cortico-basal ganglia circuits, highlighting the pivotal role of dopamine in modulating these pathways to reinforce behaviors that yield positive outcomes. We include insights from recent studies, which reveals the intricate roles of midbrain dopamine neurons in integrating action initiation and reward feedback, thereby enhancing movement-related activities in the dorsal striatum. Additionally, we discuss the molecular diversity of striatal neurons and their specific roles in reinforcement learning. The review also covers advances in transcriptome analysis techniques, such as single-cell RNA sequencing, which have provided deeper insights into the gene expression profiles associated with different neuronal populations during operant learning.

Molecular and spatial transcriptomic classification of midbrain dopamine neurons and their alterations in a LRRK2G2019S model of Parkinson's disease

Several studies have revealed that midbrain dopamine (DA) neurons, even within a single neuroanatomical area, display heterogeneous properties. In parallel, studies using single cell profiling techniques have begun to cluster DA neurons into subtypes based on their molecular signatures. Recent work has shown that molecularly defined DA subtypes within the substantia nigra (SNc) display distinctive anatomic and functional properties, and differential vulnerability in Parkinson's disease (PD). Based on these provocative results, a granular understanding of these putative subtypes and their alterations in PD models, is imperative. We developed an optimized pipeline for single-nuclear RNA sequencing (snRNA-seq) and generated a high-resolution hierarchically organized map revealing 20 molecularly distinct DA neuron subtypes belonging to three main families. We integrated this data with spatial MERFISH technology to map, with high definition, the location of these subtypes in the mouse midbrain, revealing heterogeneity even within neuroanatomical sub-structures. Finally, we demonstrate that in the preclinical LRRK2G2019S knock-in mouse model of PD, subtype organization and proportions are preserved. Transcriptional alterations occur in many subtypes including those localized to the ventral tier SNc, where differential expression is observed in synaptic pathways, which might account for previously described DA release deficits in this model. Our work provides an advancement of current taxonomic schemes of the mouse midbrain DA neuron subtypes, a high-resolution view of their spatial locations, and their alterations in a prodromal mouse model of PD.

Explaining dopamine through prediction errors and beyond

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Periaqueductal gray activates antipredatory neural responses in the amygdala of foraging rats

Pavlovian fear conditioning research suggests that the interaction between the dorsal periaqueductal gray (dPAG) and basolateral amygdala (BLA) acts as a prediction error mechanism in the formation of associative fear memories. However, their roles in responding to naturalistic predatory threats, characterized by less explicit cues and the absence of reiterative trial-and-error learning events, remain unexplored. In this study, we conducted single-unit recordings in rats during an 'approach food-avoid predator' task, focusing on the responsiveness of dPAG and BLA neurons to a rapidly approaching robot predator. Optogenetic stimulation of the dPAG triggered fleeing behaviors and increased BLA activity in naive rats. Notably, BLA neurons activated by dPAG stimulation displayed immediate responses to the robot, demonstrating heightened synchronous activity compared to BLA neurons that did not respond to dPAG stimulation. Additionally, the use of anterograde and retrograde tracer injections into the dPAG and BLA, respectively, coupled with c-Fos activation in response to predatory threats, indicates that the midline thalamus may play an intermediary role in innate antipredatory-defensive functioning.

Neural underpinnings of fine motor skills under stress and anxiety: A review

This review offers a comprehensive examination of how stress and anxiety affect motor behavior, particularly focusing on fine motor skills and gait adaptability. We explore the role of several neurochemicals, including brain-derived neurotrophic factor (BDNF) and dopamine, in modulating neural plasticity and motor control under these affective states. The review highlights the importance of developing therapeutic strategies that enhance motor performance by leveraging the interactions between key neurochemicals. Additionally, we investigate the complex interplay between emotional-cognitive states and sensorimotor behaviors, showing how stress and anxiety disrupt neural integration, leading to impairments in skilled movements and negatively impacting quality of life. Synthesizing evidence from human and rodent studies, we provide a detailed understanding of the relationships among stress, anxiety, and motor behavior. Our findings reveal neurophysiological pathways, behavioral outcomes, and potential therapeutic targets, emphasizing the intricate connections between neurobiological mechanisms, environmental factors, and motor performance.

A feature-specific prediction error model explains dopaminergic heterogeneity

The hypothesis that midbrain dopamine (DA) neurons broadcast a reward prediction error (RPE) is among the great successes of computational neuroscience. However, recent results contradict a core aspect of this theory: specifically that the neurons convey a scalar, homogeneous signal. While the predominant family of extensions to the RPE model replicates the classic model in multiple parallel circuits, we argue that these models are ill suited to explain reports of heterogeneity in task variable encoding across DA neurons. Instead, we introduce a complementary 'feature-specific RPE' model, positing that individual ventral tegmental area DA neurons report RPEs for different aspects of an animal's moment-to-moment situation. Further, we show how our framework can be extended to explain patterns of heterogeneity in action responses reported among substantia nigra pars compacta DA neurons. This theory reconciles new observations of DA heterogeneity with classic ideas about RPE coding while also providing a new perspective of how the brain performs reinforcement learning in high-dimensional environments.

A distinct circuit for biasing visual perceptual decisions and modulating superior colliculus activity through the mouse posterior striatum

The basal ganglia play a key role in visual perceptual decisions. Despite being the primary target in the basal ganglia for inputs from the visual cortex, the posterior striatum's (PS) involvement in visual perceptual behavior remains unknown in rodents. We reveal that the PS direct pathway is largely segregated from the dorsomedial striatum (DMS) direct pathway, the other major striatal target for visual cortex. We investigated the role of the PS in visual perceptual decisions by optogenetically stimulating striatal medium spiny neurons in the direct pathway (D1-MSNs) of mice performing a visual change-detection task. PS D1-MSN activation robustly biased visual decisions in a manner dependent on visual context, timing, and reward expectation. We examined the effects of PS and DMS direct pathway activation on neuronal activity in the superior colliculus (SC), a major output target of the basal ganglia. Activation of either direct pathway rapidly modulated SC neurons, but mostly targeted different SC neurons and had opposite effects. These results demonstrate that the PS in rodents provides an important route for controlling visual decisions, in parallel with the better known DMS, but with distinct anatomical and functional properties.

Striosomes Target Nigral Dopamine-Containing Neurons via Direct-D1 and Indirect-D2 Pathways Paralleling Classic Direct-Indirect Basal Ganglia Systems

Balanced activity of canonical direct D1 and indirect D2 basal ganglia pathways is considered a core requirement for normal movement, and their imbalance is an etiologic factor in movement and neuropsychiatric disorders. We present evidence for a conceptually equivalent pair of direct-D1 and indirect-D2 pathways that arise from striatal projection neurons (SPNs) of the striosome compartment rather than from SPNs of the matrix, as do the canonical pathways. These S-D1 and S-D2 striosomal pathways target substantia nigra dopamine-containing neurons instead of basal ganglia motor output nuclei. They modulate movement oppositely to the modulation by the canonical pathways: S-D1 is inhibitory and S-D2 is excitatory. The S-D1 and S-D2 circuits likely influence motivation for learning and action, complementing and reorienting canonical pathway modulation. A major conceptual reformulation of the classic direct-indirect pathway model of basal ganglia function is needed, as well as reconsideration of the effects of D2-targeting therapeutic drugs.

Exploring causal mechanisms of psychosis risk

Robust epidemiological evidence of risk and protective factors for psychosis is essential to inform preventive interventions. Previous evidence syntheses have classified these risk and protective factors according to their strength of association with psychosis. In this critical review we appraise the distinct and overlapping mechanisms of 25 key environmental risk factors for psychosis, and link these to mechanistic pathways that may contribute to neurochemical alterations hypothesised to underlie psychotic symptoms. We then discuss the implications of our findings for future research, specifically considering interactions between factors, exploring universal and subgroup-specific factors, improving understanding of temporality and risk dynamics, standardising operationalisation and measurement of risk and protective factors, and developing preventive interventions targeting risk and protective factors.

Rethinking dopamine-guided action sequence learning

As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.

Synchronous Measurements of Extracellular Action Potentials and Neurochemical Activity with Carbon Fiber Electrodes in Nonhuman Primates

Measuring the dynamic relationship between neuromodulators, such as dopamine, and neuronal action potentials is imperative to understand how these fundamental modes of neural signaling interact to mediate behavior. We developed methods to measure concurrently dopamine and extracellular action potentials (i.e., spikes) in monkeys. Standard fast-scan cyclic voltammetric (FSCV) electrochemical (EChem) and electrophysiological (EPhys) recording systems are combined and used to collect spike and dopamine signals, respectively, from an array of carbon fiber (CF) sensors implanted in the monkey striatum. FSCV requires the application of small voltages at the implanted sensors to measure redox currents generated from target molecules, such as dopamine. These applied voltages create artifacts at neighboring EPhys measurement sensors which may lead to misclassification of these signals as physiological spikes. Therefore, simple automated temporal interpolation algorithms were designed to remove these artifacts and enable accurate spike extraction. We validated these methods using simulated artifacts and demonstrated an average spike recovery rate of 84.5%. We identified and discriminated cell type-specific units in the monkey striatum that were shown to correlate to specific behavioral task parameters related to reward size and eye movement direction. Synchronously recorded spike and dopamine signals displayed contrasting relations to the task variables, suggesting a complex relationship between these two modes of neural signaling. Future application of our methods will help advance our understanding of the interactions between neuromodulator signaling and neuronal activity, to elucidate more detailed mechanisms of neural circuitry and plasticity mediating behaviors in health and in disease.

Periaqueductal gray activates antipredatory neural responses in the amygdala of foraging rats

Pavlovian fear conditioning research suggests that the interaction between the dorsal periaqueductal gray (dPAG) and basolateral amygdala (BLA) acts as a prediction error mechanism in the formation of associative fear memories. However, their roles in responding to naturalistic predatory threats, characterized by less explicit cues and the absence of reiterative trial-and-error learning events, remain unexplored. In this study, we conducted single-unit recordings in rats during an 'approach food-avoid predator' task, focusing on the responsiveness of dPAG and BLA neurons to a rapidly approaching robot predator. Optogenetic stimulation of the dPAG triggered fleeing behaviors and increased BLA activity in naive rats. Notably, BLA neurons activated by dPAG stimulation displayed immediate responses to the robot, demonstrating heightened synchronous activity compared to BLA neurons that did not respond to dPAG stimulation. Additionally, the use of anterograde and retrograde tracer injections into the dPAG and BLA, respectively, coupled with c-Fos activation in response to predatory threats, indicates that the midline thalamus may play an intermediary role in innate antipredatory defensive functioning.

Volume electron microscopy for genetically and molecularly defined neural circuits

The brain networks responsible for adaptive behavioral changes are based on the physical connections between neurons. Light and electron microscopy have long been used to study neural projections and the physical connections between neurons. Volume electron microscopy has recently expanded its scale of analysis due to methodological advances, resulting in complete wiring maps of neurites in a large volume of brain tissues and even entire nervous systems in a growing number of species. However, structural approaches frequently suffer from inherent limitations in which elements in images are identified solely by morphological criteria. Recently, an increasing number of tools and technologies have been developed to characterize cells and cellular components in the context of molecules and gene expression. These advancements include newly developed probes for visualization in electron microscopic images as well as correlative integration methods for the same elements across multiple microscopic modalities. Such approaches advance our understanding of interactions between specific neurons and circuits and may help to elucidate novel aspects of the basal ganglia network involving dopamine neurons. These advancements are expected to reveal mechanisms for processing adaptive changes in specific neural circuits that modulate brain functions.

A dopamine mechanism for reward maximization

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

Cell-type specific auditory responses in the striatum are shaped by feed forward inhibition

The posterior "tail" region of the striatum receives dense innervation from sensory brain regions and has been demonstrated to play a role in behaviors that require sensorimotor integration including discrimination 1,2 , avoidance 3 and defense 4 responses. The output neurons of the striatum, the D1 and D2 striatal projection neurons (SPNs) that make up the direct and indirect pathways, respectively, are thought to play differential roles in these behavioral responses, although it remains unclear if or how these neurons display differential responsivity to sensory stimuli. Here, we used whole-cell recordings in vivo and ex vivo to examine the strength of excitatory and inhibitory synaptic inputs onto D1 and D2 SPNs following the stimulation of upstream auditory pathways. While D1 and D2 SPNs both displayed stimulus-evoked depolarizations, D1 SPN responses were stronger and faster for all stimuli tested in vivo as well as in brain slices. This difference did not arise from differences in the strength of excitatory inputs but from differences in the strength of feed forward inhibition. Indeed, fast spiking interneurons, which are readily engaged by auditory afferents exerted stronger inhibition onto D2 SPNs compared to D1 SPNs. Our results support a model in which differences in feed forward inhibition enable the preferential recruitment of the direct pathway in response to auditory stimuli, positioning this pathway to initiate sound-driven actions.

Pan-striatal reduction in the expression of the astrocytic dopamine transporter precedes the development of dorsolateral striatum dopamine-dependent incentive heroin seeking habits

The emergence of compulsive drug-seeking habits, a hallmark feature of substance use disorder, has been shown to be predicated on the engagement of dorsolateral striatal control over behaviour. This process involves the dopamine-dependent functional coupling of the anterior dorsolateral striatum (aDLS) with the nucleus accumbens core, but the mechanisms by which this coupling occurs have not been fully elucidated. The striatum is tiled by a syncytium of astrocytes that express the dopamine transporter (DAT), the level of which is altered in individuals with heroin use disorder. Astrocytes are therefore uniquely placed functionally to bridge dopamine-dependent mechanisms across the striatum. Here we tested the hypothesis that exposure to heroin influences the expression of DAT in striatal astrocytes across the striatum before the development of DLS-dependent incentive heroin seeking habits. Using Western-blot, qPCR, and RNAscope™, we measured DAT protein and mRNA levels in whole tissue, culture and in situ astrocytes from striatal territories of rats with a well-established cue-controlled heroin seeking habit and rats trained to respond for heroin or food under continuous reinforcement. Incentive heroin seeking habits were associated with a reduction in DAT protein levels in the anterior aDLS that was preceded by a heroin-induced reduction in DAT mRNA and protein in astrocytes across the striatum. Striatal astrocytes were also shown to be susceptible to direct dopamine- and opioid-induced downregulation of DAT expression. These results suggest that astrocytes may critically regulate the striatal dopaminergic adaptations that lead to the development of incentive heroin seeking habits.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Dopamine control of social novelty preference is constrained by an interpeduncular-tegmentum circuit

Animals are inherently motivated to explore social novelty cues over familiar ones, resulting in a novelty preference (NP), although the behavioral and circuit bases underlying NP are unclear. Combining calcium and neurotransmitter sensors with fiber photometry and optogenetics in mice, we find that mesolimbic dopamine (DA) neurotransmission is strongly and predominantly activated by social novelty controlling bout length of interaction during NP, a response significantly reduced by familiarity. In contrast, interpeduncular nucleus (IPN) GABAergic neurons that project to the lateral dorsal tegmentum (LDTg) were inhibited by social novelty but activated during terminations with familiar social stimuli. Inhibition of this pathway during NP increased interaction and bout length with familiar social stimuli, while activation reduced interaction and bout length with novel social stimuli via decreasing DA neurotransmission. These data indicate interest towards novel social stimuli is encoded by mesolimbic DA which is dynamically regulated by an IPN→LDTg circuit to control NP.

Targeted micro-fiber arrays for measuring and manipulating localized multi-scale neural dynamics over large, deep brain volumes during behavior

Neural population dynamics relevant to behavior vary over multiple spatial and temporal scales across three-dimensional volumes. Current optical approaches lack the spatial coverage and resolution necessary to measure and manipulate naturally occurring patterns of large-scale, distributed dynamics within and across deep brain regions such as the striatum. We designed a new micro-fiber array approach capable of chronically measuring and optogenetically manipulating local dynamics across over 100 targeted locations simultaneously in head-fixed and freely moving mice, enabling the investigation of cell-type- and neurotransmitter-specific signals over arbitrary 3D volumes at a spatial resolution and coverage previously inaccessible. We applied this method to resolve rapid dopamine release dynamics across the striatum, revealing distinct, modality-specific spatiotemporal patterns in response to salient sensory stimuli extending over millimeters of tissue. Targeted optogenetics enabled flexible control of neural signaling on multiple spatial scales, better matching endogenous signaling patterns, and the spatial localization of behavioral function across large circuits.

Neural inhibition as implemented by an actor-critic model involves the human dorsal striatum and ventral tegmental area

Inhibition is implicated across virtually all human experiences. As a trade-off of being very efficient, this executive function is also prone to many errors. Rodent and computational studies show that midbrain regions play crucial roles during errors by sending dopaminergic learning signals to the basal ganglia for behavioural adjustment. However, the parallels between animal and human neural anatomy and function are not determined. We scanned human adults while they performed an fMRI inhibitory task requiring trial-and-error learning. Guided by an actor-critic model, our results implicate the dorsal striatum and the ventral tegmental area as the actor and the critic, respectively. Using a multilevel and dimensional approach, we also demonstrate a link between midbrain and striatum circuit activity, inhibitory performance, and self-reported autistic and obsessive-compulsive subclinical traits.

Parvalbumin and Somatostatin: Biomarkers for Two Parallel Tectothalamic Pathways in the Auditory Midbrain

The inferior colliculus (IC) represents a crucial relay station in the auditory pathway, located in the midbrain's tectum and primarily projecting to the thalamus. Despite the identification of distinct cell classes based on various biomarkers in the IC, their specific contributions to the organization of auditory tectothalamic pathways have remained poorly understood. In this study, we demonstrate that IC neurons expressing parvalbumin (ICPV+) or somatostatin (ICSOM+) represent two minimally overlapping cell classes throughout the three IC subdivisions in mice of both sexes. Strikingly, regardless of their location within the IC, these neurons predominantly project to the primary and secondary auditory thalamic nuclei, respectively. Cell class-specific input tracing suggested that ICPV+ neurons primarily receive auditory inputs, whereas ICSOM+ neurons receive significantly more inputs from the periaqueductal gray and the superior colliculus (SC), which are sensorimotor regions critically involved in innate behaviors. Furthermore, ICPV+ neurons exhibit significant heterogeneity in both intrinsic electrophysiological properties and presynaptic terminal size compared with ICSOM+ neurons. Notably, approximately one-quarter of ICPV+ neurons are inhibitory neurons, whereas all ICSOM+ neurons are excitatory neurons. Collectively, our findings suggest that parvalbumin and somatostatin expression in the IC can serve as biomarkers for two functionally distinct, parallel tectothalamic pathways. This discovery suggests an alternative way to define tectothalamic pathways and highlights the potential usefulness of Cre mice in understanding the multifaceted roles of the IC at the circuit level.

Functional Diversity of Dopamine Axons in Prefrontal Cortex During Classical Conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Enhanced Punishment Responses in Patients With Schizophrenia: An Event-Related Potential Study

It is well known that abnormal reward processing is a characteristic feature of various psychopathologies including schizophrenia. Reduced reward anticipation has been suggested as a core symptom of schizophrenia. The Monetary Incentive Delay Task (MID) is frequently used to detect reward anticipation. The present study aims to evaluate the amplitude and latency of event-related potential (ERP) P300 in patients with schizophrenia (SCH) compared to healthy controls during the MID task. Twenty patients with SCH and 21 demographically matched healthy controls (HC) were included in the study. ERP P300 amplitude and latency values were compared between groups using an MID task in which reward and loss cues were presented. Relations between P300 and clinical facets were investigated in the patient group. SCH group had enhanced mean P300 amplitudes and delayed peak latency in the punishment condition compared with HC. These higher responses were also associated with negative symptoms. SCH group showed altered reward processing as being more sensitive to loss of reward conditions as firstly evidenced by electrophysiological methods, possibly due to abnormality in various systems including social withdrawal, social defeat, and behavioral inhibition system.

Curiosity: primate neural circuits for novelty and information seeking

For many years, neuroscientists have investigated the behavioural, computational and neurobiological mechanisms that support value-based decisions, revealing how humans and animals make choices to obtain rewards. However, many decisions are influenced by factors other than the value of physical rewards or second-order reinforcers (such as money). For instance, animals (including humans) frequently explore novel objects that have no intrinsic value solely because they are novel and they exhibit the desire to gain information to reduce their uncertainties about the future, even if this information cannot lead to reward or assist them in accomplishing upcoming tasks. In this Review, I discuss how circuits in the primate brain responsible for detecting, predicting and assessing novelty and uncertainty regulate behaviour and give rise to these behavioural components of curiosity. I also briefly discuss how curiosity-related behaviours arise during postnatal development and point out some important reasons for the persistence of curiosity across generations.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Heterogeneity of mesencephalic dopaminergic neurons: From molecular classifications, electrophysiological properties to functional connectivity

The mesencephalic dopamine (DA) system is composed of neuronal subtypes that are molecularly and functionally distinct, are responsible for specific behaviors, and are closely associated with numerous brain disorders. Existing research has made significant advances in identifying the heterogeneity of mesencephalic DA neurons, which is necessary for understanding their diverse physiological functions and disease susceptibility. Moreover, there is a conflict regarding the electrophysiological properties of the distinct subsets of midbrain DA neurons. This review aimed to elucidate recent developments in the heterogeneity of midbrain DA neurons, including subpopulation categorization, electrophysiological characteristics, and functional connectivity to provide new strategies for accurately identifying distinct subtypes of midbrain DA neurons and investigating the underlying mechanisms of these neurons in various diseases.

The locus coeruleus as a global model failure system

Predictive processing models posit that brains constantly attempt to predict their sensory inputs. Prediction errors signal when these predictions are incorrect and are thought to be instructive signals that drive corrective plasticity. Recent findings support the idea that the locus coeruleus (LC) - a brain-wide neuromodulatory system - signals several types of prediction error. I discuss how these findings support models proposing that the LC signals global model failures: instances where predictions about the world are strongly violated. Focusing on the cortex, I explore the utility of this signal in learning rate control, how the LC circuit may compute the signal, and how this view may aid our understanding of neurodivergence.

Amygdalo-nigral inputs target dopaminergic and GABAergic neurons in the primate: a view from dendrites and soma

The central nucleus (CeN) of the amygdala is an important afferent to the DA system that mediates motivated learning. We previously found that CeN terminals in nonhuman primates primarily overlap the elongated lateral VTA (parabrachial pigmented nucleus, PBP, A10), and retrorubral field(A8) subregion. Here, we examined CeN afferent contacts on cell somata and proximal dendrites of DA and GABA neurons, and distal dendrites of each, using confocal and electron microscopy (EM) methods, respectively. At the soma/proximal dendrites, the proportion of TH+ and GAD1+ cells receiving at least one CeN afferent contact was surprisingly similar (TH = 0.55: GAD1=0.55 in PBP; TH = 0.56; GAD1 =0.51 in A8), with the vast majority of contacted TH+ and GAD1+ soma/proximal dendrites received 1-2 contacts. Similar numbers of tracer-labeled terminals also contacted TH-positive and GAD1-positive small dendrites and/or spines (39% of all contacted dendrites were either TH- or GAD1-labeled). Overall, axon terminals had more symmetric (putative inhibitory) axonal contacts with no difference in the relative distribution in the PBP versus A8, or onto TH+ versus GAD1+ dendrites/spines in either region. The striking uniformity in the amygdalonigral projection across the PBP-A8 terminal field suggests that neither neurotransmitter phenotype nor midbrain location dictates likelihood of a terminal contact. We discuss how this afferent uniformity can play out in recently discovered differences in DA:GABA cell densities between the PBP and A8, and affect specific outputs.

Significance statement

The amygdala's central nucleus (CeN) channels salient cues to influence both appetitive and aversive responses via DA outputs. In higher species, the broad CeN terminal field overlaps the parabrachial pigmented nucleus ('lateral A10') and the retrorubral field (A8). We quantified terminal contacts in each region on DA and GABAergic soma/proximal dendrites and small distal dendrites. There was striking uniformity in contacts on DA and GABAergic cells, regardless of soma and dendritic compartment, in both regions. Most contacts were symmetric (putative inhibitory) with little change in the ratio of inhibitory to excitatory contacts by region.We conclude that post-synaptic shifts in DA-GABA ratios are key to understanding how these relatively uniform inputs can produce diverse effects on outputs.

Social environment enrichment alleviates anxiety-like behavior in mice: Involvement of the dopamine system

Rearing environment plays a vital role in maintaining physical and mental health of both animals and humans. Plenty of studies have proved that physical environment enrichment in adolescence has protective effects on emotion, social behavior, learning and memory deficits. However, the following effects of social environment enrichment in adolescence remain largely elusive. Using the paradigm of companion rotation (CR), the present study found that social environment enrichment reduced anxiety-like behaviors of early adult male C57BL/6J mice. CR group also showed significantly higher expression of tyrosine hydroxylase in the ventral tegmental area and dopamine 1 receptor mRNA in the nucleus accumbens shell than control group. Taken together, these findings demonstrate that CR from adolescence to early adulthood can suppress the level of anxiety and upregulate dopaminergic neuron activity in early adult male C57BL/6J mice.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Separation of Channels Subserving Approach and Avoidance/Escape at the Level of the Basal Ganglia and Related Brainstem Structures

The basal ganglia have the key function of directing our behavior in the context of events from our environment and/or our internal state. This function relies on afferents targeting the main input structures of the basal ganglia, entering bids for action selection at the level of the striatum or signals for behavioral interruption at the level of the subthalamic nucleus, with behavioral reselection facilitated by dopamine signaling. Numerous experiments have studied action selection in relation to inputs from the cerebral cortex. However, less is known about the anatomical and functional link between the basal ganglia and the brainstem. In this review, we describe how brainstem structures also project to the main input structures of the basal ganglia, namely the striatum, the subthalamic nucleus and midbrain dopaminergic neurons, in the context of approach and avoidance (including escape from threat), two fundamental, mutually exclusive behavioral choices in an animal's repertoire in which the brainstem is strongly involved. We focus on three particularly well-described loci involved in approach and avoidance, namely the superior colliculus, the parabrachial nucleus and the periaqueductal grey nucleus. We consider what is known about how these structures are related to the basal ganglia, focusing on their projections toward the striatum, dopaminergic neurons and subthalamic nucleus, and explore the functional consequences of those interactions.

Inhibitory Pedunculopontine Neurons Gate Dopamine-Mediated Motor Actions of Unsigned Valence

BACKGROUND

The pedunculopontine nucleus (PPN) maintains a bidirectional connectivity with the basal ganglia that supports their shared roles in the selection and execution of motor actions. Previous studies identified a role for PPN neurons in goal-directed behavior, but the cellular substrates underlying this function have not been elucidated. We recently revealed the existence of a monosynaptic GABAergic input from the PPN that inhibits dopamine neurons of the substantia nigra. Activation of this pathway interferes with the execution of learned motor sequences when the actions are rewarded, even though the inhibition of dopamine neurons did not shift the value of the action, hence suggesting executive control over the gating of behavior.

OBJECTIVE

To test the attributes of the inhibition of dopamine neurons by the PPN in the context of goal-directed behavior regardless of whether the outcome is positively or negatively reinforced.

METHODS

We delivered optogenetic stimulation to PPN GABAergic axon terminals in the substantia nigra during a battery of behavioral tasks with positive and negative valence.

RESULTS

Inhibition of dopamine neurons by PPN optogenetic activation during an appetitive task impaired the initiation and overall execution of the behavioral sequence without affecting the consumption of reward. During an active avoidance task, the same activation impaired the ability of mice to avoid a foot shock, but their escape response was unaffected. In addition, responses to potential threats were significantly attenuated.

CONCLUSION

Our results show that PPN GABAergic neurons modulate learned, goal-directed behavior of unsigned valence without affecting overall motor behavior.

Distinct spatiotemporal brainstem pathways of outcome valence during reward- and punishment-based learning

Learning to seek rewards and avoid punishments, based on positive and negative choice outcomes, is essential for human survival. Yet, the neural underpinnings of outcome valence in the human brainstem and the extent to which they differ in reward and punishment learning contexts remain largely elusive. Here, using simultaneously acquired electroencephalography and functional magnetic resonance imaging data, we show that during reward learning the substantia nigra (SN)/ventral tegmental area (VTA) and locus coeruleus are initially activated following negative outcomes, while the VTA subsequently re-engages exhibiting greater responses for positive than negative outcomes, consistent with an early arousal/avoidance response and a later value-updating process, respectively. During punishment learning, we show that distinct raphe nucleus and SN subregions are activated only by negative outcomes with a sustained post-outcome activity across time, supporting the involvement of these brainstem subregions in avoidance behavior. Finally, we demonstrate that the coupling of these brainstem structures with other subcortical and cortical areas helps to shape participants' serial choice behavior in each context.

Synchronous Measurements of Extracellular Action Potentials and Neurochemical Activity with Carbon Fiber Electrodes in Nonhuman Primates

Measuring the dynamic relationship between neuromodulators, such as dopamine, and neuronal action potentials is imperative to understand how these fundamental modes of neural signaling interact to mediate behavior. Here, we developed methods to measure concurrently dopamine and extracellular action potentials (i.e., spikes) and applied these in a monkey performing a behavioral task. Standard fast-scan cyclic voltammetric (FSCV) electrochemical (EChem) and electrophysiological (EPhys) recording systems are combined and used to collect spike and dopamine signals, respectively, from an array of carbon fiber (CF) sensors implanted in the monkey striatum. FSCV requires the application of small voltages at the implanted sensors to measure redox currents generated from target molecules, such as dopamine. These applied voltages create artifacts at neighboring EPhys-measurement sensors, producing signals that may falsely be classified as physiological spikes. Therefore, simple automated temporal interpolation algorithms were designed to remove these artifacts and enable accurate spike extraction. We validated these methods using simulated artifacts and demonstrated an average spike recovery rate of 84.5%. This spike extraction was performed on data collected from concurrent EChem and EPhys recordings made in a task-performing monkey to discriminate cell-type specific striatal units. These identified units were shown to correlate to specific behavioral task parameters related to reward size and eye-movement direction. Synchronous measures of spike and dopamine signals displayed contrasting relations to the behavioral task parameters, as taken from our small set of representative data, suggesting a complex relationship between these two modes of neural signaling. Future application of our methods will help advance our understanding of the interactions between neuromodulator signaling and neuronal activity, to elucidate more detailed mechanisms of neural circuitry and plasticity mediating behaviors in health and in disease.

Reduction in the activity of VTA/SNc dopaminergic neurons underlies aging-related decline in novelty seeking

Curiosity, or novelty seeking, is a fundamental mechanism motivating animals to explore and exploit environments to improve survival, and is also positively associated with cognitive, intrapersonal and interpersonal well-being in humans. However, curiosity declines as humans age, and the decline even positively predicts the extent of cognitive decline in Alzheimer's disease patients. Therefore, determining the underlying mechanism, which is currently unknown, is an urgent task for the present aging society that is growing at an unprecedented rate. This study finds that seeking behaviors for both social and inanimate novelties are compromised in aged mice, suggesting that the aging-related decline in curiosity and novelty-seeking is a biological process. This study further identifies an aging-related reduction in the activity (manifesting as a reduction in spontaneous firing) of dopaminergic neurons in the ventral tegmental area (VTA) and substantia nigra pars compacta (SNc). Finally, this study establishes that this reduction in activity causally underlies the aging-related decline in novelty-seeking behaviors. This study potentially provides an interventional strategy for maintaining high curiosity in the aged population, i.e., compensating for the reduced activity of VTA/SNc dopaminergic neurons, enabling the aged population to cope more smoothly with the present growing aging society, physically, cognitively and socioeconomically.

Cell type specificity for circuit output in the midbrain dopaminergic system

Midbrain dopaminergic neurons are a relatively small group of neurons in the mammalian brain controlling a wide range of behaviors. In recent years, increasingly sophisticated tracing, imaging, transcriptomic, and machine learning approaches have provided substantial insights into the anatomical, molecular, and functional heterogeneity of dopaminergic neurons. Despite this wealth of new knowledge, it remains unclear whether and how the diverse features defining dopaminergic subclasses converge to delineate functional ensembles within the dopaminergic system. Here, we review recent studies investigating various aspects of dopaminergic heterogeneity and discuss how development, behavior, and disease influence subtype characteristics. We then outline what further approaches could be pursued to gain a more inclusive picture of dopaminergic diversity, which could be crucial to understanding the functional architecture of this system.

A role for the subthalamic nucleus in aversive learning

The subthalamic nucleus (STN) is critical for behavioral control; its dysregulation consequently correlated with neurological and neuropsychiatric disorders, including Parkinson's disease. Deep brain stimulation (DBS) targeting the STN successfully alleviates parkinsonian motor symptoms. However, low mood and depression are affective side effects. STN is adjoined with para-STN, associated with appetitive and aversive behavior. DBS aimed at STN might unintentionally modulate para-STN, causing aversion. Alternatively, the STN mediates aversion. To investigate causality between STN and aversion, affective behavior is addressed using optogenetics in mice. Selective promoters allow dissociation of STN (e.g., Pitx2) vs. para-STN (Tac1). Acute photostimulation results in aversion via both STN and para-STN. However, only STN stimulation-paired cues cause conditioned avoidance and only STN stimulation interrupts on-going sugar self-administration. Electrophysiological recordings identify post-synaptic responses in pallidal neurons, and selective photostimulation of STN terminals in the ventral pallidum replicates STN-induced aversion. Identifying STN as a source of aversive learning contributes neurobiological underpinnings to emotional affect.

Targeted micro-fiber arrays for measuring and manipulating localized multi-scale neural dynamics over large, deep brain volumes during behavior

Neural population dynamics relevant for behavior vary over multiple spatial and temporal scales across 3-dimensional volumes. Current optical approaches lack the spatial coverage and resolution necessary to measure and manipulate naturally occurring patterns of large-scale, distributed dynamics within and across deep brain regions such as the striatum. We designed a new micro-fiber array and imaging approach capable of chronically measuring and optogenetically manipulating local dynamics across over 100 targeted locations simultaneously in head-fixed and freely moving mice. We developed a semi-automated micro-CT based strategy to precisely localize positions of each optical fiber. This highly-customizable approach enables investigation of multi-scale spatial and temporal patterns of cell-type and neurotransmitter specific signals over arbitrary 3-D volumes at a spatial resolution and coverage previously inaccessible. We applied this method to resolve rapid dopamine release dynamics across the striatum volume which revealed distinct, modality specific spatiotemporal patterns in response to salient sensory stimuli extending over millimeters of tissue. Targeted optogenetics through our fiber arrays enabled flexible control of neural signaling on multiple spatial scales, better matching endogenous signaling patterns, and spatial localization of behavioral function across large circuits.

Songbird mesostriatal dopamine pathways are spatially segregated before the onset of vocal learning

Diverse dopamine (DA) pathways send distinct reinforcement signals to different striatal regions. In adult songbirds, a DA pathway from the ventral tegmental area (VTA) to Area X, the striatal nucleus of the song system, carries singing-related performance error signals important for learning. Meanwhile, a parallel DA pathway to a medial striatal area (MST) arises from a distinct group of neighboring DA neurons that lack connectivity to song circuits and do not encode song error. To test if the structural and functional segregation of these two pathways depends on singing experience, we carried out anatomical studies early in development before the onset of song learning. We find that distinct VTA neurons project to either Area X or MST in juvenile birds before the onset of substantial vocal practice. Quantitative comparisons of early juveniles (30-35 days post hatch), late juveniles (60-65 dph), and adult (>90 dph) brains revealed an outsized expansion of Area X-projecting neurons relative to MST-projecting neurons in VTA over development. These results show that a mesostriatal DA system dedicated to social communication can exist and be spatially segregated before the onset of vocal practice and associated sensorimotor experience.

Multi-timescale reinforcement learning in the brain

To thrive in complex environments, animals and artificial agents must learn to act adaptively to maximize fitness and rewards. Such adaptive behavior can be learned through reinforcement learning1, a class of algorithms that has been successful at training artificial agents2-6 and at characterizing the firing of dopamine neurons in the midbrain7-9. In classical reinforcement learning, agents discount future rewards exponentially according to a single time scale, controlled by the discount factor. Here, we explore the presence of multiple timescales in biological reinforcement learning. We first show that reinforcement agents learning at a multitude of timescales possess distinct computational benefits. Next, we report that dopamine neurons in mice performing two behavioral tasks encode reward prediction error with a diversity of discount time constants. Our model explains the heterogeneity of temporal discounting in both cue-evoked transient responses and slower timescale fluctuations known as dopamine ramps. Crucially, the measured discount factor of individual neurons is correlated across the two tasks suggesting that it is a cell-specific property. Together, our results provide a new paradigm to understand functional heterogeneity in dopamine neurons, a mechanistic basis for the empirical observation that humans and animals use non-exponential discounts in many situations10-14, and open new avenues for the design of more efficient reinforcement learning algorithms.

Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning

The auditory striatum, a sensory portion of the dorsal striatum, plays an essential role in learning and memory. In contrast to its roles and underlying mechanisms in operant conditioning, however, little is known about its contribution to classical auditory fear conditioning. Here, we reveal the function of the auditory striatum in auditory-conditioned fear memory. We find that optogenetically inhibiting auditory striatal neurons impairs fear memory formation, which is mediated through the striatal-amygdala pathway. Using calcium imaging in behaving mice, we find that auditory striatal neuronal responses to conditioned tones potentiate across memory acquisition and expression. Furthermore, nigrostriatal dopaminergic projections plays an important role in modulating conditioning-induced striatal potentiation. Together, these findings demonstrate the existence of a nigro-striatal-amygdala circuit for conditioned fear memory formation and expression.

Striatum supports fast learning but not memory recall

Animals learn to carry out motor actions in specific sensory contexts to achieve goals. The striatum has been implicated in producing sensory-motor associations, yet its contribution to memory formation or recall is not clear. To investigate the contribution of striatum to these processes, mice were taught to associate a cue, consisting of optogenetic activation of striatum-projecting neurons in visual cortex, with forelimb reaches to access food pellets. As necessary to direct learning, striatal neural activity encoded both the sensory context and outcome of reaching. With training, the rate of cued reaching increased, but brief optogenetic inhibition of striatal activity arrested learning and prevented trial-to-trial improvements in performance. However, the same manipulation did not affect performance improvements already consolidated into short- (within an hour) or long-term (across days) memories. Hence, striatal activity is necessary for trial-to-trial improvements in task performance, leading to plasticity in other brain areas that mediate memory recall.

Dopaminergic error signals retune to social feedback during courtship

Hunger, thirst, loneliness and ambition determine the reward value of food, water, social interaction and performance outcome1. Dopamine neurons respond to rewards meeting these diverse needs2-8, but it remains unclear how behaviour and dopamine signals change as priorities change with new opportunities in the environment. One possibility is that dopamine signals for distinct drives are routed to distinct dopamine pathways9,10. Another possibility is that dopamine signals in a given pathway are dynamically tuned to rewards set by the current priority. Here we used electrophysiology and fibre photometry to test how dopamine signals associated with quenching thirst, singing a good song and courting a mate change as male zebra finches (Taeniopygia guttata) were provided with opportunities to retrieve water, evaluate song performance or court a female. When alone, water reward signals were observed in two mesostriatal pathways but singing-related performance error signals were routed to Area X, a striatal nucleus specialized for singing. When courting a female, water seeking was reduced and dopamine responses to both water and song performance outcomes diminished. Instead, dopamine signals in Area X were driven by female calls timed with the courtship song. Thus the dopamine system handled coexisting drives by routing vocal performance and social feedback signals to a striatal area for communication and by flexibly re-tuning to rewards set by the prioritized drive.

A common thalamic hub for general and defensive arousal control

The expression of defensive responses to alerting sensory cues requires both general arousal and a specific arousal state associated with defensive emotions. However, it remains unclear whether these two forms of arousal can be regulated by common brain regions. We discovered that the medial sector of the auditory thalamus (ATm) in mice is a thalamic hub controlling both general and defensive arousal. The spontaneous activity of VGluT2-expressing ATm (ATmVGluT2+) neurons was correlated with and causally contributed to wakefulness. In sleeping mice, sustained ATmVGluT2+ population responses were predictive of sensory-induced arousal, the likelihood of which was markedly decreased by inhibiting ATmVGluT2+ neurons or multiple downstream pathways. In awake mice, ATmVGluT2+ activation led to heightened arousal accompanied by excessive anxiety and avoidance behavior. Notably, blocking their neurotransmission abolished alerting stimuli-induced defensive behaviors. These findings may shed light on the comorbidity of sleep disturbances and abnormal sensory sensitivity in specific brain disorders.

Dopamine release and negative valence gated by inhibitory neurons in the laterodorsal tegmental nucleus

GABAergic neurons in the laterodorsal tegmental nucleus (LDTGABA) encode aversion by directly inhibiting mesolimbic dopamine (DA). Yet, the detailed cellular and circuit mechanisms by which these cells relay unpleasant stimuli to DA neurons and regulate behavioral output remain largely unclear. Here, we show that LDTGABA neurons bidirectionally respond to rewarding and aversive stimuli in mice. Activation of LDTGABA neurons promotes aversion and reduces DA release in the lateral nucleus accumbens. Furthermore, we identified two molecularly distinct LDTGABA cell populations. Somatostatin-expressing (Sst+) LDTGABA neurons indirectly regulate the mesolimbic DA system by disinhibiting excitatory hypothalamic neurons. In contrast, Reelin-expressing LDTGABA neurons directly inhibit downstream DA neurons. The identification of separate GABAergic subpopulations in a single brainstem nucleus that relay unpleasant stimuli to the mesolimbic DA system through direct and indirect projections is critical for establishing a circuit-level understanding of how negative valence is encoded in the mammalian brain.

Striatal Dopamine Signals and Reward Learning

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.

Unique functional responses differentially map onto genetic subtypes of dopamine neurons

Dopamine neurons are characterized by their response to unexpected rewards, but they also fire during movement and aversive stimuli. Dopamine neuron diversity has been observed based on molecular expression profiles; however, whether different functions map onto such genetic subtypes remains unclear. In this study, we established that three genetic dopamine neuron subtypes within the substantia nigra pars compacta, characterized by the expression of Slc17a6 (Vglut2), Calb1 and Anxa1, each have a unique set of responses to rewards, aversive stimuli and accelerations and decelerations, and these signaling patterns are highly correlated between somas and axons within subtypes. Remarkably, reward responses were almost entirely absent in the Anxa1+ subtype, which instead displayed acceleration-correlated signaling. Our findings establish a connection between functional and genetic dopamine neuron subtypes and demonstrate that molecular expression patterns can serve as a common framework to dissect dopaminergic functions.

Reframing dopamine: A controlled controller at the limbic-motor interface

Pavlovian influences notoriously interfere with operant behaviour. Evidence suggests this interference sometimes coincides with the release of the neuromodulator dopamine in the nucleus accumbens. Suppressing such interference is one of the targets of cognitive control. Here, using the examples of active avoidance and omission behaviour, we examine the possibility that direct manipulation of the dopamine signal is an instrument of control itself. In particular, when instrumental and Pavlovian influences come into conflict, dopamine levels might be affected by the controlled deployment of a reframing mechanism that recasts the prospect of possible punishment as an opportunity to approach safety, and the prospect of future reward in terms of a possible loss of that reward. We operationalize this reframing mechanism and fit the resulting model to rodent behaviour from two paradigmatic experiments in which accumbens dopamine release was also measured. We show that in addition to matching animals' behaviour, the model predicts dopamine transients that capture some key features of observed dopamine release at the time of discriminative cues, supporting the idea that modulation of this neuromodulator is amongst the repertoire of cognitive control strategies.