Distinct representation of cue-outcome association by D1 and D2 neurons in the ventral striatum's olfactory tubercle

Transformation of valence signaling in a striatopallidal circuit

The ways in which sensory stimuli acquire motivational valence through association with other stimuli is one of the simplest forms of learning. Though we have identified many brain nuclei that play various roles in reward processing, a significant gap remains in understanding how valence encoding transforms through the layers of sensory processing. To address this gap, we carried out a comparative investigation of the anteromedial olfactory tubercle (OT), and the ventral pallidum (VP) - 2 connected nuclei of the basal ganglia which have both been implicated in reward processing. First, using anterograde and retrograde tracing, we show that both D1 and D2 neurons of the anteromedial OT project primarily to the VP and minimally elsewhere. Using 2-photon calcium imaging, we then investigated how the identity of the odor and reward contingency of the odor are differently encoded by neurons in either structure during a classical conditioning paradigm. We find that VP neurons robustly encode reward contingency, but not identity, in low-dimensional space. In contrast, the OT neurons primarily encode odor identity in high-dimensional space. Although D1 OT neurons showed larger responses to rewarded odors than other odors, consistent with prior findings, we interpret this as identity encoding with enhanced contrast. Finally, using a novel conditioning paradigm that decouples reward contingency and licking vigor, we show that both features are encoded by non-overlapping VP neurons. These results provide a novel framework for the striatopallidal circuit in which a high-dimensional encoding of stimulus identity is collapsed onto a low-dimensional encoding of motivational valence.

Control of innate olfactory valence by segregated cortical amygdala circuits

Animals perform innate behaviors that are stereotyped responses to specific evolutionarily relevant stimuli in the absence of prior learning or experience. These behaviors can be reduced to an axis of valence, whereby specific odors evoke approach or avoidance. The cortical amygdala (plCoA) mediates innate attraction and aversion to odor. However, little is known about how this brain area gives rise to behaviors of opposing motivational valence. Here, we sought to define the circuit features of plCoA that give rise to innate olfactory behaviors of valence. We characterized the physiology, gene expression, and projections of this structure, identifying a divergent, topographic organization that selectively controls innate attraction and avoidance to odor. First, we examined odor-evoked responses in these areas and found sparse encoding of odor identity, but not valence. We next considered a topographic organization and found that optogenetic stimulation of the anterior and posterior domains of plCoA elicits attraction and avoidance, respectively, suggesting a functional axis for valence. Using single cell and spatial RNA sequencing, we identified the molecular cell types in plCoA, revealing an anteroposterior gradient in cell types, whereby anterior glutamatergic neurons preferentially express Slc17a6 and posterior neurons express Slc17a7. Activation of these respective cell types recapitulates appetitive and aversive valence behaviors, and chemogenetic inhibition reveals partial necessity for valence responses to innate appetitive or aversive odors. Finally, we identified topographically organized circuits defined by projections, whereby anterior neurons preferentially project to medial amygdala, and posterior neurons preferentially project to nucleus accumbens, which are respectively sufficient and necessary for innate negative and positive olfactory valence. Together, these data advance our understanding of how the olfactory system generates stereotypic, hardwired attraction and avoidance, and supports a model whereby distinct, topographically distributed plCoA populations direct innate olfactory valence responses by signaling to divergent valence-specific targets, linking upstream olfactory identity to downstream valence behaviors, through a population code. This represents a novel circuit motif in which valence encoding is represented not by the firing properties of individual neurons, but by population level identity encoding that is routed through divergent targets to mediate distinct valence.

Endogenous opioids in the olfactory tubercle and their roles in olfaction and quality of life

Olfactory dysfunctions decrease daily quality of life (QOL) in part by reducing the pleasure of eating. Olfaction plays an essential role in flavor sensation and palatability. The decreased QOL due to olfactory dysfunction is speculated to result from abnormal neural activities in the olfactory and limbic areas of the brain, as well as peripheral odorant receptor dysfunctions. However, the specific underlying neurobiological mechanisms remain unclear. As the olfactory tubercle (OT) is one of the brain's regions with high expression of endogenous opioids, we hypothesize that the mechanism underlying the decrease in QOL due to olfactory dysfunction involves the reduction of neural activity in the OT and subsequent endogenous opioid release in specialized subregions. In this review, we provide an overview and recent updates on the OT, the endogenous opioid system, and the pleasure systems in the brain and then discuss our hypothesis. To facilitate the effective treatment of olfactory dysfunctions and decreased QOL, elucidation of the neurobiological mechanisms underlying the pleasure of eating through flavor sensation is crucial.

Connectivity of the olfactory tubercle: inputs, outputs, and their plasticity

The olfactory tubercle (OT) is a unique part of the olfactory cortex of the mammal brain in that it is also a component of the ventral striatum. It is crucially involved in motivational behaviors, particularly in adaptive olfactory learning. This review introduces the basic properties of the OT, its synaptic connectivity with other brain areas, and the plasticity of the connectivity associated with learning behavior. The adaptive properties of olfactory behavior are discussed further based on the characteristics of OT neuronal circuits.

Nature and human well-being: The olfactory pathway

The world is undergoing massive atmospheric and ecological change, driving unprecedented challenges to human well-being. Olfaction is a key sensory system through which these impacts occur. The sense of smell influences quality of and satisfaction with life, emotion, emotion regulation, cognitive function, social interactions, dietary choices, stress, and depressive symptoms. Exposures via the olfactory pathway can also lead to (anti-)inflammatory outcomes. Increased understanding is needed regarding the ways in which odorants generated by nature (i.e., natural olfactory environments) affect human well-being. With perspectives from a range of health, social, and natural sciences, we provide an overview of this unique sensory system, four consensus statements regarding olfaction and the environment, and a conceptual framework that integrates the olfactory pathway into an understanding of the effects of natural environments on human well-being. We then discuss how this framework can contribute to better accounting of the impacts of policy and land-use decision-making on natural olfactory environments and, in turn, on planetary health.

Value-related learning in the olfactory bulb occurs through pathway-dependent perisomatic inhibition of mitral cells

Associating values to environmental cues is a critical aspect of learning from experiences, allowing animals to predict and maximise future rewards. Value-related signals in the brain were once considered a property of higher sensory regions, but their wide distribution across many brain regions is increasingly recognised. Here, we investigate how reward-related signals begin to be incorporated, mechanistically, at the earliest stage of olfactory processing, namely, in the olfactory bulb. In head-fixed mice performing Go/No-Go discrimination of closely related olfactory mixtures, rewarded odours evoke widespread inhibition in one class of output neurons, that is, in mitral cells but not tufted cells. The temporal characteristics of this reward-related inhibition suggest it is odour-driven, but it is also context-dependent since it is absent during pseudo-conditioning and pharmacological silencing of the piriform cortex. Further, the reward-related modulation is present in the somata but not in the apical dendritic tuft of mitral cells, suggesting an involvement of circuit components located deep in the olfactory bulb. Depth-resolved imaging from granule cell dendritic gemmules suggests that granule cells that target mitral cells receive a reward-related extrinsic drive. Thus, our study supports the notion that value-related modulation of olfactory signals is a characteristic of olfactory processing in the primary olfactory area and narrows down the possible underlying mechanisms to deeper circuit components that contact mitral cells perisomatically.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Learning-dependent structural plasticity of intracortical and sensory connections to functional domains of the olfactory tubercle

The olfactory tubercle (OT), which is a component of the olfactory cortex and ventral striatum, has functional domains that play a role in odor-guided motivated behaviors. Learning odor-guided attractive and aversive behavior activates the anteromedial (am) and lateral (l) domains of the OT, respectively. However, the mechanism driving learning-dependent activation of specific OT domains remains unknown. We hypothesized that the neuronal connectivity of OT domains is plastically altered through olfactory experience. To examine the plastic potential of synaptic connections to OT domains, we optogenetically stimulated intracortical inputs from the piriform cortex or sensory inputs from the olfactory bulb to the OT in mice in association with a food reward for attractive learning and electrical foot shock for aversive learning. For both intracortical and sensory connections, axon boutons that terminated in the OT domains were larger in the amOT than in the lOT for mice exhibiting attractive learning and larger in the lOT than in the amOT for mice exhibiting aversive learning. These results indicate that both intracortical and sensory connections to the OT domains have learning-dependent plastic potential, suggesting that this plasticity underlies learning-dependent activation of specific OT domains and the acquisition of appropriate motivated behaviors.

Opponent Learning with Different Representations in the Cortico-Basal Ganglia Circuits

The direct and indirect pathways of the basal ganglia (BG) have been suggested to learn mainly from positive and negative feedbacks, respectively. Since these pathways unevenly receive inputs from different cortical neuron types and/or regions, they may preferentially use different state/action representations. We explored whether such a combined use of different representations, coupled with different learning rates from positive and negative reward prediction errors (RPEs), has computational benefits. We modeled animal as an agent equipped with two learning systems, each of which adopted individual representation (IR) or successor representation (SR) of states. With varying the combination of IR or SR and also the learning rates from positive and negative RPEs in each system, we examined how the agent performed in a dynamic reward navigation task. We found that combination of SR-based system learning mainly from positive RPEs and IR-based system learning mainly from negative RPEs could achieve a good performance in the task, as compared with other combinations. In such a combination of appetitive SR-based and aversive IR-based systems, both systems show activities of comparable magnitudes with opposite signs, consistent with the suggested profiles of the two BG pathways. Moreover, the architecture of such a combination provides a novel coherent explanation for the functional significance and underlying mechanism of diverse findings about the cortico-BG circuits. These results suggest that particularly combining different representations with appetitive and aversive learning could be an effective learning strategy in certain dynamic environments, and it might actually be implemented in the cortico-BG circuits.