The basolateral amygdala and lateral hypothalamus bias learning towards motivationally significant events

Monosynaptic Inputs to Ventral Tegmental Area Glutamate and GABA Co-transmitting Neurons

A unique population of ventral tegmental area (VTA) neurons co-transmits glutamate and GABA. However, the circuit inputs to VTA VGluT2+VGaT+ neurons are unknown, limiting our understanding of their functional capabilities. By coupling monosynaptic rabies tracing with intersectional genetic targeting in male and female mice, we found that VTA VGluT2+VGaT+ neurons received diverse brainwide inputs. The largest numbers of monosynaptic inputs to VTA VGluT2+VGaT+ neurons were from superior colliculus (SC), lateral hypothalamus (LH), midbrain reticular nucleus, and periaqueductal gray, whereas the densest inputs relative to brain region volume were from the dorsal raphe nucleus, lateral habenula, and VTA. Based on these and prior data, we hypothesized that LH and SC inputs were from glutamatergic neurons. Optical activation of glutamatergic LH neurons activated VTA VGluT2+VGaT+ neurons regardless of stimulation frequency and resulted in flee-like ambulatory behavior. In contrast, optical activation of glutamatergic SC neurons activated VTA VGluT2+VGaT+ neurons for a brief period of time at high frequency and resulted in head rotation and arrested ambulatory behavior (freezing). Stimulation of glutamatergic LH neurons, but not glutamatergic SC neurons, was associated with VTA VGluT2+VGaT+ footshock-induced activity and inhibition of LH glutamatergic neurons disrupted VTA VGluT2+VGaT+ tailshock-induced activity. We interpret these results such that inputs to VTA VGluT2+VGaT+ neurons may integrate diverse signals related to the detection and processing of motivationally salient outcomes.

Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning

Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of the ventral tegmental area dopamine (VTADA) neurons. Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signaling. However, recent studies reveal more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits. To understand whether the NAcC might regulate a unique component of learning, we recorded dopamine release in NAcC while male rats performed a backward conditioning task where a reward is followed by a neutral cue. We used this task because we can delineate different components of learning, which include sensory-specific inhibitory and general excitatory components. Furthermore, we have shown that VTADA neurons are necessary for both the specific and general components of backward associations. Here, we found that dopamine release in NAcC increased to the reward across learning while reducing to the cue that followed as it became more expected. This mirrors the dopamine prediction error signal seen during forward conditioning and cannot be accounted for temporal-difference reinforcement learning. Subsequent tests allowed us to dissociate these learning components and revealed that dopamine release in NAcC reflects the general excitatory component of backward associations, but not their sensory-specific component. These results emphasize the importance of examining distinct functions of different dopamine projections in reinforcement learning.

Lateral hypothalamic GABAergic neurons encode alcohol memories

In alcohol use disorder, the alcohol memories persist during abstinence, and exposure to stimuli associated with alcohol use can lead to relapse. This highlights the importance of investigating the neural substrates underlying not only relapse but also encoding and expression of alcohol memories. GABAergic neurons in the lateral hypothalamus (LH-GABA) have been shown to be critical for food-cue memories and motivation; however, the extent to which this role extends to alcohol-cue memories and motivations remains unexplored. In this study, we aimed to describe how alcohol-related memories are encoded and expressed in LH GABAergic neurons. Our first step was to monitor LH-GABA calcium transients during acquisition, extinction, and reinstatement of an alcohol-cue memory using fiber photometry. We trained the rats on a Pavlovian conditioning task, where one conditioned stimulus (CS+) predicted alcohol (20% EtOH) and another conditioned stimulus (CS-) had no outcome. We then extinguished this association through non-reinforced presentations of the CS+ and CS- and finally, in two different groups, we measured relapse under non-primed and alcohol-primed induced reinstatement. Our results show that initially both cues caused increased LH-GABA activity, and after learning only the alcohol cue increased LH-GABA activity. After extinction, this activity decreases, and we found no differences in LH-GABA activity during reinstatement in either group. Next, we inhibited LH-GABA neurons with optogenetics to show that activity of these neurons is necessary for the formation of an alcohol-cue association. These findings suggest that LH-GABA might be involved in attentional processes modulated by learning.

Monosynaptic inputs to ventral tegmental area glutamate and GABA co-transmitting neurons

A unique population of ventral tegmental area (VTA) neurons co-transmits glutamate and GABA as well as functionally signals rewarding and aversive outcomes. However, the circuit inputs to VTA VGluT2+VGaT+ neurons are unknown, limiting our understanding of the functional capabilities of these neurons. To identify the inputs to VTA VGluT2+VGaT+ neurons, we coupled monosynaptic rabies tracing with intersectional genetic targeting of VTA VGluT2+VGaT+ neurons in mice. We found that VTA VGluT2+VGaT+ neurons received diverse brain-wide inputs. The largest numbers of monosynaptic inputs to VTA VGluT2+VGaT+ neurons were from superior colliculus, lateral hypothalamus, midbrain reticular nucleus, and periaqueductal gray, whereas the densest inputs relative to brain region volume were from dorsal raphe nucleus, lateral habenula, and ventral tegmental area. Based on these and prior data, we hypothesized that lateral hypothalamus and superior colliculus inputs were glutamatergic neurons. Optical activation of glutamatergic lateral hypothalamus neurons robustly activated VTA VGluT2+VGaT+ neurons regardless of stimulation frequency and resulted in flee-like ambulatory behavior. In contrast, optical activation of glutamatergic superior colliculus neurons activated VTA VGluT2+VGaT+ neurons for a brief period of time at high stimulation frequency and resulted in head rotation and arrested ambulatory behavior (freezing). For both pathways, behaviors induced by stimulation were uncorrelated with VTA VGluT2+VGaT+ neuron activity. However, stimulation of glutamatergic lateral hypothalamus neurons, but not glutamatergic superior colliculus neurons, was associated with VTA VGluT2+VGaT+ footshock-induced activity. We interpret these results such that inputs to VTA VGluT2+VGaT+ neurons may integrate diverse signals related to the detection and processing of motivationally-salient outcomes. Further, VTA VGluT2+VGaT+ neurons may signal threat-related outcomes, possibly via input from lateral hypothalamus glutamate neurons, but not threat-induced behavioral kinematics.

Neural signatures of stress susceptibility and resilience in the amygdala-hippocampal network

The neural dynamics that underlie divergent anhedonic responses to stress remain unclear. Here, we identified neuronal dynamics in an amygdala-hippocampal circuit that distinguish stress resilience and susceptibility. In a reward-choice task, basolateral amygdala (BLA) activity in resilient mice showed enhanced discrimination of upcoming reward choices. In contrast, a rumination-like signature emerged in the BLA of susceptible mice; a linear decoder could classify the intention to switch or stay on a previously chosen reward. Spontaneous activity in the BLA of susceptible mice was higher dimensional than controls, reflecting the exploration of a larger number of distinct neural states. Manipulation of vCA1-BLA inputs rescued dysfunctional neural dynamics and anhedonia in susceptible mice, suggesting that targeting this pathway can enhance BLA circuit function and ameliorate of depression-related behaviors.

Necessity and recruitment of cue-specific neuronal ensembles within the basolateral amygdala during appetitive reversal learning

Through Pavlovian appetitive conditioning, environmental cues can become predictors of food availability. Over time, however, the food, and thus the value of the associated cues, can change based on environmental variations. This change in outcome necessitates updating of the value of the cue to appropriately alter behavioral responses to these cues. The basolateral amygdala (BLA) is critical in updating the outcomes of learned cues. However, it is unknown if the same BLA neuronal ensembles that are recruited in the initial associative memory are required when the new cue-outcome association is formed during reversal learning. The current study used the Daun02 inactivation method that enables selective targeting and disruption of activated neuronal ensembles in Fos-lacZ transgenic rats. Rats were implanted with bilateral cannulas that target the BLA and underwent appetitive discriminative conditioning in which rats had to discriminate between two auditory stimuli. One stimulus (CS+) co-terminated with food delivery, and the other stimulus was unrewarded (CS-; counterbalanced). Rats were then tested for CS+ or CS- memory retrieval and infused with either Daun02 or a vehicle solution into the BLA to inactivate either CS+ or CS- neuronal ensembles that were activated during that test. To assess if the same neuronal ensembles are necessary to update the value of the new association when the outcomes are changed, rats underwent reversal learning: the CS+ was no longer followed by food (reversal CS-, rCS-), and the CS- was now followed by food (reversal CS+; rCS+). The group that received Daun02 following CS+ session showed a decrease in conditioned responding and increased latency to the rCS- (previously CS+) during the first session of reversal learning, specifically during the first trial. This indicates that the neuronal ensemble that was activated during the recall of the CS+ memory was the same neuronal ensemble needed for learning the new outcome of the same CS, now rCS-. Additionally, the group that received Daun02 following CS- session was slower to respond to the rCS+ (previously CS-) during reversal learning. This indicates that the neuronal ensemble that was activated during the recall of the CS- memory was the same neuronal ensemble needed for learning the new outcome of the same CS. These results demonstrate that different neuronal ensembles within the BLA mediate memory recall of CS+ and CS- cues and reactivation of each cue-specific neuronal ensemble is necessary to update the value of that specific cue to respond appropriately during reversal learning. These results also indicate substantial plasticity within the BLA for behavioral flexibility as both groups eventually showed similar terminal levels of reversal learning.

Dopamine errors drive excitatory and inhibitory components of backward conditioning in an outcome-specific manner

For over two decades, phasic activity in midbrain dopamine neurons was considered synonymous with the prediction error in temporal-difference reinforcement learning.^1-4 Central to this proposal is the notion that reward-predictive stimuli become endowed with the scalar value of predicted rewards. When these cues are subsequently encountered, their predictive value is compared to the value of the actual reward received, allowing for the calculation of prediction errors.^5,6 Phasic firing of dopamine neurons was proposed to reflect this computation,^1,2 facilitating the backpropagation of value from the predicted reward to the reward-predictive stimulus, thus reducing future prediction errors. There are two critical assumptions of this proposal: (1) that dopamine errors can only facilitate learning about scalar value and not more complex features of predicted rewards, and (2) that the dopamine signal can only be involved in anticipatory cue-reward learning in which cues or actions precede rewards. Recent work^7-15 has challenged the first assumption, demonstrating that phasic dopamine signals across species are involved in learning about more complex features of the predicted outcomes, in a manner that transcends this value computation. Here, we tested the validity of the second assumption. Specifically, we examined whether phasic midbrain dopamine activity would be necessary for backward conditioning-when a neutral cue reliably follows a rewarding outcome.^16-20 Using a specific Pavlovian-to-instrumental transfer (PIT) procedure,^21-23 we show rats learn both excitatory and inhibitory components of a backward association, and that this association entails knowledge of the specific identity of the reward and cue. We demonstrate that brief optogenetic inhibition of VTA_DA neurons timed to the transition between the reward and cue reduces both of these components of backward conditioning. These findings suggest VTA_DA neurons are capable of facilitating associations between contiguously occurring events, regardless of the content of those events. We conclude that these data may be in line with suggestions that the VTA_DA error acts as a universal teaching signal. This may provide insight into why dopamine function has been implicated in myriad psychological disorders that are characterized by very distinct reinforcement-learning deficits.

Higher-Order Conditioning and Dopamine: Charting a Path Forward

Higher-order conditioning involves learning causal links between multiple events, which then allows one to make novel inferences. For example, observing a correlation between two events (e.g., a neighbor wearing a particular sports jersey), later helps one make new predictions based on this knowledge (e.g., the neighbor's wife's favorite sports team). This type of learning is important because it allows one to benefit maximally from previous experiences and perform adaptively in complex environments where many things are ambiguous or uncertain. Two procedures in the lab are often used to probe this kind of learning, second-order conditioning (SOC) and sensory preconditioning (SPC). In second-order conditioning (SOC), we first teach subjects that there is a relationship between a stimulus and an outcome (e.g., a tone that predicts food). Then, an additional stimulus is taught to precede the predictive stimulus (e.g., a light leads to the food-predictive tone). In sensory preconditioning (SPC), this order of training is reversed. Specifically, the two neutral stimuli (i.e., light and tone) are first paired together and then the tone is paired separately with food. Interestingly, in both SPC and SOC, humans, rodents, and even insects, and other invertebrates will later predict that both the light and tone are likely to lead to food, even though they only experienced the tone directly paired with food. While these processes are procedurally similar, a wealth of research suggests they are associatively and neurobiologically distinct. However, midbrain dopamine, a neurotransmitter long thought to facilitate basic Pavlovian conditioning in a relatively simplistic manner, appears critical for both SOC and SPC. These findings suggest dopamine may contribute to learning in ways that transcend differences in associative and neurological structure. We discuss how research demonstrating that dopamine is critical to both SOC and SPC places it at the center of more complex forms of cognition (e.g., spatial navigation and causal reasoning). Further, we suggest that these more sophisticated learning procedures, coupled with recent advances in recording and manipulating dopamine neurons, represent a new path forward in understanding dopamine's contribution to learning and cognition.