The Role of the Lateral Habenula in Inhibitory Learning from Reward Omission

Environmental enrichment enhances the antidepressant effect of ketamine and ameliorates spatial memory deficits in adult rats

Ketamine is a rapid-acting antidepressant associated with various cognitive side effects. To mitigate these side effects while enhancing efficacy, it can be co-administered with other antidepressants. In our study, we adopted a similar strategy by combining ketamine with environmental enrichment, a potent sensory-motor paradigm, in adult male Wistar rats. We divided the animals into four groups based on a combination of housing conditions and ketamine versus vehicle injections. The groups included those housed in standard cages or an enriched environment for 50 days, which encompassed a 13-day-long behavioral testing period. Each group received either two doses of ketamine (20 mg/kg, IP) or saline as a vehicle. We tested the animals in the novel object recognition test (NORT), forced swim test (FST), open field test (OFT), elevated plus maze (EPM), and Morris water maze (MWM), which was followed by ex vivo c-Fos immunohistochemistry. We observed that combining environmental enrichment with ketamine led to a synergistic antidepressant effect. Environmental enrichment also ameliorated the spatial memory deficits caused by ketamine in the MWM. There was enhanced neuronal activity in the habenula of the enrichment only group following the probe trial of the MWM. In contrast, no differential activity was observed in enriched animals that received ketamine injections. The present study showed how environmental enrichment can enhance the antidepressant properties of ketamine while reducing some of its side effects, highlighting the potential of combining pharmacological and sensory-motor manipulations in the treatment of mood disorders.

The lateral habenula: A hub for value-guided behavior

The habenula is an evolutionarily highly conserved diencephalic brain region divided into two major parts, medial and lateral. Over the past two decades, studies of the lateral habenula (LHb), in particular, have identified key functions in value-guided behavior in health and disease. In this review, we focus on recent insights into LHb connectivity and its functional relevance for different types of aversive and appetitive value-guided behavior. First, we give an overview of the anatomical organization of the LHb and its main cellular composition. Next, we elaborate on how distinct LHb neuronal subpopulations encode aversive and appetitive stimuli and on their involvement in more complex decision-making processes. Finally, we scrutinize the afferent and efferent connections of the LHb and discuss their functional implications for LHb-dependent behavior. A deepened understanding of distinct LHb circuit components will substantially contribute to our knowledge of value-guided behavior.

Sensing and avoiding sick conspecifics requires Gαi2+ vomeronasal neurons

BACKGROUND

Rodents utilize chemical cues to recognize and avoid other conspecifics infected with pathogens. Infection with pathogens and acute inflammation alter the repertoire and signature of olfactory stimuli emitted by a sick individual. These cues are recognized by healthy conspecifics via the vomeronasal or accessory olfactory system, triggering an innate form of avoidance behavior. However, the molecular identity of the sensory neurons and the higher neural circuits involved in the detection of sick conspecifics remain poorly understood.

RESULTS

We employed mice that are in an acute state of inflammation induced by systemic administration of lipopolysaccharide (LPS). Through conditional knockout of the G-protein Gαi2 and deletion of other key sensory transduction molecules (Trpc2 and a cluster of 16 vomeronasal type 1 receptors), in combination with behavioral testing, subcellular Ca²⁺ imaging, and pS6 and c-Fos neuronal activity mapping in freely behaving mice, we show that the Gαi2⁺ vomeronasal subsystem is required for the detection and avoidance of LPS-treated mice. The active components underlying this avoidance are contained in urine whereas feces extract and two selected bile acids, although detected in a Gαi2-dependent manner, failed to evoke avoidance behavior. Our analyses of dendritic Ca²⁺ responses in vomeronasal sensory neurons provide insight into the discrimination capabilities of these neurons for urine fractions from LPS-treated mice, and how this discrimination depends on Gαi2. We observed Gαi2-dependent stimulation of multiple brain areas including medial amygdala, ventromedial hypothalamus, and periaqueductal grey. We also identified the lateral habenula, a brain region implicated in negative reward prediction in aversive learning, as a previously unknown target involved in these tasks.

CONCLUSIONS

Our physiological and behavioral analyses indicate that the sensing and avoidance of LPS-treated sick conspecifics depend on the Gαi2 vomeronasal subsystem. Our observations point to a central role of brain circuits downstream of the olfactory periphery and in the lateral habenula in the detection and avoidance of sick conspecifics, providing new insights into the neural substrates and circuit logic of the sensing of inflammation in mice.

Lateral habenula lesions impair the association of a conditioned stimulus with the absence of an unconditioned stimulus: Retardation task

Recent studies have indicated that the lateral habenula (LHb) mediates the association of a conditioned stimulus (CS) with the absence of an unconditioned stimulus (US). We generated a CS-no US association using an explicit unpaired training procedure and evaluated the conditioned inhibitory properties using the modified version of the retardation-of-acquisition procedure, one of the procedures for assessing conditioned inhibition. First, rats in the unpaired group received explicit unpaired light (CS) and food (US) presentations, followed by light-food pairings. Rats in the comparison group received paired training alone. The rats in the two groups showed increased food-cup responses to light over paired training. However, rats in the unpaired group showed a slower acquisition of light and food excitatory conditioning than those in the comparison group. Light acquired conditioned inhibitory properties through explicitly unpaired training, as evidenced by its slowness. Second, we examined the effects of the LHb lesions on the decremental effects of unpaired learning on subsequent excitatory learning. Sham-operated rats exhibited decremental effects of unpaired learning on subsequent excitatory learning, while rats with LHb neurotoxic lesions did not. Third, we tested whether preexposure to the same number of lights presented in the unpaired training retarded the acquisition of subsequent excitatory conditioning. Preexposure to light did not significantly retard the acquisition of subsequent excitatory associations, with no LHb lesion effects. These findings indicate that LHb is critically involved in the association between CS and the absence of US.

From safety to frustration: The neural substrates of inhibitory learning in aversive and appetitive conditioning procedures

Inhibitory associative learning counters the effects of excitatory learning, whether appetitively or aversively motivated. Moreover, the affective responses accompanying the inhibitory associations are of opponent valence to the excitatory conditioned responses. Inhibitors for negative aversive outcomes (e.g. shock) signal safety, while inhibitors for appetitive outcomes (e.g. food reward) elicit frustration and/or disappointment. This raises the question as to whether studies using appetitive and aversive conditioning procedures should demonstrate the same neural substrates for inhibitory learning. We review the neural substrates of appetitive and aversive inhibitory learning as measured in different procedural variants and in the context of the underpinning excitatory conditioning on which it depends. The mesocorticolimbic dopamine pathways, retrosplenial cortex and hippocampus are consistently implicated in inhibitory learning. Further neural substrates identified in some procedural variants may be related to the specific motivation of the learning task and modalities of the learning cues. Finally, we consider the translational implications of our understanding of the neural substrates of inhibitory learning, for obesity and addictions as well as for anxiety disorders.

Infralimbic Projections to the Nucleus Accumbens Shell and Amygdala Regulate the Encoding of Cocaine Extinction Learning

Prior evidence indicates that the infralimbic cortex (IL) mediates the ongoing inhibition of cocaine seeking following self-administration and extinction training in rats, specifically through projections to the nucleus accumbens shell (NAshell). Our own data indicate that IL activity immediately following an unreinforced lever press is critical for encoding the extinction contingencies in such procedures. Whether extinction encoding requires activity in the IL exclusively or also activity in its outputs, such as those to the NAshell and amygdala, is unknown. To address this issue, we used a closed-loop optogenetic approach in female and male Sprague Dawley rats to silence IL-NAshell or IL-amygdala activity following an unreinforced lever press during extinction training. Optical illumination (20 s) was given either immediately after a lever press or following a 20 s delay. IL-NAshell inhibition immediately following an unreinforced lever press increased lever pressing during extinction training and impaired retention of extinction learning, as assessed during subsequent extinction sessions without optical inhibition. Likewise, IL-amygdala inhibition given in the same manner impaired extinction retention during sessions without inhibition. Control experiments indicate that critical encoding of extinction learning does not require activity in these pathways beyond the initial 20 s post-lever press period, as delayed IL-NAshell and IL-amygdala inhibition had no effect on extinction learning. These results suggest that a larger network extending from the IL to the NAshell and amygdala is involved in encoding extinction contingencies following cocaine self-administration.SIGNIFICANCE STATEMENT Infralimbic cortex (IL) activity following an unreinforced lever press during extinction learning encodes the extinction of cocaine-seeking behavior. However, the larger circuitry controlling such encoding has not been investigated. Using closed-loop optogenetic pathway targeting, we found that inhibition of IL projections to the nucleus accumbens shell and to the amygdala impaired the extinction of cocaine seeking. Importantly, these effects were only observed when activity was disrupted during the first 20 s post-lever press and not when given following a 20 s delay. These findings suggest that successful cocaine extinction encoding requires activity across a larger circuit beyond simply inputs to the IL.

Sex differences in neuronal activation during aversion-resistant alcohol consumption

BACKGROUND

One of the DSM-5 criteria for Alcohol Use Disorder is continued alcohol consumption despite negative consequences. This has been modeled in mice using adulteration of alcohol solution with the bitter tastant quinine. Mice that continue to consume alcohol despite this adulteration are considered aversion resistant. The limited number of studies dissecting the underlying neuronal mechanisms of aversion-resistant drinking behaviors used only male subjects. We have previously shown that female mice are more resistant to quinine adulteration of alcohol than males. Our aim here is to identify potential sex differences in neuronal activation that may underlie this behavior.

METHODS

Male and female C57BL/6J mice were allowed continuous access to 20% alcohol in a two-bottle choice procedure. To test aversion-resistance, the alcohol was adulterated with increasing concentrations (0.03, 0.1, and 0.2 mM) of quinine hydrochloride. After consumption rates were calculated, brains were extracted to examine neuronal activation using Fos immunohistochemistry.

RESULTS

We found that female mice suppressed their intake to a lesser extent than males when the alcohol solution was adulterated with quinine. Our Fos staining revealed three regions of interest that exhibit a sex difference during quinine-adulterated alcohol drinking: the ventromedial prefrontal cortex (vmPFC), the posterior insular cortex (PIC), and the ventral tegmental area (VTA). Both the vmPFC and the PIC exhibited higher neuronal activation in males during quinine-adulterated alcohol consumption. However, females showed higher Fos activation in the VTA during quinine-adulterated alcohol consumption.

CONCLUSIONS

Females more readily exhibit aversion-resistant alcohol intake than their male counterparts and exhibit some differences in neuronal activation patterns. We conclude that there are sex differences in neurocircuitry that may underlie compulsive drinking behaviors.

Lateral Habenula Beyond Avoidance: Roles in Stress, Memory, and Decision-Making With Implications for Psychiatric Disorders

In this Perspective review, we highlight some of the less explored aspects of lateral habenula (LHb) function in contextual memory, sleep, and behavioral flexibility. We provide evidence that LHb is well-situated to integrate different internal state and multimodal sensory information from memory-, stress-, motivational-, and reward-related circuits essential for both survival and decision making. We further discuss the impact of early life stress (ELS) on LHb function as an example of stress-induced hyperactivity and dysregulation of neuromodulatory systems within the LHb that promote anhedonia and motivational deficits following ELS. We acknowledge that recent technological advancements in manipulation and recording of neural circuits in simplified and well-controlled behavioral paradigms have been invaluable in our understanding of the critical role of LHb in motivation and emotional regulation as well as the involvement of LHb dysfunction in stress-induced psychopathology. However, we also argue that the use of ethologically-relevant behaviors with consideration of complex aspects of decision-making is warranted for future studies of LHb contributions in a wide range of psychiatric illnesses. We conclude this Perspective with some of the outstanding issues for the field to consider where a multi-systems approach is needed to investigate the complex nature of LHb circuitry interactions with environmental stimuli that predisposes psychiatric disorders.

The nervous system as a solution for implementing closed negative feedback control loops

Behavior can be regarded as the output of a system (action), as a function linking stimulus to response (reaction), or as an abstraction of the bidirectional relationship between the environment and the organism (interaction). When considering the latter possibility, a relevant question arises concerning how an organism can materially and continuously implement such a relationship during its lifetime in order to perpetuate itself. The feedback control approach has taken up the task of answering just that question. During the last several decades, said approach has been progressing and has started to be recognized as a paradigm shift, superseding certain canonical notions in mainstream behavior analysis, cognitive psychology, and even neuroscience. In this paper, we describe the main features of feedback control theory and its associated techniques, concentrating on its critiques of behavior analysis, as well as the commonalities they share. While some of feedback control theory's major critiques of behavior analysis arise from the fact that they focus on different levels of organization, we believe that some are legitimate and meaningful. Moreover, feedback control theory seems to blend with neurobiology more smoothly as compared to canonical behavior analysis, which only subsists in a scattered handful of fields. If this paradigm shift truly takes place, behavior analysts-whether they accept or reject this new currency-should be mindful of the basics of the feedback control approach.

Adult Neurogenesis: A Story Ranging from Controversial New Neurogenic Areas and Human Adult Neurogenesis to Molecular Regulation

The generation of new neurons in the adult brain is a currently accepted phenomenon. Over the past few decades, the subventricular zone and the hippocampal dentate gyrus have been described as the two main neurogenic niches. Neurogenic niches generate new neurons through an asymmetric division process involving several developmental steps. This process occurs throughout life in several species, including humans. These new neurons possess unique properties that contribute to the local circuitry. Despite several efforts, no other neurogenic zones have been observed in many years; the lack of observation is probably due to technical issues. However, in recent years, more brain niches have been described, once again breaking the current paradigms. Currently, a debate in the scientific community about new neurogenic areas of the brain, namely, human adult neurogenesis, is ongoing. Thus, several open questions regarding new neurogenic niches, as well as this phenomenon in adult humans, their functional relevance, and their mechanisms, remain to be answered. In this review, we discuss the literature and provide a compressive overview of the known neurogenic zones, traditional zones, and newly described zones. Additionally, we will review the regulatory roles of some molecular mechanisms, such as miRNAs, neurotrophic factors, and neurotrophins. We also join the debate on human adult neurogenesis, and we will identify similarities and differences in the literature and summarize the knowledge regarding these interesting topics.