Inactivation of ventral hippocampus projections promotes sensitivity to changes in contingency

Control of goal-directed and inflexible actions by dorsal striatal melanocortin systems, in coordination with the central nucleus of the amygdala

The dorsomedial striatum (DMS) is associated with flexible goal seeking, as opposed to routinized habits. Whether local mechanisms brake this function, for instance when habits may be adaptive, is incompletely understood. We find that a sub-population of dopamine D1 receptor-containing striatal neurons express the melanocortin-4 receptor (MC4R) for α-melanocyte stimulating hormone. These neurons within the DMS are necessary and sufficient for controlling the capacity of mice to flexibly adjust actions based on the likelihood that they will be rewarded. In investigating MC4R function, we found that it suppresses immediate-early gene levels in the DMS and concurrently, flexible goal seeking. MC4R+ neurons receive input from the central nucleus of the amygdala, and behavioral experiments indicate that they are functionally integrated into an amygdalo-striatal circuit that suppresses action flexibility in favor of routine. Publicly available spatial transcriptomics datasets were analyzed for gene transcript correlates of Mc4r expression across the striatal subregions, revealing considerable co-variation in dorsal structures. This insight led to the discovery that the function of MC4R in the dorsolateral striatum complements that in the DMS, in this case suppressing habit-like behavior. Altogether, our findings suggest that striatal MC4R controls the capacity for goal-directed and inflexible actions alike.

Linking haploinsufficiency of the autism- and schizophrenia-associated gene Cyfip1 with striatal-limbic-cortical network dysfunction and cognitive inflexibility

Impaired behavioural flexibility is a core feature of neuropsychiatric disorders and is associated with underlying dysfunction of fronto-striatal circuitry. Reduced dosage of Cyfip1 is a risk factor for neuropsychiatric disorder, as evidenced by its involvement in the 15q11.2 (BP1-BP2) copy number variant: deletion carriers are haploinsufficient for CYFIP1 and exhibit a two- to four-fold increased risk of schizophrenia, autism and/or intellectual disability. Here, we model the contributions of Cyfip1 to behavioural flexibility and related fronto-striatal neural network function using a recently developed haploinsufficient, heterozygous knockout rat line. Using multi-site local field potential (LFP) recordings during resting state, we show that Cyfip1 heterozygous rats (Cyfip1+/-) harbor disrupted network activity spanning medial prefrontal cortex, hippocampal CA1 and ventral striatum. In particular, Cyfip1+/- rats showed reduced influence of nucleus accumbens and increased dominance of prefrontal and hippocampal inputs, compared to wildtype controls. Adult Cyfip1+/- rats were able to learn a single cue-response association, yet unable to learn a conditional discrimination task that engages fronto-striatal interactions during flexible pairing of different levers and cue combinations. Together, these results implicate Cyfip1 in development or maintenance of cortico-limbic-striatal network integrity, further supporting the hypothesis that alterations in this circuitry contribute to behavioural inflexibility observed in neuropsychiatric diseases including schizophrenia and autism.

A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward

Much research has been dedicated to understanding the psychological and neural bases of goal-directed action, yet the relationship between context and goal-directed action is not well understood. Here, we used excitotoxic lesions, chemogenetics, and circuit-specific manipulations to demonstrate the role of the ventral hippocampus (vHPC) in contextual learning that supports sensitivity to action-outcome contingencies, a hallmark of goal-directed action. We found that chemogenetic inhibition of the ventral, but not dorsal, hippocampus attenuated sensitivity to instrumental contingency degradation. We then tested the hypothesis that this deficit was due to an inability to discern the relative validity of the action compared with the context as a predictor of reward. Using latent inhibition and Pavlovian context conditioning, we confirm that degradation of action-outcome contingencies relies on intact context-outcome learning and show that this learning is dependent on vHPC. Finally, we show that chemogenetic inhibition of vHPC terminals in the medial prefrontal cortex also impairs both instrumental contingency degradation and context-outcome learning. These results implicate a hippocampo-cortical pathway in adapting to changes in instrumental contingencies and indicate that the psychological basis of this deficit is an inability to learn the predictive value of the context. Our findings contribute to a broader understanding of the neural bases of goal-directed action and its contextual regulation.

Positive correlation between measures of habitual responding and motivated responding in mice

Habit and motivation are thought to be separate processes, with motivated behavior often considered to be goal directed, whereas habits are defined by the absence of goal-directed control over behavior. However, there has been increasing interrogation of the binary nature of habitual versus goal-directed behavior. Furthermore, although drug and alcohol exposure can promote the formation of habits, drug seeking itself can also be highly flexible, pointing toward the need for complex consideration of the parallel processes that drive behavior. The goal of the current study was to determine whether there was a relation between motivation-as measured by progressive ratio-and habit-as measured by contingency degradation-and whether this relation was affected by ethanol exposure history and sex. The results showed that these measures were positively correlated such that greater contingency insensitivity was associated with achieving higher break points on the progressive-ratio task. However, this relation depended on reinforcement schedule history, ethanol exposure history, and sex. These point to potential relations between measures of habit and motivation and stress the importance of carefully parsing behavioral findings and assays. These findings are also expected to inform future substance use research, as drug history may affect these relations.

Pathway specific interventions reveal the multiple roles of ventral hippocampus projections in cognitive functions

Since the 1950s study of Scoville and Milner on the case H.M., the hippocampus has attracted neuroscientists' attention. The hippocampus has been traditionally divided into dorsal and ventral parts, each of which projects to different brain structures and mediates various functions. Despite a predominant interest in its dorsal part in animal models, especially regarding episodic-like and spatial cognition, recent data highlight the role of the ventral hippocampus (vHPC), as the main hippocampal output, in cognitive processes. Here, we review recent studies conducted in rodents that have used advanced in vivo functional techniques to specifically monitor and manipulate vHPC efferent pathways and delineate the roles of these specific projections in learning and memory processes. Results highlight that vHPC projections to basal amygdala are implicated in emotional memory, to nucleus accumbens in social memory and instrumental actions and to prefrontal cortex in all the above as well as in object-based memory. Some of these hippocampal projections also modulate feeding and anxiety-like behaviours providing further evidence that the "one pathway-one function" view is outdated and future directions are proposed to better understand the role of hippocampal pathways and shed further light on its connectivity and function.

Chemogenetic inhibition of a monosynaptic projection from the basolateral amygdala to the ventral hippocampus selectively reduces appetitive, but not consummatory, alcohol drinking-related behaviours

Alcohol use disorder (AUD) and anxiety/stressor disorders frequently co-occur and this dual diagnosis represents a major health and economic problem worldwide. The basolateral amygdala (BLA) is a key brain region that is known to contribute to the aetiology of both disorders. Although many studies have implicated BLA hyperexcitability in the pathogenesis of AUD and comorbid conditions, relatively little is known about the specific efferent projections from this brain region that contribute to these disorders. Recent optogenetic studies have shown that the BLA sends a strong monosynaptic excitatory projection to the ventral hippocampus (vHC) and that this circuit modulates anxiety- and fear-related behaviours. However, it is not known if this pathway influences alcohol drinking-related behaviours. Here, we employed a rodent operant self-administration regimen that procedurally separates appetitive (e.g. seeking) and consummatory (e.g., drinking) behaviours, chemogenetics and brain region-specific microinjections, to determine if BLA-vHC circuitry influences alcohol and sucrose drinking-related measures. We first confirmed prior optogenetic findings that silencing this circuit reduced anxiety-like behaviours on the elevated plus maze. We then demonstrated that inhibiting the BLA-vHC pathway significantly reduced appetitive drinking-related behaviours for both alcohol and sucrose while having no effect on consummatory measures. Taken together, these findings provide the first indication that the BLA-vHC circuit may regulate appetitive reward seeking directed at alcohol and natural rewards and add to a growing body of evidence suggesting that dysregulation of this pathway may contribute to the pathophysiology of AUD and anxiety/stressor-related disorders.

Alcohol dependence and the ventral hippocampal influence on alcohol drinking in male mice

Examining neural circuits underlying persistent, heavy drinking provides insight into the neurobiological mechanisms driving alcohol use disorder. Facilitated by its connectivity with other parts of the brain such as the nucleus accumbens (NAc), the ventral hippocampus (vHC) supports many behaviors, including those related to reward seeking and addiction. These studies used a well-established mouse model of alcohol (ethanol) dependence. After surgery to infuse DREADD-expressing viruses (hM4Di, hM3Dq, or mCherry-only) into the vHC and position guide cannula above the NAc, male C57BL/6J mice were treated in the CIE drinking model that involved repeated cycles of chronic intermittent alcohol (CIE) vapor or air (CTL) exposure alternating with weekly test drinking cycles in which mice were offered alcohol (15% v/v) 2 h/day. Additionally, smaller groups of mice were evaluated for either cFos expression or glutamate release using microdialysis procedures. In CIE mice expressing inhibitory (hM4Di) DREADDs in the vHC, drinking increased as expected, but CNO (3 mg/kg intraperitoneally [i.p.]) given 30 min before testing did not alter alcohol intake. However, in CTL mice expressing hM4Di, CNO significantly increased alcohol drinking (∼30%; p < 0.05) to levels similar to the CIE mice. The vHC-NAc pathway was targeted by infusing CNO into the NAc (3 or 10 μM/side) 30 min before testing. CNO activation of the pathway in mice expressing excitatory (hM3Dq) DREADDs selectively reduced consumption in CIE mice back to CTL levels (∼35-45%; p < 0.05) without affecting CTL alcohol intake. Lastly, activating the vHC-NAc pathway increased cFos expression and evoked significant glutamate release from the vHC terminals in the NAc. These data indicate that reduced activity of the vHC increases alcohol consumption and that targeted, increased activity of the vHC-NAc pathway attenuates excessive drinking associated with alcohol dependence. Thus, these findings indicate that the vHC and its glutamatergic projections to the NAc are involved in excessive alcohol drinking.

A quadruple dissociation of reward-related behaviour in mice across excitatory inputs to the nucleus accumbens shell

The nucleus accumbens shell (NAcSh) is critically important for reward valuations, yet it remains unclear how valuation information is integrated in this region to drive behaviour during reinforcement learning. Using an optogenetic spatial self-stimulation task in mice, here we show that contingent activation of different excitatory inputs to the NAcSh change expression of different reward-related behaviours. Our data indicate that medial prefrontal inputs support place preference via repeated actions, ventral hippocampal inputs consistently promote place preferences, basolateral amygdala inputs produce modest place preferences but as a byproduct of increased sensitivity to time investments, and paraventricular inputs reduce place preferences yet do not produce full avoidance behaviour. These findings suggest that each excitatory input provides distinct information to the NAcSh, and we propose that this reflects the reinforcement of different credit assignment functions. Our finding of a quadruple dissociation of NAcSh input-specific behaviours provides insights into how types of information carried by distinct inputs to the NAcSh could be integrated to help drive reinforcement learning and situationally appropriate behavioural responses.

Influence of Effort-based Reward Training on Neuroadaptive Cognitive Responses: Implications for Preclinical Behavioral Approaches for Depressive Symptoms

Despite the presence of multiple pharmacotherapeutic options, incidence rates for depressive disorders continue to rise. Nonpharmacological approaches (e.g., cognitive and behavioral therapies) exhibit encouraging efficacy rates; however, a lack of preclinical models has prevented progress in the identification of relevant neurobiological mechanisms of these approaches. Accordingly, the effort-based reward (EBR) preclinical model exposes rats to response-outcome (R-O) contingencies and provides an opportunity to investigate behavioral clinical approaches. In the current study, male and female rats were assigned to either an EBR contingent- or noncontingent-trained group and exposed to 7 weeks of training. Neuroadaptive cognitive responses were assessed in a cognitive uncertainty task (UT) and an object pattern separation task (OPST). Although no significant effects of EBR were observed in the UT, EBR contingent-trained rats approached the novel panel in the most difficult trial of the OPST faster than the noncontingent-trained group. Additionally, female EBR contingent-trained rats exhibited increased engagement with the novel stimulus panel across all trials. Examination of brain-derived neurotrophic factor (BDNF) in the lateral habenula (LHb), a putative neurobiological target for depressive symptoms, revealed lower BDNF immunoreactivity in EBR contingent-trained rats. Females in both training groups exhibited higher dehydroepiandrosterone/cortisol (DHEA/CORT) ratios, suggesting, along with the increased engagement with novel stimulus panels, that female rats may be more responsive to EBR contingency training than males. Together, these results suggest that EBR contingency training offers promise as a preclinical rat model for behavioral therapeutic interventions for depressive symptoms leading to a clearer understanding of putative neurobiological mechanisms.

Anxiety and hippocampal neuronal activity: Relationship and potential mechanisms

The hippocampus has been implicated in modulating anxiety. It interacts with a variety of brain regions, both cortical and subcortical areas regulating emotion and stress responses, including prefrontal cortex, amygdala, hypothalamus, and the nucleus accumbens, to adjust anxiety levels in response to a variety of stressful conditions. Growing evidence indicates that anxiety is associated with increased neuronal excitability in the hippocampus, and alterations in local regulation of hippocampal excitability have been suggested to underlie behavioral disruptions characteristic of certain anxiety disorders. Furthermore, studies have shown that some anxiolytics can treat anxiety by altering the excitability and plasticity of hippocampal neurons. Hence, identifying cellular and molecular mechanisms and neural circuits that regulate hippocampal excitability in anxiety may be beneficial for developing targeted interventions for treatment of anxiety disorders particularly for the treatment-resistant cases. We first briefly review a role of the hippocampus in fear. We then review the evidence indicating a relationship between the hippocampal activity and fear/anxiety and discuss some possible mechanisms underlying stress-induced hippocampal excitability and anxiety-related behavior.

Adolescent social isolation induced alterations in nucleus accumbens glutamate signalling

Exposure to adversity during early childhood and adolescence increases an individual's vulnerability to developing substance use disorder. Despite the knowledge of this vulnerability, the mechanisms underlying it are still poorly understood. Excitatory afferents to the nucleus accumbens (NAc) mediate responses to both stressful and rewarding stimuli. Understanding how adolescent social isolation alters these afferents could inform the development of targeted interventions both before and after drug use. Here, we used social isolation rearing as a model of early life adversity which we have previously demonstrated increases vulnerability to cocaine addiction-like behaviour. The current study examined the effect of social isolation rearing on presynaptic glutamatergic transmission in NAc medium spiny neurons in both male and female mice. We show that social isolation rearing alters presynaptic plasticity in the NAc by decreasing the paired-pulse ratio and the size of the readily releasable pool of glutamate. Optogenetically activating the glutamatergic input from the ventral hippocampus to the NAc is sufficient to recapitulate the decreases in paired-pulse ratio and readily releasable pool size seen following electrical stimulation of all NAc afferents. Further, optogenetically inhibiting the ventral hippocampal afferent during electrical stimulation eliminates the effect of early life adversity on the paired-pulse ratio or readily releasable pool size. In summary, we demonstrate that social isolation rearing leads to alterations in glutamate transmission driven by projections from the ventral hippocampus. These data suggest that targeting the circuit from the ventral hippocampus to the nucleus accumbens could provide a means to reverse stress-induced plasticity.

Pyk2 Stabilizes Striatal Medium Spiny Neuron Structure and Striatal-Dependent Action

In day-to-day life, we often choose between pursuing familiar behaviors that have been rewarded in the past or adjusting behaviors when new strategies might be more fruitful. The dorsomedial striatum (DMS) is indispensable for flexibly arbitrating between old and new behavioral strategies. The way in which DMS neurons host stable connections necessary for sustained flexibility is still being defined. An entry point to addressing this question may be the structural scaffolds on DMS neurons that house synaptic connections. We find that the non-receptor tyrosine kinase Proline-rich tyrosine kinase 2 (Pyk2) stabilizes both dendrites and spines on striatal medium spiny neurons, such that Pyk2 loss causes dendrite arbor and spine loss. Viral-mediated Pyk2 silencing in the DMS obstructs the ability of mice to arbitrate between rewarded and non-rewarded behaviors. Meanwhile, the overexpression of Pyk2 or the closely related focal adhesion kinase (FAK) enhances this ability. Finally, experiments using combinatorial viral vector strategies suggest that flexible, Pyk2-dependent action involves inputs from the medial prefrontal cortex (mPFC), but not the ventrolateral orbitofrontal cortex (OFC). Thus, Pyk2 stabilizes the striatal medium spiny neuron structure, likely providing substrates for inputs, and supports the capacity of mice to arbitrate between novel and familiar behaviors, including via interactions with the medial-prefrontal cortex.

Arbitration of Approach-Avoidance Conflict by Ventral Hippocampus

When environmental cues or stimuli that represent both rewarding and aversive outcomes are presented, complex computations must be made in order to determine whether approach or avoidance is the better behavioral strategy. In many neuropsychiatric illnesses these computations can be skewed. In some instances, circumstances that may normally warrant avoidance instead promote approach, thus producing compulsive-like behavioral strategies that are inflexible in response to new or conflicting information. Alternatively, high sensitivity to aversion or low sensitivity to reward can result in the failure to achieve goals and loss of resilience that characterizes depressive disorders. Increases in compulsive-like behavior have been found to be associated with disrupted signaling in regions that regulate response to conflicting stimuli, including the hippocampus. Classic behavioral inhibition theories of hippocampus function in anxiety suggest that the hippocampus blocks aberrant behavior in response to anxiety related cues or stimuli. The hippocampus may act to block approach in the face of conflicting stimuli. Dysregulations of hippocampal function, as may be present in neuropsychiatric disorders, may therefore promote aberrant approach behavior. The ventral hippocampus (vHPC) subregion is key for coordinating this approach/avoidance conflict resolution, likely through its participation with cortico-striatal and mesolimbic circuits. We revisit Gray's behavioral inhibition theory of HPC function, first posited in the 1980s, and interpret in the context of new knowledge on vHPC function gained through modern technology. Taken together with the extant, classical literature on hippocampal function, we propose that these new findings suggest that vHPC circuits balance behavioral response to conflicting stimuli in a manner that is both state- and context-dependent and, further, that disruption of specific vHPC circuits tips the balance in favor of biased approach or avoidance behavioral strategies.

Chemogenetic silencing of hippocampus and amygdala reveals a double dissociation in periadolescent obesogenic diet-induced memory alterations

In addition to numerous metabolic comorbidities, obesity is associated with several adverse neurobiological outcomes, especially learning and memory alterations. Obesity prevalence is rising dramatically in youth and is persisting in adulthood. This is especially worrying since adolescence is a crucial period for the maturation of certain brain regions playing a central role in memory processes such as the hippocampus and the amygdala. We previously showed that periadolescent, but not adult, exposure to obesogenic high-fat diet (HFD) had opposite effects on hippocampus- and amygdala-dependent memory, impairing the former and enhancing the latter. However, the causal role of these two brain regions in periadolescent HFD-induced memory alterations remains unclear. Here, we first showed that periadolescent HFD induced long-term, but not short-term, object recognition memory deficits, specifically when rats were exposed to a novel context. Using chemogenetic approaches to inhibit targeted brain regions, we then demonstrated that recognition memory deficits are dependent on the activity of the ventral hippocampus, but not the basolateral amygdala. On the contrary, the HFD- induced enhancement of conditioned odor aversion specifically requires amygdala activity. Taken together, these findings suggest that HFD consumption throughout adolescence impairs long-term object recognition memory through alterations of ventral hippocampal activity during memory acquisition. Moreover, these results further highlight the bidirectional effects of adolescent HFD on hippocampal and amygdala functions.

Early-life stress is associated with a preponderance of habitual responding in a novel instrumental avoidance learning paradigm

There is substantial evidence linking early-life stress (ELS) to negative health outcomes in adulthood, including addiction. However, the neurocognitive and behavioral mechanisms through which ELS increases these risks remain unclear. To address this gap in knowledge, we developed a novel instrumental learning paradigm to explore the effects of ELS on the balance of habitual versus goal-directed learning. Habits efficiently reproduce repetitive behaviors but are inflexible whenreward contingencies related to those behaviors change. Persisting in performing a response after its outcome has been devalued is the hallmark of habitual behavior in instrumental learning. Participants with a history of higher ELS were significantly more likely to make habitual responses in this instrumental avoidance learning paradigm than individuals with a history of lower ELS. Logistic regression analysis showed that ELS is significantly related to habitual responding over and above the effects of retrospective socioeconomic status, trait and state anxiety, depression and recent levels of stress. Analysis of the differential impacts of the type of ELS suggested that these effects are largely driven by experiences of physical neglect.

Involvement of the rodent prelimbic and medial orbitofrontal cortices in goal-directed action: A brief review

Goal-directed action refers to selecting behaviors based on the expectation that they will be reinforced with desirable outcomes. It is typically conceptualized as opposing habit-based behaviors, which are instead supported by stimulus-response associations and insensitive to consequences. The prelimbic prefrontal cortex (PL) is positioned along the medial wall of the rodent prefrontal cortex. It is indispensable for action-outcome-driven (goal-directed) behavior, consolidating action-outcome relationships and linking contextual information with instrumental behavior. In this brief review, we will discuss the growing list of molecular factors involved in PL function. Ventral to the PL is the medial orbitofrontal cortex (mOFC). We will also summarize emerging evidence from rodents (complementing existing literature describing humans) that it too is involved in action-outcome conditioning. We describe experiments using procedures that quantify responding based on reward value, the likelihood of reinforcement, or effort requirements, touching also on experiments assessing food consumption more generally. We synthesize these findings with the argument that the mOFC is essential to goal-directed action when outcome value information is not immediately observable and must be recalled and inferred.

Glucocorticoid-sensitive ventral hippocampal-orbitofrontal cortical connections support goal-directed action - Curt Richter Award Paper 2019

In an ever-changing and often ambiguous environment, organisms must use previously learned associations between antecedents and outcomes to predict future associations and make optimal choices. Chronic stress can impair one's ability to flexibly adjust behaviors when environmental contingencies change, particularly in cases of early-life stress. In mice, exposure to elevated levels of the primary stress hormone, corticosterone (CORT), during early adolescence is sufficient to impair response-outcome decision making later in life, biasing response strategies towards inflexible habits. Nevertheless, neurobiological mechanisms are still being defined. Here, we report that exposure to excess CORT in adolescence causes a loss of dendritic spines on excitatory pyramidal neurons in the lateral, but not medial, orbital prefrontal cortex (loPFC) of mice, and spine loss correlates with the severity of habit biases in adulthood. Excess CORT also reduces the presence of ventral hippocampal (vHC) axon terminals in the loPFC. To identify functional consequences, we inactivated vHC→loPFC projections in typical healthy mice during a period when mice must update response-outcome expectations to optimally acquire food reinforcers. Inactivation impaired the animals' subsequent ability to sustainably choose actions based on likely outcomes, causing them to defer to habit-based response strategies. Thus, vHC→loPFC projections are necessary for response-outcome expectancy updating and a target of excess glucocorticoids during early-life development. Their degradation is likely involved in long-term biases towards habit-based behaviors following glucocorticoid excess in adolescence.