Functional interaction between the hippocampus and nucleus accumbens shell is necessary for the acquisition of appetitive spatial context conditioning

Sex-Specific Mechanisms Underlie Long-Term Potentiation at Hippocampus→Medium Spiny Neuron Synapses in the Medial Shell of the Nucleus Accumbens

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp→NAc synapses is rewarding, and mice can establish learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigated sex differences in the mechanisms underlying Hipp→NAc LTP using whole-cell electrophysiology and pharmacology. We observed similarities in basal synaptic strength between males and females and found that LTP occurs postsynaptically with similar magnitudes in both sexes. However, key sex differences emerged as LTP in males required NMDA receptors (NMDAR), whereas LTP in females utilized an NMDAR-independent mechanism involving L-type voltage-gated Ca2+ channels (VGCCs) and estrogen receptor α (ERα). We also uncovered sex-similar features as LTP in both sexes depended on CaMKII activity and occurred independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

The role of the human hippocampus in decision-making under uncertainty

The role of the hippocampus in decision-making is beginning to be more understood. Because of its prospective and inferential functions, we hypothesized that it might be required specifically when decisions involve the evaluation of uncertain values. A group of individuals with autoimmune limbic encephalitis-a condition known to focally affect the hippocampus-were tested on how they evaluate reward against uncertainty compared to reward against another key attribute: physical effort. Across four experiments requiring participants to make trade-offs between reward, uncertainty and effort, patients with acute limbic encephalitis demonstrated blunted sensitivity to reward and effort whenever uncertainty was considered, despite demonstrating intact uncertainty sensitivity. By contrast, the valuation of these two attributes (reward and effort) was intact on uncertainty-free tasks. Reduced sensitivity to changes in reward under uncertainty correlated with the severity of hippocampal damage. Together, these findings provide evidence for a context-sensitive role of the hippocampus in value-based decision-making, apparent specifically under conditions of uncertainty.

A hippocampus-accumbens code guides goal-directed appetitive behavior

The dorsal hippocampus (dHPC) is a key brain region for the expression of spatial memories, such as navigating towards a learned reward location. The nucleus accumbens (NAc) is a prominent projection target of dHPC and implicated in value-based action selection. Yet, the contents of the dHPC→NAc information stream and their acute role in behavior remain largely unknown. Here, we found that optogenetic stimulation of the dHPC→NAc pathway while mice navigated towards a learned reward location was both necessary and sufficient for spatial memory-related appetitive behaviors. To understand the task-relevant coding properties of individual NAc-projecting hippocampal neurons (dHPC→NAc), we used in vivo dual-color two-photon imaging. In contrast to other dHPC neurons, the dHPC→NAc subpopulation contained more place cells, with enriched spatial tuning properties. This subpopulation also showed enhanced coding of non-spatial task-relevant behaviors such as deceleration and appetitive licking. A generalized linear model revealed enhanced conjunctive coding in dHPC→NAc neurons which improved the identification of the reward zone. We propose that dHPC routes specific reward-related spatial and behavioral state information to guide NAc action selection.

Augmenting glutamatergic, but not dopaminergic, activity in the nucleus accumbens shell disrupts responding to a discrete alcohol cue in an alcohol context

Discrete alcohol cues and contexts are relapse triggers for people with alcohol use disorder exerting particularly powerful control over behaviour when they co-occur. Here, we investigated the neural substrates subserving the capacity for alcohol-associated contexts to elevate responding to an alcohol-predictive conditioned stimulus (CS). Specifically, rats were trained in a distinct 'alcohol context' to respond by entering a fluid port during a discrete auditory CS that predicted the delivery of alcohol and were familiarized with a 'neutral context' wherein alcohol was never available. When conditioned CS responding was tested by presenting the CS without alcohol, we found that augmenting glutamatergic activity in the nucleus accumbens (NAc) shell by microinfusing α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) reduced responding to an alcohol CS in an alcohol, but not neutral, context. Further, AMPA microinfusion robustly affected behaviour, attenuating the number, duration and latency of CS responses selectively in the alcohol context. Although dopaminergic inputs to the NAc shell were previously shown to be necessary for CS responding in an alcohol context, here, chemogenetic excitation of ventral tegmental area (VTA) dopamine neurons and their inputs to the NAc shell did not affect CS responding. Critically, chemogenetic excitation of VTA dopamine neurons affected feeding behaviour and elevated c-fos immunoreactivity in the VTA and NAc shell, validating the chemogenetic approach. These findings enrich our understanding of the substrates underlying Pavlovian responding for alcohol and reveal that the capacity for contexts to modulate responding to discrete alcohol cues is delicately underpinned by the NAc shell.

Ventral hippocampal cholecystokinin interneurons gate contextual reward memory

Associating contexts with rewards depends on hippocampal circuits, with local inhibitory interneurons positioned to play an important role in shaping activity. Here, we demonstrate that the encoding of context-reward memory requires a ventral hippocampus (vHPC) to nucleus accumbens (NAc) circuit that is gated by cholecystokinin (CCK) interneurons. In a sucrose conditioned place preference (CPP) task, optogenetically inhibiting vHPC-NAc terminals impaired the acquisition of place preference. Transsynaptic rabies tracing revealed vHPC-NAc neurons were monosynaptically innervated by CCK interneurons. Using intersectional genetic targeting of CCK interneurons, ex vivo optogenetic activation of CCK interneurons increased GABAergic transmission onto vHPC-NAc neurons, while in vivo optogenetic inhibition of CCK interneurons increased cFos in these projection neurons. Notably, CCK interneuron inhibition during sucrose CPP learning increased time spent in the sucrose-associated location, suggesting enhanced place-reward memory. Our findings reveal a previously unknown hippocampal microcircuit crucial for modulating the strength of contextual reward learning.

Dorsal hippocampus to nucleus accumbens projections drive reinforcement via activation of accumbal dynorphin neurons

The hippocampus is pivotal in integrating emotional processing, learning, memory, and reward-related behaviors. The dorsal hippocampus (dHPC) is particularly crucial for episodic, spatial, and associative memory, and has been shown to be necessary for context- and cue-associated reward behaviors. The nucleus accumbens (NAc), a central structure in the mesolimbic reward pathway, integrates the salience of aversive and rewarding stimuli. Despite extensive research on dHPC→NAc direct projections, their sufficiency in driving reinforcement and reward-related behavior remains to be determined. Our study establishes that activating excitatory neurons in the dHPC is sufficient to induce reinforcing behaviors through its direct projections to the dorso-medial subregion of the NAc shell (dmNAcSh). Notably, dynorphin-containing neurons specifically contribute to dHPC-driven reinforcing behavior, even though both dmNAcSh dynorphin- and enkephalin-containing neurons are activated with dHPC stimulation. Our findings unveil a pathway governing reinforcement, advancing our understanding of the hippocampal circuity's role in reward-seeking behaviors.

Internal-state-dependent control of feeding behavior via hippocampal ghrelin signaling

Hunger is an internal state that not only invigorates feeding but also acts as a contextual cue for higher-order control of anticipatory feeding-related behavior. The ventral hippocampus is crucial for differentiating optimal behavior across contexts, but how internal contexts such as hunger influence hippocampal circuitry is unknown. In this study, we investigated the role of the ventral hippocampus during feeding behavior across different states of hunger in mice. We found that activity of a unique subpopulation of neurons that project to the nucleus accumbens (vS-NAc neurons) increased when animals investigated food, and this activity inhibited the transition to begin eating. Increases in the level of the peripheral hunger hormone ghrelin reduced vS-NAc activity during this anticipatory phase of feeding via ghrelin-receptor-dependent increases in postsynaptic inhibition and promoted the initiation of eating. Together, these experiments define a ghrelin-sensitive hippocampal circuit that informs the decision to eat based on internal state.

Sex-specific mechanisms underlie long-term potentiation at hippocampus-nucleus accumbens synapses

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary in order to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp-NAc synapses is rewarding, and that mice can make learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigate sex differences in the mechanisms underlying Hipp-NAc LTP using whole-cell electrophysiology and pharmacology. We found that males and females display similar magnitudes of Hipp-NAc LTP which occurs postsynaptically. However, LTP in females requires L-type voltage-gated Ca 2+ channels (VGCC) for postsynaptic Ca 2+ influx, while males rely on NMDA receptors (NMDAR). Additionally, females require estrogen receptor α (ERα) activity for LTP while males do not. These differential mechanisms converge as LTP in both sexes depends on CAMKII activity and occurs independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral excitatory pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

SIGNIFICANCE STATEMENT

Strengthening of Hipp-NAc synapses drives reward-related behaviors. Male and female mice have similar magnitudes of long-term potentiation (LTP) and both sexes have a predicted postsynaptic locus of plasticity. Despite these similarities, we illustrate here that sex-specific molecular mechanisms are used to elicit LTP. Given the bidirectional relationship between Hipp-NAc synaptic strength in mediating reward-related behaviors, the use of distinct molecular mechanisms may explain sex differences observed in stress susceptibility or response to rewarding stimuli. Discovery and characterization of convergent sex differences provides mechanistic insight into the sex-specific function of Hipp-NAc circuitry and has widespread implications for circuits mediating learning and reward-related behavior.

Identification of neural circuits controlling male sexual behavior and sexual motivation by manganese-enhanced magnetic resonance imaging

Introduction

Different techniques have been used to identify the brain regions that control sexual motivation and sexual behavior. However, the influence of sexual experience on the activation of these brain regions in the same subject is unknown. Using manganese-enhanced magnetic resonance imaging (MEMRI), we analyzed the activation of brain regions in the sexual incentive motivation (SIM) and the partner preference PP (tests) on weeks 1, 5, and 10 in male rats tested for 10 weeks. AIM. In experiment 1, we analyzed the possible toxic effects of 16 mg/kg of MnCl2 on male sexual behavior, running wheel, and motor execution. In experiment 2, subjects were tested for SIM and PP using MEMRI.

Methods

In both experiments, a dose of 16 mg/kg (s.c) of chloride manganese (MnCl2) was administered 24 h before subjects were tested and placed immediately thereafter in a 7-Tesla Bruker scanner.

Results

In experiment 1, the dose of 16 mg/kg of MnCl2 did not induce behavioral alterations that could interfere with interpreting the imaging data. In experiment 2, we found a clear preference for the female in both the SIM and PP tests. We found a higher signal intensity in the olfactory bulb (OB) in week 1 of the SIM test compared to the control group. We also found increased signal intensity in the socio-sexual behavior and mesolimbic reward circuits in the SIM test in week 1. In the PP test, we found a higher signal intensity in the ventral tegmental area (VTA) in week 10 compared to the control group. In the same test, we found increased signal intensity in the socio-sexual and mesolimbic reward circuits in week 5 compared to the control group. Cohen's d analysis of the whole brain revealed that as the subjects gained sexual experience we observed a higher brain activation in the OB in the SIM group. The PP group showed higher brain activation in the cortex and subcortical structures as they acquired sexual experience.

Discussion

As the subjects gain sexual experience, more structures of the reward and socio-sexual circuits are recruited, resulting in different, and large brain activations.

Separate orexigenic hippocampal ensembles shape dietary choice by enhancing contextual memory and motivation

The hippocampus (HPC), traditionally known for its role in learning and memory, has emerged as a controller of food intake. While prior studies primarily associated the HPC with food intake inhibition, recent research suggests a critical role in appetitive processes. We hypothesized that orexigenic HPC neurons differentially respond to fats and/or sugars, potent natural reinforcers that contribute to obesity development. Results uncover previously-unrecognized, spatially-distinct neuronal ensembles within the dorsal HPC (dHPC) that are responsive to separate nutrient signals originating from the gut. Using activity-dependent genetic capture of nutrient-responsive HPC neurons, we demonstrate a causal role of both populations in promoting nutrient-specific preference through different mechanisms. Sugar-responsive neurons encode an appetitive spatial memory engram for meal location, whereas fat-responsive neurons selectively enhance the preference and motivation for fat intake. Collectively, these findings uncover a neural basis for the exquisite specificity in processing macronutrient signals from a meal that shape dietary choices.

Locating causal hubs of memory consolidation in spontaneous brain network in male mice

Memory consolidation after learning involves spontaneous, brain-wide network reorganization during rest and sleep, but how this is achieved is still poorly understood. Current theory suggests that the hippocampus is pivotal for this reshaping of connectivity. Using fMRI in male mice, we identify that a different set of spontaneous networks and their hubs are instrumental in consolidating memory during post-learning rest. We found that two types of spatial memory training invoke distinct functional connections, but that a network of the sensory cortex and subcortical areas is common for both tasks. Furthermore, learning increased brain-wide network integration, with the prefrontal, striatal and thalamic areas being influential for this network-level reconfiguration. Chemogenetic suppression of each hub identified after learning resulted in retrograde amnesia, confirming the behavioral significance. These results demonstrate the causal and functional roles of resting-state network hubs in memory consolidation and suggest that a distributed network beyond the hippocampus subserves this process.

Nucleus Accumbens Shell Neurons Encode the Kinematics of Reward Approach Locomotion

The nucleus accumbens (NAc) is considered an interface between motivation and action, with NAc neurons playing an important role in promoting reward approach. However, the encoding by NAc neurons that contributes to this role remains unknown. We recorded 62 NAc neurons in male Wistar rats (n = 5) running towards rewarded locations in an 8-arm radial maze. Variables related to locomotor approach kinematics were the best predictors of the firing rate for most NAc neurons. Nearly 18% of the recorded neurons were inhibited during the entire approach run (locomotion-off cells), suggesting that reduction in firing of these neurons promotes initiation of locomotor approach. 27% of the neurons presented a peak of activity during acceleration followed by a valley during deceleration (acceleration-on cells). Together, these neurons accounted for most of the speed and acceleration encoding identified in our analysis. In contrast, a further 16% of neurons presented a valley during acceleration followed by a peak just prior to or after reaching reward (deceleration-on cells). These findings suggest that these three classes of NAc neurons influence the time course of speed changes during locomotor approach to reward.

Shared Mechanisms of GABAergic and Opioidergic Transmission Regulate Corticolimbic Reward Systems and Cognitive Aspects of Motivational Behaviors

The functional interplay between the corticolimbic GABAergic and opioidergic systems plays a crucial role in regulating the reward system and cognitive aspects of motivational behaviors leading to the development of addictive behaviors and disorders. This review provides a summary of the shared mechanisms of GABAergic and opioidergic transmission, which modulate the activity of dopaminergic neurons located in the ventral tegmental area (VTA), the central hub of the reward mechanisms. This review comprehensively covers the neuroanatomical and neurobiological aspects of corticolimbic inhibitory neurons that express opioid receptors, which act as modulators of corticolimbic GABAergic transmission. The presence of opioid and GABA receptors on the same neurons allows for the modulation of the activity of dopaminergic neurons in the ventral tegmental area, which plays a key role in the reward mechanisms of the brain. This colocalization of receptors and their immunochemical markers can provide a comprehensive understanding for clinicians and researchers, revealing the neuronal circuits that contribute to the reward system. Moreover, this review highlights the importance of GABAergic transmission-induced neuroplasticity under the modulation of opioid receptors. It discusses their interactive role in reinforcement learning, network oscillation, aversive behaviors, and local feedback or feedforward inhibitions in reward mechanisms. Understanding the shared mechanisms of these systems may lead to the development of new therapeutic approaches for addiction, reward-related disorders, and drug-induced cognitive impairment.

Effect of APOE4 Allele and Gender on the Rate of Atrophy in the Hippocampus, Entorhinal Cortex, and Fusiform Gyrus in Alzheimer's Disease

BACKGROUND

The hippocampus, entorhinal cortex, and fusiform gyrus are brain areas that deteriorate during early-stage Alzheimer's disease (AD). The ApoE4 allele has been identified as a risk factor for AD development, is linked to an increase in the aggregation of amyloid ß (Aß) plaques in the brain, and is responsible for atrophy of the hippocampal area. However, to our knowledge, the rate of deterioration over time in individuals with AD, with or without the ApoE4 allele, has not been investigated.

METHOD

In this study, we, for the first time, analyze atrophy in these brain structures in AD patients with and without the ApoE4 using the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset.

RESULTS

It was found that the rate of decrease in the volume of these brain areas over 12 months was related to the presence of ApoE4. Further, we found that neural atrophy was not different for female and male patients, unlike prior studies, suggesting that the presence of ApoE4 is not linked to the gender difference in AD.

CONCLUSION

Our results confirm and extend previous findings, showing that the ApoE4 allele gradually impacts brain regions impacted by AD.

Endocytosis is required for consolidation of pattern-separated memories in the perirhinal cortex

Introduction

The ability to separate similar experiences into differentiated representations is proposed to be based on a computational process called pattern separation, and it is one of the key characteristics of episodic memory. Although pattern separation has been mainly studied in the dentate gyrus of the hippocampus, this cognitive function if thought to take place also in other regions of the brain. The perirhinal cortex is important for the acquisition and storage of object memories, and in particular for object memory differentiation. The present study was devoted to investigating the importance of the cellular mechanism of endocytosis for object memory differentiation in the perirhinal cortex and its association with brain-derived neurotrophic factor, which was previously shown to be critical for the pattern separation mechanism in this structure.

Methods

We used a modified version of the object recognition memory task and intracerebral delivery of a peptide (Tat-P4) into the perirhinal cortex to block endocytosis.

Results

We found that endocytosis is necessary for pattern separation in the perirhinal cortex. We also provide evidence from a molecular disconnection experiment that BDNF and endocytosis-related mechanisms interact for memory discrimination in both male and female rats.

Discussion

Our experiments suggest that BDNF and endocytosis are essential for consolidation of separate object memories and a part of a time-restricted, protein synthesis-dependent mechanism of memory stabilization in Prh during storage of object representations.

Neural circuit dynamics of drug-context associative learning in the mouse hippocampus

The environmental context associated with previous drug consumption is a potent trigger for drug relapse. However, the mechanism by which neural representations of context are modified to incorporate information associated with drugs of abuse remains unknown. Using longitudinal calcium imaging in freely behaving mice, we find that unlike the associative learning of natural reward, drug-context associations for psychostimulants and opioids are encoded in a specific subset of hippocampal neurons. After drug conditioning, these neurons weakened their spatial coding for the non-drug paired context, resulting in an orthogonal representation for the drug versus non-drug context that was predictive of drug-seeking behavior. Furthermore, these neurons were selected based on drug-spatial experience and were exclusively tuned to animals' allocentric position. Together, this work reveals how drugs of abuse alter the hippocampal circuit to encode drug-context associations and points to the possibility of targeting drug-associated memory in the hippocampus.

Ca2+-modulated photoactivatable imaging reveals neuron-astrocyte glutamatergic circuitries within the nucleus accumbens

Astrocytes are key elements of brain circuits that are involved in different aspects of the neuronal physiology relevant to brain functions. Although much effort is being made to understand how the biology of astrocytes affects brain circuits, astrocytic network heterogeneity and plasticity is still poorly defined. Here, we have combined structural and functional imaging of astrocyte activity recorded in mice using the Ca²⁺-modulated photoactivatable ratiometric integrator and specific optostimulation of glutamatergic pathways to map the functional neuron-astrocyte circuitries in the nucleus accumbens (NAc). We showed pathway-specific astrocytic responses induced by selective optostimulation of main inputs from the prefrontal cortex, basolateral amygdala, and ventral hippocampus. Furthermore, co-stimulation of glutamatergic pathways induced non-linear Ca²⁺-signaling integration, revealing integrative properties of NAc astrocytes. All these results demonstrate the existence of specific neuron-astrocyte circuits in the NAc, providing an insight to the understanding of how the NAc integrates information.

Neuron-astrocyte communication is fundamental for brain physiology, yet the heterogeneity in the functional interaction between these two elements remains poorly understood. Here we show how different neuron-astrocyte networks integrate information from distinct glutamatergic inputs.

Hippocampal Egr1-Dependent Neuronal Ensembles Negatively Regulate Motor Learning

Motor skills learning is classically associated with brain regions including cerebral and cerebellar cortices and basal ganglia nuclei. Less is known about the role of the hippocampus in the acquisition and storage of motor skills. Here, we show that mice receiving a long-term training in the accelerating rotarod display marked hippocampal transcriptional changes and reduced pyramidal neurons activity in the CA1 region when compared with naive mice. Then, we use mice in which neural ensembles are permanently labeled in an Egr1 activity-dependent fashion. Using these mice, we identify a subpopulation of Egr1-expressing pyramidal neurons in CA1 activated in short-term (STT) and long-term (LTT) trained mice in the rotarod task. When Egr1 is downregulated in the CA1 or these neuronal ensembles are depleted, motor learning is improved whereas their chemogenetic stimulation impairs motor learning performance. Thus, Egr1 organizes specific CA1 neuronal ensembles during the accelerating rotarod task that limit motor learning. These evidences highlight the role of the hippocampus in the control of this type of learning and we provide a possible underlying mechanism.SIGNIFICANCE STATEMENT It is a major topic in neurosciences the deciphering of the specific circuits underlying memory systems during the encoding of new information. However, the potential role of the hippocampus in the control of motor learning and the underlying mechanisms has been poorly addressed. In the present work we show how the hippocampus responds to motor learning and how the Egr1 molecule is one of the major responsible for such phenomenon controlling the rate of motor coordination performances.

The effects of ninjin'yoeito on the electrophysiological properties of dopamine neurons in the ventral tegmental area/substantia nigra pars compacta and medium spiny neurons in the nucleus accumbens

The ventral tegmental area (VTA), substantia nigra pars compacta (SNpc) and nucleus accumbens (NAc) are involved in the regulation of appetite and motivational behaviors. A traditional Japanese (Kampo) medicine, ninjin'yoeito (NYT), has been reported to improve decreased motivation and anorexia in patients with Alzheimer's disease and apathy-like model mice. Thus, NYT may affect the activities of neurons in the VTA, SNpc and NAc. However, little is known about the underlying mechanisms of NYT. Here, we investigated the effects of NYT on the electrophysiological properties of dopaminergic neurons in the VTA and SNpc, as well as on those of medium spiny neurons (MSNs) in the NAc (core and shell subregions), by applying the patch-clamp technique in the brain slices. NYT reduced the resting membrane potential of VTA and SNpc dopaminergic neurons. In contrast, NYT increased the firing frequency of NAc MSNs accompanied by shortened first spike latency and interspike interval. Furthermore, NYT attenuated the inward rectification and sustained outward currents. In conclusion, NYT may directly influence the excitability of dopaminergic neurons in the VTA and SNpc, as well as MSNs in the NAc (core and shell). NYT may modulate dopamine signals in appetite and motivational behaviors.

Oxytocin Receptor-Expressing Neurons in the Paraventricular Thalamus Regulate Feeding Motivation through Excitatory Projections to the Nucleus Accumbens Core

Oxytocin receptors (OTR) have been found in the paraventricular thalamus (PVT) for the regulation of feeding and maternal behaviors. However, the functional projections of OTR-expressing PVT neurons remain largely unknown. Here, we used chemogenetic and optogenetic tools to test the role of OTR-expressing PVT neurons and their projections in the regulation of food intake in both male and female OTR-Cre mice. We found chemogenetic activation of OTR-expressing PVT neurons promoted food seeking under trials with a progressive ratio schedule of reinforcement. Using Feeding Experimentation Devices for real-time meal measurements, we found chemogenetic activation of OTR-expressing PVT neurons increased meal frequency but not cumulative food intake because of a compensatory decrease in meal sizes. In combination with anterograde neural tracing and slice patch-clamp recordings, we found optogenetic stimulation of PVT OTR terminals excited neurons in the posterior basolateral amygdala (pBLA) and nucleus accumbens core (NAcC) as well as local PVT neurons through monosynaptic glutamatergic transmissions. Photostimulation of OTR-expressing PVT-NAcC projections promoted food-seeking, whereas selective activation of PVT-pBLA projections produced little effect on feeding. In contrast to selective activation of OTR terminals, photostimulation of a broader population of glutamatergic PVT terminals exerted direct excitation followed by indirect lateral inhibition on neurons in both NAcC and anterior basolateral amygdala. Together, these results suggest that OTR-expressing PVT neurons are a distinct population of PVT glutamate neurons that regulate feeding motivation through projections to NAcC.SIGNIFICANCE STATEMENT The paraventricular thalamus plays an important role in the regulation of feeding motivation. However, because of the diversity of paraventricular thalamic neurons, the specific neuron types promoting food motivation remain elusive. In this study, we provide evidence that oxytocin receptor-expressing neurons are a specific group of glutamate neurons that primarily project to the nucleus accumbens core and posterior amygdala. We found that activation of these neurons promotes the motivation for food reward and increases meal frequency through projections to the nucleus accumbens core but not the posterior amygdala. As a result, we postulate that oxytocin receptor-expressing neurons in the paraventricular thalamus and their projections to the nucleus accumbens core mainly regulate feeding motivation but not food consumption.

Model-based learning retrospectively updates model-free values

Reinforcement learning (RL) is widely regarded as divisible into two distinct computational strategies. Model-free learning is a simple RL process in which a value is associated with actions, whereas model-based learning relies on the formation of internal models of the environment to maximise reward. Recently, theoretical and animal work has suggested that such models might be used to train model-free behaviour, reducing the burden of costly forward planning. Here we devised a way to probe this possibility in human behaviour. We adapted a two-stage decision task and found evidence that model-based processes at the time of learning can alter model-free valuation in healthy individuals. We asked people to rate subjective value of an irrelevant feature that was seen at the time a model-based decision would have been made. These irrelevant feature value ratings were updated by rewards, but in a way that accounted for whether the selected action retrospectively ought to have been taken. This model-based influence on model-free value ratings was best accounted for by a reward prediction error that was calculated relative to the decision path that would most likely have led to the reward. This effect occurred independently of attention and was not present when participants were not explicitly told about the structure of the environment. These findings suggest that current conceptions of model-based and model-free learning require updating in favour of a more integrated approach. Our task provides an empirical handle for further study of the dialogue between these two learning systems in the future.

Ameliorative effects of alkaloid extract from Mitragyna speciosa (Korth.) Havil. Leaves on methamphetamine conditioned place preference in mice

ETHNOPHARMACOLOGICAL RELEVANCE

Mitragyna speciosa (Korth.) Havil., popularly known as Kratom (KT), is a medicinal plant used for pain suppression in Southeast Asia. It has been claimed to assist drug users withdraw from methamphetamine (METH) dependence. However, its use was controversial and not approved yet.

AIM OF THE STUDY

This study was conducted to characterize local field potential (LFP) patterns in the nucleus accumbens (NAc) and the hippocampus (HP) in mice with METH conditioned place preference (CPP) that were treated with KT alkaloid extract.

MATERIALS AND METHODS

Male Swiss albino ICR mice were implanted with intracraneal electrodes into the NAc and HP. To induce METH CPP, animals were injected intraperitoneally once a day with METH (1 mg/kg) and saline (0.9% w/v) alternately and put into METH/saline compartments to experience the associations between drug/saline injection and the unique environmental contexts for 10 sessions. Control group received saline injection paired with both saline/saline compartments. On post-conditioning day, effects of 40 (KT40), 80 (KT80) mg/kg KT alkaloid extract and 20 mg/kg bupropion (BP) on CPP scores and LFP powers and NAc-HP coherence were tested.

RESULTS

Two-way ANOVA revealed significant induction of CPP by METH sessions (P < 0.01). Multiple comparisons indicated that METH CPP was completely abolished by KT80 (P < 0.001). NAc gamma I (30.0-44.9 Hz) and HP delta (1.0-3.9 Hz) powers were significantly increased in mice with METH CPP (P < 0.01). The elevated NAc gamma I was significantly suppressed by KT80 (P < 0.05) and the increased HP delta was significantly reversed by KT40 (P < 0.01) and KT80 (P < 0.001). In addition, NAc-HP coherence was also significantly increased in gamma I (30.0-44.9 Hz) frequency range (P < 0.05) but it was reversed by KT80 (P < 0.05). Treatment with BP did not produce significant effect on these parameters.

CONCLUSIONS

These findings demonstrated that KT alkaloid extract significantly reversed CPP scores and LFP patterns induced by METH administration. The ameliorative effects of the extract might be beneficial for treatment of METH craving and addiction.

The influence of stimulus complexity on the effectiveness of visual associative learning

Visually guided equivalence learning is a special type of associative learning, which can be evaluated using the Rutgers Acquired Equivalence Test (RAET) among other tests. RAET applies complex stimuli (faces and colored fish) between which the test subjects build associations. The complexity of these stimuli offers the test subject several clues that might ease association learning. To reduce the number of such clues, we developed an equivalence learning test (Polygon), which is structured as RAET but uses simple grayscale geometric shapes instead of faces and colored fish. In this study, we compared the psychophysical performances of the same healthy volunteers in both RAET and Polygon test. Equivalence learning, which is a basal ganglia-associated form of learning, appears to be strongly influenced by the complexity of the visual stimuli. The simple geometric shapes were associated with poor performance as compared to faces and fish. However, the difference in stimulus complexity did not affect performance in the retrieval and transfer parts of the test phase, which are assumed to be mediated by the hippocampi.

Different encoding of reward location in dorsal and intermediate hippocampus

Hippocampal place cells fire at specific locations in the environment. They form a cognitive map that encodes spatial relations in the environment, including reward locations.¹ As part of this encoding, dorsal CA1 (dCA1) place cells accumulate at reward.^2-5 The encoding of learned reward location could vary between the dorsal and intermediate hippocampus, which differ in gene expression and cortical and subcortical connectivity.⁶ While the dorsal hippocampus is critical for spatial navigation, the involvement of intermediate CA1 (iCA1) in spatial navigation might depend on task complexity⁷ and learning phase.^8-10 The intermediate-to-ventral hippocampus regulates reward-seeking,^11-15 but little is known about the involvement in reward-directed navigation. Here, we compared the encoding of learned reward locations in dCA1 and iCA1 during spatial navigation. We used calcium imaging with a head-mounted microscope to track the activity of CA1 cells over multiple days during which mice learned different reward locations. In dCA1, the fraction of active place cells increased in anticipation of reward, but the pool of active cells changed with the reward location. In iCA1, the same cells anticipated multiple reward locations. Our results support a model in which the dCA1 cognitive map incorporates a changing population of cells that encodes reward proximity through increased population activity, while iCA1 provides a reward-predictive code through a dedicated subpopulation. Both of these location-invariant codes persisted over time, and together they provide a dual hippocampal reward location code, assisting goal-directed navigation.^16,17.

Cocaine-induced projection-specific and cell type-specific adaptations in the nucleus accumbens

Cocaine craving, seeking, and relapse are mediated, in part, by cocaine-induced adaptive changes in the brain reward circuits. The nucleus accumbens (NAc) integrates and prioritizes different emotional and motivational inputs to the reward system by processing convergent glutamatergic projections from the medial prefrontal cortex, basolateral amygdala, ventral hippocampus, and other limbic and paralimbic brain regions. Medium spiny neurons (MSNs) are the principal projection neurons in the NAc, which can be divided into two major subpopulations, namely dopamine receptor D1- versus D2-expressing MSNs, with complementing roles in reward-associated behaviors. After cocaine experience, NAc MSNs exhibit complex and differential adaptations dependent on cocaine regimen, withdrawal time, cell type, location (NAc core versus shell), and related input and output projections, or any combination of these factors. Detailed characterization of these cellular adaptations has been greatly facilitated by the recent development of optogenetic/chemogenetic techniques combined with transgenic tools. In this review, we discuss such cell type- and projection-specific adaptations induced by cocaine experience. Specifically, (1) D1 and D2 NAc MSNs frequently exhibit differential adaptations in spinogenesis, glutamatergic receptor trafficking, and intrinsic membrane excitability, (2) cocaine experience differentially changes the synaptic transmission at different afferent projections onto NAc MSNs, (3) cocaine-induced NAc adaptations exhibit output specificity, e.g., being different at NAc-ventral pallidum versus NAc-ventral tegmental area synapses, and (4) the input, output, subregion, and D1/D2 cell type may together determine cocaine-induced circuit plasticity in the NAc. In light of the projection- and cell-type specificity, we also briefly discuss ensemble and circuit mechanisms contributing to cocaine craving and relapse after drug withdrawal.

What Behavioral Abilities Emerged at Key Milestones in Human Brain Evolution? 13 Hypotheses on the 600-Million-Year Phylogenetic History of Human Intelligence

This paper presents 13 hypotheses regarding the specific behavioral abilities that emerged at key milestones during the 600-million-year phylogenetic history from early bilaterians to extant humans. The behavioral, intellectual, and cognitive faculties of humans are complex and varied: we have abilities as diverse as map-based navigation, theory of mind, counterfactual learning, episodic memory, and language. But these faculties, which emerge from the complex human brain, are likely to have evolved from simpler prototypes in the simpler brains of our ancestors. Understanding the order in which behavioral abilities evolved can shed light on how and why our brains evolved. To propose these hypotheses, I review the available data from comparative psychology and evolutionary neuroscience.

Striatal Transcriptome Reveals Differences Between Cognitively Impaired and Unimpaired Aged Male Rats

Cognitive processes require striatal activity. The underlying molecular mechanisms are widely unknown. For this reason the striatal transcriptome of young (YM), aged cognitively impaired (OMB), and unimpaired (OMG) male rats was analyzed. The global comparison of transcripts reveal a higher number of differences between OMG and YM as compared to OMB and YM. Hierarchical clustering detects differences in up- and down-regulated gene clusters in OMG and OMB when compared to YM. In OMG we found more single genes to be specifically regulated in this group than in OMB when compared to young. These genes were considered as cognition specific, whereas genes shared in OMG and OMB were considered as age specific. OMB specific up-regulated genes are related to negative control of cell differentiation and transcription (Hopx), to phagocytosis (Cd202) and cell adhesion (Pcdhb21), whereas down-regulated genes are related to associative learning, behavioral fear response and synaptic transmission (Gabra5). OMG specific up-regulated genes are in the context of maintenance of transcription and estrogen receptor signaling (Padi2, Anxa3), signal transduction [Rassf4, Dock8)], sterol regulation (Srebf1), and complement activity (C4a, C4b). Down-regulated genes are related to lipid oxidation reduction processes (Far2) and positive regulation of axon extension (Islr2). These relations were supported by pathway analysis, which reveals cholesterol metabolism processes in both aged group and cholesterol biosynthesis specifically in OMG; adipogenesis and focal adhesion in OMB. In OMG glucuronidation, estrogen metabolism, inflammatory responses and TGF beta signaling where detected as specific for this group. Signal transduction of the sphingosine-1-phospate-receptor (S1P) receptor was the main pathway difference in the comparison of OMB and OMG with downregulated genes in the first group. This difference could also be observed in the OMB vs. YM comparison but not in the OMG vs. YM analysis. Thus, an up-regulation of cognition related genes could be observed in OMG compared to OMB rats. The S1P pathway discriminated between OMB and OMG as well as between OMB and OMG. Since this pathway has been described as essential for cognitive processes in the striatum of mice, it may, among steroid hormone signaling, significantly contribute to the maintenance of cognitive processes in OMG.

Arbitration of Approach-Avoidance Conflict by Ventral Hippocampus

When environmental cues or stimuli that represent both rewarding and aversive outcomes are presented, complex computations must be made in order to determine whether approach or avoidance is the better behavioral strategy. In many neuropsychiatric illnesses these computations can be skewed. In some instances, circumstances that may normally warrant avoidance instead promote approach, thus producing compulsive-like behavioral strategies that are inflexible in response to new or conflicting information. Alternatively, high sensitivity to aversion or low sensitivity to reward can result in the failure to achieve goals and loss of resilience that characterizes depressive disorders. Increases in compulsive-like behavior have been found to be associated with disrupted signaling in regions that regulate response to conflicting stimuli, including the hippocampus. Classic behavioral inhibition theories of hippocampus function in anxiety suggest that the hippocampus blocks aberrant behavior in response to anxiety related cues or stimuli. The hippocampus may act to block approach in the face of conflicting stimuli. Dysregulations of hippocampal function, as may be present in neuropsychiatric disorders, may therefore promote aberrant approach behavior. The ventral hippocampus (vHPC) subregion is key for coordinating this approach/avoidance conflict resolution, likely through its participation with cortico-striatal and mesolimbic circuits. We revisit Gray's behavioral inhibition theory of HPC function, first posited in the 1980s, and interpret in the context of new knowledge on vHPC function gained through modern technology. Taken together with the extant, classical literature on hippocampal function, we propose that these new findings suggest that vHPC circuits balance behavioral response to conflicting stimuli in a manner that is both state- and context-dependent and, further, that disruption of specific vHPC circuits tips the balance in favor of biased approach or avoidance behavioral strategies.

Psychostimulant-Induced Adaptations in Nucleus Accumbens Glutamatergic Transmission

Carrying different aspects of emotional and motivational signals, glutamatergic synaptic projections from multiple limbic and paralimbic brain regions converge to the nucleus accumbens (NAc), in which these arousing signals are processed and prioritized for behavioral output. In animal models of drug addiction, some key drug-induced alterations at NAc glutamatergic synapses underlie important cellular and circuit mechanisms that promote subsequent drug taking, seeking, and relapse. With the focus of cocaine, we review changes at NAc glutamatergic synapses that occur after different drug procedures and abstinence durations, and the behavioral impact of these changes.

Absence of methamphetamine-induced conditioned place preference in weaver mutant mice

Aims

G protein‐activated inwardly rectifying potassium (GIRK) channels are related to rewarding effects of addictive drugs. The GIRK2 subunit is thought to play key roles in the reward system. Weaver mutant mice exhibit abnormal GIRK2 function and different behaviors that are caused by several addictive substances compared with wild‐type mice. However, mechanisms of reward‐related alterations in weaver mutant mice remain unclear. The present study investigated changes in the rewarding effects of methamphetamine (METH) in weaver mutant mice.

Methods

The rewarding effects of METH (4.0 mg/kg) were investigated using the conditioned place preference (CPP) paradigm. Extracellular dopamine level in the nucleus accumbens (NAc) was measured by in vivo microdialysis. To identify brain regions that were associated with these changes in rewarding effects, METH‐induced alterations of Fos expression were investigated by immunohistochemical analysis.

Results

Weaver mutant mice exhibited a significant decrease in METH‐induced CPP and dopamine release in the NAc. Methamphetamine significantly increased Fos expression in the posterior NAc (pNAc) shell in wild‐type but not in weaver mutant mice.

Conclusions

Methamphetamine did not induce rewarding effects in weaver mutant mice. The pNAc shell exhibited a significant difference in neuronal activity between wild‐type and weaver mutant mice. The present results suggest that the absence of METH‐induced CPP in weaver mutant mice is probably related to an innate reduction of dopamine and decreased neural activity in the pNAc shell that is partially attributable to the change of GIRK channel function. GIRK channels, especially those containing the GIRK2 subunit, appear to be involved in METH dependence.

Methamphetamine did not induce rewarding effects in weaver mutant mice that possess a mutation in the GIRK2 subunit. The posterior nucleus accumbens shell exhibited a significant difference in neuronal activity between wild‐type and weaver mutant mice.

Dissociable mesolimbic dopamine circuits control responding triggered by alcohol-predictive discrete cues and contexts

Context can influence reactions to environmental cues and this elemental process has implications for substance use disorder. Using an animal model, we show that an alcohol-associated context elevates entry into a fluid port triggered by a conditioned stimulus (CS) that predicted alcohol (CS-triggered alcohol-seeking). This effect persists across multiple sessions and, after it diminishes in extinction, the alcohol context retains the capacity to augment reinstatement. Systemically administered eticlopride and chemogenetic inhibition of ventral tegmental area (VTA) dopamine neurons reduce CS-triggered alcohol-seeking. Chemogenetically silencing VTA dopamine terminals in the nucleus accumbens (NAc) core reduces CS-triggered alcohol-seeking, irrespective of context, whereas silencing VTA dopamine terminals in the NAc shell selectively reduces the elevation of CS-triggered alcohol-seeking in an alcohol context. This dissociation reveals new roles for divergent mesolimbic dopamine circuits in the control of responding to a discrete cue for alcohol and in the amplification of this behaviour in an alcohol context.

ErbB4 Null Mice Display Altered Mesocorticolimbic and Nigrostriatal Dopamine Levels as well as Deficits in Cognitive and Motivational Behaviors

Natural genetic variants of Neuregulin1 (NRG1) and its cognate receptor ErbB4 are associated with a risk for schizophrenia. Whereas most studies on NRG1-ErbB4 signaling have focused on GABAergic interneurons, ErbB4 is also expressed by midbrain dopaminergic neurons where it modulates extracellular dopamine (DA) levels. Here, we report that extracellular steady-state levels of DA are reduced in the medial prefrontal cortex (mPFC; −65%), hippocampus (−53%) and nucleus accumbens (NAc; −35%), but are elevated in the dorsal striatum (+25%) of ErbB4 knock-out mice (ErbB4 KOs) relative to wild-type controls. This pattern of DA imbalance recapitulates the reported prefrontal cortical reduction and striatal increase of DA levels in schizophrenia patients. Next, we report on a battery of behavioral tasks used to evaluate locomotor, cognitive and motivational behaviors in ErbB4 KOs relative to controls. We found that ErbB4 KOs are hyperactive in a novel open field but not in their familiar home cage, are more sensitive to amphetamine, perform poorly in the T-maze and novel object recognition (NOR) tasks, exhibit reduced spatial learning and memory on the Barnes maze, and perform markedly worse in conditioned place preference (CPP) tasks when associating cued-reward palatable food with location. However, we found that the poor performance of ErbB4 KOs in CPP are likely due to deficits in spatial memory, instead of reward seeking, as ErbB4 KOs are more motivated to work for palatable food rewards. Our findings indicate that ErbB4 signaling affects tonic DA levels and modulates a wide array of behavioral deficits relevant to psychiatric disorders, including schizophrenia.

Functional connectivity among brain regions affected in Alzheimer's disease is associated with CSF TNF-α in APOE4 carriers

It is now recognized that understanding how neuroinflammation affects brain function may provide new insights into Alzheimer's pathophysiology. Tumor necrosis factor (TNF)-α, an inflammatory cytokine marker, has been implicated in Alzheimer's disease (AD), as it can impair neuronal function through suppression of long-term potentiation. Our study investigated the relationship between cerebrospinal fluid TNF-α and functional connectivity (FC) in a cohort of 64 older adults (μ age = 69.76 years; 30 cognitively normal, 34 mild AD). Higher cerebrospinal fluid TNF-α levels were associated with lower FC among brain regions important for high-level decision-making, inhibitory control, and memory. This effect was moderated by apolipoprotein E-ε4 (APOE4) status. Graph theory metrics revealed there were significant differences between APOE4 carriers at the node level, and by diagnosis at the network level suggesting global brain network dysfunction in participants with AD. These findings suggest proinflammatory mechanisms may contribute to reduced FC in regions important for high-level cognition. Future studies are needed to understand the role of inflammation on brain function and clinical progression, especially in APOE4 carriers.

The Law of Recency: An Episodic Stimulus-Response Retrieval Account of Habit Acquisition

A habit is a regularity in automatic responding to a specific situation. Classical learning psychology explains the emergence of habits by an extended learning history during which the response becomes associated to the situation (learning of stimulus-response associations) as a function of practice ("law of exercise") and/or reinforcement ("law of effect"). In this paper, we propose the "law of recency" as another route to habit acquisition that draws on episodic memory models of automatic response regulation. According to this account, habitual responding results from (a) storing stimulus-response episodes in memory, and (b) retrieving these episodes when encountering the stimulus again. This leads to a reactivation of the response that was bound to the stimulus (c) even in the absence of extended practice and reinforcement. As a measure of habit formation, we used a modified color-word contingency learning (CL) paradigm, in which irrelevant stimulus features (i.e., word meaning) were predictive of the to-be-executed color categorization response. The paradigm we developed allowed us to assess effects of global CL and of an instance-based episodic response retrieval simultaneously within the same experiment. Two experiments revealed robust CL as well as episodic response retrieval effects. Importantly, these effects were not independent: Controlling for response retrieval effects eliminated effects of CL, which supports the claim that habit formation can be mediated by episodic retrieval processes, and that short-term binding effects are not fundamentally separate from long-term learning processes. Our findings have theoretical and practical implications regarding (a) models of long-term learning, and (b) the emergence and change of habitual responding.

Cognitive dysfunction in mice lacking proper glucocorticoid receptor dimerization

Stress is a major risk factor for depression and anxiety. One of the effects of stress is the (over-) activation of the hypothalamic-pituitary-adrenal (HPA) axis and the release of stress hormones such as glucocorticoids (GCs). Chronically increased stress hormone levels have been shown to have detrimental effects on neuronal networks by inhibiting neurotrophic processes particularly in the hippocampus proper. Centrally, GCs modulate metabolic as well as behavioural processes by activating two classes of corticoid receptors, high-affinity mineralocorticoid receptors (MR) and low-affinity glucocorticoid receptors (GR). Upon activation, GR can modulate gene transcription either as a monomeric protein, or as a dimer interacting directly with DNA. GR can also modulate cellular processes via non-genomic mechanisms, for example via a GPCR-protein interaction. We evaluated the behavioral phenotype in mice with a targeted mutation in the GR in a FVB/NJ background. In GRdim/dim mice, GR proteins form poor homodimers, while the GR monomer remains intact. We evaluated the effect of poor GR dimerization on hippocampus-dependent cognition as well as on exploration and emotional behavior under baseline and chronically increased stress hormone levels. We found that GRdim/dim mice did not behave differently from GRwt/wt littermates under baseline conditions. However, after chronic elevation of stress hormone levels, GRdim/dim mice displayed a significant impairment in hippocampus-dependent memory compared to GRwt/wt mice, which correlated with differential expression of hippocampal Bdnf/TrkB and Fkbp5.

Dorsal and Ventral Hippocampal Sharp-Wave Ripples Activate Distinct Nucleus Accumbens Networks

Memories of positive experiences link places, events, and reward outcomes. These memories recruit interactions between the hippocampus and nucleus accumbens (NAc). Both dorsal and ventral hippocampus (dH and vH) project to the NAc, but it remains unknown whether dH and vH act in concert or separately to engage NAc representations related to space and reward. We recorded simultaneously from the dH, vH, and NAc of rats during an appetitive spatial task and focused on hippocampal sharp-wave ripples (SWRs) to identify times of memory reactivation across brain regions. Here, we show that dH and vH awake SWRs occur asynchronously and activate distinct and opposing patterns of NAc spiking. Only NAc neurons activated during dH SWRs were tuned to task- and reward-related information. These temporally and anatomically separable hippocampal-NAc interactions point to distinct channels of mnemonic processing in the NAc, with the dH-NAc channel specialized for spatial task and reward information. VIDEO ABSTRACT.

Offline ventral subiculum-ventral striatum serial communication is required for spatial memory consolidation

The hippocampal formation is considered essential for spatial navigation. In particular, subicular projections have been suggested to carry spatial information from the hippocampus to the ventral striatum. However, possible cross-structural communication between these two brain regions in memory formation has thus far been unknown. By selectively silencing the subiculum-ventral striatum pathway we found that its activity after learning is crucial for spatial memory consolidation and learning-induced plasticity. These results provide new insight into the neural circuits underlying memory consolidation and establish a critical role for off-line cross-regional communication between hippocampus and ventral striatum to promote the storage of complex information.

Cell-Type- and Endocannabinoid-Specific Synapse Connectivity in the Adult Nucleus Accumbens Core

The nucleus accumbens (NAc) is a mesocorticolimbic structure that integrates cognitive, emotional and motor functions. Although its role in psychiatric disorders is widely acknowledged, the understanding of its circuitry is not complete. Here, we combined optogenetic and whole-cell recordings to draw a functional portrait of excitatory disambiguated synapses onto D1 and D2 medium spiny neurons (MSNs) in the adult male mouse NAc core. Comparing synaptic properties of ventral hippocampus (vHipp), basolateral amygdala (BLA) and prefrontal cortex (PFC) inputs revealed a hierarchy of synaptic inputs that depends on the identity of the postsynaptic target MSN. Thus, the BLA is the dominant excitatory pathway onto D1 MSNs (BLA > PFC = vHipp) while PFC inputs dominate D2 MSNs (PFC > vHipp > BLA). We also tested the hypothesis that endocannabinoids endow excitatory circuits with pathway- and cell-specific plasticity. Thus, whereas CB1 receptors (CB1R) uniformly depress excitatory pathways regardless of MSNs identity, TRPV1 receptors (TRPV1R) bidirectionally control inputs onto the NAc core in a pathway-specific manner. Finally, we show that the interplay of TRPV1R/CB1R shapes plasticity at BLA-NAc synapses. Together these data shed new light on synapse and circuit specificity in the adult NAc core and illustrate how endocannabinoids contribute to pathway-specific synaptic plasticity.SIGNIFICANCE STATEMENT We examined the impact of connections from the ventral hippocampus (vHipp,) basolateral amygdala (BLA) and prefrontal cortex (PFC) onto identified medium spiny neurons (MSNs) in the adult accumbens core. We found BLA inputs were strongest at D1 MSNs while PFC inputs dominate D2 MSNs. Pathway- and cell-specific circuit control was also facilitated by endocannabinoids that endow bidirectional synaptic plasticity at identified BLA-NAc synapses. These data provide mechanistic insights on synapse and circuit specificity in the adult NAc core.

Fornix Stimulation Induces Metabolic Activity and Dopaminergic Response in the Nucleus Accumbens

The Papez circuit, including the fornix white matter bundle, is a well-known neural network that is involved in multiple limbic functions such as memory and emotional expression. We previously reported a large-animal study of deep brain stimulation (DBS) in the fornix that found stimulation-induced hemodynamic responses in both the medial limbic and corticolimbic circuits on functional resonance imaging (fMRI) and evoked dopamine responses in the nucleus accumbens (NAc), as measured by fast-scan cyclic voltammetry (FSCV). The effects of DBS on the fornix are challenging to analyze, given its structural complexity and connection to multiple neuronal networks. In this study, we extend our earlier work to a rodent model wherein we characterize regional brain activity changes resulting from fornix stimulation using fludeoxyglucose (¹⁸F-FDG) micro positron emission tomography (PET) and monitor neurochemical changes using FSCV with pharmacological confirmation. Both global functional changes and local changes were measured in a rodent model of fornix DBS. Functional brain activity was measured by micro-PET, and the neurochemical changes in local areas were monitored by FSCV. Micro-PET images revealed increased glucose metabolism within the medial limbic and corticolimbic circuits. Neurotransmitter efflux induced by fornix DBS was monitored at NAc by FSCV and identified by specific neurotransmitter reuptake inhibitors. We found a significant increase in the metabolic activity in several key regions of the medial limbic circuits and dopamine efflux in the NAc following fornix stimulation. These results suggest that electrical stimulation of the fornix modulates the activity of brain memory circuits, including the hippocampus and NAc within the dopaminergic pathway.

Assessing the role of toll-like receptor in isolated, standard and enriched housing conditions

Depression is a common psychiatric disorder that has been poorly understood. Consequently, current antidepressant agents have clinical limitations. Until today, most have exhibited the slow onset of therapeutic action and, more importantly, their effect on remission has been minimal. Thus, the need to find new forms of therapeutic intervention is urgent. The inflammation hypothesis of depression is widely acknowledged and is one that theories the relationship between the function of the immune system and its contribution to the neurobiology of depression. In this research, we utilized an environmental isolation (EI) approach as a valid animal model of depression, employing biochemical, molecular, and behavioral studies. The aim was to investigate the anti-inflammatory effect of etanercept, a tumor necrosis factor-α inhibitor on a toll-like receptor 7 (TLR 7) signaling pathway in a depressive rat model, and compare these actions to fluoxetine, a standard antidepressant agent. The behavioral analysis indicates that depression-related symptoms are reduced after acute administration of fluoxetine and, to a lesser extent, etanercept, and are prevented by enriched environment (EE) housing conditions. Experimental studies were conducted by evaluating immobility time in the force swim test and pleasant feeling in the sucrose preference test. The mRNA expression of the TLR 7 pathway in the hippocampus showed that TLR 7, MYD88, and TRAF6 were elevated in isolated rats compared to the standard group, and that acute treatment with an antidepressant and anti-inflammatory drugs reversed these effects. This research indicates that stressful events have an impact on behavioral well-being, TLR7 gene expression, and the TLR7 pathway. We also found that peripheral administration of etanercept reduces depressive-like behaviour in isolated rats: this could be due to the indirect modulation of the TLR7 pathway and other TLRs in the brain. Furthermore, fluoxetine treatment reversed depressive-like behaviour and molecularly modulated the expression of TLR7, suggesting that fluoxetine exerts antidepressant effects partially by modulating the TLR7 signaling pathway.

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the “landscape” (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.

Neural Representation of Overlapping Path Segments and Reward Acquisitions in the Monkey Hippocampus

Disambiguation of overlapping events is thought to be the hallmark of episodic memory. Recent rodent studies have reported that when navigating overlapping path segments in the different routes place cell activity in the same overlapping path segments were remapped according to different goal locations in different routes. However, it is unknown how hippocampal neurons disambiguate reward delivery in overlapping path segments in different routes. In the present study, we recorded monkey hippocampal neurons during performance of three virtual navigation (VN) tasks in which a monkey alternately navigated two different routes that included overlapping path segments (common central hallway) and acquired rewards in the same locations in overlapping path segments by manipulating a joystick. The results indicated that out of 106 hippocampal neurons, 57 displayed place-related activity (place-related neurons), and 18 neurons showed route-dependent activity in the overlapping path segments, consistent with a hippocampal role in the disambiguation of overlapping path segments. Moreover, 75 neurons showed neural correlates to reward delivery (reward-related neurons), whereas 56 of these 75 reward-related neurons showed route-dependent reward-related activity in the overlapping path segments. The ensemble activity of reward-related neurons represented reward delivery, locations, and routes in the overlapping path segments. In addition, ensemble activity patterns of hippocampal neurons more distinctly represented overlapping path segments than non-overlapping path segments. The present results provide neurophysiological evidence of disambiguation in the monkey hippocampus, consistent with a hippocampal role in episodic memory, and support a recent computational model of "neural differentiation," in which overlapping items are better represented by repeated retrieval with competitive learning.

Differential Roles of Accumbal GSK3β in Cocaine versus Morphine-Induced Place Preference, U50,488H-Induced Place Aversion, and Object Memory

Previous research has demonstrated that activity of glycogen synthase kinase-3 (GSK3) is necessary for the rewarding effects of cocaine. In the present study, a conditional GSK3β gene knockdown model was used to determine if GSK3β activity specifically in the nucleus accumbens is important for cocaine conditioned reward. The roles of accumbal GSK3β in morphine conditioned reward, trans-(±)-3,4-dichloro-N-methyl-N-[2-(1-pyrrolidinyl)cyclohexyl]benzeneacetamide methanesulfonate salt (U50,488H)-induced conditioned place aversion, and cognitive function were also studied. Adult male and female GSK3β-floxed or wild-type mice were injected with adeno-associated virus/Cre into the nucleus accumbens to reduce expression of GSK3β and underwent behavioral testing 4 weeks later. The development of cocaine-induced conditioned place preference was significantly attenuated in mice with reduced levels of GSK3β in the nucleus accumbens, whereas the development of morphine-induced place preference remained intact. Conditional knockdown of GSK3β in the accumbens prevented the development of conditioned aversion produced by U50,488H, a κ-opioid receptor agonist. Cognitive memory tests revealed deficits in object location memory, but not novel object recognition in mice with accumbal GSK3β knockdown. These data demonstrate that GSK3β in the nucleus accumbens is required for cocaine conditioned place preference and U50,488H conditioned place aversion, as well as spatial memory in object location task, indicating differential roles of GSK3β in the psychostimulant and opiate reward process, as well as in memory for spatial locations and object identity. SIGNIFICANCE STATEMENT: Knockdown of GSK3β in the nucleus accumbens attenuated the development of cocaine-induced place preference, as well as conditioned place aversion to U50,488H, a κ-opioid receptor agonist. In contrast, the development of morphine place preference was not altered by GSK3β knockdown. GSK3β knockdown in nucleus accumbens impaired performance in the object location task, but not the novel object recognition task. These results elucidate different physiological roles of accumbal GSKβ in conditioned reward, aversion, and memory.

Age-related differences in appetitive trace conditioning and novel object recognition procedures

•

Longitudinal study of middle age in the rat with matched younger control cohort.

•

Appetitive trace conditioning and novel object recognition tests of working memory.

•

Transient between-groups working memory impairments aged 12 compared with 2 months.

•

Object exploration reduced with age but working memory recovered.

•

Object exploration and ITI nosepoking showed some correlation with 5-HIAA/5-HT.

Appetitive trace conditioning (TC) was examined over 6 months in younger-adult (2–8 months) and middle-aged (12–18 months) male Wistar RccHan rats, to test for early age-related impairment in working memory. Novel object recognition (NOR) was included as a comparison task, to provide a positive control in the event that the expected impairment in TC was not demonstrated. The results showed that TC improved at both ages at the 2 s but not at the 10 s trace interval. There was, however, evidence for reduced improvement from one day to the next in the middle-aged cohort tested with the 2 s trace conditioned stimulus. Moreover, within the 10 s trace, responding progressively distributed later in the trace interval, in the younger-adult but not the middle-aged cohort. Middle-aged rats showed NOR discriminative impairment at a 24 h but not at a 10 min retention interval. Object exploration was overall reduced in middle-aged rats and further reduced longitudinally. At the end of the study, assessing neurochemistry by HPLC-ED showed reduced 5-HIAA/5-HT in the dorsal striatum of the middle-aged rats and some correlations between striatal 5-HIAA/5-HT and activity parameters. Overall the results suggest that, taken in isolation, age-related impairments may be overcome by experience. This recovery in performance was seen despite the drop in activity levels in older animals, which might be expected to contribute to cognitive decline.

Formation of a morphine-conditioned place preference does not change the size of evoked potentials in the ventral hippocampus-nucleus accumbens projection

In opioid addiction, cues and contexts associated with drug reward can be powerful triggers for drug craving and relapse. The synapses linking ventral hippocampal outputs to medium spiny neurons of the accumbens may be key sites for the formation and storage of associations between place or context and reward, both drug-related and natural. To assess this, we implanted rats with electrodes in the accumbens shell to record synaptic potentials evoked by electrical stimulation of the ventral hippocampus, as well as continuous local-field-potential activity. Rats then underwent morphine-induced (10 mg/kg) conditioned-place-preference training, followed by extinction. Morphine caused an acute increase in the slope and amplitude of accumbens evoked responses, but no long-term changes were evident after conditioning or extinction of the place preference, suggesting that the formation of this type of memory does not lead to a net change in synaptic strength in the ventral hippocampal output to the accumbens. However, analysis of the local field potential revealed a marked sensitization of theta- and high-gamma-frequency activity with repeated morphine administration. This phenomenon may be linked to the behavioral changes—such as psychomotor sensitization and the development of drug craving—that are associated with chronic use of addictive drugs.

Multisensory guided associative learning in healthy humans

Associative learning is a basic cognitive function by which discrete and often different percepts are linked together. The Rutgers Acquired Equivalence Test investigates a specific kind of associative learning, visually guided equivalence learning. The test consists of an acquisition (pair learning) and a test (rule transfer) phase, which are associated primarily with the function of the basal ganglia and the hippocampi, respectively. Earlier studies described that both fundamentally-involved brain structures in the visual associative learning, the basal ganglia and the hippocampi, receive not only visual but also multisensory information. However, no study has investigated whether there is a priority for multisensory guided equivalence learning compared to unimodal ones. Thus we had no data about the modality-dependence or independence of the equivalence learning. In the present study, we have therefore introduced the auditory- and multisensory (audiovisual)-guided equivalence learning paradigms and investigated the performance of 151 healthy volunteers in the visual as well as in the auditory and multisensory paradigms. Our results indicated that visual, auditory and multisensory guided associative learning is similarly effective in healthy humans, which suggest that the acquisition phase is fairly independent from the modality of the stimuli. On the other hand, in the test phase, where participants were presented with acquisitions that were learned earlier and associations that were until then not seen or heard but predictable, the multisensory stimuli elicited the best performance. The test phase, especially its generalization part, seems to be a harder cognitive task, where the multisensory information processing could improve the performance of the participants.

Hippocampal pattern separation supports reinforcement learning

Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B-, AC-, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning.

Anatomic Review of the Ventral Capsule/Ventral Striatum and the Nucleus Accumbens to Guide Target Selection for Deep Brain Stimulation for Obsessive-Compulsive Disorder

BACKGROUND

Disturbances in the reward network of the brain underlie addiction, depression, and obsessive-compulsive disorder. The ventral capsule/ventral striatum and nucleus accumbens (NAc) region is a clinically approved target for deep brain stimulation for obsessive-compulsive disorder.

METHODS

We performed a comprehensive literature review to define clinically relevant anatomy and connectivity of the ventral capsule/ventral striatum and NAc region to guide target selection for deep brain stimulation.

RESULTS

Architecturally and functionally, the NAc is divided into the core and the shell, with each area having different connections. The shell primarily receives limbic information, and the core typically receives information from the motor system. In general, afferents from the prefrontal cortex, hippocampus, and amygdala are excitatory. The dopaminergic projections to the NAc from the ventral tegmental area modulate the balance of these excitatory inputs. Several important inputs to the NAc converge at the junction of the internal capsule (IC) and the anterior commissure (AC): the ventral amygdalofugal pathways that run parallel to and underneath the AC, the precommissural fornical fibers that run anterior to the AC, axons from the ventral prefrontal cortex and medial orbitofrontal cortex that occupy the most ventral part of the IC and embedding within the NAc and AC, and the superolateral branch of the medial forebrain bundle located parallel to the anterior thalamic radiation in the IC.

CONCLUSIONS

The caudal part of the NAc passing through the IC-AC junction may be an effective target for deep brain stimulation to improve behavioral symptoms associated with obsessive-compulsive disorder.

A Hippocampus-Accumbens Tripartite Neuronal Motif Guides Appetitive Memory in Space

Retrieving and acting on memories of food-predicting environments are fundamental processes for animal survival. Hippocampal pyramidal cells (PYRs) of the mammalian brain provide mnemonic representations of space. Yet the substrates by which these hippocampal representations support memory-guided behavior remain unknown. Here, we uncover a direct connection from dorsal CA1 (dCA1) hippocampus to nucleus accumbens (NAc) that enables the behavioral manifestation of place-reward memories. By monitoring neuronal ensembles in mouse dCA1→NAc pathway, combined with cell-type selective optogenetic manipulations of input-defined postsynaptic neurons, we show that dCA1 PYRs drive NAc medium spiny neurons and orchestrate their spiking activity using feedforward inhibition mediated by dCA1-connected parvalbumin-expressing fast-spiking interneurons. This tripartite cross-circuit motif supports spatial appetitive memory and associated NAc assemblies, being independent of dorsal subiculum and dispensable for both spatial novelty detection and reward seeking. Our findings demonstrate that the dCA1→NAc pathway instantiates a limbic-motor interface for neuronal representations of space to promote effective appetitive behavior.