The nucleus accumbens: a switchboard for goal-directed behaviors

Sex-biased neural encoding of threat discrimination in nucleus accumbens afferents drives suppression of reward behavior

Learning to predict threat is essential, but equally important-yet often overlooked-is learning about the absence of threat. Here, by recording neural activity in two nucleus accumbens (NAc) glutamatergic afferents during aversive and neutral cues, we reveal sex-biased encoding of threat cue discrimination. In male mice, NAc afferents from the ventral hippocampus are preferentially activated by threat cues. In female mice, these ventral hippocampus-NAc projections are activated by both threat and nonthreat cues, whereas NAc afferents from medial prefrontal cortex are more strongly recruited by footshock and reliably discriminate threat from nonthreat. Chemogenetic pathway-specific inhibition identifies a double dissociation between ventral hippocampus-NAc and medial prefrontal cortex-NAc projections in cue-mediated suppression of reward-motivated behavior in male and female mice, despite similar synaptic connectivity. We suggest that these sex biases may reflect sex differences in behavioral strategies that may have relevance for understanding sex differences in risk of psychiatric disorders.

CRF release from a unique subpopulation of accumbal neurons constrains action-outcome acquisition in reward learning

BACKGROUND

The nucleus accumbens (NAc) mediates reward learning and motivation. Despite an abundance of neuropeptides, peptidergic neurotransmission from the NAc has not been integrated into current models of reward learning. The existence of a sparse population of neurons containing corticotropin releasing factor (CRF) has been previously documented. Here we provide a comprehensive analysis of their identity and functional role in shaping reward learning.

METHODS

To do this, we took a multidisciplinary approach that included florescent in situ hybridization (Nmice ≥ 3), tract tracing (Nmice = 5), ex vivo electrophysiology (Ncells ≥ 30), in vivo calcium imaging with fiber photometry (Nmice ≥ 4) and use of viral strategies in transgenic lines to selectively delete CRF peptide from NAc neurons (Nmice ≥ 4). Behaviors used were instrumental learning, sucrose preference and spontaneous exploration in an open field.

RESULTS

Here we show that the vast majority of NAc CRF-containing (NAcCRF) neurons are spiny projection neurons (SPNs) comprised of dopamine D1-, D2- or D1/D2-containing SPNs that primarily project and connect to the ventral pallidum and to a lesser extent the ventral midbrain. As a population, they display mature and immature SPN firing properties. We demonstrate that NAcCRF neurons track reward outcomes during operant reward learning and that CRF release from these neurons acts to constrain initial acquisition of action-outcome learning, and at the same time facilitates flexibility in the face of changing contingencies.

CONCLUSION

We conclude that CRF release from this sparse population of SPNs is critical for reward learning under normal conditions.

Distinct Action Signals by Subregions in the Nucleus Accumbens during STOP-Change Performance

The nucleus accumbens (NAc) is thought to contribute to motivated behavior by signaling the value of reward-predicting cues and the delivery of anticipated reward. The NAc is subdivided into core and shell, with each region containing different populations of neurons that increase or decrease firing to rewarding events. While there are numerous theories of functions pertaining to these subregions and cell types, most are in the context of reward processing, with fewer considering that the NAc might serve functions related to action selection more generally. We recorded from single neurons in the NAc as rats of both sexes performed a STOP-change task that is commonly used to study motor control and impulsivity. In this task, rats respond quickly to a spatial cue on 80% of trials (GO) and must stop and redirect planned movement on 20% of trials (STOP). We found that the activity of reward-excited neurons signaled accurate response direction on GO, but not STOP, trials and that these neurons exhibited higher precue firing after correct trials. In contrast, reward-inhibited neurons significantly represented response direction on STOP trials at the time of the instrumental response. Finally, the proportion of reward-excited to reward-inhibited neurons and the strength of precue firing decreased as the electrode traversed the NAc. We conclude that reward-excited cells (more common in core) promote proactive action selection, while reward-inhibited cells (more common in shell) contribute to accurate responding on STOP trials that require reactive suppression and redirection of behavior.

CRF release from a unique subpopulation of accumbal neurons constrains action-outcome acquisition in reward learning

Background

The nucleus accumbens (NAc) mediates reward learning and motivation. Despite an abundance of neuropeptides, peptidergic neurotransmission from the NAc has not been integrated into current models of reward learning. The existence of a sparse population of neurons containing corticotropin releasing factor (CRF) has been previously documented. Here we provide a comprehensive analysis of their identity and functional role in shaping reward learning.

Methods

To do this, we took a multidisciplinary approach that included florescent in situ hybridization (N mice ≥ 3), tract tracing (N mice = 5), ex vivo electrophysiology (N cells ≥ 30), in vivo calcium imaging with fiber photometry (N mice ≥ 4) and use of viral strategies in transgenic lines to selectively delete CRF peptide from NAc neurons (N mice ≥ 4). Behaviors used were instrumental learning, sucrose preference and spontaneous exploration in an open field.

Results

Here we show that the vast majority of NAc CRF-containing (NAc CRF ) neurons are spiny projection neurons (SPNs) comprised of dopamine D1-, D2- or D1/D2-containing SPNs that primarily project and connect to the ventral pallidum and to a lesser extent the ventral midbrain. As a population, they display mature and immature SPN firing properties. We demonstrate that NAc CRF neurons track reward outcomes during operant reward learning and that CRF release from these neurons acts to constrain initial acquisition of action-outcome learning, and at the same time facilitates flexibility in the face of changing contingencies.

Conclusion

We conclude that CRF release from this sparse population of SPNs is critical for reward learning under normal conditions.

Sex-Specific Mechanisms Underlie Long-Term Potentiation at Hippocampus→Medium Spiny Neuron Synapses in the Medial Shell of the Nucleus Accumbens

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp→NAc synapses is rewarding, and mice can establish learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigated sex differences in the mechanisms underlying Hipp→NAc LTP using whole-cell electrophysiology and pharmacology. We observed similarities in basal synaptic strength between males and females and found that LTP occurs postsynaptically with similar magnitudes in both sexes. However, key sex differences emerged as LTP in males required NMDA receptors (NMDAR), whereas LTP in females utilized an NMDAR-independent mechanism involving L-type voltage-gated Ca2+ channels (VGCCs) and estrogen receptor α (ERα). We also uncovered sex-similar features as LTP in both sexes depended on CaMKII activity and occurred independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

Sex-specific mechanisms underlie long-term potentiation at hippocampus-nucleus accumbens synapses

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary in order to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp-NAc synapses is rewarding, and that mice can make learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigate sex differences in the mechanisms underlying Hipp-NAc LTP using whole-cell electrophysiology and pharmacology. We found that males and females display similar magnitudes of Hipp-NAc LTP which occurs postsynaptically. However, LTP in females requires L-type voltage-gated Ca 2+ channels (VGCC) for postsynaptic Ca 2+ influx, while males rely on NMDA receptors (NMDAR). Additionally, females require estrogen receptor α (ERα) activity for LTP while males do not. These differential mechanisms converge as LTP in both sexes depends on CAMKII activity and occurs independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral excitatory pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

SIGNIFICANCE STATEMENT

Strengthening of Hipp-NAc synapses drives reward-related behaviors. Male and female mice have similar magnitudes of long-term potentiation (LTP) and both sexes have a predicted postsynaptic locus of plasticity. Despite these similarities, we illustrate here that sex-specific molecular mechanisms are used to elicit LTP. Given the bidirectional relationship between Hipp-NAc synaptic strength in mediating reward-related behaviors, the use of distinct molecular mechanisms may explain sex differences observed in stress susceptibility or response to rewarding stimuli. Discovery and characterization of convergent sex differences provides mechanistic insight into the sex-specific function of Hipp-NAc circuitry and has widespread implications for circuits mediating learning and reward-related behavior.

Neural oscillations in the ventral striatum reveal differences between the encoding of palatable food and ethanol consumption

BACKGROUND

Across multiple levels of investigation, there appear to be convergent neuronal processes underlying substance use and other motivated behaviors (i.e., the pursuit and consumption of rewarding substances). The consumption of alcohol and sweet, high-fat food engages many of the same brain regions, especially, the ventral striatum. In the current study, we hypothesized that ventral striatal local field potentials (LFPs) recorded during self-administration sessions could be used to detect when the consumption of 10% ethanol or sweet-fat food (SF) was occurring compared to all other behaviors, including naturalistic controls (i.e., water or house-chow).

METHODS

We used an intermittent limited access approach to condition Sprague-Dawley rats to consume either ethanol or SF while we recorded LFPs. We used machine learning and simple logistic regressions to determine whether LFP features could classify when consumption of each substance was occurring, and whether a general model could predict consumption of both substances. We report performance as the average area under the receiver operator characteristic curve (AUROC).

RESULTS

Consumption of a single substance was differentiable from all other behaviors, as evidenced by the AUROC (ethanol = 0.84 and SF = 0.83, p < 0.01). Models built from the combined dataset (general) did modestly overall (general → general = 0.68, p < 0.05), and did not detect the consumption of the two substances similarly (general → SF = 0.5 and general → ethanol = 0.63, p > 0.05).

CONCLUSIONS

Models successfully classified ethanol and SF consumption versus all other behavior/naturalistic controls. However, the findings highlight differences in how the ventral striatum represents the consumption of ethanol and SF and show that, although there is potential for finding biomarkers related to substance use, it may be difficult to build a model that performs well detecting multiple substances.

Context coding in the mouse nucleus accumbens modulates motivationally relevant information

Neural activity in the nucleus accumbens (NAc) is thought to track fundamentally value-centric quantities linked to reward and effort. However, the NAc also contributes to flexible behavior in ways that are difficult to explain based on value signals alone, raising the question of if and how nonvalue signals are encoded in NAc. We recorded NAc neural ensembles while head-fixed mice performed an odor-based biconditional discrimination task where an initial discrete cue modulated the behavioral significance of a subsequently presented reward-predictive cue. We extracted single-unit and population-level correlates related to the cues and found value-independent coding for the initial, context-setting cue. This context signal occupied a population-level coding space orthogonal to outcome-related representations and was predictive of subsequent behaviorally relevant responses to the reward-predictive cues. Together, these findings support a gating model for how the NAc contributes to behavioral flexibility and provide a novel population-level perspective from which to view NAc computations.

Distributed cell assemblies spanning prefrontal cortex and striatum

Highly synchronous neuronal assembly activity is deemed essential for cognitive brain function. In theory, such synchrony could coordinate multiple brain areas performing complementary processes. However, cell assemblies have been observed only in single structures, typically cortical areas, and little is known about their synchrony with downstream subcortical structures, such as the striatum. Here, we demonstrate distributed cell assemblies activated at high synchrony (∼10 ms) spanning prefrontal cortex and striatum. In addition to including neurons at different brain hierarchical levels, surprisingly, they synchronized functionally distinct limbic and associative sub-regions. These assembly activations occurred when members shifted their firing phase relative to ongoing 4 Hz and theta rhythms, in association with high gamma oscillations. This suggests that these rhythms could mediate the emergence of cross-structural assemblies. To test for the role of assemblies in behavior, we trained the rats to perform a task requiring cognitive flexibility, alternating between two different rules in a T-maze. Overall, assembly activations were correlated with task-relevant parameters, including impending choice, reward, rule, or rule order. Moreover, these behavioral correlates were more robustly expressed by assemblies than by their individual member neurons. Finally, to verify whether assemblies can be endogenously generated, we found that they were indeed spontaneously reactivated during sleep and quiet immobility. Thus, cell assemblies are a more general coding mechanism than previously envisioned, linking distributed neocortical and subcortical areas at high synchrony.

High Fructose Corn Syrup-Moderate Fat Diet Potentiates Anxio-Depressive Behavior and Alters Ventral Striatal Neuronal Signaling

The neurobiological mechanisms that mediate psychiatric comorbidities associated with metabolic disorders such as obesity, metabolic syndrome and diabetes remain obscure. High fructose corn syrup (HFCS) is widely used in beverages and is often included in food products with moderate or high fat content that have been linked to many serious health issues including diabetes and obesity. However, the impact of such foods on the brain has not been fully characterized. Here, we evaluated the effects of long-term consumption of a HFCS-Moderate Fat diet (HFCS-MFD) on behavior, neuronal signal transduction, gut microbiota, and serum metabolomic profile in mice to better understand how its consumption and resulting obesity and metabolic alterations relate to behavioral dysfunction. Mice fed HFCS-MFD for 16 weeks displayed enhanced anxiogenesis, increased behavioral despair, and impaired social interactions. Furthermore, the HFCS-MFD induced gut microbiota dysbiosis and lowered serum levels of serotonin and its tryptophan-based precursors. Importantly, the HFCS-MFD altered neuronal signaling in the ventral striatum including reduced inhibitory phosphorylation of glycogen synthase kinase 3β (GSK3β), increased expression of ΔFosB, increased Cdk5-dependent phosphorylation of DARPP-32, and reduced PKA-dependent phosphorylation of the GluR1 subunit of the AMPA receptor. These findings suggest that HFCS-MFD-induced changes in the gut microbiota and neuroactive metabolites may contribute to maladaptive alterations in ventral striatal function that underlie neurobehavioral impairment. While future studies are essential to further evaluate the interplay between these factors in obesity and metabolic syndrome-associated behavioral comorbidities, these data underscore the important role of peripheral-CNS interactions in diet-induced behavioral and brain function. This study also highlights the clinical need to address neurobehavioral comorbidities associated with obesity and metabolic syndrome.

Adolescent nicotine induces depressive and anxiogenic effects through ERK 1-2 and Akt-GSK-3 pathways and neuronal dysregulation in the nucleus accumbens

Long-term tobacco dependence typically develops during adolescence and neurodevelopmental nicotine exposure is associated with affective disturbances that manifest as a variety of neuropsychiatric comorbidities in clinical and preclinical studies, including mood and anxiety-related disorders. The nucleus accumbens shell (NASh) is critically involved in regulating emotional processing, and both molecular and neuronal disturbances in this structure are associated with mood and anxiety-related pathologies. In the present study, we used a rodent model of adolescent neurodevelopmental nicotine exposure to examine the expression of several molecular biomarkers associated with mood/anxiety-related phenotypes. We report that nicotine exposure during adolescence (but not adulthood) induces profound upregulation of the ERK 1-2 and Akt-GSK-3 signalling pathways directly within the NASh, as well as downregulation of local D1R expression that persists into adulthood. These adaptations were accompanied by decreases in τ, α, β, and γ-band oscillatory states, hyperactive medium spiny neuron activity with depressed bursting rates, and anxiety and depressive-like behavioural abnormalities. Pharmacologically targeting these molecular and neuronal adaptations revealed that selective inhibition of local ERK 1-2 and Akt-GSK-3 signalling cascades rescued nicotine-induced high-γ-band oscillatory signatures and phasic bursting rates in the NASh, suggesting that they are involved in mediating adolescent nicotine-induced depressive and anxiety-like neuropathological trajectories.

Mapping Large-Scale Networks Associated with Action, Behavioral Inhibition and Impulsivity

A key aspect of behavioral inhibition is the ability to wait before acting. Failures in this form of inhibition result in impulsivity and are commonly observed in various neuropsychiatric disorders. Prior evidence has implicated medial frontal cortex, motor cortex, orbitofrontal cortex (OFC), and ventral striatum in various aspects of inhibition. Here, using distributed recordings of brain activity [with local-field potentials (LFPs)] in rodents, we identified oscillatory patterns of activity linked with action and inhibition. Low-frequency (δ) activity within motor and premotor circuits was observed in two distinct networks, the first involved in cued, sensory-based responses and the second more generally in both cued and delayed actions. By contrast, θ activity within prefrontal and premotor regions (medial frontal cortex, OFC, ventral striatum, and premotor cortex) was linked with inhibition. Connectivity at θ frequencies was observed within this network of brain regions. Interestingly, greater connectivity between primary motor cortex (M1) and other motor regions was linked with greater impulsivity, whereas greater connectivity between M1 and inhibitory brain regions (OFC, ventral striatum) was linked with improved inhibition and diminished impulsivity. We observed similar patterns of activity on a parallel task in humans: low-frequency activity in sensorimotor cortex linked with action, θ activity in OFC/ventral prefrontal cortex (PFC) linked with inhibition. Thus, we show that δ and θ oscillations form distinct large-scale networks associated with action and inhibition, respectively.

Amphetamine reduces reward encoding and stabilizes neural dynamics in rat anterior cingulate cortex

Psychostimulants such as d-amphetamine (AMPH) often have behavioral effects that appear paradoxical within the framework of optimal choice theory. AMPH typically increases task engagement and the effort animals exert for reward, despite decreasing reward valuation. We investigated neural correlates of this phenomenon in the anterior cingulate cortex (ACC), a brain structure implicated in signaling cost-benefit utility. AMPH decreased signaling of reward, but not effort, in the ACC of freely-moving rats. Ensembles of simultaneously recorded neurons generated task-specific trajectories of neural activity encoding past, present, and future events. Low-dose AMPH contracted these trajectories and reduced their variance, whereas high-dose AMPH expanded both. We propose that under low-dose AMPH, increased network stability balances moderately increased excitability, which promotes accelerated unfolding of a neural 'script' for task execution, despite reduced reward valuation. Noise from excessive excitability at high doses overcomes stability enhancement to drive frequent deviation from the script, impairing task execution.

Cognition and Reward Circuits in Schizophrenia: Synergistic, Not Separate

Schizophrenia has been studied from the perspective of cognitive or reward-related impairments, yet it cannot be wholly related to one or the other process and their corresponding neural circuits. We posit a comprehensive circuit-based model proposing that dysfunctional interactions between the brain's cognitive and reward circuits underlie schizophrenia. The model is underpinned by how the relationship between glutamatergic and dopaminergic dysfunction in schizophrenia drives interactions between cognition and reward circuits. We argue that this interaction is synergistic: that is, deficits of cognition and reward processing interact, and this interaction is a core feature of schizophrenia. In adopting this position, we undertake a focused review of animal physiology and human clinical data, and in proposing this synergistic model, we highlight dopaminergic afferents from the ventral tegmental area to nucleus accumbens (mesolimbic circuit) and frontal cortex (mesocortical circuit). We then expand on the role of glutamatergic inputs to these dopamine circuits and dopaminergic modulation of critical excitatory pathways with attention given to the role of glutamatergic hippocampal outputs onto nucleus accumbens. Finally, we present evidence for how in schizophrenia, dysfunction in the mesolimbic and mesocortical circuits and their corresponding glutamatergic inputs gives rise to clinical and cognitive phenotypes and is associated with positive and negative symptom dimensions. The synthesis attempted here provides an impetus for a conceptual shift that links cognitive and motivational aspects of schizophrenia and that can lead to treatment approaches that seek to harmonize network interactions between the brain's cognition and reward circuits with ameliorative effects in each behavioral domain.

A biophysical model of striatal microcircuits suggests gamma and beta oscillations interleaved at delta/theta frequencies mediate periodicity in motor control

Striatal oscillatory activity is associated with movement, reward, and decision-making, and observed in several interacting frequency bands. Local field potential recordings in rodent striatum show dopamine- and reward-dependent transitions between two states: a "spontaneous" state involving β (∼15-30 Hz) and low γ (∼40-60 Hz), and a state involving θ (∼4-8 Hz) and high γ (∼60-100 Hz) in response to dopaminergic agonism and reward. The mechanisms underlying these rhythmic dynamics, their interactions, and their functional consequences are not well understood. In this paper, we propose a biophysical model of striatal microcircuits that comprehensively describes the generation and interaction of these rhythms, as well as their modulation by dopamine. Building on previous modeling and experimental work suggesting that striatal projection neurons (SPNs) are capable of generating β oscillations, we show that networks of striatal fast-spiking interneurons (FSIs) are capable of generating δ/θ (ie, 2 to 6 Hz) and γ rhythms. Under simulated low dopaminergic tone our model FSI network produces low γ band oscillations, while under high dopaminergic tone the FSI network produces high γ band activity nested within a δ/θ oscillation. SPN networks produce β rhythms in both conditions, but under high dopaminergic tone, this β oscillation is interrupted by δ/θ-periodic bursts of γ-frequency FSI inhibition. Thus, in the high dopamine state, packets of FSI γ and SPN β alternate at a δ/θ timescale. In addition to a mechanistic explanation for previously observed rhythmic interactions and transitions, our model suggests a hypothesis as to how the relationship between dopamine and rhythmicity impacts motor function. We hypothesize that high dopamine-induced periodic FSI γ-rhythmic inhibition enables switching between β-rhythmic SPN cell assemblies representing the currently active motor program, and thus that dopamine facilitates movement in part by allowing for rapid, periodic shifts in motor program execution.

Basal ganglia volume and shape in anorexia nervosa

Background

Reward-centred models have proposed that anomalies in the basal ganglia circuitry that underlies reward learning and habit formation perpetuate anorexia nervosa (AN). The present study aimed to investigate the volume and shape of key basal ganglia regions, including the bilateral caudate, putamen, nucleus accumbens (NAcc), and globus pallidus in AN.

Methods

The present study combined data from two existing studies resulting in a sample size of 46 women with AN and 56 age-matched healthy comparison (HC) women. Group differences in volume and shape of the regions of interest were examined. Within the AN group, the impact of eating disorder characteristics on volume and shape of the basal ganglia regions were also explored.

Results

The shape analyses revealed inward deformations in the left caudate, right NAcc, and bilateral ventral and internus globus pallidus, and outward deformations in the right middle and posterior globus pallidus in the AN group.

Conclusions

The present findings appear to fit with the theoretical models suggesting that there are alterations in the basal ganglia regions associated with habit formation and reward processing in AN. Further investigation of structural and functional connectivity of these regions in AN as well as their role in recovery would be of interest.

Ruminative Tendency Relates to Ventral Striatum Functionality: Evidence From Task and Resting-State fMRI

BACKGROUND

Ruminative responding involves repetitive and passive thinking about one's negative affect. This tendency interferes with initiation of goal-directed rewarding strategies, which could alleviate depressive states. Such reward-directed response selection has been shown to be mediated by ventral striatum/nucleus accumbens (VS/NAcc) function. However, to date, no study has examined whether trait rumination relates to VS/NAcc functionality. Here, we tested whether rumination moderates VS/NAcc function both in response to reward and during a ruminative state.

METHODS

Trait rumination was considered dimensionally using Rumination Response Scale (RRS) scores. Our sample (N = 80) consisted of individuals from a community sample and from patients diagnosed with major depressive disorder, providing a broad range of RRS scores. Participants underwent fMRI to assess two modes of VS/NAcc functionality: 1) in response to reward, and 2) during resting-state, as a proxy for ruminative state. We then tested for associations between RRS scores and VS/NAcc functional profiles, statistically controlling for overall depressive symptom severity.

RESULTS

RRS scores correlated positively with VS/NAcc response to reward. Furthermore, we noted that higher RRS scores were associated with increased ruminative-dependent resting-state functional connectivity of the VS/NAcc with the left orbitofrontal cortex.

CONCLUSIONS

These findings suggest that ruminative tendencies manifest in VS/NAcc reward- and rumination-related functions, providing support for a theoretical-clinical perspective of rumination as a habitual impairment in selection of rewarding, adaptive coping strategies.

Distributed Encoding of Reinforcement in Rat Cortico-Striatal-Limbic Networks

Decision-making in the mammalian brain typically involves multiple brain structures within the midbrain, thalamus, striatum, limbic system, and cortex. Although task specific contributions of each brain region have been identified, neurons responding to reinforcement have been found throughout these structures. We sought to determine if any brain area, or cluster of areas, are the source of information, and if the fidelity of information varies among the areas. We recorded simultaneous field potentials (FPs) in rats from seven brain regions as they completed a binary choice task. The FPs of a 0.5 s window following reinforcement were given as input to a classifier that attempted to predict whether or not the rat received reward on each trial. The classifier correctly categorized reward on 77% of trials. Any region-specific signal could be omitted without lowering accuracy. Frequencies above 40 Hz and signals recorded later than 0.25 s following reinforcement were necessary to achieve this accuracy. Further, the classifier was able to predict reinforcement outcome above chance levels when using FPs from any single recorded brain region. Some combinations of structures, however, were more predictive than others. Analysis of FPs prior to reward revealed most regions reflected the prior probability of reward. Lastly, analyses of information flow suggested reinforcement information does not originate within a single structure of the network, within the resolution afforded by FP recordings. These data suggest reward delivery information is rapidly distributed non-uniformly across the network, and there is no canonical flow of information about reward events in the recorded structures.

Impact of Stress on Gamma Oscillations in the Rat Nucleus Accumbens During Spontaneous Social Interaction

Alteration in social behavior is one of the most debilitating symptoms of major depression, a stress related mental illness. Social behavior is modulated by the reward system, and gamma oscillations in the nucleus accumbens (NAc) seem to be associated with reward processing. In this scenario, the role of gamma oscillations in depression remains unknown. We hypothesized that gamma oscillations in the rat NAc are sensitive to the effects of social distress. One group of male Sprague-Dawley rats were exposed to chronic social defeat stress (CSDS) while the other group was left undisturbed (control group). Afterward, a microelectrode array was implanted in the NAc of all animals. Local field potential (LFP) activity was acquired using a wireless recording system. Each implanted rat was placed in an open field chamber for a non-social interaction condition, followed by introducing another unfamiliar rat, creating a social interaction condition, where the implanted rat interacted freely and continuously with the unfamiliar conspecific in a natural-like manner (see Supplementary Videos). We found that the high-gamma band power in the NAc of non-stressed rats was higher during the social interaction compared to a non-social interaction condition. Conversely, we did not find significant differences at this level in the stressed rats when comparing the social interaction- and non-social interaction condition. These findings suggest that high-gamma oscillations in the NAc are involved in social behavior. Furthermore, alterations at this level could be an electrophysiological signature of the effect of chronic social stress on reward processing.

High-Frequency Activation of Nucleus Accumbens D1-MSNs Drives Excitatory Potentiation on D2-MSNs

Subtypes of nucleus accumbens medium spiny neurons (MSNs) promote dichotomous outcomes in motivated behaviors. However, recent reports indicate enhancing activity of either nucleus accumbens (NAc) core MSN subtype augments reward, suggesting coincident MSN activity may underlie this outcome. Here, we report a collateral excitation mechanism in which high-frequency, NAc core dopamine 1 (D1)-MSN activation causes long-lasting potentiation of excitatory transmission (LLP) on dopamine receptor 2 (D2)-MSNs. Our mechanistic investigation demonstrates that this form of plasticity requires release of the excitatory peptide substance P from D1-MSNs and robust cholinergic interneuron activation through neurokinin receptor stimulation. We also reveal that D2-MSN LLP requires muscarinic 1 receptor activation, intracellular calcium signaling, and GluR2-lacking AMPAR insertion. This study uncovers a mechanism for shaping NAc core activity through the transfer of excitatory information from D1-MSNs to D2-MSNs and may provide a means for altering goal-directed behavior through coordinated MSN activity.

Formation of a morphine-conditioned place preference does not change the size of evoked potentials in the ventral hippocampus-nucleus accumbens projection

In opioid addiction, cues and contexts associated with drug reward can be powerful triggers for drug craving and relapse. The synapses linking ventral hippocampal outputs to medium spiny neurons of the accumbens may be key sites for the formation and storage of associations between place or context and reward, both drug-related and natural. To assess this, we implanted rats with electrodes in the accumbens shell to record synaptic potentials evoked by electrical stimulation of the ventral hippocampus, as well as continuous local-field-potential activity. Rats then underwent morphine-induced (10 mg/kg) conditioned-place-preference training, followed by extinction. Morphine caused an acute increase in the slope and amplitude of accumbens evoked responses, but no long-term changes were evident after conditioning or extinction of the place preference, suggesting that the formation of this type of memory does not lead to a net change in synaptic strength in the ventral hippocampal output to the accumbens. However, analysis of the local field potential revealed a marked sensitization of theta- and high-gamma-frequency activity with repeated morphine administration. This phenomenon may be linked to the behavioral changes—such as psychomotor sensitization and the development of drug craving—that are associated with chronic use of addictive drugs.

Anatomic Review of the Ventral Capsule/Ventral Striatum and the Nucleus Accumbens to Guide Target Selection for Deep Brain Stimulation for Obsessive-Compulsive Disorder

BACKGROUND

Disturbances in the reward network of the brain underlie addiction, depression, and obsessive-compulsive disorder. The ventral capsule/ventral striatum and nucleus accumbens (NAc) region is a clinically approved target for deep brain stimulation for obsessive-compulsive disorder.

METHODS

We performed a comprehensive literature review to define clinically relevant anatomy and connectivity of the ventral capsule/ventral striatum and NAc region to guide target selection for deep brain stimulation.

RESULTS

Architecturally and functionally, the NAc is divided into the core and the shell, with each area having different connections. The shell primarily receives limbic information, and the core typically receives information from the motor system. In general, afferents from the prefrontal cortex, hippocampus, and amygdala are excitatory. The dopaminergic projections to the NAc from the ventral tegmental area modulate the balance of these excitatory inputs. Several important inputs to the NAc converge at the junction of the internal capsule (IC) and the anterior commissure (AC): the ventral amygdalofugal pathways that run parallel to and underneath the AC, the precommissural fornical fibers that run anterior to the AC, axons from the ventral prefrontal cortex and medial orbitofrontal cortex that occupy the most ventral part of the IC and embedding within the NAc and AC, and the superolateral branch of the medial forebrain bundle located parallel to the anterior thalamic radiation in the IC.

CONCLUSIONS

The caudal part of the NAc passing through the IC-AC junction may be an effective target for deep brain stimulation to improve behavioral symptoms associated with obsessive-compulsive disorder.

Cannabis users exhibit increased cortical activation during resting state compared to non-users

Studies have shown altered task-based brain functioning as a result of cannabis use. To date, however, whether similar alterations in baseline resting state and functional organization of neural activity are observable in cannabis users remains unknown. We characterized global resting state cortical activations and functional connectivity via electroencephalography (EEG) in cannabis users and related these activations to measures of cannabis use. Resting state EEG in the eyes closed condition was collected from age- and sex-matched cannabis users (N = 17; 6 females; mean age = 30.9 ± 7.4 years) and non-using controls (N = 21; 9 females; mean age = 33.1 ± 11.6 years). Power spectral density and spectral coherence were computed to determine differences in cortical activations and connectivity between the two groups in the delta (1-4Hz), theta (4-7 Hz), alpha (8-12 Hz), beta (13-30 Hz), and gamma (31-50 Hz) frequency bands. Cannabis users exhibited decreased delta and increased theta, beta, and gamma power compared to controls, suggesting increased cortical activation in resting state and a disinhibition of inhibitory functions that may interrupt cognitive processes. Cannabis users also exhibited increased interhemispheric and intrahemispheric coherence relative to controls, reduced mean network degree, and increased clustering coefficient in specific regions and frequencies. This increased cortical activity may indicate a loss of neural refinement and efficiency that may indicate a "noisy" brain. Lastly, measures related to cannabis use were correlated with spectral power and functional connectivity measures, indicating that specific electrophysiological signals are associated with cannabis use. These results suggest that there are differences in cortical activity and connectivity between cannabis users and non-using controls in the resting state that may be related to putative cognitive impairments and can inform effectiveness of intervention programs.

Cannabinoid disruption of learning mechanisms involved in reward processing

The increasing use of cannabis, its derivatives, and synthetic cannabinoids for medicinal and recreational purposes has led to burgeoning interest in understanding the addictive potential of this class of molecules. It is estimated that ∼10% of marijuana users will eventually show signs of dependence on the drug, and the diagnosis of cannabis use disorder (CUD) is increasing in the United States. The molecule that sustains the use of cannabis is Δ⁹-tetrahydrocannabinol (Δ⁹-THC), and our knowledge of its effects, and those of other cannabinoids on brain function has expanded rapidly in the past two decades. Additionally, the identification of endogenous cannabinoid (endocannabinoid) systems in brain and their roles in physiology and behavior, demonstrate extensive involvement of these lipid signaling molecules in regulating CNS function. Here, we examine roles for endogenous cannabinoids in shaping synaptic activity in cortical and subcortical brain circuits, and we discuss mechanisms in which exogenous cannabinoids, such as Δ⁹-THC, interact with endocannabinoid systems to disrupt neuronal network oscillations. We then explore how perturbation of the interaction of this activity within brain reward circuits may lead to impaired learning. Finally, we propose that disruption of cellular plasticity mechanisms by exogenous cannabinoids in cortical and subcortical circuits may explain the difficulty in establishing viable cannabinoid self-administration models in animals.

Subunit-specific NMDAR antagonism dissociates schizophrenia subtype-relevant oscillopathies associated with frontal hypofunction and hippocampal hyperfunction

NMDAR antagonism alters mesolimbic, hippocampal, and cortical function, acutely reproducing the positive, cognitive, and negative symptoms of schizophrenia. These physiological and behavioral effects may depend differentially on NMDAR subtype- and region-specific effects. The dramatic electrophysiological signatures of NMDAR blockade in rodents include potentiated high frequency oscillations (HFOs, ∼140 Hz), likely generated in mesolimbic structures, and increased HFO phase-amplitude coupling (PAC), a phenomenon related to goal-directed behavior and dopaminergic tone. This study examined the impact of subtype-specific NMDAR antagonism on HFOs and PAC. We found that positive-symptom-associated NR2A-preferring antagonism (NVP-AAM077), but not NR2B-specific antagonism (Ro25-6985) or saline control, replicated increases in HFO power seen with nonspecific antagonism (MK-801). However, PAC following NR2A-preferring antagonism was distinct from all other conditions. While θ-HFO PAC was prominent or potentiated in other conditions, NVP-AAM077 increased δ-HFO PAC and decreased θ-HFO PAC. Furthermore, active wake epochs exhibiting narrowband frontal δ oscillations, and not broadband sleep-associated δ, selectively exhibited δ-HFO coupling, while paradoxical sleep epochs having a high CA1 θ to frontal δ ratio selectively exhibited θ-HFO coupling. Our results suggest: (1) NR2A-preferring antagonism induces oscillopathies reflecting frontal hyperfunction and hippocampal hypofunction; and (2) HFO PAC indexes cortical vs. hippocampal control of mesolimbic circuits.

Gamma Oscillations in the Rat Ventral Striatum Originate in the Piriform Cortex

Local field potentials (LFPs) recorded from the human and rodent ventral striatum (vStr) exhibit prominent, behaviorally relevant gamma-band oscillations. These oscillations are related to local spiking activity and transiently synchronize with anatomically related areas, suggesting a possible role in organizing vStr activity. However, the origin of vStr gamma is unknown. We recorded vStr gamma oscillations across a 1.4 mm² grid spanned by 64 recording electrodes as male rats rested and foraged for rewards, revealing a highly consistent power gradient originating in the adjacent piriform cortex. Phase differences across the vStr were consistently small (<15°) and current source density analysis further confirmed the absence of local sink-source pairs in the vStr. Reversible occlusions of the ipsilateral (but not contralateral) nostril, known to abolish gamma oscillations in the piriform cortex, strongly reduced vStr gamma power and the occurrence of transient gamma-band events. These results imply that local circuitry is not a major contributor to gamma oscillations in the vStr LFP and that piriform cortex is an important driver of gamma-band oscillations in the vStr and associated limbic areas.SIGNIFICANCE STATEMENT The ventral striatum (vStr) is an area of anatomical convergence in circuits underlying motivated behavior, but it remains unclear how its inputs from different sources interact. A major proposal about how neural circuits may switch dynamically between convergent inputs is through temporal organization reflected in local field potential (LFP) oscillations. Our results show that, in the rat, the mechanisms controlling gamma-band oscillations in the vStr LFP are primarily located in the in the adjacent piriform cortex rather than in the vStr itself, providing a novel interpretation of previous rodent work on gamma oscillations in the vStr and related circuits and an important consideration for future work seeking to use oscillations in these areas as biomarkers for behavioral and neurological disorders.

Kappa Opioid Receptors Mediate Heterosynaptic Suppression of Hippocampal Inputs in the Rat Ventral Striatum

Kappa opioid receptors (KORs) are highly enriched within the ventral striatum (VS) and are thought to modulate striatal neurotransmission. This includes presynaptic inhibition of local glutamatergic release from excitatory inputs to the VS. However, it is not known which inputs drive this modulation and what impact they have on the local circuit dynamics within the VS. Individual medium spiny neurons (MSNs) within the VS serve as a site of convergence for glutamatergic inputs arising from the PFC and limbic regions, such as the hippocampus (HP). Recent data suggest that competition can arise between these inputs with robust cortical activation leading to a reduction in ongoing HP-evoked MSN responses. Here, we investigated the contribution of KOR signaling in PFC-driven heterosynaptic suppression of HP inputs onto MSNs using whole-cell patch-clamp recordings in slices from adult rats. Optogenetically evoked HP EPSPs were greatly attenuated after a short latency (50 ms) following burst-like PFC electrical stimulation, and the magnitude of this suppression was partially reversed following blockade of GABA_ARs (GABA Type A receptors), but not GABA_BRs (GABA Type B receptors). A similar reduction in suppression was observed in the presence of the KOR antagonist, norBNI. Combined blockade of local GABA_ARs and KORs resulted in complete blockade of PFC-induced heterosynaptic suppression of less salient HP inputs. These findings highlight a mechanism by which strong, transient PFC activity can take precedence over other excitatory inputs to the VS.SIGNIFICANCE STATEMENT Emerging evidence suggests that kappa opioid receptor (KOR) activation can selectively modulate striatal glutamatergic inputs onto medium spiny neurons (MSNs). In this study, we found that robust cortical stimulation leads to a reduction in ongoing hippocampal-evoked MSNs responses through the combined recruitment of local inhibitory mechanisms and activation of presynaptic KORs in the ventral striatum (VS). These processes are likely to facilitate the efficient transfer of cortical information through the VS during critical decision making by dampening competing information from less salient excitatory inputs. These data provide a novel mechanism through which VS information processing could influence decision making, a function thought to occur primarily in the PFC.

Dynamic corticostriatal activity biases social bonding in monogamous female prairie voles

Adult pair bonding involves dramatic changes in the perception and valuation of another individual¹. One key change is that partners come to reliably activate the brain's reward system^2-6, though the precise neural mechanisms by which partners become rewarding during sociosexual interactions leading to a bond remain unclear. Using a prairie vole model of social bonding⁷, we show how a functional circuit from medial prefrontal cortex (mPFC) to nucleus accumbens (NAcc) is dynamically modulated to enhance females' affiliative behavior towards a partner. Individual variation in the strength of this functional connectivity, particularly after the first mating encounter, predicts how quickly animals begin affiliative huddling with their partner. Rhythmically activating this circuit in a social context without mating biases later preference towards a partner, indicating that this circuit's activity is not just correlated with how quickly animals become affiliative but causally accelerates it. These results provide the first dynamic view of corticostriatal activity during bond formation, revealing how social interactions can recruit brain reward systems to drive changes in affiliative behavior.

Reward Network Immediate Early Gene Expression in Mood Disorders

Over the past three decades, it has become clear that aberrant function of the network of interconnected brain regions responsible for reward processing and motivated behavior underlies a variety of mood disorders, including depression and anxiety. It is also clear that stress-induced changes in reward network activity underlying both normal and pathological behavior also cause changes in gene expression. Here, we attempt to define the reward circuitry and explore the known and potential contributions of activity-dependent changes in gene expression within this circuitry to stress-induced changes in behavior related to mood disorders, and contrast some of these effects with those induced by exposure to drugs of abuse. We focus on a series of immediate early genes regulated by stress within this circuitry and their connections, both well-explored and relatively novel, to circuit function and subsequent reward-related behaviors. We conclude that IEGs play a crucial role in stress-dependent remodeling of reward circuitry, and that they may serve as inroads to the molecular, cellular, and circuit-level mechanisms of mood disorder etiology and treatment.

Sustained Attentional States Require Distinct Temporal Involvement of the Dorsal and Ventral Medial Prefrontal Cortex

Attending the sensory environment for cue detection is a cognitive operation that occurs on a time scale of seconds. The dorsal and ventral medial prefrontal cortex (mPFC) contribute to separate aspects of attentional processing. Pyramidal neurons in different parts of the mPFC are active during cognitive behavior, yet whether this activity is causally underlying attentional processing is not known. We aimed to determine the precise temporal requirements for activation of the mPFC subregions during the seconds prior to cue detection. To test this, we used optogenetic silencing of dorsal or ventral mPFC pyramidal neurons at defined time windows during a sustained attentional state. We find that the requirement of ventral mPFC pyramidal neuron activity is strictly time-locked to stimulus detection. Inhibiting the ventral mPFC 2 s before or during cue presentation reduces response accuracy and hampers behavioral inhibition. The requirement for dorsal mPFC activity on the other hand is temporally more loosely related to a preparatory attentional state, and short lapses in pyramidal neuron activity in dorsal mPFC do not affect performance. This only occurs when the dorsal mPFC is inhibited during the entire preparatory period. Together, our results reveal that a dissociable temporal recruitment of ventral and dorsal mPFC is required during attentional processing.

Perimovement decrease of alpha/beta oscillations in the human nucleus accumbens

The present work clarifies how the nucleus accumbens contributes to action. This region is often assumed to influence behavior “off-line” by evaluating outcomes. Studying rare recordings of local field potentials from the human nucleus accumbens, we observe a perimovement decrease of alpha and beta oscillations in seven of eight individuals, a signal that, in the motor system, is directly related to action preparation. Our results support the idea of an online role of this region for imminent action.

The human nucleus accumbens is thought to play an important role in guiding future action selection via an evaluation of current action outcomes. Here we provide electrophysiological evidence for a more direct, i.e., online, role during action preparation. We recorded local field potentials from the nucleus accumbens in patients with epilepsy undergoing surgery for deep brain stimulation. We found a consistent decrease in the power of alpha/beta oscillations (10–30 Hz) before and around the time of movements. This perimovement alpha/beta desynchronization was observed in seven of eight patients and was present both before instructed movements in a serial reaction time task as well as before self-paced, deliberate choices in a decision making task. A similar beta decrease over sensorimotor cortex and in the subthalamic nucleus has been directly related to movement preparation and execution. Our results support the idea of a direct role of the human nucleus accumbens in action preparation and execution.

Olanzapine Treatment of Adolescent Rats Alters Adult D2 Modulation of Cortical Inputs to the Ventral Striatum

BACKGROUND

The striatal dopamine system undergoes vast ontogenetic changes during adolescence, making the brain vulnerable to drug treatments that target this class of neurotransmitters. Atypical antipsychotic drugs are often prescribed to children and adolescents for off-label treatment of neuropsychiatric disorders, yet the long-term impact this treatment has on brain development remains largely unknown.

METHODS

Adolescent male rats were treated with olanzapine or vehicle for 3 weeks (during postnatal day 28-49) using a dosing condition designed to approximate closely D2 receptor occupancies in the human therapeutic range. We assessed D2 receptor modulation of corticostriatal inputs onto medium spiny neurons in the adult ventral striatum using in vitro whole-cell current clamp recordings.

RESULTS

The D2/D3 agonist quinpirole (5 µM) enhanced cortically driven medium spiny neuron synaptic responses in slices taken from adult rats treated with vehicle during adolescence, as in untreated adult rats. However, in slices from mature rats treated with olanzapine during adolescence, quinpirole reduced medium spiny neuron activation. The magnitude of decrease was similar to previous observations in untreated, prepubertal rats. These changes may reflect alterations in local inhibitory circuitry, as the GABA-A antagonist picrotoxin (100 µM) reversed the effects of quinpirole in vehicle-treated slices but had no impact on cortically evoked responses in olanzapine-treated slices.

CONCLUSIONS

These data suggest that adolescent atypical antipsychotic drug treatment leads to enduring changes in dopamine modulation of corticostriatal synaptic function.

Using In Vitro Electrophysiology to Screen Medications: Accumbal Plasticity as an Engram of Alcohol Dependence

The nucleus accumbens (NAc) is a central component of the mesocorticolimbic reward system. Increasing evidence strongly implicates long-term synaptic neuroadaptations in glutamatergic excitatory activity of the NAc shell and/or core medium spiny neurons in response to chronic drug and alcohol exposure. Such neuroadaptations likely play a critical role in the development and expression of drug-seeking behaviors. We have observed unique cell-type-specific bidirectional changes in NAc synaptic plasticity (metaplasticity) following acute and chronic intermittent ethanol exposure. Other investigators have also previously observed similar metaplasticity in the NAc following exposure to psychostimulants, opiates, and amazingly, even following an anhedonia-inducing experience. Considering that the proteome of the postsynaptic density likely contains hundreds of biochemicals, proteins and other components and regulators, we believe that there is a large number of potential molecular sites through which accumbal metaplasticity may be involved in chronic alcohol abuse. Many of our companion laboratories are now engaged in identifying and screening medications targeting candidate genes and its products previously linked to maladaptive alcohol phenotypes. We hypothesize that if manipulation of such target genes and their products change NAc plasticity, then that observation constitutes an important validation step for the development of novel therapeutics to treat alcohol dependence.

Low- and high-gamma oscillations deviate in opposite directions from zero-phase synchrony in the limbic corticostriatal loop

The loop structure of cortico-striatal anatomy in principle enables both descending (cortico-striatal) and ascending (striato-cortical) influences, but the factors that regulate the flow of information in these loops are not known. We report that low- and high-gamma oscillations (∼50 and ∼80 Hz, respectively) in the local field potential of freely moving rats are highly synchronous between the infralimbic region of the medial prefrontal cortex (mPFC) and the ventral striatum (vStr). Strikingly, high-gamma oscillations in mPFC preceded those in vStr, whereas low-gamma oscillations in mPFC lagged those in vStr, with short (∼1 ms) time lags. These systematic deviations from zero-phase synchrony were consistent across measures based on amplitude cross-correlation and phase slopes and were robustly maintained between behavioral states and different individual subjects. Furthermore, low- and high-gamma oscillations were associated with distinct ensemble spiking patterns in vStr, even when controlling for overt behavioral differences and slow changes in neural activity. These results imply that neural activity in vStr and mPFC is tightly coupled at the gamma timescale and raise the intriguing possibility that frequency-specific deviations from this coupling may signal transient leader-follower switches.

Behavioral plasticity through the modulation of switch neurons

A central question in artificial intelligence is how to design agents capable of switching between different behaviors in response to environmental changes. Taking inspiration from neuroscience, we address this problem by utilizing artificial neural networks (NNs) as agent controllers, and mechanisms such as neuromodulation and synaptic gating. The novel aspect of this work is the introduction of a type of artificial neuron we call "switch neuron". A switch neuron regulates the flow of information in NNs by selectively gating all but one of its incoming synaptic connections, effectively allowing only one signal to propagate forward. The allowed connection is determined by the switch neuron's level of modulatory activation which is affected by modulatory signals, such as signals that encode some information about the reward received by the agent. An important aspect of the switch neuron is that it can be used in appropriate "switch modules" in order to modulate other switch neurons. As we show, the introduction of the switch modules enables the creation of sequences of gating events. This is achieved through the design of a modulatory pathway capable of exploring in a principled manner all permutations of the connections arriving on the switch neurons. We test the model by presenting appropriate architectures in nonstationary binary association problems and T-maze tasks. The results show that for all tasks, the switch neuron architectures generate optimal adaptive behaviors, providing evidence that the switch neuron model could be a valuable tool in simulations where behavioral plasticity is required.

No unified reward prediction error in local field potentials from the human nucleus accumbens: evidence from epilepsy patients

Functional magnetic resonance imaging (fMRI), cyclic voltammetry, and single-unit electrophysiology studies suggest that signals measured in the nucleus accumbens (Nacc) during value-based decision making represent reward prediction errors (RPEs), the difference between actual and predicted rewards. Here, we studied the precise temporal and spectral pattern of reward-related signals in the human Nacc. We recorded local field potentials (LFPs) from the Nacc of six epilepsy patients during an economic decision-making task. On each trial, patients decided whether to accept or reject a gamble with equal probabilities of a monetary gain or loss. The behavior of four patients was consistent with choices being guided by value expectations. Expected value signals before outcome onset were observed in three of those patients, at varying latencies and with nonoverlapping spectral patterns. Signals after outcome onset were correlated with RPE regressors in all subjects. However, further analysis revealed that these signals were better explained as outcome valence rather than RPE signals, with gamble gains and losses differing in the power of beta oscillations and in evoked response amplitudes. Taken together, our results do not support the idea that postsynaptic potentials in the Nacc represent a RPE that unifies outcome magnitude and prior value expectation. We discuss the generalizability of our findings to healthy individuals and the relation of our results to measurements of RPE signals obtained from the Nacc with other methods.

Cortical drive of low-frequency oscillations in the human nucleus accumbens during action selection

The nucleus accumbens is thought to contribute to action selection by integrating behaviorally relevant information from multiple regions, including prefrontal cortex. Studies in rodents suggest that information flow to the nucleus accumbens may be regulated via task-dependent oscillatory coupling between regions. During instrumental behavior, local field potentials (LFP) in the rat nucleus accumbens and prefrontal cortex are coupled at delta frequencies (Gruber AJ, Hussain RJ, O'Donnell P. PLoS One 4: e5062, 2009), possibly mediating suppression of afferent input from other areas and thereby supporting cortical control (Calhoon GG, O'Donnell P. Neuron 78: 181–190, 2013). In this report, we demonstrate low-frequency cortico-accumbens coupling in humans, both at rest and during a decision-making task. We recorded LFP from the nucleus accumbens in six epilepsy patients who underwent implantation of deep brain stimulation electrodes. All patients showed significant coherence and phase-synchronization between LFP and surface EEG at delta and low theta frequencies. Although the direction of this coupling as indexed by Granger causality varied between subjects in the resting-state data, all patients showed a cortical drive of the nucleus accumbens during action selection in a decision-making task. In three patients this was accompanied by a significant coherence increase over baseline. Our results suggest that low-frequency cortico-accumbens coupling represents a highly conserved regulatory mechanism for action selection.

Dopamine in the nucleus accumbens modulates the memory of social defeat in Syrian hamsters (Mesocricetus auratus)

Conditioned defeat (CD) is a behavioral response that occurs in Syrian hamsters after they experience social defeat. Subsequently, defeated hamsters no longer produce territorial aggression but instead exhibit heightened levels of avoidance and submission, even when confronted with a smaller, non-aggressive intruder. Dopamine in the nucleus accumbens is hypothesized to act as a signal of salience for both rewarding and aversive stimuli to promote memory formation and appropriate behavioral responses to significant events. The purpose of the present study was to test the hypothesis that dopamine in the nucleus accumbens modulates the acquisition and expression of behavioral responses to social defeat. In Experiment 1, bilateral infusion of the non-specific D1/D2 receptor antagonist cis(z)flupenthixol (3.75 μg/150 nl saline) into the nucleus accumbens 5 min prior to defeat training significantly reduced submissive and defensive behavior expressed 24h later in response to a non-aggressive intruder. In Experiment 2, infusion of 3.75 μg cis-(Z)-flupenthixol 5 min before conditioned defeat testing with a non-aggressive intruder significantly increased aggressive behavior in drug-infused subjects. In Experiment 3, we found that the effect of cis-(Z)-flupenthixol on aggression was specific to defeated animals as infusion of drug into the nucleus accumbens of non-defeated animals did not significantly alter their behavior in response to a non-aggressive intruder. These data demonstrate that dopamine in the nucleus accumbens modulates both acquisition and expression of social stress-induced behavioral changes and suggest that the nucleus accumbens plays an important role in the suppression of aggression that is observed after social defeat.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.

Oscillatory activity in the medial prefrontal cortex and nucleus accumbens correlates with impulsivity and reward outcome

Actions expressed prematurely without regard for their consequences are considered impulsive. Such behaviour is governed by a network of brain regions including the prefrontal cortex (PFC) and nucleus accumbens (NAcb) and is prevalent in disorders including attention deficit hyperactivity disorder (ADHD) and drug addiction. However, little is known of the relationship between neural activity in these regions and specific forms of impulsive behaviour. In the present study we investigated local field potential (LFP) oscillations in distinct sub-regions of the PFC and NAcb on a 5-choice serial reaction time task (5-CSRTT), which measures sustained, spatially-divided visual attention and action restraint. The main findings show that power in gamma frequency (50-60 Hz) LFP oscillations transiently increases in the PFC and NAcb during both the anticipation of a cue signalling the spatial location of a nose-poke response and again following correct responses. Gamma oscillations were coupled to low-frequency delta oscillations in both regions; this coupling strengthened specifically when an error response was made. Theta (7-9 Hz) LFP power in the PFC and NAcb increased during the waiting period and was also related to response outcome. Additionally, both gamma and theta power were significantly affected by upcoming premature responses as rats waited for the visual cue to respond. In a subgroup of rats showing persistently high levels of impulsivity we found that impulsivity was associated with increased error signals following a nose-poke response, as well as reduced signals of previous trial outcome during the waiting period. Collectively, these in-vivo neurophysiological findings further implicate the PFC and NAcb in anticipatory impulsive responses and provide evidence that abnormalities in the encoding of rewarding outcomes may underlie trait-like impulsive behaviour.

How does a specific learning and memory system in the mammalian brain gain control of behavior?

This review addresses a fundamental, yet poorly understood set of issues in systems neuroscience. The issues revolve around conceptualizations of the organization of learning and memory in the mammalian brain. One intriguing, and somewhat popular, conceptualization is the idea that there are multiple learning and memory systems in the mammalian brain and they interact in different ways to influence and/or control behavior. This approach has generated interesting empirical and theoretical work supporting this view. One issue that needs to be addressed is how these systems influence or gain control of voluntary behavior. To address this issue, we clearly specify what we mean by a learning and memory system. We then review two types of processes that might influence which memory system gains control of behavior. One set of processes are external factors that can affect which system controls behavior in a given situation including task parameters like the kind of information available to the subject, types of training experience, and amount of training. The second set of processes are brain mechanisms that might influence what memory system controls behavior in a given situation including executive functions mediated by the prefrontal cortex; switching mechanisms mediated by ascending neurotransmitter systems, the unique role of the hippocampus during learning. The issue of trait differences in control of different learning and memory systems will also be considered in which trait differences in learning and memory function are thought to potentially emerge from differences in level of prefrontal influence, differences in plasticity processes, differences in ascending neurotransmitter control, differential access to effector systems like motivational and motor systems. Finally, we present scenarios in which different mechanisms might interact. This review was conceived to become a jumping off point for new work directed at understanding these issues. The outcome of this work, in combination with other approaches, might improve understanding of the mechanisms of volition in human and non-human animals.

Dopamine D1/D5 receptors mediate informational saliency that promotes persistent hippocampal long-term plasticity

Dopamine (DA) plays an essential role in the enablement of cognition. It adds color to experience-dependent information storage, conferring salience to the memories that result. At the synaptic level, experience-dependent information storage is enabled by synaptic plasticity, and given its importance for memory formation, it is not surprising that DA comprises a key neuromodulator in the enablement of synaptic plasticity, and particularly of plasticity that persists for longer periods of time: Analogous to long-term memory. The hippocampus, that is a critical structure for the synaptic processing of semantic, episodic, spatial, and declarative memories, is specifically affected by DA, with the D1/D5 receptor proving crucial for hippocampus-dependent memory. Furthermore, D1/D5 receptors are pivotal in conferring the properties of novelty and reward to information being processed by the hippocampus. They also facilitate the expression of persistent forms of synaptic plasticity, and given reports that both long-term potentiation and long-term depression encode different aspects of spatial representations, this suggests that D1/D5 receptors can drive the nature and qualitative content of stored information in the hippocampus. In light of these observations, we propose that D1/D5 receptors gate hippocampal long-term plasticity and memory and are pivotal in conferring the properties of novelty and reward to information being processed by the hippocampus.

Impact of appetitive and aversive outcomes on brain responses: linking the animal and human literatures

Decision-making is motivated by the possibility of obtaining reward and/or avoiding punishment. Though many have investigated behavior associated with appetitive or aversive outcomes, few have examined behaviors that rely on both. Fewer still have addressed questions related to how anticipated appetitive and aversive outcomes interact to alter neural signals related to expected value, motivation, and salience. Here we review recent rodent, monkey, and human research that address these issues. Further development of this area will be fundamental to understanding the etiology behind human psychiatric diseases and cultivating more effective treatments.

The role of α5 GABAA receptor agonists in the treatment of cognitive deficits in schizophrenia

Currently available pharmacotherapies for the treatment of schizophrenia are ineffective in restoring the disrupted cognitive function associated with this disorder. As such, there is a continued search for more viable novel drug targets. Engaging in cognitive behaviors is associated with distinct coordinated oscillatory activity across brain regions, in particular the hippocampus and prefrontal cortex. In schizophrenia patients, pathological alterations in the functionality of GABAergic interneurons in the PFC and HPC responsible for generating network oscillations are thought to contribute to impaired cognition. Destabilized GABAergic interneuron activity in the HPC is further associated with aberrant increases in HPC output and enhanced dopamine neuron activity. Consequently, drugs directed at restoring HPC function could impact both oscillatory activity along with dopamine tone. There is compelling evidence from animal models of schizophrenia that allosteric modulation of the α5 subunit of the GABAA receptor is a viable means of resolving aberrant dopamine system activity through indirect alteration of HPC output. Consequently, these compounds are promising for their potential in also ameliorating cognitive deficits attributed to dysfunction in HPC network activity.

Olanzapine treatment of adolescent rats alters adult reward behaviour and nucleus accumbens function

Antipsychotic drugs are increasingly used in children and adolescents to treat a variety of psychiatric disorders. However, little is known about the long-term effects of early life antipsychotic drug (APD) treatment. Most APDs are potent antagonists or partial agonists of dopamine (DA) D₂ receptors; atypical APDs also have multiple serotonergic activities. DA and serotonin regulate many neurodevelopmental processes. Thus, early life APD treatment can, potentially, perturb these processes, causing long-term behavioural and neurobiological sequelae. We treated adolescent, male rats with olanzapine (Ola) on post-natal days 28-49, under dosing conditions that approximate those employed therapeutically in humans. As adults, they exhibited enhanced conditioned place preference for amphetamine, as compared to vehicle-treated rats. In the nucleus accumbens core, DA D₁ receptor binding was reduced, D₂ binding was increased and DA release evoked by electrical stimulation of the ventral tegmental area was reduced. Thus, adolescent Ola treatment enduringly alters a key behavioural response to rewarding stimuli and modifies DAergic neurotransmission in the nucleus accumbens. The persistence of these changes suggests that even limited periods of early life Ola treatment may induce enduring changes in other reward-related behaviours and in behavioural and neurobiological responses to therapeutic and illicit psychotropic drugs. These results underscore the importance of improved understanding of the enduring sequelae of paediatric APD treatment as a basis for weighing the benefits and risks of adolescent APD therapy, especially prophylactic treatment in high-risk, asymptomatic patients.

Cortical operation of the ventral striatal switchboard

How does the ventral striatum (VS) prioritize and process afferent input? In this issue, Calhoon and O'Donnell (2013) demonstrate that cortical projections to the VS can attenuate hippocampal and thalamic VS input, suggesting that the cortex can uniquely control VS circuit dynamics.