Basolateral amygdala - nucleus accumbens circuitry regulates optimal cue-guided risk/reward decision making

Sex differences in sensitivity to dopamine receptor manipulations of risk-based decision making in rats

Risky decision making involves the ability to weigh risks and rewards associated with different options to make adaptive choices. Previous work has established a necessary role for the basolateral amygdala (BLA) in mediating effective decision making under risk of punishment, but the mechanisms by which the BLA mediates this process are less clear. Because this form of decision making is profoundly sensitive to dopaminergic (DA) manipulations, we hypothesized that DA receptors in the BLA may be involved in risk-taking behavior. To test this hypothesis, male and female Long-Evans rats were trained in a decision-making task in which rats chose between a small, safe food reward and a larger food reward that was associated with a variable risk of footshock punishment. Once behavioral stability emerged, rats received intra-BLA infusions of ligands targeting distinct dopamine receptor subtypes prior to behavioral testing. Intra-BLA infusions of the dopamine D2 receptor (D2R) agonist quinpirole decreased risk taking in females at all doses, and this reduction in risk taking was accompanied by an increase in sensitivity to punishment. In males, decreased risk taking was only observed at the highest dose of quinpirole. In contrast, intra-BLA manipulations of dopamine D1 or D3 receptors (D1R and D3R, respectively) had no effect on risk taking. Considered together, these data suggest that differential D2R sensitivity in the BLA may contribute to the well-established sex differences in risk taking. Neither D1Rs nor D3Rs, however, appear to contribute to risky decision making in either sex.

Ultrastructural Changes of Synapses in the Hippocampus of Sprague Dawley Rat Brain following Exposure to Naphthalene Balls

Introduction

The synaptic contacts play an important role in central nervous system (CNS) functioning. Ultrastructural features of synapses in CNS are not studied in naphthalene neurotoxicity model.

Materials and Methodology

In the present work, transmission electron microscopy was used for studying the ultrastructural features of synapses in the hippocampus of Sprague Dawley rat brain, on subsequent exposure to naphthalene balls. The ultrastructural changes were observed for naphthalene low dose (200 mg), high dose (400 mg) after the treatment for 28 days, and post-delayed toxicity phase after 14 days in Sprague Dawley rats.

Results

In comparison with different groups of naphthalene exposure including control and satellite, axon degeneration, axonal demyelination and abnormal synapses was observed in high dose naphthalene administration group. In the post-delayed naphthalene toxicity group, degeneration of synaptic contacts was observed.

Conclusions

This exploration of ultrastructural variations in the synapses of Hippocampus gives information that will be valued in naphthalene neurotoxicological research.

Updating the striatal-pallidal wiring diagram

The striatal and pallidal complexes are basal ganglia structures that orchestrate learning and execution of flexible behavior. Models of how the basal ganglia subserve these functions have evolved considerably, and the advent of optogenetic and molecular tools has shed light on the heterogeneity of subcircuits within these pathways. However, a synthesis of how molecularly diverse neurons integrate into existing models of basal ganglia function is lacking. Here, we provide an overview of the neurochemical and molecular diversity of striatal and pallidal neurons and synthesize recent circuit connectivity studies in rodents that takes this diversity into account. We also highlight anatomical organizational principles that distinguish the dorsal and ventral basal ganglia pathways in rodents. Future work integrating the molecular and anatomical properties of striatal and pallidal subpopulations may resolve controversies regarding basal ganglia network function.

Individuals with cannabis use are associated with widespread morphological alterations in the subregions of the amygdala, hippocampus, and pallidum

BACKGROUND

Cannabis is the most frequently used illicit drug worldwide. Although multiple structural MRI studies of individuals with cannabis use (CB) have been undertaken, the reports of the volume alterations in the amygdala, hippocampus, and pallidum are not consistent. This study aims to detect subregion-level morphological alterations, analyze the correlation areas with cannabis usage characteristics, and gain new insights into the neuro mechanisms of CB.

METHODS

By leveraging the novel surface-based subcortical morphometry method, 20 CB and 22 age- and sex-matched healthy controls (HC) were included to explore their volumetric and morphological differences in the three subcortical structures. Afterward, the correlation analysis between surface morphological eigenvalues and cannabis usage characteristics was performed.

RESULTS

Compared with volumetric measures, the surface-based subcortical morphometry method detected more significant global morphological deformations in the left amygdala, right hippocampus, and right pallidum (overall-p < 0.05, corrected). More obvious morphological alterations (atrophy or expansion) were observed in specific subregions (vertex-based p-value<0.05, uncorrected) of the three subcortical structures. Both positive and negative subregional correlation areas were reported by the correlation analysis.

CONCLUSIONS

The current study illuminated new pathophysiologic mechanisms in the amygdala, hippocampus, and pallidum at the subregion level, which may inform the subsequent smaller-scale CB research.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Examining ventral subiculum and basolateral amygdala projections to the nucleus accumbens shell: Differential expression of VGLuT1, VGLuT2 and VGaT in the rat

Projections to the striatum are well-identified. For example, in the ventral striatum, two major inputs to the medial nucleus accumbens shell include the ventral subiculum and basolateral amygdala. However, the chemical phenotype(s) of these projection neurons remain unclear. In this study, we examined amygdalostriatal and corticostriatal connectivity in rats using injections of the retrograde tracer cholera toxin b into the nucleus accumbens shell. To determine the neurotransmitter identity of projection neurons, we combined retrograde tracing with RNAscope in-situ hybridization, using mRNA probes against vesicular transporters associated with glutamatergic (VGluT1 - Slc17a7, VGluT2 - Slc17a6) or GABAergic (VGaT - Slc32a1) neurotransmission. Confocal imaging was used to examine vesicular transporter mRNA expression in the ventral subiculum and basolateral amygdala inputs to the nucleus accumbens shell. Both projections contained mostly VGluT1-expressing neurons. Interestingly, almost a quarter of ventral subiculum to nucleus accumbens shell projections co-expressed VGluT1 and VGluT2 compared to a relatively small number (∼3%) that were co-expressed in basolateral amygdala to nucleus accumbens shell afferents. However, almost a quarter of basolateral amygdala to nucleus accumbens shell projections were VGaT-positive. These findings highlight the diverse proportions of glutamatergic and GABAergic afferents in two major projections to the nucleus accumbens shell and raise important questions for functional studies.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Prefrontal Dopaminergic Regulation of Cue-Guided Risky Decision-Making Performance in Rats

Risky decision-making is the decision made by individuals when they know the probability of each outcome. In order to survive in unpredictable environments, it is necessary for individuals to assess the probability of events occurring to an make appropriate decisions. There are few studies on the neural basis of risky decision-making behavior guided by external cues, which is related to the relative paucity of animal behavioral paradigms. Previous studies have shown that the prefrontal cortex (PFC) plays a key role in risk-based decision-making. The PFC receives projections from the dopamine (DA) system from the ventral tegmental area of the midbrain. The mesocorticolimbic DA system regulates the judgments of reward and value in decision-making. However, the specific receptor mechanism for prefrontal DA regulation of cue-guided risky decision-making behavior remains unclear. Here we established a cue-guided risky decision-making behavioral paradigm (RDM task) to detect the behavior of rats making decisions between a small certain reward and a large uncertain reward in a self-paced manner. The D1 receptor antagonist SCH-23390 (5 mM) or agonist SKF-82958 (5 mM), and the D2 receptor antagonist thioridazine hydrochloride (5 mM) or agonist MLS-1547 (5 mM) was injected into the mPFC, respectively, to investigate how the behavior in the RDM task was changed. The results showed that: (1) rats were able to master the operation of the cue-guided RDM task in a self-paced way; (2) a majority of rats were inclined to choose risk rather than a safe option when the reward expectations were equal; and (3) risk selection was reduced upon inhibition of D1 receptors or stimulation of D2 receptors, but increased upon stimulation of D1 receptors or inhibition of D2 receptors, suggesting that the RDM performance is regulated by D1 and D2 receptors in the mPFC. The present results suggest that DA receptors in the mPFC of rats are involved in regulating cue-guided RDM behavior, with differential involvement of D1 and D2 receptors in the regulation.

Behavior of Rats in a Self-Paced Risky Decision-Making Task Based on Definite Probability

Risky decision-making (RDM) is when individuals make choices based on the definite cognition for the probabilities of the options. Risk is embodied in the certainty of reward, and the smaller the probability is, the greater the risk will be. As simulated in human behavior paradigms, RDM scenarios in real life are often guided by external cues that inform the likelihood of receiving certain rewards. There are few studies on the neural basis of RDM behavior guided by external cues, which is related to the relative paucity of the animal behavioral paradigms. Here, we established a cue-guided RDM task to detect the behavior of rats making a decision between a small certain reward and a large uncertain reward in a naturalistic manner. The reward of the risk option could be adjusted to observe the change of choice. Our results showed that: (1) rats were able to master the operation of the cue-guided RDM task; (2) many rats were inclined to choose risk rather than the safe option when the reward expectations were equal; (3) rats were able to adjust the decision strategy in time upon a change in risk, suggesting that they have the ability to perceive risk indicated by the external cues.

Functional connectivity in reward-related networks is associated with individual differences in gambling strategies in male Lister hooded rats

Individuals with gambling disorder display deficits in decision-making in the Iowa Gambling Task. The rat Gambling Task (rGT) is a rodent analogue that can be used to investigate the neurobiological mechanisms underlying gambling behaviour. The aim of this explorative study was to examine individual strategies in the rGT and investigate possible behavioural and neural correlates associated with gambling strategies. Thirty-two adult male Lister hooded rats underwent behavioural testing in the multivariate concentric square field™ (MCSF) and the novel cage tests, were trained on and performed the rGT and subsequently underwent resting-state functional magnetic resonance imaging (R-fMRI). In the rGT, stable gambling strategies were found with subgroups of rats that preferred the suboptimal safest choice as well as the disadvantageous choice, that is, the riskiest gambling strategy. R-fMRI results revealed associations between gambling strategies and brain regions central for reward networks. Moreover, rats with risky gambling strategies differed from those with strategic and intermediate strategies in brain functional connectivity. No differences in behavioural profiles, as assessed with the MCSF and novel cage tests, were observed between the gambling strategy groups. In conclusion, stable individual differences in gambling strategies were found. Intrinsic functional connectivity using R-fMRI provides novel evidence to support the notion that individual differences in gambling strategies are associated with functional connectivity in brain regions important for reward networks.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

Volumetric trajectories of hippocampal subfields and amygdala nuclei influenced by adolescent alcohol use and lifetime trauma

Alcohol use and exposure to psychological trauma frequently co-occur in adolescence and share many risk factors. Both exposures have deleterious effects on the brain during this sensitive developmental period, particularly on the hippocampus and amygdala. However, very little is known about the individual and interactive effects of trauma and alcohol exposure and their specific effects on functionally distinct substructures within the adolescent hippocampus and amygdala. Adolescents from a large longitudinal sample (N = 803, 2684 scans, 51% female, and 75% White/Caucasian) ranging in age from 12 to 21 years were interviewed about exposure to traumatic events at their baseline evaluation. Assessments for alcohol use and structural magnetic resonance imaging scans were completed at baseline and repeated annually to examine neurodevelopmental trajectories. Hippocampal and amygdala subregions were segmented using Freesurfer v6.0 tools, followed by volumetric analysis with generalized additive mixed models. Longitudinal statistical models examined the effects of cumulative lifetime trauma measured at baseline and alcohol use measured annually on trajectories of hippocampal and amygdala subregions, while controlling for covariates known to impact brain development. Greater alcohol use, quantified using the Cahalan scale and measured annually, was associated with smaller whole hippocampus (β = -12.0, p_FDR = 0.009) and left hippocampus tail volumes (β = -1.2, p_FDR = 0.048), and larger right CA3 head (β = 0.4, p_FDR = 0.027) and left subiculum (β = 0.7, p_FDR = 0.046) volumes of the hippocampus. In the amygdala, greater alcohol use was associated with larger right basal nucleus volume (β = 1.3, p_FDR = 0.040). The effect of traumatic life events measured at baseline was associated with larger right CA3 head volume (β = 1.3, p_FDR = 0.041) in the hippocampus. We observed an interaction between baseline trauma and within-person age change where younger adolescents with greater trauma exposure at baseline had smaller left hippocampal subfield volumes in the subiculum (β = 0.3, p_FDR = 0.029) and molecular layer HP head (β = 0.3, p_FDR = 0.041). The interaction also revealed that older adolescents with greater trauma exposure at baseline had larger right amygdala nucleus volume in the paralaminar nucleus (β = 0.1, p_FDR = 0.045), yet smaller whole amygdala volume overall (β = -3.7, p_FDR = 0.003). Lastly, we observed an interaction between alcohol use and baseline trauma such that adolescents who reported greater alcohol use with greater baseline trauma showed smaller right hippocampal subfield volumes in the CA1 head (β = -1.1, p_FDR = 0.011) and hippocampal head (β = -2.6, p_FDR = 0.025), yet larger whole hippocampus volume overall (β = 10.0, p_FDR = 0.032). Cumulative lifetime trauma measured at baseline and alcohol use measured annually interact to affect the volume and trajectory of hippocampal and amygdala substructures (measured via structural MRI annually), regions that are essential for emotion regulation and memory. Our findings demonstrate the value of examining these substructures and support the hypothesis that the amygdala and hippocampus are not homogeneous brain regions.

Prediction errors and valence: From single units to multidimensional encoding in the amygdala

The amygdala-one of the primary structures of the limbic system-is comprised of interconnected nuclei situated within the temporal lobe. It has a well-established role in the modulation of negative affective states, as well as in fear processing. However, its vast projections with diverse brain regions-ranging from the cortex to the brainstem-are suggestive of its more complex involvement in affective or motivational aspects of cognitive processing. The amygdala can play an invaluable role in context-dependent associative learning, unsigned prediction error learning, influencing outcome selection, and multidimensional encoding. In this review, we delve into the amygdala's role in associative learning and outcome selection, emphasizing its intrinsic involvement in the appropriate context-dependent modulation of motivated behavior.

Serotonergic modulation of basolateral amygdala nucleus in the extinction of reward-driven learning: The role of 5-HT bioavailability and 5-HT1A receptor

Serotonin (5-HT) neurotransmission has been associated with reward-related behaviour. Moreover, the serotonergic system modulates the basolateral amygdala (BLA), a structure involved in reward encoding, and reward prediction error. However, the role played by 5-HT on BLA during a reward-driven task has not been fully elucidated. In this paper, we investigated whether serotonergic modulation of the BLA is involved in reward-driven learning. To this end, we trained Long Evans rats in an operant conditioning task, and examined the effects of fluoxetine treatment (a selective serotonin reuptake inhibitor, 10 mg/kg) in combination with BLA lesions with NMDA (20 mg/mL) on extinction learning. We also investigated whether intra-BLA injection of the serotonergic 5-HT_1A receptor agonist 8-OH DPAT, or antagonist WAY-100635, alters extinction performance. We found that fluoxetine treatment strongly accelerated extinction learning, while BLA lesions partially reverted this effect and slightly impaired consolidation of extinction. Stimulation and inhibition of 5-HT_1A receptors in BLA induced opposite effects to those of fluoxetine, impairing or accelerating extinction performance, respectively. Our findings suggest that 5-HT modulates reward-driven learning, and 5-HT_1A receptors located in the BLA are relevant for extinction.

Dorsomedial striatal contributions to different forms of risk/reward decision making

Optimal decision making involving reward uncertainty is integral to adaptive goal-directed behavior. In some instances, these decisions are guided by internal representations of reward history, whereas in other situations, external cues inform a decision maker about how likely certain actions are to yield reward. Different regions of the frontal lobe form distributed networks with striatal and amygdalar regions that facilitate different types of risk/reward decision making. The dorsal medial striatum (DMS) is one key output region of the prefrontal cortex, yet there have been few preclinical studies investigating the involvement of the DMS in different forms of risk/reward decision making. The present study addressed this issue, wherein separate groups of male rats were trained on one of two tasks where they chose between a small/certain or a large/risky reward. In a probabilistic discounting task, reward probabilities changed systematically over blocks of trials (100-6.25% or 6.25-100%), requiring rats to use internal representations of reward history to guide choice. Cue-guided decision-making was assessed with a "Blackjack" task, where different auditory cues indicated the odds associated with the large/risky option (50 or 12.5%). Inactivation of the DMS with GABA agonists impaired adjustments in choice biases during probabilistic discounting, resulting in either increases or decreases in risky choice as the probabilities associated with the large/risky reward decreased or increased over a session. In comparison, DMS inactivation increased risky choices on poor-odds trials on the Blackjack task, which was associated with a reduced impact that non-rewarded choices had on subsequent choices. DMS inactivation also impaired performance of an auditory conditional discrimination. These findings highlight a previously uncharacterized role for the DMS in facilitating flexible action selection during multiple forms of risk/reward decision making.

Neural substrates of the interplay between cognitive load and emotional involvement in bilingual decision making

Prior work has reported that foreign language influences decision making by either reducing access to emotion or imposing additional cognitive demands. In this fMRI study, we employed a cross-task design to assess at the neural level whether and how the interaction between cognitive load and emotional involvement is affected by language (native L1 vs. foreign L2). Participants completed a Lexico-semantic task where in each trial they were presented with a neutrally or a negatively valenced word either in L1 or L2, either under cognitive load or not. We manipulated cognitive load by varying the difficulty of the task: to increase cognitive demands, we used traditional characters instead of simplified ones in L1 (Chinese), and words with capital letters instead of lowercase letters in L2 (English). After each trial, participants decided whether to take a risky decision in a gambling game. During the Gamling task, left amygdala and right insula were more activated after having processed a negative word under cognitive load in the Lexico-semantic task. However, this was true for L1 but not for L2. In particular, in L1, cognitive load facilitated rather than hindered access to emotion. Further suggesting that cognitive load can enhance emotional sensitivity in L1 but not in L2, we found that functional connectivity between reward-related striatum and right insula increased under cognitive load only in L1. Overall, results suggest that cognitive load in L1 can favor access to emotion and lead to impulsive decision making, whereas cognitive load in L2 can attenuate access to emotion and lead to more rational decisions.

Prefrontal cortical and nucleus accumbens contributions to discriminative conditioned suppression of reward-seeking

Fear can potently inhibit ongoing behavior, including reward-seeking, yet the neural circuits that underlie such suppression remain to be clarified. Prior studies have demonstrated that distinct subregions of the rodent medial prefrontal cortex (mPFC) differentially affect fear behavior, whereby fear expression is promoted by the more dorsal prelimbic cortex (PL) and inhibited by the more ventral infralimbic cortex (IL). These mPFC regions project to subregions of the nucleus accumbens, the core (NAcC) and shell (NAcS), that differentially contribute to reward-seeking as well as affective processes that may be relevant to fear expression. Here, we investigated how these mPFC and NAc subregions contribute to discriminative fear conditioning, assessed by conditioned suppression of reward-seeking. Bilateral inactivation of the NAcS or PL reduced the expression of conditioned suppression to a shock-associated CS+, whereas NAcC inactivation reduced reward-seeking without affecting suppression. IL inactivation caused a general reduction in conditioned suppression following discriminative conditioning, but not when using a single-stimulus design. Pharmacological disconnection of the PL → NAcS pathway revealed that this projection mediates conditioned suppression. These data add to a growing literature implicating discrete cortico-striatal pathways in the suppression of reward-seeking in response to aversive stimuli. Dysfunction within related structures may contribute to aberrant patterns of behavior in psychiatric illnesses including substance use disorders.

Maladaptive consequences of repeated intermittent exposure to uncertainty

Recently we reported that nucleus accumbens (NAcc) dopamine (DA) tracks uncertainty during operant responding for non-caloric saccharin. We also showed that repeated intermittent exposure to this uncertainty, like exposure to drugs of abuse, leads to sensitization of the locomotor and NAcc DA effects of amphetamine and promotes the subsequent self-administration of the drug. Here we review these findings together with others showing that NAcc glutamate signaling is similarly affected by uncertainty. Extracellular levels of glutamate in this site also track uncertainty in a task in which nose poking for saccharin on an escalating variable ratio schedule of reinforcement is associated with progressively increasing variance between performance of the operant and payout. Furthermore, sensitized behavioral responding to and for amphetamine following exposure to uncertainty is accompanied by increased levels of Ca2+/calmodulin-dependent protein kinase II (CaMKII) and protein kinase C (PKC) phosphorylation as well as altered protein levels of the transcription factor ∆FosB (increased) and glutamate transporter 1 (GLT1; decreased) in NAcc tissues. Notably, phosphorylation by CaMKII and PKC regulates AMPA receptor trafficking and function in this site, is elevated following psychostimulant exposure, and is necessary for the expression of enhanced drug taking. Increased ∆FosB and decreased GLT1 levels are observed following psychostimulant exposure, are associated with increased drug taking and seeking, and are known to modulate AMPA receptors and extracellular glutamate levels respectively. These adaptations in glutamate transmission as well as those observed with DA following repeated intermittent exposure to uncertainty are similar to those produced by exposure to abused drugs. Together, they point to the recruitment of both DA and glutamate signaling pathways in the NAcc in both drug and behavioral addictions. As uncertainty is central to games of chance, these findings have particular relevance for gambling disorders known to exhibit comorbidity with drug abuse.