Effects of expectations for different reward magnitudes on neuronal activity in primate striatum

Synchronous Measurements of Extracellular Action Potentials and Neurochemical Activity with Carbon Fiber Electrodes in Nonhuman Primates

Measuring the dynamic relationship between neuromodulators, such as dopamine, and neuronal action potentials is imperative to understand how these fundamental modes of neural signaling interact to mediate behavior. We developed methods to measure concurrently dopamine and extracellular action potentials (i.e., spikes) in monkeys. Standard fast-scan cyclic voltammetric (FSCV) electrochemical (EChem) and electrophysiological (EPhys) recording systems are combined and used to collect spike and dopamine signals, respectively, from an array of carbon fiber (CF) sensors implanted in the monkey striatum. FSCV requires the application of small voltages at the implanted sensors to measure redox currents generated from target molecules, such as dopamine. These applied voltages create artifacts at neighboring EPhys measurement sensors which may lead to misclassification of these signals as physiological spikes. Therefore, simple automated temporal interpolation algorithms were designed to remove these artifacts and enable accurate spike extraction. We validated these methods using simulated artifacts and demonstrated an average spike recovery rate of 84.5%. We identified and discriminated cell type-specific units in the monkey striatum that were shown to correlate to specific behavioral task parameters related to reward size and eye movement direction. Synchronously recorded spike and dopamine signals displayed contrasting relations to the task variables, suggesting a complex relationship between these two modes of neural signaling. Future application of our methods will help advance our understanding of the interactions between neuromodulator signaling and neuronal activity, to elucidate more detailed mechanisms of neural circuitry and plasticity mediating behaviors in health and in disease.

Striatal Neurons Are Recruited Dynamically into Collective Representations of Self-Initiated and Learned Actions in Freely Moving Mice

Striatal spiny projection neurons are hyperpolarized-at-rest (HaR) and driven to action potential threshold by a small number of powerful inputs-an input-output configuration that is detrimental to response reliability. Because the striatum is important for habitual behaviors and goal-directed learning, we conducted a microendoscopic imaging in freely moving mice that express a genetically encoded Ca2+ indicator sparsely in striatal HaR neurons to evaluate their response reliability during self-initiated movements and operant conditioning. The sparse expression was critical for longitudinal studies of response reliability, and for studying correlations among HaR neurons while minimizing spurious correlations arising from contamination by the background signal. We found that HaR neurons are recruited dynamically into action representation, with distinct neuronal subsets being engaged in a moment-by-moment fashion. While individual neurons respond with little reliability, the population response remained stable across days. Moreover, we found evidence for the temporal coupling between neuronal subsets during conditioned (but not innate) behaviors.

Synchronous Measurements of Extracellular Action Potentials and Neurochemical Activity with Carbon Fiber Electrodes in Nonhuman Primates

Measuring the dynamic relationship between neuromodulators, such as dopamine, and neuronal action potentials is imperative to understand how these fundamental modes of neural signaling interact to mediate behavior. Here, we developed methods to measure concurrently dopamine and extracellular action potentials (i.e., spikes) and applied these in a monkey performing a behavioral task. Standard fast-scan cyclic voltammetric (FSCV) electrochemical (EChem) and electrophysiological (EPhys) recording systems are combined and used to collect spike and dopamine signals, respectively, from an array of carbon fiber (CF) sensors implanted in the monkey striatum. FSCV requires the application of small voltages at the implanted sensors to measure redox currents generated from target molecules, such as dopamine. These applied voltages create artifacts at neighboring EPhys-measurement sensors, producing signals that may falsely be classified as physiological spikes. Therefore, simple automated temporal interpolation algorithms were designed to remove these artifacts and enable accurate spike extraction. We validated these methods using simulated artifacts and demonstrated an average spike recovery rate of 84.5%. This spike extraction was performed on data collected from concurrent EChem and EPhys recordings made in a task-performing monkey to discriminate cell-type specific striatal units. These identified units were shown to correlate to specific behavioral task parameters related to reward size and eye-movement direction. Synchronous measures of spike and dopamine signals displayed contrasting relations to the behavioral task parameters, as taken from our small set of representative data, suggesting a complex relationship between these two modes of neural signaling. Future application of our methods will help advance our understanding of the interactions between neuromodulator signaling and neuronal activity, to elucidate more detailed mechanisms of neural circuitry and plasticity mediating behaviors in health and in disease.

Orbitofrontal cortex control of striatum leads economic decision-making

Animals must continually evaluate stimuli in their environment to decide which opportunities to pursue, and in many cases these decisions can be understood in fundamentally economic terms. Although several brain regions have been individually implicated in these processes, the brain-wide mechanisms relating these regions in decision-making are unclear. Using an economic decision-making task adapted for rats, we find that neural activity in both of two connected brain regions, the ventrolateral orbitofrontal cortex (OFC) and the dorsomedial striatum (DMS), was required for economic decision-making. Relevant neural activity in both brain regions was strikingly similar, dominated by the spatial features of the decision-making process. However, the neural encoding of choice direction in OFC preceded that of DMS, and this temporal relationship was strongly correlated with choice accuracy. Furthermore, activity specifically in the OFC projection to the DMS was required for appropriate economic decision-making. These results demonstrate that choice information in the OFC is relayed to the DMS to lead accurate economic decision-making.

Economic value in the Brain: A meta-analysis of willingness-to-pay using the Becker-DeGroot-Marschak auction

Forming and comparing subjective values (SVs) of choice options is a critical stage of decision-making. Previous studies have highlighted a complex network of brain regions involved in this process by utilising a diverse range of tasks and stimuli, varying in economic, hedonic and sensory qualities. However, the heterogeneity of tasks and sensory modalities may systematically confound the set of regions mediating the SVs of goods. To identify and delineate the core brain valuation system involved in processing SV, we utilised the Becker-DeGroot-Marschak (BDM) auction, an incentivised demand-revealing mechanism which quantifies SV through the economic metric of willingness-to-pay (WTP). A coordinate-based activation likelihood estimation meta-analysis analysed twenty-four fMRI studies employing a BDM task (731 participants; 190 foci). Using an additional contrast analysis, we also investigated whether this encoding of SV would be invariant to the concurrency of auction task and fMRI recordings. A fail-safe number analysis was conducted to explore potential publication bias. WTP positively correlated with fMRI-BOLD activations in the left ventromedial prefrontal cortex with a sub-cluster extending into anterior cingulate cortex, bilateral ventral striatum, right dorsolateral prefrontal cortex, right inferior frontal gyrus, and right anterior insula. Contrast analysis identified preferential engagement of the mentalizing-related structures in response to concurrent scanning. Together, our findings offer succinct empirical support for the core structures participating in the formation of SV, separate from the hedonic aspects of reward and evaluated in terms of WTP using BDM, and show the selective involvement of inhibition-related brain structures during active valuation.

Shared and distinct neural activity during anticipation and outcome of win and loss: A meta-analysis of the monetary incentive delay task

Reward and punishment motivate decision making and behavioral changes. Numerous studies have examined regional activities during anticipation and outcome of win and loss in the monetary incentive delay task (MIDT). However, the great majority of studies reported findings of anticipation or outcome and of win or loss alone. It remains unclear how the neural correlates share and differentiate amongst these processes. We conducted an Activation Likelihood Estimation meta-analysis of 81 studies of the MIDT (5,864 subjects), including 24 published since the most recent meta-analysis, to identify and, with conjunction and subtraction, contrast regional responses to win anticipation, loss anticipation, win outcome, and loss outcome. Win and loss anticipation engaged a shared network of bilateral anterior insula (AI), striatum, thalamus, supplementary motor area (SMA), and precentral gyrus. Win and loss outcomes did not share regional activities. Win and loss outcome each engaged higher activity in medial orbitofrontal cortex (mOFC) and dorsal anterior cingulate cortex. Bilateral striatum and right occipital cortex responded to both anticipation and outcome of win, and right AI to both phases of loss. Win anticipation vs. outcome engaged higher activity in bilateral AI, striatum, SMA and precentral gyrus and right thalamus, and lower activity in bilateral mOFC and posterior cingulate cortex as well as right inferior frontal and angular gyri. Loss anticipation relative to outcome involved higher activity in bilateral striatum and left AI. These findings collectively suggest shared and distinct regional responses during monetary wins and losses. Delineating the neural correlates of these component processes may facilitate empirical research of motivated behaviors and dysfunctional approach and avoidance in psychopathology.

Neuroimaging oxytocin modulation of social reward learning in schizophrenia

BACKGROUND

Conventional pharmacological approaches have limited effectiveness for schizophrenia. There is interest in the application of oxytocin, which is involved in social cognition. Clinical trials have yielded mixed results, with a gap in understanding neural mechanisms.

AIMS

To evaluate the behavioural impact of oxytocin administration on a social learning task in individuals with schizophrenia, and elucidate any differential neural activity produced.

METHOD

We recruited 20 clinically stable right-handed men diagnosed with schizophrenia or schizoaffective disorder. In a double-blind cross-over randomised controlled study, 40 IU of oxytocin or placebo were administered before functional magnetic resonance imaging of participants playing a multi-round economic exchange game of trust. Participants had the role of investors (investment trials) receiving repayment on their investments (repayment trials), playing one session against a computer and a second against a player believed to be human.

RESULTS

During investment trials, oxytocin increased neural signalling in the right lateral parietal cortex for both human and computer player trials, and attenuated signalling in the right insula for human player trials. For repayment trials, oxytocin elicited signal increases in left insula and left ventral caudate, and a signal decrease in right amygdala during the human player trials; conversely it resulted in right dorsal caudate activation during the computer player trials. We did not find a significant change in behavioural performance associated with oxytocin administration, or any associations with symptoms.

CONCLUSIONS

During a social learning task oxytocin modulates cortical and limbic substrates of the reward-processing network. These perturbations can be putatively linked to the pathoaetiology of schizophrenia.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Brain Structure and Optimism Bias: A Voxel-Based Morphometry Approach

Individuals often anticipate an unrealistically favorable future for themselves (personal optimism bias) or others (social optimism bias). While such biases are well established, little is known about their neuroanatomy. In this study, participants engaged in a soccer task and estimated the likelihood of successful passes in personal and social scenarios. Voxel-based morphometry revealed that personal optimism bias varied as a positive function of gray matter volume (GMV) in the putamen, frontal pole, hippocampus, temporal pole, inferior temporal gyrus, visual association areas, and mid-superior temporal gyrus. Social optimism bias correlated positively with GMV in the temporoparietal junction and negatively with GMV in the inferior temporal gyrus and pre-supplementary motor areas. Together, these findings suggest that parts of our optimistic outlook are biologically rooted. Moreover, while the two biases looked similar at the behavioral level, they were related to distinct gray matter structures, proposing that their underlying mechanisms are not identical.

A multi-pronged investigation of option generation using depression, PET and modafinil

Option generation is a critical process in decision making, but previous studies have largely focused on choices between options given by a researcher. Consequently, how we self-generate options for behaviour remain poorly understood. Here, we investigated option generation in major depressive disorder and how dopamine might modulate this process, as well as the effects of modafinil (a putative cognitive enhancer) on option generation in healthy individuals. We first compared differences in self-generated options between healthy non-depressed adults [n = 44, age = 26.3 years (SD 5.9)] and patients with major depressive disorder [n = 54, age = 24.8 years (SD 7.4)]. In the second study, a subset of depressed individuals [n = 22, age = 25.6 years (SD 7.8)] underwent PET scans with 11C-raclopride to examine the relationships between dopamine D2/D3 receptor availability and individual differences in option generation. Finally, a randomized, double-blind, placebo-controlled, three-way crossover study of modafinil (100 mg and 200 mg), was conducted in an independent sample of healthy people [n = 19, age = 23.2 years (SD 4.8)] to compare option generation under different doses of this drug. The first study revealed that patients with major depressive disorder produced significantly fewer options [t(96) = 2.68, P = 0.009, Cohen's d = 0.54], albeit with greater uniqueness [t(96) = -2.54, P = 0.01, Cohen's d = 0.52], on the option generation task compared to healthy controls. In the second study, we found that 11C-raclopride binding potential in the putamen was negatively correlated with fluency (r = -0.69, P = 0.001) but positively associated with uniqueness (r = 0.59, P = 0.007). Hence, depressed individuals with higher densities of unoccupied putamen D2/D3 receptors in the putamen generated fewer but more unique options, whereas patients with lower D2/D3 receptor availability were likely to produce a larger number of similar options. Finally, healthy participants were less unique [F(2,36) = 3.32, P = 0.048, partial η2 = 0.16] and diverse [F(2,36) = 4.31, P = 0.021, partial η2 = 0.19] after taking 200 mg versus 100 mg and 0 mg of modafinil, while fluency increased linearly with dosage at a trend level [F(1,18) = 4.11, P = 0.058, partial η2 = 0.19]. Our results show, for the first time, that option generation is affected in clinical depression and that dopaminergic activity in the putamen of patients with major depressive disorder may play a key role in the self-generation of options. Modafinil was also found to influence option generation in healthy people by reducing the creativity of options produced.

Computational models of adaptive behavior and prefrontal cortex

The real world is uncertain, and while ever changing, it constantly presents itself in terms of new sets of behavioral options. To attain the flexibility required to tackle these challenges successfully, most mammalian brains are equipped with certain computational abilities that rely on the prefrontal cortex (PFC). By examining learning in terms of internal models associating stimuli, actions, and outcomes, we argue here that adaptive behavior relies on specific interactions between multiple systems including: (1) selective models learning stimulus-action associations through rewards; (2) predictive models learning stimulus- and/or action-outcome associations through statistical inferences anticipating behavioral outcomes; and (3) contextual models learning external cues associated with latent states of the environment. Critically, the PFC combines these internal models by forming task sets to drive behavior and, moreover, constantly evaluates the reliability of actor task sets in predicting external contingencies to switch between task sets or create new ones. We review different models of adaptive behavior to demonstrate how their components map onto this unifying framework and specific PFC regions. Finally, we discuss how our framework may help to better understand the neural computations and the cognitive architecture of PFC regions guiding adaptive behavior.

A causal role for the right frontal eye fields in value comparison

Recent studies have suggested close functional links between overt visual attention and decision making. This suggests that the corresponding mechanisms may interface in brain regions known to be crucial for guiding visual attention - such as the frontal eye field (FEF). Here, we combined brain stimulation, eye tracking, and computational approaches to explore this possibility. We show that inhibitory transcranial magnetic stimulation (TMS) over the right FEF has a causal impact on decision making, reducing the effect of gaze dwell time on choice while also increasing reaction times. We computationally characterize this putative mechanism by using the attentional drift diffusion model (aDDM), which reveals that FEF inhibition reduces the relative discounting of the non-fixated option in the comparison process. Our findings establish an important causal role of the right FEF in choice, elucidate the underlying mechanism, and provide support for one of the key causal hypotheses associated with the aDDM.

Single caudate neurons encode temporally discounted value for formulating motivation for action

The term 'temporal discounting' describes both choice preferences and motivation for delayed rewards. Here we show that neuronal activity in the dorsal part of the primate caudate head (dCDh) signals the temporally discounted value needed to compute the motivation for delayed rewards. Macaque monkeys performed an instrumental task, in which visual cues indicated the forthcoming size and delay duration before reward. Single dCDh neurons represented the temporally discounted value without reflecting changes in the animal's physiological state. Bilateral pharmacological or chemogenetic inactivation of dCDh markedly distorted the normal task performance based on the integration of reward size and delay, but did not affect the task performance for different reward sizes without delay. These results suggest that dCDh is involved in encoding the integrated multi-dimensional information critical for motivation.

Reward modulates the association between sensory noise and brain activity during perceptual decision-making

Perceptual decisions entail the accumulation of evidence until a decision criterion is reached. The amount of noise in this process is inversely related to the behavioral performance of the decision-maker. Hence, reducing the amount of perceived noise could improve performance in perceptual decisions. In this study, we investigated whether providing monetary reward for correct responses in a perceptual decision-making task would enhance performance based on prior research linking noise reduction to the administration of reward. To this end, thirty-one healthy young adults carried out an incentivized dot tracking task (iDT) during recording of functional magnetic resonance imaging (fMRI). Behavioral responses were fitted to a Bayesian version of the drift-diffusion model that, among other parameters, also includes an estimate of sensory noise. Fifty percent of the trials were incentivized to compare rewarded with unrewarded trials regarding behavior, brain responses and estimates of model parameters. In order to establish a link between the noise parameter and fMRI activity, we correlated percent signal change (PSC) values from nucleus accumbens and caudate nucleus with noise levels in rewarded and unrewarded trials respectively. Although reward did not affect behavioral performance and model parameters, the fMRI analyses showed notable differences in nucleus accumbens, caudate nucleus and rostral anterior cingulate cortex in rewarded relative to unrewarded trials. Furthermore, higher PSC within nucleus accumbens was significantly associated with lower sensory noise levels, which was specific to rewarded trials. This work is consistent with previous findings on reward modulation of brain responses and marks a first step towards elucidating the effects of reward-induced noise suppression during perceptual decision-making.

Neural Dynamics of Reward-Induced Response Activation and Inhibition

Reward-predictive stimuli can increase an automatic response tendency, which needs to be counteracted by effortful response inhibition when this tendency is inappropriate for the current task. Here we investigated how the human brain implements this dynamic process by adopting a reward-modulated Simon task while acquiring EEG and fMRI data in separate sessions. In the Simon task, a lateral target stimulus triggers an automatic response tendency of the spatially corresponding hand, which needs to be overcome if the activated hand is opposite to what the task requires, thereby delaying the response. We associated high or low reward with different targets, the location of which could be congruent or incongruent with the correct response hand. High-reward targets elicited larger Simon effects than low-reward targets, suggesting an increase in the automatic response tendency induced by the stimulus location. This tendency was accompanied by modulations of the lateralized readiness potential over the motor cortex, and was inhibited soon after if the high-reward targets were incongruent with the correct response hand. Moreover, this process was accompanied by enhanced theta oscillations in medial frontal cortex and enhanced activity in a frontobasal ganglia network. With dynamical causal modeling, we further demonstrated that the connection from presupplementary motor area (pre-SMA) to right inferior frontal cortex (rIFC) played a crucial role in modulating the reward-modulated response inhibition. Our results support a dynamic neural model of reward-induced response activation and inhibition, and shed light on the neural communication between reward and cognitive control in generating adaptive behaviors.

Interindividual differences in incentive sensitivity moderate motivational effects of competition and cooperation on motor performance

Established research has documented the pervasive influence of incentives (i.e., food, sex, money) on animal and human behavior. Additionally, motivational theories postulating intra–individually stable preferences for specific types of incentives (i.e., motives) highlight that effects of a given incentive are highly dependent on the motive disposition of the individual. Indeed, also research on motor performance has documented the interactive effects of motives and motive–specific incentives on motor outcomes. However, the majority of this research has relied on correlational designs focusing on the effects of the achievement motive, with few studies addressing the role of the affiliation and power motive. In order to extend findings in this domain, we tested whether a fit between individuals’ power (affiliation) motive and incentives of competition (cooperation) would improve motor performance. Following baseline measures, participants performed a dart–throwing task as part of a dyadic performance (i.e., cooperative) or a one–on–one competition scenario. In the dyadic performance scenario, a stronger affiliation motive did not translate to better performance. However, in the one–on–one competition scenario a stronger power motive was associated with better performance. Results highlight the role of the power motive in predicting motor performance, particularly in competitive situations.

Ventral Caudate and Anterior Insula Recruitment During Value Estimation of Passionate Rewarding Cues

“Wanting”, a component of reward processing, is a motivational property that guides decision making in goal-oriented behavior. This includes behavior aiming at supporting relational bonds, even at the group level. Accordingly, group belongingness works as this motivational property, which is fundamentally different from romantic or maternal love. While primary rewards (or learned associations, such as money) have been largely used to study the conceptual framework associated with “wanting,” other cues triggering behavior, such as passionate motives, are less well-studied. We investigated the neural correlates of value estimation of a passion-driven incentive in neuropsychologically defined football fans. We asked the participants (n = 57) to compute the value of football tickets (the cues that trigger passionate behavior in this “tribal love” context). The trials were all different, comprising tickets for different matches. The participants had no restrictions on the amount to be introduced. This enabled a parametric functional magnetic resonance imaging design based on the explicit estimated value given by the participants in a trial-by-trial approach. Using a whole-brain approach (to prevent biased focus on value-related regions), only the activity in the ventral caudate and left anterior insula showed a critical relationship with the reported value. Higher normalized values led to more activity in the striatum and left insula. The parametric map shows that these regions encode the magnitude of incentive by indexing self-relevant value. Other regions were involved in value computation, such as the ventromedial prefrontal cortex, lateral orbitofrontal cortex, and dorsolateral prefrontal cortex, but did not exhibit parametric patterns. The involvement of the nucleus accumbens in value estimation was only found in region of interest -based analysis, which emphasizes the role of the ventral caudate for the presently studied social “reinforcer” cue.

Topographic distinction in long-term value signals between presumed dopamine neurons and presumed striatal projection neurons in behaving monkeys

Nigrostriatal dopamine (DA) projections are anatomically organized along the dorsolateral-ventromedial axis, conveying long-term value signals to the striatum for shaping actions toward multiple future rewards. The present study examines whether the topographic organization of long-term value signals are observed upon activity of presumed DA neurons and presumed striatal projection neurons (phasically active neurons, PANs), as predicted based on anatomical literature. Our results indicate that DA neurons in the dorsolateral midbrain encode long-term value signals on a short timescale, while ventromedial midbrain DA neurons encode such signals on a relatively longer timescale. Activity of the PANs in the dorsal striatum is more heterogeneous for encoding long-term values, although significant differences in long-term value signals were observed between the caudate nucleus and putamen. These findings suggest that topographic DA signals for long-term values are not simply transferred to striatal neurons, possibly due to the contribution of other projections to the striatum.

Homeostatic regulation of reward via synaptic insertion of calcium-permeable AMPA receptors in nucleus accumbens

The incentive effects of food and related cues are determined by stimulus properties and the internal state of the organism. Enhanced hedonic reactivity and incentive motivation in energy deficient subjects have been demonstrated in animal models and humans. Defining the neurobiological underpinnings of these state-based modulatory effects could illuminate fundamental mechanisms of adaptive behavior, as well as provide insight into maladaptive consequences of weight loss dieting and the relationship between disturbed eating behavior and substance abuse. This article summarizes research of our laboratory aimed at identifying neuroadaptations induced by chronic food restriction (FR) that increase the reward magnitude of drugs and associated cues. The main findings are that FR decreases basal dopamine (DA) transmission, upregulates signaling downstream of the D1 DA receptor (D1R), and triggers synaptic incorporation of calcium-permeable AMPA receptors (CP-AMPARs) in the nucleus accumbens (NAc). Selective antagonism of CP-AMPARs decreases excitatory postsynaptic currents in NAc medium spiny neurons of FR rats and blocks the enhanced rewarding effects of d-amphetamine and a D1R, but not a D2R, agonist. These results suggest that FR drives CP-AMPARs into the synaptic membrane of D1R-expressing MSNs, possibly as a homeostatic response to reward loss. FR subjects also display diminished aversion for contexts associated with LiCl treatment and centrally infused cocaine. An encompassing, though speculative, hypothesis is that NAc synaptic incorporation of CP-AMPARs in response to food scarcity and other forms of sustained reward loss adaptively increases incentive effects of reward stimuli and, at the same time, diminishes responsiveness to aversive stimuli that have potential to interfere with goal pursuit.

The Nucleus Accumbens Core is Necessary to Scale Fear to Degree of Threat

Fear is adaptive when the level of the response rapidly scales to degree of threat. Using a discrimination procedure consisting of danger, uncertainty, and safety cues, we have found rapid fear scaling (within 2 s of cue presentation) in male rats. Here, we examined a possible role for the nucleus accumbens core (NAcc) in the acquisition and expression of fear scaling. In experiment 1, male Long-Evans rats received bilateral sham or neurotoxic NAcc lesions, recovered, and underwent fear discrimination. NAcc-lesioned rats were generally impaired in scaling fear to degree of threat, and specifically impaired in rapid uncertainty-safety discrimination. In experiment 2, male Long-Evans rats received NAcc transduction with halorhodopsin (Halo) or a control fluorophore. After fear scaling was established, the NAcc was illuminated during cue or control periods. NAcc-Halo rats receiving cue illumination were specifically impaired in rapid uncertainty-safety discrimination. The results reveal a general role for the NAcc in scaling fear to degree of threat, and a specific role in rapid discrimination of uncertain threat and safety.SIGNIFICANCE STATEMENT Rapidly discriminating cues for threat and safety is essential for survival and impaired threat-safety discrimination is a hallmark of stress and anxiety disorders. In two experiments, we induced nucleus accumbens core (NAcc) dysfunction in rats receiving fear discrimination consisting of cues for danger, uncertainty, and safety. Permanent NAcc dysfunction, via neurotoxic lesion, generally disrupted the ability to scale fear to degree of threat, and specifically impaired one component of scaling: rapid discrimination of uncertain threat and safety. Reversible NAcc dysfunction, via optogenetic inhibition, specifically impaired rapid discrimination of uncertain threat and safety. The results reveal that the NAcc is essential to scale fear to degree of threat, and is a plausible source of dysfunction in stress and anxiety disorders.

Trade-off between motor performance and behavioural flexibility in the action selection of cricket escape behaviour

To survive a predator’s attack successfully, animals choose appropriate actions from multiple escape responses. The motor performance of escape response governs successful survival, which implies that the action selection in escape behaviour is based on the trade-off between competing behavioural benefits. Thus, quantitative assessment of motor performance will shed light on the biological basis of decision-making. To explore the trade-off underlying the action selection, we focused on two distinct wind-elicited escape responses of crickets, running and jumping. We first hypothesized a trade-off between speed and directional accuracy. This hypothesis was rejected because crickets could control the escape direction in jumping as precisely as in running; further, jumping had advantages with regard to escape speed. Next, we assumed behavioural flexibility, including responsiveness to additional predator’s attacks, as a benefit of running. The double stimulus experiment revealed that crickets running in the first response could respond more frequently to a second stimulus and control the movement direction more precisely compared to when they chose jumping for the first response. These data suggest that not only the motor performance but also the future adaptability of subsequent behaviours are considered as behavioural benefits, which may be used for choosing appropriate escape reactions.

Feeding Behavior of Mice under Different Food Allocation Regimens

Social interaction, a basic survival strategy for many animal species, helps maintain a social environment that has limited conflict. Social dominance has a dramatic effect on motivation. Recent evidence suggests that some primate and nonprimate species display aversive behavior toward food allocation regimens that differ from their peers. Thus, we examined the behaviors displayed by mice under different food allocation regimens. We analyzed changes in food intake using several parameters. In the same food condition, the mice received the same food; in the quality different condition, the mice received different foods; in the quantity different condition, one mouse did not receive food; and in the no food condition, none of the mice received food. To test differences based on food quality, one mouse received normal solid food as a less preferred reward, and the other received chocolate chips as a high-level reward. No behavioral change was observed in comparison to the same food condition. To test differences based on food quantity, one mouse received chocolate chips while the other received nothing. Mice who received nothing spent more time on the other side of the reward throughout the experiment. Interestingly, highly rewarded mice required more time to consume the chocolate chips. Thus, under different food allocation regimens, mice changed their behavior by being more hesitant. Moreover, mice alter food intake behavior according to the social environment. The findings help elucidate potential evolutionary aspects that help maintain social cohesion while providing insights into potential mechanisms underlying socially anxious behavior.

Neuronal Representation of Object Choice in the Striatum of the Monkey

According to a widely held view, the decision-making process can be conceptualized as a two-step process: “object choice,” which does not include physical actions, followed by “movement choice,” in which action is executed to obtain the object. Accumulating evidence in the field of decision neuroscience suggests that the cortico-basal ganglia circuits play a crucial role in decision-making. However, the underlying mechanisms of the object and movement choices remain poorly understood, mainly because the two processes occur simultaneously in most experiments. In this study, to uncover the neuronal basis of object choice in the striatum, the main input site of the basal ganglia, we designed a behavioral task in which the processes of object and movement choice were temporally separated, and recorded the single-unit activity of phasically active neurons (PANs) (n = 375) in the striatum of two monkeys. We focused our study mainly on neuronal representation during the object choice period, before movement choice, using a mutual information analysis. Population striatal activities significantly represented the information of the chosen object during the object choice period, which indicated that the monkeys actually made the object choice during the task. For the activity of each individual neuron during the object choice period, we identified offered object- and chosen object-type neurons, corresponding to pre- and post-decision signals, respectively. We also found the movement-type neurons during the movement period after the object choice. Most offered object- or chosen object-type neurons were not overlapped with movement-type neurons. The presence of object choice-related signals independent of movement signal in the striatum indicated that the striatum was part of the site where object choice was made within a cortico-basal ganglia circuit.

NMDA receptor-dependent plasticity in the nucleus accumbens connects reward-predictive cues to approach responses

Learning associations between environmental cues and rewards is a fundamental adaptive function. Via such learning, reward-predictive cues come to activate approach to locations where reward is available. The nucleus accumbens (NAc) is essential for cued approach behavior in trained subjects, and cue-evoked excitations in NAc neurons are critical for the expression of this behavior. Excitatory synapses within the NAc undergo synaptic plasticity that presumably contributes to cued approach acquisition, but a direct link between synaptic plasticity within the NAc and the development of cue-evoked neural activity during learning has not been established. Here we show that, with repeated cue-reward pairings, cue-evoked excitations in the NAc emerge and grow in the trials prior to the detectable expression of cued approach behavior. We demonstrate that the growth of these signals requires NMDA receptor-dependent plasticity within the NAc, revealing a neural mechanism by which the NAc participates in learning of conditioned reward-seeking behaviors.

Conditioned stimuli elicit phasic changes in nucleus accumbens (NAc) firing that invigorate approach responses to predicted rewards. Here the authors show that NAc neurons acquire cue-evoked responses during learning as a result of excitatory plasticity within the NAc.

A glutamatergic insular-striatal projection regulates the reinstatement of cue-associated morphine-seeking behavior in mice

Recently, the insular cortex (IC) was identified as part of the neuronal circuit responsible for the reward expectations in cue-triggered behaviours. Moreover, there are evidences that connections between the IC and the ventral striatum, particularly with the nucleus accumbens (NAc), may mediate the retrieval and performance of actions based on incentive memory. However, the precise role of the IC-NAc connections in cue-related drug-seeking behaviour remains unclear. We used the morphine-induced conditioned place preference (CPP) paradigm to assess the formation and relapse of cue-related drug-seeking. cFos immunostaining was used to determine the activation of the brain regions. Chemogenetic and optogenetic methods were used to manipulate the activity of IC-to-NAc projection neurons. The result showed that neurons in IC and NAc core but not NAc shell were activated following cue-induced morphine-seeking behaviour. Negligible effect of inhibition of IC-to-NAc core projection (IC^{→NAc core}) on morphine CPP expression, whereas chemogenetic inactivation of this projection potently blocked the reinstatement of expressed morphine CPP. Furthermore, optogenetic inhibition of glutamatergic IC^{→NAc core} inputs significant suppressed the CPP reinstatement without significant effect on CPP expression. We demonstrated here, for the first time, that IC^{→NAc core} glutamatergic projection is required for the reinstatement of cue-associated drug seeking behaviour in mice. The present study provide insights into modulations of relapse of cue-associated drug-seeking behaviour following repeated overexposure to opioids in humans.

Translating striatal activity from brain slice to whole animal neurophysiology: A guide for neuroscience research integrating diverse levels of analysis

An important goal of this review is highlighting research in neuroscience as examples of multilevel functional and anatomical analyses addressing basic science issues and applying results to the understanding of diverse disorders. The research of Dr. Michael Levine, a leader in neuroscience, exemplifies this approach by uncovering fundamental properties of basal ganglia function and translating these findings to clinical applications. The review focuses on neurophysiological research connecting results from in vitro and in vivo recordings. A second goal is to utilize these research connections to produce novel, accurate descriptions for corticostriatal processing involved in varied, complex functions. Medium spiny neurons in striatum act as integrators combining input with baseline activity creating motivational "events." Basic research on corticostriatal synapses is described and links developed to issues with clinical relevance such as inhibitory gating, self-injurious behavior, and relative reward valuation. Work is highlighted on dopamine-glutamate interactions. Individual medium spiny neurons express both D₁ and D₂ receptors and encode information in a bivalent manner depending upon the mix of receptors involved. Current work on neurophysiology of reward processing has taken advantage of these basic approaches at the cellular and molecular levels. Future directions in studying physiology of reward processing and action sequencing could profit by incorporating the divergent ways dopamine modulates incoming neurochemical signals. Primary investigators leading research teams should mirror Mike Levine's efforts in "climbing the mountain" of scientific inquiry by performing analyses at different levels of inquiry, integrating the findings, and building comprehensive answers to problems unsolvable without this bold approach.

Individual differences in dopamine D2 receptor availability correlate with reward valuation

Reward valuation, which underlies all value-based decision-making, has been associated with dopamine function in many studies of nonhuman animals, but there is relatively less direct evidence for an association in humans. Here, we measured dopamine D₂ receptor (DRD2) availability in vivo in humans to examine relations between individual differences in dopamine receptor availability and neural activity associated with a measure of reward valuation, expected value (i.e., the product of reward magnitude and the probability of obtaining the reward). Fourteen healthy adult subjects underwent PET with [¹⁸F]fallypride, a radiotracer with strong affinity for DRD2, and fMRI (on a separate day) while performing a reward valuation task. [¹⁸F]fallypride binding potential, reflecting DRD2 availability, in the midbrain correlated positively with neural activity associated with expected value, specifically in the left ventral striatum/caudate. The present results provide in vivo evidence from humans showing midbrain dopamine characteristics are associated with reward valuation.

Choice-Selective Neurons in the Auditory Cortex and in Its Striatal Target Encode Reward Expectation

Learned behavioral responses to sounds depend largely on the expected outcomes associated with each potential choice. Where and how the nervous system integrates expectations about reward with auditory sensory information to drive appropriate decisions is not fully understood. Using a two-alternative choice task in which the expected reward associated with each sound varied over time, we investigated potential sites along the corticostriatal pathway for the integration of sound signals, behavioral choice, and reward information in male mice. We found that auditory cortical neurons encode not only sound identity, but also the animal's choice and the expected size of reward. This influence of reward expectation on sound- and choice-related activity was further enhanced in the major striatal target of the auditory cortex: the posterior tail of the dorsal striatum. These results indicate that choice-specific information is integrated with reward signals throughout the corticostriatal pathway, potentially contributing to adaptation in sound-driven behavior.SIGNIFICANCE STATEMENT Learning and maintenance of sensory-motor associations require that neural circuits keep track of sensory stimuli, choices, and outcomes. It is not clear at what stages along the auditory sensorimotor pathway these signals are integrated to influence future behavior in response to sounds. Our results show that the activity of auditory cortical neurons and of their striatal targets encodes the animals' choices and expectation of reward, in addition to stimulus identity. These results challenge previous views of the influence of motor signals on auditory circuits and identifies potential loci for integration of task-related information necessary for updating auditory decisions in changing environments.

Reward Processing in Adolescent Depression Across Neuroimaging Modalities

Depressive symptoms have long been associated with abnormalities in neural processing of reward. However, no review has yet consolidated evidence of such deficits in adolescent depression, integrating findings across neuroimaging modalities, such as functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). The current review found consistent evidence of reduced striatal responses in anticipation and upon receipt of rewards, and blunted feedback-related negativity (FRN) potentials associated with depression in adolescence, consistent with the adult literature. Furthermore, while these occurred in currently depressed adolescents, they were also found to be predictive of the onset of depressive symptoms in longitudinal studies with community-based adolescent samples. This paper makes recommendations for future work to continue to elucidate this relationship, a greater understanding of which may lead to more targeted and efficacious treatments for depression in adolescence.

Expected Value of Reward Predicts Episodic Memory for Incidentally Learnt Reward-Item Associations

In this paper, we draw connections between reward processing and cognition by behaviourally testing the implications of neurobiological theories of reward processing on memory. Single-cell neurophysiology in non-human primates and imaging work in humans suggests that the dopaminergic reward system responds to different components of reward: expected value; outcome or prediction error; and uncertainty of reward (Schultz et al., 2008). The literature on both incidental and motivated learning has focused on understanding how expected value and outcome—linked to increased activity in the reward system—lead to consolidation-related memory enhancements. In the current study, we additionally investigate the impact of reward uncertainty on human memory. The contribution of reward uncertainty—the spread of the reward probability distribution irrespective of the magnitude—has not been previously examined. To examine the effects of uncertainty on memory, a word-learning task was introduced, along with a surprise delayed recognition memory test. Using Bayesian model selection, we found evidence only for expected value as a predictor of memory performance. Our findings suggest that reward uncertainty does not enhance memory for individual items. This supports emerging evidence that an effect of uncertainty on memory is only observed in high compared to low risk environments.

Ventral striatum links motivational and motor networks during operant-conditioned movement in rats

Voluntary actions require motives. It is already known that the medial prefrontal cortex (MPFC) assess the motivational values. However, it remains unclear how the motivational process gains access to the motor execution system in the brain. Here we present evidence that the ventral striatum (VS) plays a hub-like role in mediating motivational and motor processing in operant behavior. We used positron emission tomography (PET) to detect the neural activation areas associated with motivational action. Using obtained regions, partial correlation analysis was performed to examine how the motivational signals propagate to the motor system. The results revealed that VS activity propagated to both MPFC and primary motor cortex through the thalamus. Moreover, muscimol injection into the VS suppressed the motivational behavior, supporting the idea of representations of motivational signals in VS that trigger motivational behavior. These results suggest that the VS-thalamic pathway plays a pivotal role for both motivational processing through interactions with the MPFC and for motor processing through interactions with the motor BG circuits.

Previous cocaine self-administration disrupts reward expectancy encoding in ventral striatum

The nucleus accumbens core (NAc) is important for integrating and providing information to downstream areas about the timing and value of anticipated reward. Although NAc is one of the first brain regions to be affected by drugs of abuse, we still do not know how neural correlates related to reward expectancy are affected by previous cocaine self-administration. To address this issue, we recorded from single neurons in the NAc of rats that had previously self-administered cocaine or sucrose (control). Neural recordings were then taken while rats performed an odor-guided decision-making task in which we independently manipulated value of expected reward by changing the delay to or size of reward across a series of trial blocks. We found that previous cocaine self-administration made rats more impulsive, biasing choice behavior toward more immediate reward. Further, compared to controls, cocaine-exposed rats showed significantly fewer neurons in the NAc that were responsive during odor cues and reward delivery, and in the reward-responsive neurons that remained, diminished directional and value encoding was observed. Lastly, we found that after cocaine exposure, reward-related firing during longer delays was reduced compared to controls. These results demonstrate that prior cocaine self-administration alters reward-expectancy encoding in NAc, which could contribute to poor decision making observed after chronic cocaine use.

Persistent coding of outcome-predictive cue features in the rat nucleus accumbens

The nucleus accumbens (NAc) is important for learning from feedback, and for biasing and invigorating behaviour in response to cues that predict motivationally relevant outcomes. NAc encodes outcome-related cue features such as the magnitude and identity of reward. However, little is known about how features of cues themselves are encoded. We designed a decision making task where rats learned multiple sets of outcome-predictive cues, and recorded single-unit activity in the NAc during performance. We found that coding of cue identity and location occurred alongside coding of expected outcome. Furthermore, this coding persisted both during a delay period, after the rat made a decision and was waiting for an outcome, and after the outcome was revealed. Encoding of cue features in the NAc may enable contextual modulation of on-going behaviour, and provide an eligibility trace of outcome-predictive stimuli for updating stimulus-outcome associations to inform future behaviour.

A possible social relative reward effect: Influences of outcome inequity between rats during operant responding

Social interactions/situations have dramatic influences on motivation. Creating animal models examining these influences promotes a better understanding of the psychological and biological underpinnings of social motivation. Rodents are sensitive to social history/experience during associative conditioning and food-sharing tasks. Would reward-oriented operant behavior be sensitive to social influences by showing a negative contrast-like effect when another organism obtains a greater value outcome? We used a side-by-side arrangement of operant response chambers wherein one animal obtained consistently high reward signaled by a discrete cue. The neighboring, experimental rat experienced different combinations of high and low reward trial sequences. Control conditions included distraction from a conspecific in the neighboring chamber (rat distractor) or cue/food dispenser operating without a conspecific (program distractor) in addition to testing subjects alone. Results support an influence of the other animal actively performing the task on the experimental subject's behavior. Primarily, responding was significantly slower for the low reward trials while the neighboring rat was receiving the higher magnitude reward. The lever-press and not food-cup retrieval latency was significantly slower during exposure to a conspecific neighbor performing the operant task. The effect was not obtained in all session sequences and was more pronounced using longer series of consecutive low reward trials. The slowing effect was also obtained with the program-distractor experience in a different trial sequence. These findings suggest a social-induced negative incentive contrast effect in rats possibly mediated by an outcome inequity process that could have key similarities to complex situational-affective effects on motivation involving frustration or jealously.

Non-motor Characterization of the Basal Ganglia: Evidence From Human and Non-human Primate Electrophysiology

Although the basal ganglia have been implicated in a growing list of human behaviors, they include some of the least understood nuclei in the brain. For several decades studies have employed numerous methodologies to uncover evidence pointing to the basal ganglia as a hub of both motor and non-motor function. Recently, new electrophysiological characterization of the basal ganglia in humans has become possible through direct access to these deep structures as part of routine neurosurgery. Electrophysiological approaches for identifying non-motor function have the potential to unlock a deeper understanding of pathways that may inform clinical interventions and particularly neuromodulation. Various electrophysiological modalities can also be combined to reveal functional connections between the basal ganglia and traditional structures throughout the neocortex that have been linked to non-motor behavior. Several reviews have previously summarized evidence for non-motor function in the basal ganglia stemming from behavioral, clinical, computational, imaging, and non-primate animal studies; in this review, instead we turn to electrophysiological studies of non-human primates and humans. We begin by introducing common electrophysiological methodologies for basal ganglia investigation, and then we discuss studies across numerous non-motor domains–emotion, response inhibition, conflict, decision-making, error-detection and surprise, reward processing, language, and time processing. We discuss the limitations of current approaches and highlight the current state of the information.

Valuation of knowledge and ignorance in mesolimbic reward circuitry

Humans desire to know what the future holds. Yet, at times they decide to remain ignorant (e.g., reject medical screenings). These decisions have important societal implications in domains ranging from health to finance. We show how the opportunity to gain information is valued and explain why knowledge is not always preferred. Specifically, the mesolimbic reward circuitry selectively treats the opportunity to gain knowledge about favorable, but not unfavorable, outcomes as a reward to be approached. This coding predicts biased information seeking: Participants choose knowledge about future desirable outcomes more than about undesirable ones, vice versa for ignorance, and are willing to pay for both. This work demonstrates a role for valence in how the human brain values knowledge.

The pursuit of knowledge is a basic feature of human nature. However, in domains ranging from health to finance people sometimes choose to remain ignorant. Here, we show that valence is central to the process by which the human brain evaluates the opportunity to gain information, explaining why knowledge may not always be preferred. We reveal that the mesolimbic reward circuitry selectively treats the opportunity to gain knowledge about future favorable outcomes, but not unfavorable outcomes, as if it has positive utility. This neural coding predicts participants’ tendency to choose knowledge about future desirable outcomes more often than undesirable ones, and to choose ignorance about future undesirable outcomes more often than desirable ones. Strikingly, participants are willing to pay both for knowledge and ignorance as a function of the expected valence of knowledge. The orbitofrontal cortex (OFC), however, responds to the opportunity to receive knowledge over ignorance regardless of the valence of the information. Connectivity between the OFC and mesolimbic circuitry could contribute to a general preference for knowledge that is also modulated by valence. Our findings characterize the importance of valence in information seeking and its underlying neural computation. This mechanism could lead to suboptimal behavior, such as when people reject medical screenings or monitor investments more during bull than bear markets.

Neural encoding of choice during a delayed response task in primate striatum and orbitofrontal cortex

Reward outcomes are available in many diverse situations and all involve choice. If there are multiple outcomes each rewarding, then decisions regarding relative value lead to choosing one over another. Important factors related to choice context should be encoded and utilized for this form of adaptive choosing. These factors can include the number of alternatives, the pacing of choice behavior and the possibility to reverse one's choice. An essential step in understanding if the context of choice is encoded is to directly compare choice with a context in which choice is absent. Neural activity in orbitofrontal cortex and striatum encodes potential value parameters related to reward quality and quantity as well as relative preference. We examined how neural activations in these brain regions are sensitive to choice situations and potentially involved in a prediction for the upcoming outcome selection. Neural activity was recorded and compared between a two-choice spatial delayed response task and an imperative 'one-option' task. Neural activity was obtained that extended from the instruction cue to the movement similar to previous work utilizing the identical imperative task. Orbitofrontal and striatal neural responses depended upon the decision about the choice of which reward to collect. Moreover, signals to predictive instruction cues that precede choice were selective for the choice situation. These neural responses could reflect chosen value with greater information on relative value of individual options as well as encode choice context itself embedded in the task as a part of the post-decision variable.

Striatal action-value neurons reconsidered

It is generally believed that during economic decisions, striatal neurons represent the values associated with different actions. This hypothesis is based on studies, in which the activity of striatal neurons was measured while the subject was learning to prefer the more rewarding action. Here we show that these publications are subject to at least one of two critical confounds. First, we show that even weak temporal correlations in the neuronal data may result in an erroneous identification of action-value representations. Second, we show that experiments and analyses designed to dissociate action-value representation from the representation of other decision variables cannot do so. We suggest solutions to identifying action-value representation that are not subject to these confounds. Applying one solution to previously identified action-value neurons in the basal ganglia we fail to detect action-value representations. We conclude that the claim that striatal neurons encode action-values must await new experiments and analyses.

Dynamic Encoding of Effort and Reward throughout the Execution of Action by External Globus Pallidus Neurons in Monkeys

Humans and animals must evaluate the costs and expected benefits of their actions to make adaptive choices. Prior studies have demonstrated the involvement of the basal ganglia in this evaluation. However, little is known about the role of the external part of the globus pallidus (GPe), which is well positioned to integrate motor and reward-related information, in this process. To investigate this role, the activity of 126 neurons was recorded in the associative and limbic parts of the GPe of two monkeys performing a behavioral task in which different levels of force were required to obtain different amounts of liquid reward. The results first revealed that the activity of associative and limbic GPe neurons could be modulated not only by cognitive and limbic but also motor information at the same time, both during a single period or during different periods throughout the trial, mainly in an independent way. Moreover, as a population, GPe neurons encoded these types of information dynamically throughout the trial, when each piece of information was the most relevant for the achievement of the action. Taken together, these results suggest that GPe neurons could be dedicated to the parallel monitoring of task parameters essential to adjusting and maintaining goal-directed behavior.

Controlling striatal function via anterior frontal cortex stimulation

Motivational, cognitive and action goals are processed by distinct, topographically organized, corticostriatal circuits. We aimed to test whether processing in the striatum is under causal control by cortical regions in the human brain by investigating the effects of offline transcranial magnetic stimulation (TMS) over distinct frontal regions associated with motivational, cognitive and action goal processing. Using a three-session counterbalanced within-subject crossover design, continuous theta burst stimulation was applied over the anterior prefrontal cortex (aPFC), dorsolateral prefrontal cortex, or premotor cortex, immediately after which participants (N = 27) performed a paradigm assessing reward anticipation (motivation), task (cognitive) switching, and response (action) switching. Using task-related functional magnetic resonance imaging (fMRI), we assessed the effects of stimulation on processing in distinct regions of the striatum. To account for non-specific effects, each session consisted of a baseline (no-TMS) and a stimulation (post-TMS) fMRI run. Stimulation of the aPFC tended to decrease reward-related processing in the caudate nucleus, while stimulation of the other sites was unsuccessful. A follow-up analysis revealed that aPFC stimulation also decreased processing in the putamen as a function of the interaction between all factors (reward, cognition and action), suggesting stimulation modulated the transfer of motivational information to cortico-striatal circuitry associated with action control.

Neuroanatomical correlates of grit: Growth mindset mediates the association between gray matter structure and trait grit in late adolescence

There is a long-standing interest in exploring the factors related to student achievement. As a newly explored personality trait, grit is defined as a person's tendency to pursue long-term goals with continual perseverance and passion, and grit plays a critical role in student achievement. Increasing evidence has shown that growth mindset, the belief that one's basic abilities are malleable and can be developed through effort, is a potential factor for cultivating grit. However, less is known about the association between grit and the brain and the role of growth mindset in this association. Here, we utilized voxel-based morphometry to examine the neuroanatomical correlates of grit in 231 healthy adolescent students by performing structural magnetic resonance imaging. The whole-brain regression analyses revealed that the regional gray matter volume (rGMV) in the left dorsolateral prefrontal cortex (DLPFC) negatively predicted grit. In contrast, the rGMV in the right putamen positively predicted grit. Furthermore, mediating analyses suggested that growth mindset served as a mediator in the association between left DLPFC volume and grit. Our results persisted even after controlling for the influences of self-control and delayed gratification. Overall, our study presents novel evidence for the neuroanatomical basis of grit and highlights that growth mindset might play an essential role in cultivating a student's grit level.

Reward Size Informs Repeat-Switch Decisions and Strongly Modulates the Activity of Neurons in Parietal Cortex

Behavior is guided by previous experience. Good, positive outcomes drive a repetition of a previous behavior or choice, whereas poor or bad outcomes lead to an avoidance. How these basic drives are implemented by the brain has been of primary interest to psychology and neuroscience. We engaged animals in a choice task in which the size of a reward outcome strongly governed the animals' subsequent decision whether to repeat or switch the previous choice. We recorded the discharge activity of neurons implicated in reward-based choice in 2 regions of parietal cortex. We found that the tendency to retain previous choice following a large (small) reward was paralleled by a marked decrease (increase) in the activity of parietal neurons. This neural effect is independent of, and of sign opposite to, value-based modulations reported in parietal cortex previously. This effect shares the same basic properties with signals previously reported in the limbic system that detect the size of the recently obtained reward to mediate proper repeat-switch decisions. We conclude that the size of the obtained reward is a decision variable that guides the decision between retaining a choice or switching, and neurons in parietal cortex strongly respond to this novel decision variable.

Mean Diffusivity in the Dopaminergic System and Neural Differences Related to Dopaminergic System

BACKGROUND

The mean diffusivity (MD) parameter obtained by diffusion tensor imaging provides a measure of how freely water molecules move in brain tissue. Greater tissue density conferred by closely arrayed cellular structures is assumed to lower MD by inhibiting the free diffusion of water molecules.

METHODS

In this paper, we review studies showing MD variation among regions of the brain dopaminergic system (MDDS), especially subcortical structures such as the putamen, caudate nucleus, and globus pallidus, in different conditions with known associations to dopaminergic system function or dysfunction. The methodologies and background related to MD and MDDS are also discussed.

RESULTS

Past studies indicate that MDDS is sensitive to pathological derangement of dopaminergic activity, neural changes caused by cognitive and pharmacological interventions that are known to affect the dopaminergic system, and individual character traits related to dopaminergic function.

CONCLUSION

These results suggest that MDDS can be one useful tool to tap the neural differences related to the dopaminergic system.

Transcriptomic analysis of instinctive and learned reward-related behaviors in honey bees

We used transcriptomics to compare instinctive and learned, reward-based honey bee behaviors with similar spatio-temporal components: mating flights by males (drones) and time-trained foraging flights by females (workers), respectively. Genome-wide gene expression profiling via RNA sequencing was performed on the mushroom bodies, a region of the brain known for multi-modal sensory integration and responsive to various types of reward. Differentially expressed genes (DEGs) associated with the onset of mating (623 genes) were enriched for the gene ontology (GO) categories of Transcription, Unfolded Protein Binding, Post-embryonic Development, and Neuron Differentiation. DEGs associated with the onset of foraging (473) were enriched for Lipid Transport, Regulation of Programmed Cell Death, and Actin Cytoskeleton Organization. These results demonstrate that there are fundamental molecular differences between similar instinctive and learned behaviors. In addition, there were 166 genes with strong similarities in expression across the two behaviors - a statistically significant overlap in gene expression, also seen in Weighted Gene Co-Expression Network Analysis. This finding indicates that similar instinctive and learned behaviors also share common molecular architecture. This common set of DEGs was enriched for Regulation of RNA Metabolic Process, Transcription Factor Activity, and Response to Ecdysone. These findings provide a starting point for better understanding the relationship between instincts and learned behaviors. In addition, because bees collect food for their colony rather than for themselves, these results also support the idea that altruistic behavior relies, in part, on elements of brain reward systems associated with selfish behavior.

The effects of ethanol on diverse components of choice in the rat: reward discrimination, preference and relative valuation

Alcohol consumption impairs judgment and choice. How alcohol alters these crucial processes is primarily unknown. Choice can be fractionated into different components including reward discrimination, preference and relative valuation that can function together or in isolation depending upon diverse factors including choice context. We examined the diverse components and contextual effects by analyzing the effects of alcohol drinking on choice behavior in a task with a reduced level of temporal and spatial constraints. Rats were trained to drink 10% ethanol during 6 weeks of behavior testing using a combined sucrose-fade and two-bottle free-choice procedure. Two different sucrose pellet outcomes (e.g., constant vs. variable) were presented each week to examine the impact of voluntary drinking on reward-based decision-making. Behavioral contexts of single option, free choice and extinction were examined for each outcome set. Comparisons were made between alcohol and control groups and within the alcohol group over time to inspect choice profiles. Between-group results showed alcohol drinking animals expressed altered place preference and modified sucrose reward approach latencies. The within-group profile showed that alcohol drinking animals can express adequate reward discrimination, preference and incentive contrast during free choice. All of these components were significantly reduced during the context of extinction. Control animals were also impacted by extinction but not as severely. The findings point to a need for a greater focus on the context and the diverse components of choice when examining external and internal factors influencing decision-making during alcohol or other substance of abuse exposure.

Effects of anandamide administration on components of reward processing during free choice

Previous research has implicated the positive modulation of anandamide, an endocannabinoid neurotransmitter, on feeding behavior. Anandamide is particularly noteworthy as it acts as an endogenous ligand of the CB1 receptor, the same receptor that is activated by tetrahydrocannabinol, the primary psychoactive component in Cannabis sativa. Cannabis legalization in North America has presented with a need to study endocannabinoid agonists and their effects on behavior. Much has yet to be determined in terms of the role of the endocannabinoid system in decision-making scenarios. The research presented here tested the hypothesis that anandamide would augment motivation and reward processing via appetitive and consummatory measures during an operant, foraging task. A three-box design was used in order to provide the animals with a free choice, exploratory foraging environment. Discrimination, preference, and incentive contrast were analyzed as discrete measures of decision-making in the three-box paradigm. Anandamide administration (1mg/kg) was found to significantly increase motivation for the optimal foraging outcome and alter basic processing of reward information involved in discrimination and relative valuation. The positive effects of anandamide on eating behavior and motivation have implications toward possible treatment modalities for patient populations presenting with disorders of motivation. These findings suggest the need for continued investigation of the endocannabinoid system as a central component of motivated behavior.