Learned Value Shapes Responses to Objects in Frontal and Ventral Stream Networks in Macaque Monkeys

The effect of emotional faces on reward-related probability learning in depressed patients

BACKGROUND

Existing research indicates that individuals with Major Depressive Disorder (MDD) exhibit a bias toward salient negative stimuli. However, the impact of such biased stimuli on concurrent cognitive and affective processes in individuals with depression remains inadequately understood. This study aimed to investigate the effects of salient environmental stimuli, specifically emotional faces, on reward-associated processes in MDD.

METHODS

Thirty-three patients with recurrent MDD and thirty-two healthy controls (HC) matched for age, sex, and education were included in the study. We used a reward-related associative learning (RRAL) task primed with emotional (happy, sad, neutral) faces to investigate the effect of salient stimuli on reward-related learning and decision-making in functional magnetic resonance imaging (fMRI). Participants were instructed to ignore emotional faces during the task. The fMRI data were analyzed using a full-factorial general linear model (GLM) in Statistical Parametric Mapping (SPM12).

RESULTS

In depressed patients, cues primed with sad faces were associated with reduced amygdala activation. However, both HC and MDD group exhibited reduced ventral striatal activity while learning reward-related cues and receiving rewards.

LIMITATIONS

The patients'medication usage was not standardized.

CONCLUSIONS

This study underscores the functional alteration of the amygdala in response to cognitive tasks presented with negative emotionally salient stimuli in the environment of MDD patients. The observed alterations in amygdala activity suggest potential interconnected effects with other regions of the prefrontal cortex. Understanding the intricate neural connections and their disruptions in depression is crucial for unraveling the complex pathophysiology of the disorder.

Preferences reveal dissociable encoding across prefrontal-limbic circuits

Individual preferences for the flavor of different foods and fluids exert a strong influence on behavior. Most current theories posit that preferences are integrated with other state variables in the orbitofrontal cortex (OFC), which is thought to derive the relative subjective value of available options to guide choice behavior. Here, we report that instead of a single integrated valuation system in the OFC, another complementary one is centered in the ventrolateral prefrontal cortex (vlPFC) in macaques. Specifically, we found that the OFC and vlPFC preferentially represent outcome flavor and outcome probability, respectively, and that preferences are separately integrated into value representations in these areas. In addition, the vlPFC, but not the OFC, represented the probability of receiving the available outcome flavors separately, with the difference between these representations reflecting the degree of preference for each flavor. Thus, both the vlPFC and OFC exhibit dissociable but complementary representations of subjective value, both of which are necessary for decision-making.

Gaze differences in configural and elemental evaluation during multi-attribute decision-making

Introduction

While many everyday choices are between multi-attribute options, how attribute values are integrated to allow such choices remains unclear. Recent findings suggest a distinction between elemental (attribute-by-attribute) and configural (holistic) evaluation of multi-attribute options, with different neural substrates. Here, we asked if there are behavioral or gaze pattern differences between these putatively distinct modes of multi-attribute decision-making.

Methods

Thirty-nine healthy men and women learned the monetary values of novel multi-attribute pseudo-objects (fribbles) and then made choices between pairs of these objects while eye movements were tracked. Value was associated with individual attributes in the elemental condition, and with unique combinations of attributes in the configural condition. Choice, reaction time, gaze fixation time on options and individual attributes, and within- and between-option gaze transitions were recorded.

Results

There were systematic behavioral differences between elemental and configural conditions. Elemental trials had longer reaction times and more between-option transitions, while configural trials had more within-option transitions. The effect of last fixation on choice was more pronounced in the configural condition.

Discussion

We observed differences in gaze patterns and the influence of last fixation location on choice in multi-attribute value-based choices depending on how value is associated with those attributes. This adds support for the claim that multi-attribute option values may emerge either elementally or holistically, reminiscent of similar distinctions in multi-attribute object recognition. This may be important to consider in neuroeconomics research that involve visually-presented complex objects.

Neural responses in macaque prefrontal cortex are linked to strategic exploration

Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.

The current status and trend of the functional magnetic resonance combined with stimulation in animals

As a non-radiative, non-invasive imaging technique, functional magnetic resonance imaging (fMRI) has excellent effects on studying the activation of blood oxygen levels and functional connectivity of the brain in human and animal models. Compared with resting-state fMRI, fMRI combined with stimulation could be used to assess the activation of specific brain regions and the connectivity of specific pathways and achieve better signal capture with a clear purpose and more significant results. Various fMRI methods and specific stimulation paradigms have been proposed to investigate brain activation in a specific state, such as electrical, mechanical, visual, olfactory, and direct brain stimulation. In this review, the studies on animal brain activation using fMRI combined with different stimulation methods were retrieved. The instruments, experimental parameters, anesthesia, and animal models in different stimulation conditions were summarized. The findings would provide a reference for studies on estimating specific brain activation using fMRI combined with stimulation.

Limited Pairings of Electrical Micro-stimulation of the Ventral Tegmental Area and a Visual Stimulus Enhance Visual Cortical Responses

Previous studies demonstrated that pairing a visual stimulus and electrical micro-stimulation of the ventral tegmental area (VTA-EM) for multiple days is sufficient to induce visual cortical plasticity and changes perception. However, a brief epoch of VTA-EM-stimulus pairing within a single day has been shown to result in a behavioral preference for the paired stimulus. Here, we investigated whether a brief single-day session of VTA-EM-stimulus pairings is sufficient to induce changes in visual cortical responses. We examined macaque posterior inferior temporal (PIT) cortex because previous studies demonstrated response changes after VTA-EM stimulus pairing in that area. Multi-unit recordings in PIT were interleaved with VTA-EM-stimulus pairing epochs. During the short VTA-EM-stimulus pairing epochs (60 pairings), one image (fractal) was paired with VTA-EM (STIM) whereas another, unpaired fractal was presented as control. Two other fractals (dummies) were presented only during the recordings. The difference in response between the STIM and control fractals already increased after the first VTA-EM-stimulus pairing epoch, reflecting a relative increase of the response to the STIM fractal. However, the response to the STIM fractal did not increase further with more VTA-EM-stimulus pairing epochs. The relative increase in firing rate for the paired fractal was present early in the response, in line with a local/ bottom-up origin. These effects were absent when comparing the responses to the dummies pre- and post-VTA-EM. This study shows that pairing a visual image and VTA-EM in a brief single-day session is sufficient to increase the response for the paired image in macaque PIT.

Face learning via brief real-world social interactions includes changes in face-selective brain areas and hippocampus

Making new acquaintances requires learning to recognise previously unfamiliar faces. In the current study, we investigated this process by staging real-world social interactions between actors and the participants. Participants completed a face-matching behavioural task in which they matched photographs of the actors (whom they had yet to meet), or faces similar to the actors (henceforth called foils). Participants were then scanned using functional magnetic resonance imaging (fMRI) while viewing photographs of actors and foils. Immediately after exiting the scanner, participants met the actors for the first time and interacted with them for 10 min. On subsequent days, participants completed a second behavioural experiment and then a second fMRI scan. Prior to each session, actors again interacted with the participants for 10 min. Behavioural results showed that social interactions improved performance accuracy when matching actor photographs, but not foil photographs. The fMRI analysis revealed a difference in the neural response to actor photographs and foil photographs across all regions of interest (ROIs) only after social interactions had occurred. Our results demonstrate that short social interactions were sufficient to learn and discriminate previously unfamiliar individuals. Moreover, these learning effects were present in brain areas involved in face processing and memory.

Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges

In the past decade, decision neuroscience and neuroeconomics have developed many new insights in the study of decision making. This review provides an overarching update on how the field has advanced in this time period. Although our initial review a decade ago outlined several theoretical, conceptual, methodological, empirical, and practical challenges, there has only been limited progress in resolving these challenges. We summarize significant trends in decision neuroscience through the lens of the challenges outlined for the field and review examples where the field has had significant, direct, and applicable impacts across economics and psychology. First, we review progress on topics including reward learning, explore-exploit decisions, risk and ambiguity, intertemporal choice, and valuation. Next, we assess the impacts of emotion, social rewards, and social context on decision making. Then, we follow up with how individual differences impact choices and new exciting developments in the prediction and neuroforecasting of future decisions. Finally, we consider how trends in decision-neuroscience research reflect progress toward resolving past challenges, discuss new and exciting applications of recent research, and identify new challenges for the field. This article is categorized under: Psychology > Reasoning and Decision Making Psychology > Emotion and Motivation.

Primate anterior insular cortex represents economic decision variables proposed by prospect theory

In humans, risk attitude is highly context-dependent, varying with wealth levels or for different potential outcomes, such as gains or losses. These behavioral effects have been modelled using prospect theory, with the key assumption that humans represent the value of each available option asymmetrically as a gain or loss relative to a reference point. It remains unknown how these computations are implemented at the neuronal level. Here we show that macaques, like humans, change their risk attitude across wealth levels and gain/loss contexts using a token gambling task. Neurons in the anterior insular cortex (AIC) encode the ‘reference point’ (i.e., the current wealth level of the monkey) and reflect ‘loss aversion’ (i.e., option value signals are more sensitive to change in the loss than in the gain context) as postulated by prospect theory. In addition, changes in the activity of a subgroup of AIC neurons correlate with the inter-trial fluctuations in choice and risk attitude. Taken together, we show that the primate AIC in risky decision-making may be involved in monitoring contextual information used to guide the animal’s willingness to accept risk.

Prospect theory predicts irrational effects in human decision-making, but relies on ad-hoc assumptions. Here, authors provide a neural basis for this by showing that anterior insular cortex encodes key economic variables proposed by prospect theory.

Prefrontal cortex interactions with the amygdala in primates

This review addresses functional interactions between the primate prefrontal cortex (PFC) and the amygdala, with emphasis on their contributions to behavior and cognition. The interplay between these two telencephalic structures contributes to adaptive behavior and to the evolutionary success of all primate species. In our species, dysfunction in this circuitry creates vulnerabilities to psychopathologies. Here, we describe amygdala-PFC contributions to behaviors that have direct relevance to Darwinian fitness: learned approach and avoidance, foraging, predator defense, and social signaling, which have in common the need for flexibility and sensitivity to specific and rapidly changing contexts. Examples include the prediction of positive outcomes, such as food availability, food desirability, and various social rewards, or of negative outcomes, such as threats of harm from predators or conspecifics. To promote fitness optimally, these stimulus-outcome associations need to be rapidly updated when an associative contingency changes or when the value of a predicted outcome changes. We review evidence from nonhuman primates implicating the PFC, the amygdala, and their functional interactions in these processes, with links to experimental work and clinical findings in humans where possible.

Ultrasound modulation of macaque prefrontal cortex selectively alters credit assignment-related activity and behavior

Credit assignment is the association of specific instances of reward to the specific events, such as a particular choice, that caused them. Without credit assignment, choice values reflect an approximate estimate of how good the environment was when the choice was made—the global reward state—rather than exactly which outcome the choice caused. Combined transcranial ultrasound stimulation (TUS) and functional magnetic resonance imaging in macaques demonstrate credit assignment–related activity in prefrontal area 47/12o, and when this signal was disrupted with TUS, choice value representations across the brain were impaired. As a consequence, behavior was no longer guided by choice value, and decision-making was poorer. By contrast, global reward state–related activity in the adjacent anterior insula remained intact and determined decision-making after prefrontal disruption.

A Preferential Role for Ventromedial Prefrontal Cortex in Assessing "the Value of the Whole" in Multiattribute Object Evaluation

Everyday decision-making commonly involves assigning values to complex objects with multiple value-relevant attributes. Drawing on object recognition theories, we hypothesized two routes to multiattribute evaluation: assessing the value of the whole object based on holistic attribute configuration or summing individual attribute values. In two samples of healthy human male and female participants undergoing eye tracking and functional magnetic resonance imaging (fMRI) while evaluating novel pseudo objects, we found evidence for both forms of evaluation. Fixations to and transitions between attributes differed systematically when the value of pseudo objects was associated with individual attributes or attribute configurations. Ventromedial prefrontal cortex (vmPFC) and perirhinal cortex were engaged when configural processing was required. These results converge with our recent findings that individuals with vmPFC lesions were impaired in decisions requiring configural evaluation but not when evaluating the sum of the parts. This suggests that multiattribute decision-making engages distinct evaluation mechanisms relying on partially dissociable neural substrates, depending on the relationship between attributes and value.SIGNIFICANCE STATEMENT Decision neuroscience has only recently begun to address how multiple choice-relevant attributes are brought together during evaluation and choice among complex options. Object recognition research makes a crucial distinction between individual attribute and holistic/configural object processing, but how the brain evaluates attributes and whole objects remains unclear. Using fMRI and eye tracking, we found that the vmPFC and the perirhinal cortex contribute to value estimation specifically when value was related to whole objects, that is, predicted by the unique configuration of attributes and not when value was predicted by the sum of individual attribute values. This perspective on the interactions between subjective value and object processing mechanisms provides a novel bridge between the study of object recognition and reward-guided decision-making.

Neural responsivity to social rewards in autistic female youth

Autism is hypothesized to be in part driven by a reduced sensitivity to the inherently rewarding nature of social stimuli. Previous neuroimaging studies have indicated that autistic males do indeed display reduced neural activity to social rewards, but it is unknown whether this finding extends to autistic females, particularly as behavioral evidence suggests that affected females may not exhibit the same reduction in social motivation as their male peers. We therefore used functional magnetic resonance imaging to examine social reward processing during an instrumental implicit learning task in 154 children and adolescents (ages 8-17): 39 autistic girls, 43 autistic boys, 33 typically developing girls, and 39 typically developing boys. We found that autistic girls displayed increased activity to socially rewarding stimuli, including greater activity in the nucleus accumbens relative to autistic boys, as well as greater activity in lateral frontal cortices and the anterior insula compared with typically developing girls. These results demonstrate for the first time that autistic girls do not exhibit the same reduction in activity within social reward systems as autistic boys. Instead, autistic girls display increased neural activation to such stimuli in areas related to reward processing and salience detection. Our findings indicate that a reduced sensitivity to social rewards, as assessed with a rewarded instrumental implicit learning task, does not generalize to affected female youth and highlight the importance of studying potential sex differences in autism to improve our understanding of the condition and its heterogeneity.

Rapid event-related, BOLD fMRI, non-human primates (NHP): choose two out of three

Human functional magnetic resonance imaging (fMRI) typically employs the blood-oxygen-level-dependent (BOLD) contrast mechanism. In non-human primates (NHP), contrast enhancement is possible using monocrystalline iron-oxide nanoparticles (MION) contrast agent, which has a more temporally extended response function. However, using BOLD fMRI in NHP is desirable for interspecies comparison, and the BOLD signal’s faster response function promises to be beneficial for rapid event-related (rER) designs. Here, we used rER BOLD fMRI in macaque monkeys while viewing real-world images, and found visual responses and category selectivity consistent with previous studies. However, activity estimates were very noisy, suggesting that the lower contrast-to-noise ratio of BOLD, suboptimal behavioural performance, and motion artefacts, in combination, render rER BOLD fMRI challenging in NHP. Previous studies have shown that rER fMRI is possible in macaques with MION, despite MION’s prolonged response function. To understand this, we conducted simulations of the BOLD and MION response during rER, and found that no matter how fast the design, the greater amplitude of the MION response outweighs the contrast loss caused by greater temporal smoothing. We conclude that although any two of the three elements (rER, BOLD, NHP) have been shown to work well, the combination of all three is particularly challenging.

Learning in Visual Regions as Support for the Bias in Future Value-Driven Choice

Reinforcement learning can bias decision-making toward the option with the highest expected outcome. Cognitive learning theories associate this bias with the constant tracking of stimulus values and the evaluation of choice outcomes in the striatum and prefrontal cortex. Decisions however first require processing of sensory input, and to date, we know far less about the interplay between learning and perception. This functional magnetic resonance imaging study (N = 43) relates visual blood oxygen level-dependent (BOLD) responses to value beliefs during choice and signed prediction errors after outcomes. To understand these relationships, which co-occurred in the striatum, we sought relevance by evaluating the prediction of future value-based decisions in a separate transfer phase where learning was already established. We decoded choice outcomes with a 70% accuracy with a supervised machine learning algorithm that was given trial-by-trial BOLD from visual regions alongside more traditional motor, prefrontal, and striatal regions. Importantly, this decoding of future value-driven choice outcomes again highlighted an important role for visual activity. These results raise the intriguing possibility that the tracking of value in visual cortex is supportive for the striatal bias toward the more valued option in future choice.

Altered neural activity to monetary reward/loss processing in episodic migraine

The dysfunctions of the mesolimbic cortical reward circuit have been proposed to contribute to migraine pain. Although supporting empirical evidence was mainly found in connection with primary rewards or in chronic migraine where the pain experience is (almost) constant. Our goal however was to investigate the neural correlates of secondary reward/loss anticipation and consumption using the monetary incentive delay task in 29 episodic migraine patients and 41 headache-free controls. Migraine patients showed decreased activation in one cluster covering the right inferior frontal gyrus during reward consumption compared to controls. We also found significant negative correlation between the time of the last migraine attack before the scan and activation of the parahippocampal gyrus and the right hippocampus yielded to loss anticipation. During reward/loss consumption, a relative increase in the activity of the visual areas was observed the more time passed between the last attack and the scan session. Our results suggest intact reward/loss anticipation but altered reward consumption in migraine, indicating a decreased reactivity to monetary rewards. The findings also raise the possibility that neural responses to loss anticipation and reward/loss consumption could be altered by the proximity of the last migraine attack not just during pre-ictal periods, but interictally as well.

Visual stimulus-driven functional organization of macaque prefrontal cortex

The extent to which the major subdivisions of prefrontal cortex (PFC) can be functionally partitioned is unclear. In approaching the question, it is often assumed that the organization is task dependent. Here we use fMRI to show that PFC can respond in a task-independent way, and we leverage these responses to uncover a stimulus-driven functional organization. The results were generated by mapping the relative location of responses to faces, bodies, scenes, disparity, color, and eccentricity in four passively fixating macaques. The results control for individual differences in functional architecture and provide the first account of a systematic visual stimulus-driven functional organization across PFC. Responses were focused in dorsolateral PFC (DLPFC), in the ventral prearcuate region; and in ventrolateral PFC (VLPFC), extending into orbital PFC. Face patches were in the VLPFC focus and were characterized by a striking lack of response to non-face stimuli rather than an especially strong response to faces. Color-biased regions were near but distinct from face patches. One scene-biased region was consistently localized with different contrasts and overlapped the disparity-biased region to define the DLPFC focus. All visually responsive regions showed a peripheral visual-field bias. These results uncover an organizational scheme that presumably constrains the flow of information about different visual modalities into PFC.

Gustatory responses in macaque monkeys revealed with fMRI: Comments on taste, taste preference, and internal state

Studies of the neural mechanisms underlying value-based decision making typically employ food or fluid rewards to motivate subjects to perform cognitive tasks. Rewards are often treated as interchangeable, but it is well known that the specific tastes of foods and fluids and the values associated with their taste sensations influence choices and contribute to overall levels of food consumption. Accordingly, we characterized the gustatory system in three macaque monkeys (Macaca mulatta) and examined whether gustatory responses were modulated by preferences and hydration status. To identify taste-responsive cortex, we delivered small quantities (0.1 ml) of sucrose (sweet), citric acid (sour), or distilled water in random order without any predictive cues while scanning monkeys using event-related fMRI. Neural effects were evaluated by using each session in each monkey as a data point in a second-level analysis. By contrasting BOLD responses to sweet and sour tastes with those from distilled water in a group level analysis, we identified taste responses in primary gustatory cortex area G, an adjacent portion of the anterior insular cortex, and prefrontal cortex area 12o. Choice tests administered outside the scanner revealed that all three monkeys strongly preferred sucrose to citric acid or water. BOLD responses in the ventral striatum, ventral pallidum, and amygdala reflected monkeys' preferences, with greater BOLD responses to sucrose than citric acid. Finally, we examined the influence of hydration level by contrasting BOLD responses to receipt of fluids when monkeys were thirsty and after ad libitum water consumption. BOLD responses in area G and area 12o in the left hemisphere were greater following full hydration. By contrast, BOLD responses in portions of medial frontal cortex were reduced after ad libitum water consumption. These findings highlight brain regions involved in representing taste, taste preference and internal state.

First-Pass Processing of Value Cues in the Ventral Visual Pathway

Real-world value often depends on subtle, continuously variable visual cues specific to particular object categories, like the tailoring of a suit, the condition of an automobile, or the construction of a house. Here, we used microelectrode recording in behaving monkeys to test two possible mechanisms for category-specific value-cue processing: (1) previous findings suggest that prefrontal cortex (PFC) identifies object categories, and based on category identity, PFC could use top-down attentional modulation to enhance visual processing of category-specific value cues, providing signals to PFC for calculating value, and (2) a faster mechanism would be first-pass visual processing of category-specific value cues, immediately providing the necessary visual information to PFC. This, however, would require learned mechanisms for processing the appropriate cues in a given object category. To test these hypotheses, we trained monkeys to discriminate value in four letter-like stimulus categories. Each category had a different, continuously variable shape cue that signified value (liquid reward amount) as well as other cues that were irrelevant. Monkeys chose between stimuli of different reward values. Consistent with the first-pass hypothesis, we found early signals for category-specific value cues in area TE (the final stage in monkey ventral visual pathway) beginning 81 ms after stimulus onset-essentially at the start of TE responses. Task-related activity emerged in lateral PFC approximately 40 ms later and consisted mainly of category-invariant value tuning. Our results show that, for familiar, behaviorally relevant object categories, high-level ventral pathway cortex can implement rapid, first-pass processing of category-specific value cues.

Temporal-prefrontal cortical network for discrimination of valuable objects in long-term memory

Remembering and discriminating objects based on their previously learned values are essential for goal-directed behaviors. While the cerebral cortex is known to contribute to object recognition, surprisingly little is known about its role in retaining long-term object-value associations. To address this question, we trained macaques to arbitrarily associate small or large rewards with many random fractal objects (>100) and then used fMRI to study the long-term retention of value-based response selectivity across the brain. We found a pronounced long-term value memory in core subregions of temporal and prefrontal cortex where, several months after training, fractals previously associated with high reward ("good" stimuli) elicited elevated fMRI responses compared with those associated with low reward ("bad" stimuli). Similar long-term value-based modulation was also observed in subregions of the striatum, amygdala, and claustrum, but not in the hippocampus. The value-modulated temporal-prefrontal subregions showed strong resting-state functional connectivity to each other. Moreover, for areas outside this core, the magnitude of long-term value responses was predicted by the strength of resting-state functional connectivity to the core subregions. In separate testing, free-viewing gaze behavior indicated that the monkeys retained stable long-term memory of object value. These results suggest an implicit and high-capacity memory mechanism in the temporal-prefrontal circuitry and its associated subcortical regions for long-term retention of object-value memories that can guide value-oriented behavior.

Differences in reward processing between putative cell types in primate prefrontal cortex

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli.

Inverted activity patterns in ventromedial prefrontal cortex during value-guided decision-making in a less-is-more task

Ventromedial prefrontal cortex has been linked to choice evaluation and decision-making in humans but understanding the role it plays is complicated by the fact that little is known about the corresponding area of the macaque brain. We recorded activity in macaques using functional magnetic resonance imaging during two very different value-guided decision-making tasks. In both cases ventromedial prefrontal cortex activity reflected subjective choice values during decision-making just as in humans but the relationship between the blood oxygen level-dependent signal and both decision-making and choice value was inverted and opposite to the relationship seen in humans. In order to test whether the ventromedial prefrontal cortex activity related to choice values is important for decision-making we conducted an additional lesion experiment; lesions that included the same ventromedial prefrontal cortex region disrupted normal subjective evaluation of choices during decision-making.

Ventromedial prefrontal cortex in humans shows functional magnetic resonance imaging signals related to the subjective values of choices that are taken during decision-making as well as task-negative signals. Here, the authors report that in macaque ventromedial prefrontal cortex both activity patterns are inverted and lesions of this area disrupt subjective choice evaluation.

Flexible and Stable Value Coding Areas in Caudate Head and Tail Receive Anatomically Distinct Cortical and Subcortical Inputs

Anatomically distinct areas within the basal ganglia encode flexible- and stable-value memories for visual objects (Hikosaka et al., 2014), but an important question remains: do they receive inputs from the same or different brain areas or neurons? To answer this question, we first located flexible and stable value-coding areas in the caudate head (CDh) and caudate tail (CDt) of two rhesus macaque monkeys, and then injected different retrograde tracers into these areas of each monkey. We found that CDh and CDt received different inputs from several cortical and subcortical areas including temporal cortex, prefrontal cortex, cingulate cortex, amygdala, claustrum and thalamus. Superior temporal cortex and inferior temporal cortex projected to both CDh and CDt, with more CDt-projecting than CDh-projecting neurons. In superior temporal cortex and dorsal inferior temporal cortex, layers 3 and 5 projected to CDh while layers 3 and 6 projected to CDt. Prefrontal and cingulate cortex projected mostly to CDh bilaterally, less to CDt unilaterally. A cluster of neurons in the basolateral amygdala projected to CDt. Rostral-dorsal claustrum projected to CDh while caudal-ventral claustrum projected to CDt. Within the thalamus, different nuclei projected to either CDh or CDt. The medial centromedian nucleus and lateral parafascicular nucleus projected to CDt while the medial parafascicular nucleus projected to CDh. The inferior pulvinar and lateral dorsal nuclei projected to CDt. The ventral anterior and medial dorsal nuclei projected to CDh. We found little evidence of neurons projecting to both CDh and CDt across the brain. These data suggest that CDh and CDt can control separate functions using anatomically separate circuits. Understanding the roles of these striatal projections will be important for understanding how value memories are created and stored.

Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes

Advantageous foraging choices benefit from an estimation of two aspects of a resource's value: its current desirability and availability. Both orbitofrontal and ventrolateral prefrontal areas contribute to updating these valuations, but their precise roles remain unclear. To explore their specializations, we trained macaque monkeys on two tasks: one required updating representations of a predicted outcome's desirability, as adjusted by selective satiation, and the other required updating representations of an outcome's availability, as indexed by its probability. We evaluated performance on both tasks in three groups of monkeys: unoperated controls and those with selective, fiber-sparing lesions of either the OFC or VLPFC. Representations that depend on the VLPFC but not the OFC play a necessary role in choices based on outcome availability; in contrast, representations that depend on the OFC but not the VLPFC play a necessary role in choices based on outcome desirability.

Trait Rumination Influences Neural Correlates of the Anticipation but Not the Consumption Phase of Reward Processing

Cumulative evidence suggests that trait rumination can be defined as an abstract information processing mode, which leads people to constantly anticipate the likely impact of present events on future events and experiences. A previous study with remitted depressed patients suggested that enhanced rumination tendencies distort brain mechanisms of anticipatory processes associated with reward and loss cues. In the present study, we explored the impact of trait rumination on neural activity during reward and loss anticipation among never-depressed people. We analyzed the data of 37 healthy controls, who performed the monetary incentive delay (MID) task which was designed for the simultaneous measurement of the anticipation (motivational) and consumption (hedonic) phase of reward processing, during functional magnetic resonance imaging (fMRI). Our results show that rumination—after controlling for age, gender, and current mood—significantly influenced neural responses to reward (win) cues compared to loss cues. Blood-oxygenation-level-dependent (BOLD) activity in the left inferior frontal gyrus (IFG) triangularis, left anterior insula, and left rolandic operculum was positively related to Ruminative Response Scale (RRS) scores. We did not detect any significant rumination-related activations associated with win-neutral or loss-neutral cues and with reward or loss consumption. Our results highlight the influence of trait rumination on reward anticipation in a non-depressed sample. They also suggest that for never-depressed ruminators rewarding cues are more salient than loss cues. BOLD response during reward consumption did not relate to rumination, suggesting that rumination mainly relates to processing of the motivational (wanting) aspect of reward rather than the hedonic (liking) aspect, at least in the absence of pathological mood.