FMRI visualization of brain activity during a monetary incentive delay task

Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study

Responses to monetary reward in humans have been assessed in a number of recent functional imaging studies, and it is clear that the neuronal substrates of financial reinforcement overlap extensively with regions responding to primary reinforcers, such as food. Money has the practical advantage of being an objectively quantifiable reinforcer. In this study, we exploit this advantage using a parametric functional magnetic resonance imaging design to look at the patterns of responding to systematically varying reward values. Twelve healthy volunteers were scanned during performance of a rewarded target detection task, in which the reward value varied between task blocks. We observed three distinct patterns of responding in different regions. Amygdala, striatum, and dopaminergic midbrain responded to the presence of rewards, regardless of value. In contrast, premotor cortex showed a linear increase in response with increasing reward value. Finally, medial and lateral foci of orbitofrontal cortex responded nonlinearly, such that response was enhanced for the lowest and highest reward values relative to the midrange. These results suggest functional distinction in response patterns within a distributed reward system.

The Multi-Source Interference Task: validation study with fMRI in individual subjects

Dorsal anterior cingulate cortex (dACC) plays critical roles in cognitive processing, but group-averaging techniques have generally been required to obtain significant dACC activation in functional neuroimaging studies. Development of a task that reliably and robustly activates dACC within individuals is needed to improve imaging studies of neuropsychiatric disorders and localization of dACC in normal volunteers. By combining sources of cognitive interference (Stroop, Eriksen and Simon) with factors known to increase dACC activity, the Multi-Source Interference Task (MSIT) maximally taxes dACC, making it possible to reliably activate dACC within individuals using functional magnetic resonance imaging (fMRI). In this study, eight normal adult volunteers performed the MSIT during fMRI. We compared fMRI responses and performance data between interference and control trials. Significant dACC activation (P < 1.7 x 10(-4)) was observed in all eight individuals and in the group-averaged fMRI data. In addition to dACC activation, group data also showed activation of presumably networked regions including dorsolateral prefrontal, premotor, and parietal cortices. The MSIT's reaction time interference effect (overall mean 312 +/- 61 ms) was up to 10 times greater than that of its component predecessors and temporally stable over hundreds of trials. The robustness, reliability and stability of the neuroimaging and performance data should make the MSIT a useful task with which to study normal human cognition and psychiatric pathophysiology.

Neural economics and the biological substrates of valuation

A recent flurry of neuroimaging and decision-making experiments in humans, when combined with single-unit data from orbitofrontal cortex, suggests major additions to current models of reward processing. We review these data and models and use them to develop a specific computational relationship between the value of a predictor and the future rewards or punishments that it promises. The resulting computational model, the predictor-valuation model (PVM), is shown to anticipate a class of single-unit neural responses in orbitofrontal and striatal neurons. The model also suggests how neural responses in the orbitofrontal-striatal circuit may support the conversion of disparate types of future rewards into a kind of internal currency, that is, a common scale used to compare the valuation of future behavioral acts or stimuli.

Contributions of the prefrontal cortex to the neural basis of human decision making

The neural basis of decision making has been an elusive concept largely due to the many subprocesses associated with it. Recent efforts involving neuroimaging, neuropsychological studies, and animal work indicate that the prefrontal cortex plays a central role in several of these subprocesses. The frontal lobes are involved in tasks ranging from making binary choices to making multi-attribute decisions that require explicit deliberation and integration of diverse sources of information. In categorizing different aspects of decision making, a division of the prefrontal cortex into three primary regions is proposed. (1) The orbitofrontal and ventromedial areas are most relevant to deciding based on reward values and contribute affective information regarding decision attributes and options. (2) Dorsolateral prefrontal cortex is critical in making decisions that call for the consideration of multiple sources of information, and may recruit separable areas when making well defined versus poorly defined decisions. (3) The anterior and ventral cingulate cortex appear especially relevant in sorting among conflicting options, as well as signaling outcome-relevant information. This topic is broadly relevant to cognitive neuroscience as a discipline, as it generally comprises several aspects of cognition and may involve numerous brain regions depending on the situation. The review concludes with a summary of how these regions may interact in deciding and possible future research directions for the field.

Brain activation during facial emotion processing

Functional neuroimaging studies have helped identify neural systems involved in cognitive processing and more recently have indicated limbic activation to emotional stimuli. Some functional magnetic resonance imaging (fMRI) studies have reported increased amygdala response during exposure to emotional stimuli while others have not shown such activation. The present study was designed to test the hypothesis that activation of the amygdala is related to the relevance of the emotional valence of stimuli. Healthy young participants (7 men, 7 women) were studied in a high-field (4 tesla) scanner using blood oxygenation-level dependent (BOLD) signal changes in a blocked "box car" design. They viewed facial displays of happiness, sadness, anger, fear, and disgust as well as neutral faces obtained from professional actors and actresses of diverse ethnicity and age. Their task alternated between emotion discrimination (indicating whether the emotion was positive or negative) and age discrimination (indicating whether the poser was older or younger than 30). Blocks contained the same proportion of emotional and neutral faces. Limbic response was greater during the emotion than during the age discrimination conditions. The response was most pronounced in the amygdala, but was also present in the hippocampus and circumscribed voxels in other limbic regions. These results support the central role of the amygdala in emotion processing, and indicate its sensitivity to the task relevance of the emotional display.

The neural system that bridges reward and cognition in humans: an fMRI study

We test the hypothesis that motivational and cognitive processes are linked by a specific neural system to reach maximal efficiency. We studied six normal subjects performing a working memory paradigm (n-back tasks) associated with different levels of monetary reward during an fMRI session. The study showed specific brain activation in relation with changes in both the cognitive loading and the reward associated with task performance. First, the working memory tasks activated a network including the dorsolateral prefrontal cortex [Brodmann area (BA) 9/46] and, in addition, in the lateral frontopolar areas (BA 10), but only in the more demanding condition (3-back task). This result suggests that lateral prefrontal areas are organized in a caudo-rostral continuum in relation with the increase in executive requirement. Second, reward induces an increased activation in the areas already activated by working memory processing and in a supplementary region, the medial frontal pole (BA 10), regardless of the level of cognitive processing. It is postulated that the latter region plays a specific role in monitoring the reward value of ongoing cognitive processes. Third, we detected areas where the signal decreases (ventral-BA 11/47 and subgenual prefrontal cortices) in relation with both the increase of cognitive demand and the reward. The deactivation may represent an emotional gating aimed at inhibiting adverse emotional signals to maximize the level of performance. Taken together, these results suggest a balance between increasing activity in cortical cognitive areas and decreasing activity in the limbic and paralimbic structures during ongoing higher cognitive processing.

The medial frontal cortex and the rapid processing of monetary gains and losses

We report the observation of neural processing that occurs within 265 milliseconds after outcome stimuli that inform human participants about gains and losses in a gambling task. A negative-polarity event-related brain potential, probably generated by a medial-frontal region in or near the anterior cingulate cortex, was greater in amplitude when a participant's choice between two alternatives resulted in a loss than when it resulted in a gain. The sensitivity to losses was not simply a reflection of detecting an error; gains did not elicit the medial-frontal activity when the alternative choice would have yielded a greater gain, and losses elicited the activity even when the alternative choice would have yielded a greater loss. Choices made after losses were riskier and were associated with greater loss-related activity than choices made after gains. It follows that medial-frontal computations may contribute to mental states that participate in higher level decisions, including economic choices.

The role of the amygdala in signaling prospective outcome of choice

Can brain activity reveal a covert choice? Making a choice often evokes distinct emotions that accompany decision processes. Amygdala has been implicated in choice behavior that is guided by a prospective negative outcome. However, its specific involvement in emotional versus cognitive processing of choice behavior has been a subject of controversy. In this study, the human amygdala was monitored by functional magnetic resonance imaging (fMRI) while subjects were playing in a naturalistic choice paradigm against the experimenter. In order to win, players had to occasionally choose to bluff their opponent, risk "getting caught," and suffer a loss. A critical period, when choice has been made but outcome was still unknown, activated the amygdala preferentially following the choice that entailed risk of loss. Thus, the response of the amygdala differentiated between subject's covert choice of either playing fair or foul. These results support a role of the amygdala in choice behavior, both in the appraisal of inherent value of choice and the signaling of prospective negative outcomes.

Neural responses during anticipation of a primary taste reward

The aim of this study was to determine the brain regions involved in anticipation of a primary taste reward and to compare these regions to those responding to the receipt of a taste reward. Using fMRI, we scanned human subjects who were presented with visual cues that signaled subsequent reinforcement with a pleasant sweet taste (1 M glucose), a moderately unpleasant salt taste (0.2 M saline), or a neutral taste. Expectation of a pleasant taste produced activation in dopaminergic midbrain, posterior dorsal amygdala, striatum, and orbitofrontal cortex (OFC). Apart from OFC, these regions were not activated by reward receipt. The findings indicate that when rewards are predictable, brain regions recruited during expectation are, in part, dissociable from areas responding to reward receipt.

Decreased gray matter concentration in the insular, orbitofrontal, cingulate, and temporal cortices of cocaine patients

BACKGROUND

Structural deficiencies within limbic and prefrontal regions may contribute to the characteristic drug-seeking and drug-taking behaviors that prevail in persons dependent on cocaine. To date, a focal structural analysis of the brains of cocaine patients has not been undertaken.

METHODS

We used voxel based morphometry in conjunction with statistical parametric mapping on the structural magnetic resonance images of cocaine-dependent (n = 13) and cocaine-naive individuals (n = 16) to assess differences between the two groups in gray and white matter concentration.

RESULTS

We report a decrease in gray matter concentration in the ventromedial orbitofrontal, anterior cingulate, anteroventral insular, and superior temporal cortices of cocaine patients in comparison to controls (p <.01 corrected for multiple comparisons). The average percentage decrease in gray matter concentration within a region ranged from 5% to 11%. White matter concentration did not differ between groups.

CONCLUSIONS

We conclude that the brains of cocaine patients are structurally dissimilar from those of nondrug-using controls. The differences were detected in regions involved in decision-making, behavioral inhibition and assignation of emotional valence to environmental stimuli and, hence, may contribute to some of the behavioral deficits characteristic of chronic cocaine users.

Dorsal anterior cingulate cortex: a role in reward-based decision making

Dorsal anterior cingulate cortex (dACC) is a brain region that subserves cognition and motor control, but the mechanisms of these functions remain unknown. Human neuroimaging and monkey electrophysiology studies have provided valuable insights, but it has been difficult to link the two literatures. Based on monkey single-unit recordings, we hypothesized that human dACC is comprised of a mixture of functionally distinct cells that variously anticipate and detect targets, indicate novelty, influence motor responses, encode reward values, and signal errors. As an initial test of this conceptualization, the current event-related functional MRI study used a reward-based decision-making task to isolate responses from a subpopulation of dACC cells sensitive to reward reduction. As predicted, seven of eight subjects showed significant (P < 10(-4)) dACC activation when contrasting reduced reward (REDrew) trials to fixation (FIX). Confirmatory group analyses then corroborated the predicted ordinal relationships of functional MRI activation expected during each trial type (REDrew > SWITCH > CONrew > or = FIX). The data support a role for dACC in reward-based decision making, and by linking the human and monkey literatures, provide initial support for the existence of heterogeneity within dACC. These findings should be of interest to those studying reward, cognition, emotion, motivation, and motor control.

Dorsal anterior cingulate cortex: a role in reward-based decision making

Dorsal anterior cingulate cortex (dACC) is a brain region that subserves cognition and motor control, but the mechanisms of these functions remain unknown. Human neuroimaging and monkey electrophysiology studies have provided valuable insights, but it has been difficult to link the two literatures. Based on monkey single-unit recordings, we hypothesized that human dACC is comprised of a mixture of functionally distinct cells that variously anticipate and detect targets, indicate novelty, influence motor responses, encode reward values, and signal errors. As an initial test of this conceptualization, the current event-related functional MRI study used a reward-based decision-making task to isolate responses from a subpopulation of dACC cells sensitive to reward reduction. As predicted, seven of eight subjects showed significant (P < 10(-4)) dACC activation when contrasting reduced reward (REDrew) trials to fixation (FIX). Confirmatory group analyses then corroborated the predicted ordinal relationships of functional MRI activation expected during each trial type (REDrew > SWITCH > CONrew > or = FIX). The data support a role for dACC in reward-based decision making, and by linking the human and monkey literatures, provide initial support for the existence of heterogeneity within dACC. These findings should be of interest to those studying reward, cognition, emotion, motivation, and motor control.

Reward circuitry activation by noxious thermal stimuli

Using functional magnetic resonance imaging (fMRI), we observed that noxious thermal stimuli (46 degrees C) produce significant signal change in putative reward circuitry as well as in classic pain circuitry. Increases in signal were observed in the sublenticular extended amygdala of the basal forebrain (SLEA) and the ventral tegmentum/periaqueductal gray (VT/PAG), while foci of increased signal and decreased signal were observed in the ventral striatum and nucleus accumbens (NAc). Early and late phases were observed for signals in most brain regions, with early activation in reward related regions such as the SLEA, VT/PAG, and ventral striatum. In contrast, structures associated with somatosensory perception, including SI somatosensory cortex, thalamus, and insula, showed delayed activation. These data support the notion that there may be a shared neural system for evaluation of aversive and rewarding stimuli.

Dissociation of reward anticipation and outcome with event-related fMRI

Reward processing involves both appetitive and consummatory phases. We sought to examine whether reward anticipation vs outcomes would recruit different regions of ventral forebrain circuitry using event-related fMRI. Nine healthy volunteers participated in a monetary incentive delays task in which they either responded to a cued target for monetary reward, responded to a cued target for no reward, or did not respond to a cued target during scanning. Multiple regression analyses indicated that while anticipation of reward vs non-reward activated foci in the ventral striatum, reward vs non-reward outcomes activated foci in the ventromedial frontal cortex. These findings suggest that reward anticipation and outcomes may differentially recruit distinct regions that lie along the trajectory of ascending dopamine projections.

Beautiful faces have variable reward value: fMRI and behavioral evidence

The brain circuitry processing rewarding and aversive stimuli is hypothesized to be at the core of motivated behavior. In this study, discrete categories of beautiful faces are shown to have differing reward values and to differentially activate reward circuitry in human subjects. In particular, young heterosexual males rate pictures of beautiful males and females as attractive, but exert effort via a keypress procedure only to view pictures of attractive females. Functional magnetic resonance imaging at 3 T shows that passive viewing of beautiful female faces activates reward circuitry, in particular the nucleus accumbens. An extended set of subcortical and paralimbic reward regions also appear to follow aspects of the keypress rather than the rating procedures, suggesting that reward circuitry function does not include aesthetic assessment.

Predictability modulates human brain response to reward

Certain classes of stimuli, such as food and drugs, are highly effective in activating reward regions. We show in humans that activity in these regions can be modulated by the predictability of the sequenced delivery of two mildly pleasurable stimuli, orally delivered fruit juice and water. Using functional magnetic resonance imaging, the activity for rewarding stimuli in both the nucleus accumbens and medial orbitofrontal cortex was greatest when the stimuli were unpredictable. Moreover, the subjects' stated preference for either juice or water was not directly correlated with activity in reward regions but instead was correlated with activity in sensorimotor cortex. For pleasurable stimuli, these findings suggest that predictability modulates the response of human reward regions, and subjective preference can be dissociated from this response.

Functional imaging of neural responses to expectancy and experience of monetary gains and losses

Neural responses accompanying anticipation and experience of monetary gains and losses were monitored by functional magnetic resonance imaging. Trials comprised an initial "prospect" (expectancy) phase, when a set of three monetary amounts was displayed, and a subsequent "outcome" phase, when one of these amounts was awarded. Hemodynamic responses in the sublenticular extended amygdala (SLEA) and orbital gyrus tracked the expected values of the prospects, and responses to the highest value set of outcomes increased monotonically with monetary value in the nucleus accumbens, SLEA, and hypothalamus. Responses to prospects and outcomes were generally, but not always, seen in the same regions. The overlap of the observed activations with those seen previously in response to tactile stimuli, gustatory stimuli, and euphoria-inducing drugs is consistent with a contribution of common circuitry to the processing of diverse rewards.