The hippocampus, ventromedial prefrontal cortex, and episodic and semantic memory

The human ventromedial prefrontal cortex (vmPFC)/anterior cingulate cortex is implicated in reward and emotion, but also in memory. It is shown how the human orbitofrontal cortex connecting with the vmPFC and anterior cingulate cortex provide a route to the hippocampus for reward and emotional value to be incorporated into episodic memory, enabling memory of where a reward was seen. It is proposed that this value component results in primarily episodic memories with some value component to be repeatedly recalled from the hippocampus so that they are more likely to become incorporated into neocortical semantic and autobiographical memories. The same orbitofrontal and anterior cingulate regions also connect in humans to the septal and basal forebrain cholinergic nuclei, thereby helping to consolidate memory, and helping to account for why damage to the vMPFC impairs memory. The human hippocampus and vmPFC thus contribute in complementary ways to forming episodic and semantic memories.

Selective Devaluation Affects the Processing of Preferred Rewards

The present study investigated whether the representation of subjective preferences in the event-related potential is manipulable through selective devaluation, i.e., the consumption of a specific food item until satiety. Thirty-four participants completed a gambling task in which they chose between virtual doors to find one of three snack items, representing a high, medium, or low preference outcome as defined by individual desire-to-eat ratings. In one of two test sessions, they underwent selective devaluation of the high preference outcome. In the other, they completed the task on an empty stomach. Consistent with previous findings, averaged across sessions, amplitudes were increased for more preferred rewards in the time windows of P2, late FRN, and P300. As hypothesised, we also found a selective devaluation effect for the high preference outcome in the P300 time window, reflected in a decrease in amplitude. The present results provide evidence for modulations of reward processing not only by individual factors, such as subjective preferences, but also by the current motivational state. Importantly, the present data suggest that selective devaluation effects in the P300 may be a promising tool to further characterise altered valuation of food rewards in the context of eating disorders and obesity.

Examining the value of body gestures in social reward contexts

Brain regions associated with the processing of tangible rewards (such as money, food, or sex) are also involved in anticipating social rewards and avoiding social punishment. To date, studies investigating the neural underpinnings of social reward have presented feedback via static or dynamic displays of faces to participants. However, research demonstrates that participants find another type of social stimulus, namely, biological motion, rewarding as well, and exert effort to engage with this type of stimulus. Here we examine whether feedback presented via body gestures in the absence of facial cues also acts as a rewarding stimulus and recruits reward-related brain regions. To achieve this, we investigated the neural underpinnings of anticipating social reward and avoiding social disapproval presented via gestures alone, using a social incentive delay task. As predicted, the anticipation of social reward and avoidance of social disapproval engaged reward-related brain regions, including the nucleus accumbens, in a manner similar to previous studies' reports of feedback presented via faces and money. This study provides the first evidence that human body motion alone engages brain regions associated with reward processing in a similar manner to other social (i.e. faces) and non-social (i.e. money) rewards. The findings advance our understanding of social motivation in human perception and behavior.

Subjective reward value of visual sexual stimuli is coded in human striatum and orbitofrontal cortex

Human neuroimaging research suggests the existence of one core network for the subjective valuation of rewards, including the striatum and orbitofrontal cortex. However, there is little research on the neural representation of subjective reward values of visual sexual stimuli (VSS) and on the role of these subjective valuations in the development of related addictive behaviors. Here, we investigate how neural reactivity to VSS is connected to individual preference using functional magnetic resonance imaging (fMRI). During the fMRI scan, 72 men viewed different VSS film clips. Ratings regarding valence and sexual arousal were collected and used as parametric modulators in the fMRI analysis. Subjects also filled out questionnaires on self-reported symptoms of problematic pornography use (PPU). Firstly, we found that neural reactivity towards VSS clips in the nucleus accumbens, caudate nucleus and orbitofrontal cortex was positively correlated with individual ratings of the respective VSS in all subjects. Second, the strength of the association between neural activity and sexual arousal ratings was positively correlated with self-reported symptoms of PPU. The first result suggests a precise appraisal of VSS according to individual preferences in established reward valuation regions. Secondly, stronger neural differentiation based on preference in participants with more PPU symptoms indicates an increased importance of VSS/preference fit in these individuals. This heightened correspondence between individual liking and neural activity may facilitate PPU development by increased signaling of incentive salience, thus boosting motivation to seek out and respond to these preferred stimuli.

Neural correlates of delay discount alterations in addiction and psychiatric disorders: A systematic review of magnetic resonance imaging studies

Delay discounting (DD) represents decreased subjective value for delayed reward relative to the same reward at present. The concept of DD has been applied for pathophysiology of addiction and psychiatric disorders. However, the detailed neuroimaging correlates of DD underlying pathophysiology still remain unclear. Thus, we conducted a systematic review to investigate neural correlates of DD on magnetic resonance imaging studies among addiction and psychiatric disorders. Specific search terms were set on PubMed to identify relevant articles. Initial search identified 551 records and 31 studies met the inclusion criteria. The present review revealed that greater DD was correlated with increased activity in areas related to reward evaluation and prediction as well as decreased activity in areas related to cognitive control. Healthy controls showed smaller changes in activities of these areas associated with DD when compared to patient groups. As the neural basis related to DD, three neural networks have been proposed that are associated with the actions of short-term interests and long-term benefits. Among the three potential neural networks on DD, the first one included the ventromedial prefrontal cortex and ventral striatum and implicated in evaluating reward values, the second network included the anterior cingulate cortex and linked to cognitive control, and the third network included the middle temporal gyrus and was involved in predictions and affection. This review generated consistent findings on the neural basis of DD among patients with addiction and psychiatric disorders, which may represent the pathophysiology related to DD and impulsivity of mental illness.

Comparing the reward value of cigarettes and food during tobacco abstinence and nonabstinence

BACKGROUND

Some addiction theories propose that nicotine dependence is characterized by an imbalance between motivation for cigarettes compared to non-drug rewards. This imbalance may become increasingly polarized during abstinence, which further potentiates smoking. The present study evaluated motivation for cigarettes and food during abstinence and nonabstinence in daily smokers. This study modified a previously validated cue-reactivity procedure to include food as a cue condition, thereby allowing the comparison of cigarettes to food and neutral cues. The Choice Behavior Under Cued Conditions (CBUCC) procedure, in which participants are presented with cues and spend money in order to gain immediate access to that cue, generates multiple variables to evaluate motivational factors and drug use behaviors including reward value, craving, seeking, choice time, and consumption.

METHODS

Fifty daily cigarette smokers underwent two CBUCC sessions under overnight abstinent and nonabstinent conditions.

RESULTS

As an index of reward value, participants spent more money to access cigarettes than food or water and more for food relative to water. Abstinence increased the reward value of cigarettes but did not significantly affect the reward value of food or water. Participants also demonstrated cue-specific craving for cigarettes and food, although overall cigarette craving was greater than food craving.

CONCLUSIONS

This study indicated that motivation was greater for cigarettes than food. Abstinence increased motivation for cigarettes but had little impact on motivation for food. This suggests that heavy smokers do not reallocate motivational resources towards cigarettes during abstinence; rather, motivational processes for food remain constant from nonabstinent to abstinent sessions.

Subjective preferences differentially modulate the processing of rewards gained by own vs. observed choices

The present EEG study investigated the impact of subjective reward preferences and agency on outcome processing. 47 healthy adults (11 male; 36 female) with preferences for either milk or white chocolate completed two runs of a gambling task involving their preferred chocolate (high preference outcomes, HPOs), non-preferred chocolate (medium preference outcomes, MPOs), and a lesser liked non-chocolate reward (low preference outcomes, LPOs). In the 'active' run, subjects chose between three different response options to receive the outcomes. In the 'observational' run, they observed another person's choices and subsequent outcomes. Cluster-based permutation analyses of event-related potential (ERPs) revealed that early processing in the P2 time window reflected outcome salience, differentiating HPOs and MPOs from LPOs, especially for outcomes following own choices, while not distinguishing between HPOs and MPOs. In contrast, processing in later stages, i.e., the typical time windows for feedback-related negativity (FRN) and P300, showed evidence of differential coding of HPOs and MPOs and was also modulated by agency. ERPs clearly differentiated between all three outcome types in the FRN and P300 time windows for outcomes following active but not for observed choices. The present study adds to evidence for modulation of outcome processing by contextual and inter-individual factors. In particular, our findings suggest that subjective preferences are complementarily represented in subjective reward valuation and in motivational value representations indexed by the FRN and the P300.

Progressive ratio (PR) schedules and the sipometer: Do they measure wanting, liking, and/or reward? A tribute to Anthony Sclafani and Karen Ackroff

This paper honors the contributions made by Anthony (Tony) Sclafani and Karen Ackroff to both the Columbia University Seminar on Appetitive Behavior and to the field of ingestive behavior in general. We review their use of the progressive ratio (PR) licking paradigm, to determine whether the taste of sucrose, independent of its post-ingestive effects, is always positively reinforcing in animals. They demonstrated a monotonic increase in licking as concentration increased, and obtained results identical to those obtained with a lever-pressing paradigm, but licking was easier and more natural than lever pressing. The PR paradigm was translated to evaluate liquid food reward value in humans. An instrument (the sipometer) was devised that initially permitted a few seconds access to small amounts of a sweet beverage as the participants increased the time to obtain it in 3-5-sec increments. The device went through two refinements and currently delivers the reinforcer and measures the pressure exerted to obtain it. The sipometer is compared with other techniques for measuring motivation and reward. The use of the sipometer and the PR method are discussed in relation to the theoretical challenges inherent in measuring motivation and pleasure, from both psychological and behavioral economics perspectives, and why it is or is not important to separate these processes for both theoretical and practical applications.

Decreased reward value of biological motion among individuals with autistic traits

•

The Social Motivation Theory of ASD links social impairments to reduced value of social stimuli.

•

We evaluated the reward value of human motion among people with a range of AQ scores.

•

Subjects value human motion more than robotic or control motion, but this preference diminishes with higher AQ scores.

The Social Motivation Theory posits that a reduced sensitivity to the value of social stimuli, specifically faces, can account for social impairments in Autism Spectrum Disorders (ASD). Research has demonstrated that typically developing (TD) individuals preferentially orient towards another type of salient social stimulus, namely biological motion. Individuals with ASD, however, do not show this preference. While the reward value of faces to both TD and ASD individuals has been well-established, the extent to which individuals from these populations also find human motion to be rewarding remains poorly understood. The present study investigated the value assigned to biological motion by TD participants in an effort task, and further examined whether these values differed among individuals with more autistic traits. The results suggest that TD participants value natural human motion more than rigid, machine-like motion or non-human control motion, but this preference is attenuated among individuals reporting more autistic traits. This study provides the first evidence to suggest that individuals with more autistic traits find a broader conceptualisation of social stimuli less rewarding compared to individuals with fewer autistic traits. By quantifying the social reward value of human motion, the present findings contribute an important piece to our understanding of social motivation in individuals with and without social impairments.

Indirect Pathway of Caudal Basal Ganglia for Rejection of Valueless Visual Objects

The striatum controls behavior in two ways: facilitation and suppression through the direct and indirect pathways, respectively. However, it is still unclear what information is processed in these pathways. To address this question, we studied two pathways originating from the primate caudate tail (CDt). We found that the CDt innervated the caudal-dorsal-lateral part of the substantia nigra pars reticulata (cdlSNr), directly or indirectly through the caudal-ventral part of the globus pallidus externus (cvGPe). Notably, cvGPe neurons receiving inputs from the CDt were mostly visual neurons that encoded stable reward values of visual objects based on long-past experiences. Their dominant response was inhibition by valueless objects, which generated disinhibition of cdlSNr neurons and inhibition of superior colliculus neurons. Our data suggest that low-value signals are sent by the CDt-indirect pathway to suppress saccades to valueless objects, whereas high-value signals are sent by the CDt-direct pathway to facilitate saccades to valuable objects.

A test of the reward-value hypothesis

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

The reward value of sucrose in leptin-deficient obese mice

Leptin-deficient patients report higher "liking" ratings for food, and leptin replacement therapy normalizes these ratings even before weight loss is achieved. Since animals cannot report their ratings, we studied the relationship between leptin and food reward in leptin-deficient ob/ob mice using a optogenetic assay that quantifies the reward value of sucrose. In this assay, mice chose between one sipper dispensing the artificial sweetener sucralose coupled to optogenetic activation of dopaminergic (DA) neurons, and another sipper dispensing sucrose. We found that the reward value of sucrose was high under a state of leptin deficiency, as well as at a dose of leptin that does not suppress food intake (12.5 ng/h). Treatment with higher doses of leptin decreased the reward value of sucrose before weight loss was achieved (100 ng/h), as seen in leptin-deficient patients. These results phenocopy in mice the behavior of leptin-deficient patients.

Limbic systems for emotion and for memory, but no single limbic system

The concept of a (single) limbic system is shown to be outmoded. Instead, anatomical, neurophysiological, functional neuroimaging, and neuropsychological evidence is described that anterior limbic and related structures including the orbitofrontal cortex and amygdala are involved in emotion, reward valuation, and reward-related decision-making (but not memory), with the value representations transmitted to the anterior cingulate cortex for action-outcome learning. In this 'emotion limbic system' a computational principle is that feedforward pattern association networks learn associations from visual, olfactory and auditory stimuli, to primary reinforcers such as taste, touch, and pain. In primates including humans this learning can be very rapid and rule-based, with the orbitofrontal cortex overshadowing the amygdala in this learning important for social and emotional behaviour. Complementary evidence is described showing that the hippocampus and limbic structures to which it is connected including the posterior cingulate cortex and the fornix-mammillary body-anterior thalamus-posterior cingulate circuit are involved in episodic or event memory, but not emotion. This 'hippocampal system' receives information from neocortical areas about spatial location, and objects, and can rapidly associate this information together by the different computational principle of autoassociation in the CA3 region of the hippocampus involving feedback. The system can later recall the whole of this information in the CA3 region from any component, a feedback process, and can recall the information back to neocortical areas, again a feedback (to neocortex) recall process. Emotion can enter this memory system from the orbitofrontal cortex etc., and be recalled back to the orbitofrontal cortex etc. during memory recall, but the emotional and hippocampal networks or 'limbic systems' operate by different computational principles, and operate independently of each other except insofar as an emotional state or reward value attribute may be part of an episodic memory.