Not all that glittered is gold: neural mechanisms that determine when reward will enhance or impair memory

Expected Value of Reward Predicts Episodic Memory for Incidentally Learnt Reward-Item Associations

In this paper, we draw connections between reward processing and cognition by behaviourally testing the implications of neurobiological theories of reward processing on memory. Single-cell neurophysiology in non-human primates and imaging work in humans suggests that the dopaminergic reward system responds to different components of reward: expected value; outcome or prediction error; and uncertainty of reward (Schultz et al., 2008). The literature on both incidental and motivated learning has focused on understanding how expected value and outcome—linked to increased activity in the reward system—lead to consolidation-related memory enhancements. In the current study, we additionally investigate the impact of reward uncertainty on human memory. The contribution of reward uncertainty—the spread of the reward probability distribution irrespective of the magnitude—has not been previously examined. To examine the effects of uncertainty on memory, a word-learning task was introduced, along with a surprise delayed recognition memory test. Using Bayesian model selection, we found evidence only for expected value as a predictor of memory performance. Our findings suggest that reward uncertainty does not enhance memory for individual items. This supports emerging evidence that an effect of uncertainty on memory is only observed in high compared to low risk environments.

Adaptive scaling of reward in episodic memory: a replication study

Reward is thought to enhance episodic memory formation via dopaminergic consolidation. Bunzeck, Dayan, Dolan, and Duzel [(2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380–1394] provided functional magnetic resonance imaging (fMRI) and behavioural evidence that reward and episodic memory systems are sensitive to the contextual value of a reward—whether it is relatively higher or lower—as opposed to absolute value or prediction error. We carried out a direct replication of their behavioural study and did not replicate their finding that memory performance associated with reward follows this pattern of adaptive scaling. An effect of reward outcome was in the opposite direction to that in the original study, with lower reward outcomes leading to better memory than higher outcomes. There was a marginal effect of reward context, suggesting that expected value affected memory performance. We discuss the robustness of the reward memory relationship to variations in reward context, and whether other reward-related factors have a more reliable influence on episodic memory.

Memory Performance for Everyday Motivational and Neutral Objects Is Dissociable from Attention

Episodic memory is typically better for items coupled with monetary reward or punishment during encoding. It is yet unclear whether memory is also enhanced for everyday objects with appetitive or aversive values learned through a lifetime of experience, and to what extent episodic memory enhancement for motivational and neutral items is attributable to attention. In a first experiment, we investigated attention to everyday motivational objects using eye-tracking during free-viewing and subsequently tested episodic memory using a remember/know procedure. Attention was directed more to aversive stimuli, as evidenced by longer viewing durations, whereas recollection was higher for both appetitive and aversive objects. In the second experiment, we manipulated the visual contrast of neutral objects through changes of contrast to further dissociate attention and memory encoding. While objects presented with high visual contrast were looked at longer, recollection was best for objects presented in unmodified, medium contrast. Generalized logistic mixed models on recollection performance showed that attention as measured by eye movements did not enhance subsequent memory, while motivational value (Experiment 1) and visual contrast (Experiment 2) had quadratic effects in opposite directions. Our findings suggest that an enhancement of incidental memory encoding for appetitive items can occur without an increase in attention and, vice versa, that enhanced attention towards salient neutral objects is not necessarily associated with memory improvement. Together, our results provide evidence for a double dissociation of attention and memory effects under certain conditions.

What is in the feedback? Effect of induced happiness vs. sadness on probabilistic learning with vs. without exploration

According to dominant neuropsychological theories of affect, emotions signal salience of events and in turn facilitate a wide spectrum of response options or action tendencies. Valence of an emotional experience is pivotal here, as it alters reward and punishment processing, as well as the balance between safety and risk taking, which can be translated into changes in the exploration-exploitation trade-off during reinforcement learning (RL). To test this idea, we compared the behavioral performance of three groups of participants that all completed a variant of a standard probabilistic learning task, but who differed regarding which mood state was actually induced and maintained (happy, sad or neutral). To foster a change from an exploration to an exploitation-based mode, we removed feedback information once learning was reliably established. Although changes in mood were successful, learning performance was balanced between the three groups. Critically, when focusing on exploitation-driven learning only, they did not differ either. Moreover, mood valence did not alter the learning rate or exploration per se, when titrated using complementing computational modeling. By comparing systematically these results to our previous study (Bakic et al., 2014), we found that arousal levels did differ between studies, which might account for limited modulatory effects of (positive) mood on RL in the present case. These results challenge the assumption that mood valence alone is enough to create strong shifts in the way exploitation or exploration is eventually carried out during (probabilistic) learning. In this context, we discuss the possibility that both valence and arousal are actually necessary components of the emotional mood state to yield changes in the use and exploration of incentives cues during RL.