Working memory accuracy for multiple targets is driven by reward expectation and stimulus contrast with different time-courses

Evidence for the Beneficial Effect of Reward on Working Memory: A Meta-Analytic Study

Rewards act as external motivators and can improve performance in various cognitive tasks. However, previous research demonstrated mixed findings regarding the effect of reward on working memory (WM) performance, and the question of whether reward enhances WM performance is arguable. It remains unclear how the effect of reward on WM can be influenced by various factors, such as types of reward and experimental paradigms. In this meta-analytic study, we systematically investigated the effect of reward on WM by analyzing data from 51 eligible studies involving a total of 1767 participants. Our results showed that reward robustly enhanced WM performance, with non-monetary rewards inducing more benefits than monetary rewards. This may be because, while both types of reward could induce extrinsic motivation, non-monetary rewards enhanced intrinsic motivation while monetary rewards reduced it. Notably, all three reward methods-reward binding, reward expectation, and subliminal reward-effectively improved WM performance, with the reward binding paradigm exhibiting the greatest effects. This finding suggests that the reward effect can be attributed to both increasing the total amount of WM resources and improving the flexibility of resource reallocation. Moreover, the type of WM, the experimental paradigms, and the outcome measures are three moderators that should be jointly considered when assessing the reward effects on WM. Overall, this meta-analytic study provides solid evidence that reward improves WM performance and reveals possible mechanisms underlying these improvements.

Working memory processes and intrinsic motivation: An EEG study

Processes typically encompassed by working memory (WM) include encoding, retention, and retrieval of information. Previous research has demonstrated that motivation can influence WM performance, although the specific WM processes affected by motivation are not yet fully understood. In this study, we investigated the effects of motivation on different WM processes, examining how task difficulty modulates these effects. We hypothesized that motivation level and personality traits of the participants (N = 48, 32 females; mean age = 21) would modulate the parietal alpha and frontal theta electroencephalography (EEG) correlates of WM encoding, retention, and retrieval phases of the Sternberg task. This effect was expected to be more pronounced under conditions of very high task difficulty. We found that increasing difficulty led to reduced accuracy and increased response time, but no significant relationship was found between motivation and accuracy. However, EEG data revealed that motivation influenced WM processes, as indicated by changes in alpha and theta oscillations. Specifically, higher levels of the Resilience trait-associated with mental toughness, hardiness, self-efficacy, achievement motivation, and low anxiety-were related to increased alpha desynchronization during encoding and retrieval. Increased scores of Subjective Motivation to perform well in the task were related to enhanced frontal midline theta during retention. Additionally, these effects were significantly stronger under conditions of high difficulty. These findings provide insights into the specific WM processes that are influenced by motivation, and underscore the importance of considering both task difficulty and intrinsic motivation in WM research.

Dynamic expectations: Behavioral and electrophysiological evidence of sub-second updates in reward predictions

Expectations are often dynamic: sports fans know that expectations are rapidly updated as games unfold. Yet expectations have traditionally been studied as static. Here we present behavioral and electrophysiological evidence of sub-second changes in expectations using slot machines as a case study. In Study 1, we demonstrate that EEG signal before the slot machine stops varies based on proximity to winning. Study 2 introduces a behavioral paradigm to measure dynamic expectations via betting, and shows that expectation trajectories vary as a function of winning proximity. Notably, these expectation trajectories parallel Study 1's EEG activity. Studies 3 (EEG) and 4 (behavioral) replicate these findings in the loss domain. These four studies provide compelling evidence that dynamic sub-second updates in expectations can be behaviorally and electrophysiologically measured. Our research opens promising avenues for understanding the dynamic nature of reward expectations and their impact on cognitive processes.

Reward influences the allocation but not the availability of resources in visual working memory

Visual working memory possesses capacity constraints limiting the availability of resources for encoding and maintaining information. Studies have shown that prospective rewards improve performance on visual working memory tasks, but it remains unclear whether rewards increase total resource availability or simply influence the allocation of resources. Participants performed a continuous report visual working memory task with oriented grating stimuli. On each trial, participants were presented with a priority cue, which signaled the item most likely to be probed, and a reward cue, which signaled the magnitude of a performance-contingent reward. We showed that rewards decreased recall error for cued items and increased recall error for noncued items. This tradeoff was due to a change in the probability of successfully encoding a cued versus a noncued item rather than a change in recall precision or the probability of binding errors. Rewards did not modulate performance when priority cues were retroactively presented after the stimulus presentation period, indicating that rewards only affect resource allocation when participants are able to engage proactive control before encoding. Additionally, reward had no effect on visual working memory performance when priority cues were absent and thus unable to guide resource allocation. These findings indicate that rewards influence the flexible allocation of resources during selection and encoding in visual working memory, but do not augment total capacity. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Dynamic expectations: Behavioral and electrophysiological evidence of sub-second updates in reward predictions

Expectations are often dynamic: any sports fan knows that expectations are rapidly updated as games unfold. Yet expectations have traditionally been studied as static. Here, using slot machines as a case study, we provide parallel behavioral and electrophysiological evidence of sub-second moment-to-moment changes in expectations. In Study 1, we show that the dynamics of the EEG signal before the slot machine stopped differed depending on the nature of the outcome, including not only whether the participant won or lost, but also how close they came to winning. In line with our predictions, Near Win Before outcomes (the slot machine stops one item before a match) were similar to Wins, but different than Near Win After (the machine stops one item after a match) and Full Miss (the machine stops two or three items from a match). In Study 2, we designed a novel behavioral paradigm to measure moment-to-moment changes in expectations via dynamic betting. We found that different outcomes also elicited unique expectation trajectories in the deceleration phase. Notably, these behavioral expectation trajectories paralleled Study 1's EEG activity in the last second prior to the machine's stop. In Studies 3 (EEG) and 4 (behavior) we replicated these findings in the loss domain where a match entails a loss. Again, we found a significant correlation between behavioral and EEG results. These four studies provide the first evidence that dynamic sub-second updates in expectations can be behaviorally and electrophysiologically measured. Our findings open up new avenues for studying the ongoing dynamics of reward expectations and their role in healthy and unhealthy cognition.

Better Controlled, Better Maintained: Sense of Agency Facilitates Working Memory

The cognitive effects of sense of agency (SoA) attract increasing attention. It is unclear how SoA influences working memory (WM). In the present study, participants first moved several boxes. One of the boxes was more or less controllable than the majority. After boxes stopped moving, to-be-remembered items appeared. Memory performance and SoA over them were subsequently tested. In Experiments 1a and 1b, the majority of boxes, serving as context, were under low and high control respectively. To further examine whether the maintenance stage was influenced, the effect of selective encoding was minimized in Experiments 2a and 2b. Experiment 2b further eliminated the impact of agency judgments and tested the relationship among SoA, WM, and preference. Memory was better for items with strong SoA in the high and low control contexts. The effect partly stems from the modulation of the maintenance stage in WM, in which reward-based processes could be engaged.

Task prioritization modulates alpha, theta and beta EEG dynamics reflecting proactive cognitive control

Most neuroscientific studies investigating mental effort apply unspecific effort allocation paradigms. In contrast, the present EEG study targets specific effort allocation during task prioritization. Twenty-eight participants performed a cued number classification task during the retention interval of a working memory task including retrospective cues. One of two possible number classifications was done per trial. Each trial started with a cue indicating which of the two tasks would be more important in the upcoming trial. Subjects were told to engage in both tasks, but to concentrate on the important one. Feedback given at the end of each trial was calculated based on task performance, with scores obtained from the relevant task being tripled. Participants performed significantly better in either task when it was important compared to when not. Task prioritization modulates theta, alpha and beta oscillations, predominantly during task preparation. Multivariate pattern analysis revealed that the exact type of the two possible number classifications was decodable, however, decoding accuracy did not depend on task importance. Hemispheric alpha power asymmetries indicating attentional orienting between working memory representations also did not depend on task importance. The findings suggest that task prioritization primarily affects proactive cognitive control on a superordinate level.

No evidence that the retro-cue benefit requires reallocation of memory resources

Selective mechanisms allow us to prioritize items held in working memory. Does this reflect reallocation of working memory resources? We examined a critical prediction of this account-that reallocating more resources from one item to another should provide a greater benefit. We used a reward manipulation to create variable allocation of resources. Subsequently, a retro-cue instructed participants to drop a memory item. This retro-cue improved performance for the prioritized items relative to a neutral baseline. However, in contrast to the prevailing reallocation account, we found no difference between dropping a higher versus lower reward item. Importantly, removal of high versus low reward items led to better encoding of subsequently presented items, demonstrating that our reward manipulation was successful. While allocation of resources can influence the encoding and storage of new information into working memory, reallocation does not appear to be essential for selection effects in working memory.

Reward and loss incentives improve spatial working memory by shaping trial-by-trial posterior frontoparietal signals

Integrating motivational signals with cognition is critical for goal-directed activities. The mechanisms that link neural changes with motivated working memory continue to be understood. Here, we tested how externally cued and non-cued (internally represented) reward and loss impact spatial working memory precision and neural circuits in human subjects using fMRI. We translated the classic delayed-response spatial working memory paradigm from non-human primate studies to take advantage of a continuous numeric measure of working memory precision, and the wealth of translational neuroscience yielded by these studies. Our results demonstrated that both cued and non-cued reward and loss improved spatial working memory precision. Visual association regions of the posterior prefrontal and parietal cortices, specifically the precentral sulcus (PCS) and intraparietal sulcus (IPS), had increased BOLD signal during incentivized spatial working memory. A subset of these regions had trial-by-trial increases in BOLD signal that were associated with better working memory precision, suggesting that these regions may be critical for linking neural signals with motivated working memory. In contrast, regions straddling executive networks, including areas in the dorsolateral prefrontal cortex, anterior parietal cortex and cerebellum displayed decreased BOLD signal during incentivized working memory. While reward and loss similarly impacted working memory processes, they dissociated during feedback when money won or avoided in loss was given based on working memory performance. During feedback, the trial-by-trial amount and valence of reward/loss received was dissociated amongst regions such as the ventral striatum, habenula and periaqueductal gray. Overall, this work suggests motivated spatial working memory is supported by complex sensory processes, and that the IPS and PCS in the posterior frontoparietal cortices may be key regions for integrating motivational signals with spatial working memory precision.

Motivation improves working memory by two processes: Prioritisation and retrieval thresholds

Motivation can improve performance when the potential rewards outweigh the cost of effort expended. In working memory (WM), people can prioritise rewarded items at the expense of unrewarded items, suggesting a fixed memory capacity. But can capacity itself change with motivation? Across four experiments (N = 30-34) we demonstrate motivational improvements in WM even when all items were rewarded. However, this was not due to better memory precision, but rather better selection of the probed item within memory. Motivational improvements operated independently of encoding, maintenance, or attention shifts between items in memory. Moreover, motivation slowed responses. This contrasted with the benefits of rewarding items unequally, which allowed prioritisation of one item over another. We conclude that motivation can improve memory recall, not via precision or capacity, but via speed-accuracy trade-offs when selecting the item to retrieve.

Reward Expectation Differentially Modulates Global and Local Spatial Working Memory Accuracy

Although it has been suggested that reward expectation affects the performance of spatial working memory tasks, controversial results have been found in previous experiments. Hence, it is still unclear to what extent reward expectation has an effect on working memory. To clarify this question, a memory-guided saccade task was applied, in which participants were instructed to retain and reconstruct a temporospatial sequence of four locations by moving their eyes in each trial. The global- and local-level spatial working memory accuracies were calculated to determine the reward effect on the global and local level of processing in spatial working memory tasks. Although high reward expectation enhanced the encoding of spatial information, the percentage of trials in which the cued location was correctly fixated decreased with increment of reward expectation. The reconstruction of the global temporospatial sequence was enhanced by reward expectation, whereas the local reconstruction performance was not affected by reward. Furthermore, the improvements in local representations of uncued locations and local sequences were at the cost of the representation of cued locations. The results suggest that the reward effect on spatial working memory is modulated by the level of processing, which supports the flexible resource theory during maintenance.

Entrainment of Astrocytic and Neuronal Ca2+ Population Dynamics During Information Processing of Working Memory in Mice

Astrocytes are increasingly recognized to play an active role in learning and memory, but whether neural inputs can trigger event-specific astrocytic Ca²⁺ dynamics in real time to participate in working memory remains unclear due to the difficulties in directly monitoring astrocytic Ca²⁺ dynamics in animals performing tasks. Here, using fiber photometry, we showed that population astrocytic Ca²⁺ dynamics in the hippocampus were gated by sensory inputs (centered at the turning point of the T-maze) and modified by the reward delivery during the encoding and retrieval phases. Notably, there was a strong inter-locked and antagonistic relationship between the astrocytic and neuronal Ca²⁺ dynamics with a 3-s phase difference. Furthermore, there was a robust synchronization of astrocytic Ca²⁺ at the population level among the hippocampus, medial prefrontal cortex, and striatum. The inter-locked, bidirectional communication between astrocytes and neurons at the population level may contribute to the modulation of information processing in working memory.

Exploring reward-related attention selectivity deficits in Parkinson's disease

An important aspect of managing a limited cognitive resource like attention is to use the reward value of stimuli to prioritize the allocation of attention to higher-value over lower-value stimuli. Recent evidence suggests this depends on dopaminergic signaling of reward. In Parkinson's disease, both reward sensitivity and attention are impaired, but whether these deficits are directly related to one another is unknown. We tested whether Parkinson's patients use reward information when automatically allocating their attention and whether this is modulated by dopamine replacement. We compared patients, tested both ON and OFF dopamine replacement medication, to older controls using a standard attention capture task. First, participants learned the different reward values of stimuli. Then, these reward-associated stimuli were used as distractors in a visual search task. We found that patients were generally distracted by the presence of the distractors but that the degree of distraction caused by the high-value and low-value distractors was similar. Furthermore, we found no evidence to support the possibility that dopamine replacement modulates the effect of reward on automatic attention allocation. Our results suggest a possible inability in Parkinson's patients to use the reward value of stimuli when automatically allocating their attention, and raise the possibility that reward-driven allocation of resources may affect the adaptive modulation of other cognitive processes.

The neural and molecular basis of working memory function in psychosis: a multimodal PET-fMRI study

Working memory (WM) deficits predict clinical and functional outcomes in schizophrenia but are poorly understood and unaddressed by existing treatments. WM encoding and WM retrieval have not been investigated in schizophrenia without the confounds of illness chronicity or the use of antipsychotics and illicit substances. Moreover, it is unclear if WM deficits may be linked to cannabinoid 1 receptor dysfunction in schizophrenia. Sixty-six volunteers (35 controls, 31 drug-free patients with diagnoses of schizophrenia or schizoaffective disorder) completed the Sternberg Item-Recognition paradigm during an fMRI scan. Neural activation during WM encoding and WM retrieval was indexed using the blood-oxygen-level-dependent hemodynamic response. A subset of volunteers (20 controls, 20 drug-free patients) underwent a dynamic PET scan to measure [11C] MePPEP distribution volume (ml/cm3) to index CB1R availability. In a whole-brain analysis, there was a significant main effect of group on task-related BOLD responses in the superior parietal lobule during WM encoding, and the bilateral hippocampus during WM retrieval. Region of interest analyses in volunteers who had PET/fMRI indicated that there was a significant main effect of group on task-related BOLD responses in the right hippocampus, left DLPFC, left ACC during encoding; and in the bilateral hippocampus, striatum, ACC and right DLPFC during retrieval. Striatal CB1R availability was positively associated with mean striatal activation during WM retrieval in male patients (R = 0.5, p = 0.02) but not male controls (R = -0.20, p = 0.53), and this was significantly different between groups, Z = -2.20, p = 0.02. Striatal CB1R may contribute to the pathophysiology of WM deficits in male patients and have implications for drug development in schizophrenia.

Massive Effects of Saliency on Information Processing in Visual Working Memory

Limitations in the ability to temporarily represent information in visual working memory (VWM) are crucial for visual cognition. Whether VWM processing is dependent on an object’s saliency (i.e., how much it stands out) has been neglected in VWM research. Therefore, we developed a novel VWM task that allows direct control over saliency. In three experiments with this task (on 10, 31, and 60 adults, respectively), we consistently found that VWM performance is strongly and parametrically influenced by saliency and that both an object’s relative saliency (compared with concurrently presented objects) and absolute saliency influence VWM processing. We also demonstrated that this effect is indeed due to bottom-up saliency rather than differential fit between each object and the top-down attentional template. A simple computational model assuming that VWM performance is determined by the weighted sum of absolute and relative saliency accounts well for the observed data patterns.

Reward history impacts attentional orienting and inhibitory control on untrained tasks

It has been robustly shown that stimuli with reward history receive attentional priority. However, the majority of this research tests reward history effects on attentional bias using similar tasks for both the reward learning phase and the unrewarded testing phase, which limits our understanding of how the effects of reward history generalize beyond the trained tasks and mental sets. Across two new experiments, the current study addresses these issues by first associating reward with a stimulus in a visual search paradigm, and then testing value-driven effects of that stimulus in untrained and unrewarded tasks, including a cueing paradigm, a go/no-go task, and a delay discounting task. Results of Experiment 1 demonstrate that history of reward association in a visual search task generalizes to value-driven attentional bias in a different attention paradigm (i.e., cueing), indicating these effects are indeed attributable to imbued value that can transfer to other tasks beyond that in which the reward was trained. The results of Experiment 2 demonstrate that in addition to eliciting attentional orienting on untrained tasks, reward history can lead to better inhibitory control in the go/no-go task. We find no evidence for reward history effects in the delay discounting task. Together, these experiments demonstrate that when the reward association task is in the attention domain, reward history modulates attentional priority, and this effect generalizes to untrained and unrewarded tasks that utilize both spatial and nonspatial attention.

Effects of social and nonsocial reward on executive function in preschoolers

INTRODUCTION

Executive function, a set of higher order cognitive skills underlying goal-directed behaviors, develops rapidly during preschool years. Reward increases executive function engagement in adolescents and adults. However, there is still a scarcity of data on how reward affects executive function in young children. The present study examines whether different incentive types contribute differently to executive function performance and neural activity in children.

METHODS

Twenty-five preschoolers of 5-6 years old were provided an incentive Go/No-go task, comparing social, nonsocial, and nonreward conditions. Activations in the prefrontal regions during the tasks were measured using functional near-infrared spectroscopy.

RESULTS

The results revealed that social reward enhanced right prefrontal activations in young children. In contrast to adult literature, younger children did not show any significant differences in executive function performance across conditions.

CONCLUSION

This study expands our understanding of motivation and EF engagement in preschoolers. Specifically, social reward enhanced prefrontal activations in young children. The implications and recommendations for future research are discussed.

Dopamine is associated with prioritization of reward-associated memories in Parkinson's disease

Patients with Parkinson's disease have reduced reward sensitivity related to dopaminergic neuron loss, which is associated with impairments in reinforcement learning. Increasingly, however, dopamine-dependent reward signals are recognized to play an important role beyond reinforcement learning. In particular, it has been shown that reward signals mediated by dopamine help guide the prioritization of events for long-term memory consolidation. Meanwhile, studies of memory in patients with Parkinson's disease have focused on overall memory capacity rather than what is versus what isn't remembered, leaving open questions about the effect of dopamine replacement on the prioritization of memories by reward and the time-dependence of this effect. The current study sought to fill this gap by testing the effect of reward and dopamine on memory in patients with Parkinson's disease. We tested the effect of dopamine modulation and reward on two forms of long-term memory: episodic memory for neutral objects and memory for stimulus-value associations. We measured both forms of memory in a single task, adapting a standard task of reinforcement learning with incidental episodic encoding events of trial-unique objects. Objects were presented on each trial at the time of feedback, which was either rewarding or not. Memory for the trial-unique images and for the stimulus-value associations, and the influence of reward on both, was tested immediately after learning and 2 days later. We measured performance in Parkinson's disease patients tested either ON or OFF their dopaminergic medications and in healthy older control subjects. We found that dopamine was associated with a selective enhancement of memory for reward-associated images, but that it did not influence overall memory capacity. Contrary to predictions, this effect did not differ between the immediate and delayed memory tests. We also found that while dopamine had an effect on reward-modulated episodic memory, there was no effect of dopamine on memory for stimulus-value associations. Our results suggest that impaired prioritization of cognitive resource allocation may contribute to the early cognitive deficits of Parkinson's disease.

The possibility to make choices modulates feature-based effects of reward

When making decisions, humans can maximize the positive outcome of their actions by choosing the option associated with the highest reward. We have recently shown that choices modulate effects of reward via a bias in spatial attention: Locations associated with a lower reward are anticipatorily suppressed, as indicated by delayed responses to low-reward targets and increased parieto-occipital alpha power. Here, we investigated whether this inhibition also occurs when reward is not coupled to location but to a nonspatial feature (color). We analyzed reaction times to single targets associated with a low or high reward as a function of whether a second trial type, choice-trials, were interleaved. In choice-trials, participants could choose either one of two targets to obtain the associated reward. Indeed, responses to low-reward targets were slower when choice-trials were present, magnifying the influence of reward, and this delay was more pronounced in trials immediately following a choice. No corresponding changes in parieto-occipital alpha power were observed, but the behavioral findings suggest that choices modulate a reward-related bias in feature-based attention in a similar manner as for spatial attention, and support the idea that reward primarily affects behaviour when it is of immediate relevance.

Do Reward-Related Distractors Impair Cognitive Performance? Perhaps Not

Over a hundred prior studies show that reward-related distractors capture attention. It is less clear, however, whether and when reward-related distractors affect performance on tasks that require cognitive control. In this experiment, we examined whether reward-related distractors impair performance during a demanding arithmetic task. Participants (N = 81) solved math problems, while they were exposed to task-irrelevant stimuli that were previously associated with monetary rewards (vs. not). Although we found some evidence for reward learning in the training phase, results from the test phase showed no evidence that reward-related distractors harm cognitive performance. This null effect was invariant across different versions of our task. We examined the results further with Bayesian analyses, which showed positive evidence for the null. Altogether, the present study showed that reward-related distractors did not harm performance on a mental arithmetic task. When considered together with previous studies, the present study suggests that the negative impact of reward-related distractors on cognitive control is not as straightforward as it may seem, and that more research is needed to clarify the circumstances under which reward-related distractors harm cognitive control.

Comparing Effects of Reward Anticipation on Working Memory in Younger and Older Adults

Goal-directed behavior requires sufficient resource allocation of cognitive control processes, such as the ability to prioritize relevant over less relevant information in working memory. Findings from neural recordings in animals and human multimodal imaging studies suggest that reward incentive mechanisms could facilitate the encoding and updating of context representations, which can have beneficial effects on working memory performance in young adults. In order to investigate whether these performance enhancing effects of reward on working memory processes are still preserved in old age, the current study aimed to investigate whether aging alters the effects of reward anticipation on the encoding and updating mechanisms in working memory processing. Therefore, a reward modulated verbal n-back task with age-adjusted memory load manipulation was developed to investigate reward modulation of working memory in younger (age 20-27) and older (age 65-78) adults. Our results suggest that the mechanism of reward anticipation in enhancing the encoding and updating of stimulus representations in working memory is still preserved in old age. EZ-diffusion modeling showed age distinct patterns of reward modulation of model parameters that correspond to different processes of memory-dependent decision making. Whereas processes of memory evidence accumulation and sensorimotor speed benefited from reward modulation, responses did not become more cautious with incentive motivation for older adults as it was observed in younger adults. Furthermore, individual differences in reward-related enhancement of decision speed correlated with cognitive processing fluctuation and memory storage capacity in younger adults, but no such relations were observed in older adults. These findings indicate that although beneficial effects of reward modulation on working memory can still be observed in old age, not all performance aspects are facilitated. Whereas reward facilitation of content representations in working memory seems to be relatively preserved, aging seems to affect the updating of reward contexts. Future research is needed to elucidate potential mechanisms for motivational regulation of the plasticity of working memory in old age.

Somatosensory working memory in human reinforcement-based motor learning

Recent studies using visuomotor adaptation and sequence learning tasks have assessed the involvement of working memory in the visuospatial domain. The capacity to maintain previously performed movements in working memory is perhaps even more important in reinforcement-based learning to repeat accurate movements and avoid mistakes. Using this kind of task in the present work, we tested the relationship between somatosensory working memory and motor learning. The first experiment involved separate memory and motor learning tasks. In the memory task, the participant's arm was displaced in different directions by a robotic arm, and the participant was asked to judge whether a subsequent test direction was one of the previously presented directions. In the motor learning task, participants made reaching movements to a hidden visual target and were provided with positive feedback as reinforcement when the movement ended in the target zone. It was found that participants that had better somatosensory working memory showed greater motor learning. In a second experiment, we designed a new task in which learning and working memory trials were interleaved, allowing us to study participants' memory for movements they performed as part of learning. As in the first experiment, we found that participants with better somatosensory working memory also learned more. Moreover, memory performance for successful movements was better than for movements that failed to reach the target. These results suggest that somatosensory working memory is involved in reinforcement motor learning and that this memory preferentially keeps track of reinforced movements. NEW & NOTEWORTHY The present work examined somatosensory working memory in reinforcement-based motor learning. Working memory performance was reliably correlated with the extent of learning. With the use of a paradigm in which learning and memory trials were interleaved, memory was assessed for movements performed during learning. Movements that received positive feedback were better remembered than movements that did not. Thus working memory does not track all movements equally but is biased to retain movements that were rewarded.

Reward-associated distractors can harm cognitive performance

When people carry out cognitive tasks, they sometimes suffer from distractions, that is, drops in performance that occur close in time to task-irrelevant stimuli. In this research, we examine how the pursuit of rewards contributes to distractions. In two experiments, participants performed a math task (in which they could earn monetary rewards vs. not) while they were exposed to task-irrelevant stimuli (that were previously associated with monetary rewards vs. not). In Experiment 1, irrelevant cues that were previously associated with rewards (vs. not) impaired performance. In Experiment 2, this effect was only replicated when these reward-associated distractors appeared relatively early during task performance. While the results were thus somewhat mixed, they generally support the idea that reward associations can augment the negative effect of distractors on performance.

A two-level hierarchical framework of visual short-term memory

Over the last couple of decades, a vast amount of research has been dedicated to understanding the nature and the architecture of visual short-term memory (VSTM), the mechanism by which currently relevant visual information is maintained. According to discrete-capacity models, VSTM is constrained by a limited number of discrete representations held simultaneously. In contrast, shared-resource models regard VSTM as limited in resources, which can be distributed flexibly between varying numbers of representations; and a new interference model posits that capacity is limited by interference among items. In this article, we begin by reviewing benchmark findings regarding the debate over VSTM limitations, focusing on whether VSTM storage is all-or-none and on whether object complexity affects capacity. After that, we put forward a hybrid framework of VSTM architecture, arguing that this system is composed of a two-level hierarchy of memory stores, each containing a different set of representations: (1) perceptual memory, a resourcelike level containing analog automatically formed representations of visual stimuli in varying degrees of activation, and (2) visual working memory, in which a subset of three to four items from perceptual memory are bound to conceptual representations and to their locations, thus conveying discrete (digital/symbolic) information which appears quantized. While perceptual memory has a large capacity and is relatively nonselective, visual working memory is restricted in the number of items that can be maintained simultaneously, and its content is regulated by a gating mechanism.

Separate and combined effects of action relevance and motivational value on visual working memory

Visual working memory contents can be selectively weighted according to differences in their task-relevance. In the present study, we examined the influence of two more indirect selection biases established by a concurrent task or learned reward associations: action relevance and motivational value. In three experiments, memory performance was assessed with the same color change detection task. Potential action relevance and motivational value were each determined by a specific feature of the memory items (location or shape, respectively) and manipulated orthogonally. Investigated separately (Experiments 1A and 1B), both selection biases modulated visual working memory. In combination (Experiment 2), action relevance and motivational value still each exerted an influence, but not in a fully independent and additive manner. While action relevance impacted performance irrespective of the reward associated with the items, an effect of motivational value was only observed for action-relevant items. These results support the notion that visual working memory is automatically biased as an inherent part of action planning. More generally, these findings highlight the versatile nature of visual working memory: Contents can be flexibly weighted to reflect differences in their importance, taking into account several sources of information.

Are there multiple ways to direct attention in working memory?

In visual working memory tasks, memory for an item is enhanced if participants are told that the item is relatively more valuable than others presented within the same trial. Experiment 1 explored whether these probe value boosts (termed prioritization effects in previous literature) are affected by probe frequency (i.e., how often the more valuable item is tested). Participants were presented with four colored shapes sequentially and asked to recall the color of one probed item following a delay. They were informed that the first item was more valuable (differential probe value) or as valuable as the other items (equal probe value), and that this item would be tested more frequently (differential probe frequency) or as frequently (equal probe frequency) as the other items. Probe value and probe frequency boosts were observed at the first position, though both were accompanied by costs to other items. Probe value and probe frequency boosts were additive, suggesting the manipulations yield independent effects. Further supporting this, experiment 2 revealed that probe frequency boosts are not reliant on executive resources, directly contrasting with previous findings regarding probe value. Taken together, these outcomes suggest there may be several ways in which attention can be directed in working memory.