Temporal dynamics of encoding, storage, and reallocation of visual working memory

Influence of presentation duration on filtering of irrelevant stimuli in visual working memory

In environments teeming with distractions, the ability to selectively focus on relevant information is crucial for advanced cognitive processing. Existing research using event-related potential (ERP) technology has shown active suppression of irrelevant stimuli during the consolidation phase of visual working memory (VWM). In previous studies, participants have always been given sufficient time to consolidate VWM, while suppressing distracting information. However, it remains unclear whether the suppression of irrelevant distractors requires continuous effort throughout their presence or whether this suppression is only necessary after the consolidation of task-relevant information. To address this question, our study examines whether distractor suppression is necessary in scenarios where consolidation time is limited. This research investigates the effect of varying presentation durations on the filtering of distractors in VWM. We tasked participants with memorizing two color stimuli and ignoring four distractors, presented for either 50 ms or 200 ms. Using ERP technology, we discovered that the distractor-induced distractor positivity (PD) amplitude is larger during longer presentation durations compared to shorter ones. These findings underscore the significant impact of presentation duration on the efficacy of distractor suppression in VWM, as prolonged exposure results in a stronger suppression effect on distractors. This study sheds light on the temporal dynamics of attention and memory, emphasizing the critical role of stimulus timing in cognitive tasks. These findings provide valuable insights into the mechanisms underlying VWM and have significant implications for models of attention and memory.

The neural basis of swap errors in working memory

When making decisions in a cluttered world, humans and other animals often have to hold multiple items in memory at once-such as the different items on a shopping list. Psychophysical experiments in humans and other animals have shown remembered stimuli can sometimes become confused, with participants reporting chimeric stimuli composed of features from different stimuli. In particular, subjects will often make "swap errors" where they misattribute a feature from one object as belonging to another object. While swap errors have been described behaviorally and theoretical explanations have been proposed, their neural mechanisms are unknown. Here, we elucidate these neural mechanisms by analyzing neural population recordings from monkeys performing two multistimulus working memory tasks. In these tasks, monkeys were cued to report the color of an item that either was previously shown at a corresponding location or will be shown at the corresponding location. Animals made swap errors in both tasks. In the neural data, we find evidence that the neural correlates of swap errors emerged when correctly remembered information is selected from working memory. This led to a representation of the distractor color as if it were the target color, underlying the eventual swap error. We did not find consistent evidence that swap errors arose from misinterpretation of the cue or errors during encoding or storage in working memory. These results provide evidence that swap errors emerge during selection of correctly remembered information from working memory, and highlight this selection as a crucial-yet surprisingly brittle-neural process.

Cortical and white matter substrates supporting visuospatial working memory

OBJECTIVE

In tasks involving new visuospatial information, we rely on working memory, supported by a distributed brain network. We investigated the dynamic interplay between brain regions, including cortical and white matter structures, to understand how neural interactions change with different memory loads and trials, and their subsequent impact on working memory performance.

METHODS

Patients undertook a task of immediate spatial recall during intracranial EEG monitoring. We charted the dynamics of cortical high-gamma activity and associated functional connectivity modulations in white matter tracts.

RESULTS

Elevated memory loads were linked to enhanced functional connectivity via occipital longitudinal tracts, yet decreased through arcuate, uncinate, and superior-longitudinal fasciculi. As task familiarity grew, there was increased high-gamma activity in the posterior inferior-frontal gyrus (pIFG) and diminished functional connectivity across a network encompassing frontal, parietal, and temporal lobes. Early pIFG high-gamma activity was predictive of successful recall. Including this metric in a logistic regression model yielded an accuracy of 0.76.

CONCLUSIONS

Optimizing visuospatial working memory through practice is tied to early pIFG activation and decreased dependence on irrelevant neural pathways.

SIGNIFICANCE

This study expands our knowledge of human adaptation for visuospatial working memory, showing the spatiotemporal dynamics of cortical network modulations through white matter tracts.

A dynamic neural resource model bridges sensory and working memory

Probing memory of a complex visual image within a few hundred milliseconds after its disappearance reveals significantly greater fidelity of recall than if the probe is delayed by as little as a second. Classically interpreted, the former taps into a detailed but rapidly decaying visual sensory or 'iconic' memory (IM), while the latter relies on capacity-limited but comparatively stable visual working memory (VWM). While iconic decay and VWM capacity have been extensively studied independently, currently no single framework quantitatively accounts for the dynamics of memory fidelity over these time scales. Here, we extend a stationary neural population model of VWM with a temporal dimension, incorporating rapid sensory-driven accumulation of activity encoding each visual feature in memory, and a slower accumulation of internal error that causes memorized features to randomly drift over time. Instead of facilitating read-out from an independent sensory store, an early cue benefits recall by lifting the effective limit on VWM signal strength imposed when multiple items compete for representation, allowing memory for the cued item to be supplemented with information from the decaying sensory trace. Empirical measurements of human recall dynamics validate these predictions while excluding alternative model architectures. A key conclusion is that differences in capacity classically thought to distinguish IM and VWM are in fact contingent upon a single resource-limited WM store.

The self-bias in working memory: the favorability of self-referential stimuli in resource allocation

Self-representations guide and shape our thoughts and behaviour. People usually exhibit inherent biases in perception, attention, and memory to favour the information associated with themselves over that associated with others. The present study explored the phenomenon of self-bias in working memory (WM), specifically how self-referential processing impacts WM precision. Four precision-based experiments were conducted to assess the recall precision of self-referential items and items associated with other social agents. The findings revealed a robust self-prioritisation effect in WM precision, wherein self-referential items were recalled with greater precision than items associated with other social agents. Additionally, increased precision for self-referential items did not decrease the precision for simultaneously remembered items. This effect was limited by the total amount of WM resources and not influenced by a perceptual distractor. The inherent self-bias in WM can serve as a proxy to access the role self-representation in goal-oriented cognitive processing, providing a means of exploring the interaction between self-reference and high-level cognitive function.

EZ-CDM: Fast, simple, robust, and accurate estimation of circular diffusion model parameters

The investigation of cognitive processes that form the basis of decision-making in paradigms involving continuous outcomes has gained the interest of modeling researchers who aim to develop a dynamic decision theory that accounts for both speed and accuracy. One of the most important of these continuous models is the circular diffusion model (CDM, Smith. Psychological Review, 123(4), 425. 2016), which posits a noisy accumulation process mathematically described as a stochastic two-dimensional Wiener process inside a disk. Despite the considerable benefits of this model, its mathematical intricacy has limited its utilization among scholars. Here, we propose a straightforward and user-friendly method for estimating the CDM parameters and fitting the model to continuous-scale data using simple formulas that can be readily computed and do not require theoretical knowledge of model fitting or extensive programming. Notwithstanding its simplicity, we demonstrate that the aforementioned method performs with a level of accuracy that is comparable to that of the maximum likelihood estimation method. Furthermore, a robust version of the method is presented, which maintains its simplicity while exhibiting a high degree of resistance to contaminant responses. Additionally, we show that the approach is capable of reliably measuring the key parameters of the CDM, even when these values are subject to across-trial variability. Finally, we demonstrate the practical application of the method on experimental data. Specifically, an illustrative example is presented wherein the method is employed along with estimating the probability of guessing. It is hoped that the straightforward methodology presented here will, on the one hand, help narrow the divide between theoretical constructs and empirical observations on continuous response tasks and, on the other hand, inspire cognitive psychology researchers to shift their laboratory investigations towards continuous response paradigms.

The Distractor Positivity Component and the Inhibition of Distracting Stimuli

There has been a long-lasting debate about whether salient stimuli, such as uniquely colored objects, have the ability to automatically distract us. To resolve this debate, it has been suggested that salient stimuli do attract attention but that they can be suppressed to prevent distraction. Some research supporting this viewpoint has focused on a newly discovered ERP component called the distractor positivity (PD), which is thought to measure an inhibitory attentional process. This collaborative review summarizes previous research relying on this component with a specific emphasis on how the PD has been used to understand the ability to ignore distracting stimuli. In particular, we outline how the PD component has been used to gain theoretical insights about how search strategy and learning can influence distraction. We also review alternative accounts of the cognitive processes indexed by the PD component. Ultimately, we conclude that the PD component is a useful tool for understanding inhibitory processes related to distraction and may prove to be useful in other areas of study related to cognitive control.

The slow rate of working memory consolidation from vision is a structural limit

The speed with which information from vision is transformed into working memory (WM) representations that resist interference from ongoing perception and cognition is the subject of conflicting results. Using distinct paradigms, researchers have arrived at estimates of the consolidation time course ranging from 25 ms to 1 s - a range of more than an order of magnitude. However, comparisons of consolidation duration across very different estimation paradigms rely on the implicit assumption that WM consolidation speed is a stable, structural constraint of the WM system. The extremely large variation in WM consolidation speed estimates across measurement approaches motivated the current work's goal of determining whether consolidation speed truly is a stable structural constraint of WM encoding, or instead might be under strategic control as suggested by some accounts. By manipulating the relative task priority of WM encoding and a subsequent sensorimotor decision in a dual-task paradigm, the current experiments demonstrate that the long duration of WM consolidation does not change as a result of task-specific strategies. These results allow comparison of WM consolidation across estimation approaches, are consistent with recent multi-phase WM consolidation models, and are consistent with consolidation duration being an inflexible structural limit.

A spatially continuous diffusion model of visual working memory

We present results from five visual working memory (VWM) experiments in which participants were briefly shown between 2 and 6 colored squares. They were then cued to recall the color of one of the squares and they responded by choosing the color on a continuous color wheel. The experiments provided response proportions and response time (RT) measures as a function of angle for the choices. Current VWM models for this task include discrete models that assume an item is either within working memory or not and resource models that assume that memory strength varies as a function of the number of items. Because these models do not include processes that allow them to account for RT data, we implemented them within the spatially continuous diffusion model (SCDM, Ratcliff, 2018) and use the experimental data to evaluate these combined models. In the SCDM, evidence retrieved from memory is represented as a spatially continuous normal distribution and this drives the decision process until a criterion (represented as a 1-D line) is reached, which produces a decision. Noise in the accumulation process is represented by continuous Gaussian process noise over spatial position. The models that fit best from the discrete and resource-based classes converged on a common model that had a guessing component and that allowed the height of the normal memory-strength distribution to vary with number of items. The guessing component was implemented as a regular decision process driven by a flat evidence distribution, a zero-drift process. The combination of choice and RT data allows models that were not identifiable based on choice data alone to be discriminated.

The association between working memory precision and the nonlinear dynamics of frontal and parieto-occipital EEG activity

Electrophysiological working memory (WM) research shows brain areas communicate via macroscopic oscillations across frequency bands, generating nonlinear amplitude modulation (AM) in the signal. Traditionally, AM is expressed as the coupling strength between the signal and a prespecified modulator at a lower frequency. Therefore, the idea of AM and coupling cannot be studied separately. In this study, 33 participants completed a color recall task while their brain activity was recorded through EEG. The AM of the EEG data was extracted using the Holo-Hilbert spectral analysis (HHSA), an adaptive method based on the Hilbert-Huang transforms. The results showed that WM load modulated parieto-occipital alpha/beta power suppression. Furthermore, individuals with higher frontal theta power and lower parieto-occipital alpha/beta power exhibited superior WM precision. In addition, the AM of parieto-occipital alpha/beta power predicted WM precision after presenting a target-defining probe array. The phase-amplitude coupling (PAC) between the frontal theta phase and parieto-occipital alpha/beta AM increased with WM load while processing incoming stimuli, but the PAC itself did not predict the subsequent recall performance. These results suggest frontal and parieto-occipital regions communicate through theta-alpha/beta PAC. However, the overall recall precision depends on the alpha/beta AM following the onset of the retro cue.

Attentional selection is a sufficient cause for visual working memory interference

Visual attention and visual working memory (VWM) are intertwined processes that allow navigation of the visual world. These systems can compete for highly limited cognitive resources, creating interference effects when both operate in tandem. Performing an attentional task while maintaining a VWM load often leads to a loss of memory information. These losses are seen even with very simple visual search tasks. Previous research has argued that this may be due to the attentional selection process, of choosing the target item out of surrounding nontarget items. Over two experiments, the current study disentangles the roles of search and selection in visual search and their influence on a retained VWM load. Experiment 1 revealed that, when search stimuli were relatively simple, target-absent searches (which did not require attentional selection) did not provoke memory interference, whereas target-present search did. In Experiment 2, the number of potential targets was varied in the search displays. In one condition, participants were required to select any one of the items displayed, requiring an attentional selection but no need to search for a specific item. Importantly, this condition led to memory interference to the same extent as a condition where a single target was presented among nontargets. Together, these results show that the process of attentional selection is a sufficient cause for interference with a concurrently maintained VWM load.

Reward influences the allocation but not the availability of resources in visual working memory

Visual working memory possesses capacity constraints limiting the availability of resources for encoding and maintaining information. Studies have shown that prospective rewards improve performance on visual working memory tasks, but it remains unclear whether rewards increase total resource availability or simply influence the allocation of resources. Participants performed a continuous report visual working memory task with oriented grating stimuli. On each trial, participants were presented with a priority cue, which signaled the item most likely to be probed, and a reward cue, which signaled the magnitude of a performance-contingent reward. We showed that rewards decreased recall error for cued items and increased recall error for noncued items. This tradeoff was due to a change in the probability of successfully encoding a cued versus a noncued item rather than a change in recall precision or the probability of binding errors. Rewards did not modulate performance when priority cues were retroactively presented after the stimulus presentation period, indicating that rewards only affect resource allocation when participants are able to engage proactive control before encoding. Additionally, reward had no effect on visual working memory performance when priority cues were absent and thus unable to guide resource allocation. These findings indicate that rewards influence the flexible allocation of resources during selection and encoding in visual working memory, but do not augment total capacity. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Precision of phonological errors in aphasia supports resource models of phonological working memory in language production

Working memory (WM) is critical for many cognitive functions including language production. A key feature of WM is its capacity limitation. Two models have been proposed to account for such capacity limitation: slot models and resource models. In recent years, resource models have found support in both visual and auditory perception, but do they also extend to production? We investigate this by analyzing sublexical errors from four individuals with aphasia. Using tools from computational linguistics, we first define the concept of "precision" of sublexical errors. We then demonstrate that such precision decreases with increased working memory load, i.e., word length, as predicted by resource models. Finally, we rule out alternative accounts of this effect, such as articulatory simplification. These data provide the first evidence for the applicability of the resource model to production and further point to the generalizability of this account as a model of resource division in WM.

Working memory is updated by reallocation of resources from obsolete to new items

Visual working memory (VWM) resources are limited, placing constraints on how much visual information can be simultaneously retained. During visually guided activity, stored information can quickly become outdated, so updating mechanisms are needed to ensure the contents of memory remain relevant to current task goals. In particular, successful deallocation of resources from items that become obsolete is likely to be critical for maintaining the precision of those representations still in memory. The experiments in this study involved presenting two memory arrays of coloured disks in sequence. The appearance of the second array was a cue to replace, rehearse, or add a new colour to the colours in memory. We predicted that successful resource reallocation should result in comparable recall precision when an item was replaced or rehearsed, owing to the removal of pre-replacement features. In contrast, a failure to update WM should lead to comparable precision with a condition in which a new colour was added to memory. We identified a very small proportion (∼5%) of trials in which participants incorrectly reported a feature from the first array in place of its replacement in the second, which we interpreted as a failure to incorporate the information from the second display into memory. Once these trials were discounted, precision estimates were consistent with complete redistribution of resources in the case of updating a single item. We conclude that working memory can be efficiently updated when previous information becomes obsolete, but that this is a demanding active process that occasionally fails.

No evidence that the retro-cue benefit requires reallocation of memory resources

Selective mechanisms allow us to prioritize items held in working memory. Does this reflect reallocation of working memory resources? We examined a critical prediction of this account-that reallocating more resources from one item to another should provide a greater benefit. We used a reward manipulation to create variable allocation of resources. Subsequently, a retro-cue instructed participants to drop a memory item. This retro-cue improved performance for the prioritized items relative to a neutral baseline. However, in contrast to the prevailing reallocation account, we found no difference between dropping a higher versus lower reward item. Importantly, removal of high versus low reward items led to better encoding of subsequently presented items, demonstrating that our reward manipulation was successful. While allocation of resources can influence the encoding and storage of new information into working memory, reallocation does not appear to be essential for selection effects in working memory.

Little Support for Discrete Item Limits in Visual Working Memory

Some theorists argue that working memory is limited to a discrete number of items and that additional items are not encoded at all. Adam et al. (2017) presented evidence supporting this hypothesis: Participants reproduced visual features of up to six items in a self-chosen order. After the third or fourth response, error distributions were indistinguishable from guessing. I present four experiments with young adults (each N = 24) reexamining this finding. Experiment 1 presented items slowly and sequentially. Experiment 2 presented them simultaneously but longer than in the experiments of Adam et al. Experiments 3 and 4 exactly replicated one original experiment of Adam et al. All four experiments failed to replicate the evidence for guessing-like error distributions. Modeling data from individuals revealed a mixture of some who do and others who do not produce guessing-like distributions. This heterogeneity increases the credibility of an alternative to the item-limit hypothesis: Some individuals decide to guess on hard trials even when they have weak information in memory.

Sensory recruitment in visual short-term memory: A systematic review and meta-analysis of sensory visual cortex interference using transcranial magnetic stimulation

Sensory visual areas are involved in encoding information in visual short-term memory (VSTM). Yet it remains unclear whether sensory visual cortex is a necessary component of the brain network for maintenance of information in VSTM. Here, we aimed to systematically review studies that have investigated the role of the sensory visual cortex in VSTM using transcranial magnetic stimulation (TMS) and to quantitatively explore these effects using meta-analyses. Fourteen studies were identified and reviewed. Eight studies provided sufficient data for meta-analysis. Two meta-analyses, one regarding the VSTM encoding phase (17 effect sizes) and one regarding the VSTM maintenance phase (15 effect sizes), two meta-regressions (32 effect sizes in each), and one exploratory meta-analysis were conducted. Our results indicate that the sensory visual cortex is similarly involved in both the encoding and maintenance VSTM phase. We suggest that some cases where evidence did not show significant TMS effects was due to low memory or perceptual task demands. Overall, these findings support the idea that sensory visual areas are part of the brain network responsible for successfully maintaining information in VSTM.

Luminance Contrast Drives Interactions between Perception and Working Memory

Visual working memory (WM) enables the use of past sensory experience in guiding behavior. Yet, laboratory tasks commonly evaluate WM in a way that separates it from its sensory bottleneck. To understand how perception interacts with visual memory, we used a delayed shape recognition task to probe how WM may differ for stimuli that bias processing toward different visual pathways. Luminance compared with chromatic signals are more efficient in driving the processing of shapes and may thus also lead to better WM encoding, maintenance, and memory recognition. To evaluate this prediction, we conducted two experiments. In the first psychophysical experiment, we measured contrast thresholds for different WM loads. Luminance contrast was encoded into WM more efficiently than chromatic contrast, even when both sets of stimuli were equated for discriminability. In the second experiment, which also equated stimuli for discriminability, early sensory responses in the EEG that are specific to luminance pathways were modulated by WM load and thus likely reflect the neural substrate of the increased efficiency. Our results cannot be accounted for by simple saliency differences between luminance and color. Rather, they provide evidence for a direct connection between low-level perceptual mechanisms and WM by showing a crucial role of luminance for forming WM representations of shape.

Dynamics of Visual Perceptual Decision-Making in Freely Behaving Mice

The temporal dynamics of perceptual decisions offer a key window into the cognitive processes contributing to decision-making. Investigating perceptual dynamics in a genetically tractable animal model can facilitate the subsequent unpacking of the underlying neural mechanisms. Here, we investigated the time course as well as fundamental psychophysical constants governing visual perceptual decision-making in freely behaving mice. We did so by analyzing response accuracy against reaction time (RT), i.e., conditional accuracy, in a series of two-alternative forced choice (2-AFC) orientation discrimination tasks in which we varied target size, luminance, duration, and presence of a foil. Our results quantified two distinct stages in the time course of mouse visual decision-making: a "sensory encoding" stage in which conditional accuracy exhibits a classic trade-off with response speed, and a subsequent "short-term memory (STM)-dependent" stage in which conditional accuracy exhibits a classic asymptotic decay following stimulus offset. We estimated the duration of visual sensory encoding as 200-320 ms across tasks, the lower bound of the duration of STM as ∼1700 ms, and the briefest duration of visual stimulus input that is informative as ≤50 ms. Separately, by varying stimulus onset delay, we demonstrated that the conditional accuracy function (CAF) and RT distribution can be independently modulated, and found that the duration for which mice naturally withhold from responding is a quantitative metric of impulsivity. Taken together, our results establish a quantitative foundation for investigating the neural circuit bases of visual decision dynamics in mice.

Dynamics of Visual Perceptual Decision-Making in Freely Behaving Mice

The temporal dynamics of perceptual decisions offer a key window into the cognitive processes contributing to decision-making. Investigating perceptual dynamics in a genetically tractable animal model can facilitate the subsequent unpacking of the underlying neural mechanisms. Here, we investigated the time course as well as fundamental psychophysical constants governing visual perceptual decision-making in freely behaving mice. We did so by analyzing response accuracy against reaction time (RT), i.e., conditional accuracy, in a series of two-alternative forced choice (2-AFC) orientation discrimination tasks in which we varied target size, luminance, duration, and presence of a foil. Our results quantified two distinct stages in the time course of mouse visual decision-making: a “sensory encoding” stage in which conditional accuracy exhibits a classic trade-off with response speed, and a subsequent “short-term memory (STM)-dependent” stage in which conditional accuracy exhibits a classic asymptotic decay following stimulus offset. We estimated the duration of visual sensory encoding as 200–320 ms across tasks, the lower bound of the duration of STM as ∼1700 ms, and the briefest duration of visual stimulus input that is informative as ≤50 ms. Separately, by varying stimulus onset delay, we demonstrated that the conditional accuracy function (CAF) and RT distribution can be independently modulated, and found that the duration for which mice naturally withhold from responding is a quantitative metric of impulsivity. Taken together, our results establish a quantitative foundation for investigating the neural circuit bases of visual decision dynamics in mice.

Working Memory for Spatial Sequences: Developmental and Evolutionary Factors in Encoding Ordinal and Relational Structures

Sequence learning is a ubiquitous facet of human and animal cognition. Here, using a common sequence reproduction task, we investigated whether and how the ordinal and relational structures linking consecutive elements are acquired by human adults, children, and macaque monkeys. While children and monkeys exhibited significantly lower precision than adults for spatial location and temporal order information, only monkeys appeared to exceedingly focus on the first item. Most importantly, only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used a chunking strategy to compress sequences in working memory. Monkeys did not detect such relational structures, even after extensive training. Monkey behavior was captured by a conjunctive coding model, whereas a chunk-based conjunctive model explained more variance in humans. These age- and species-related differences are indicative of developmental and evolutionary mechanisms of sequence encoding and may provide novel insights into the uniquely human cognitive capacities.SIGNIFICANCE STATEMENT Sequence learning, the ability to encode the order of discrete elements and their relationships presented within a sequence, is a ubiquitous facet of cognition among humans and animals. By exploring sequence-processing abilities at different human developmental stages and in nonhuman primates, we found that only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used an internal language to compress sequences in working memory. The findings provided insights into understanding the origins of sequence capabilities in humans and how they evolve through development to identify the unique aspects of human cognitive capacity, which includes the comprehension, learning, and production of sequences, and perhaps, above all, language processing.

Does motor noise contaminate estimates of the precision of visual working memory?

The continuous-report task, in which subjects report the color of visual working memory representation by clicking on a color wheel, has become the gold standard for measuring the precision and number of representations stored in visual working memory. This task requires fine motor control, typically with a mouse, but the precision of responses have been interpreted as being entirely due to the precision of the memory representations, without regard to the contribution of noise from the response effectors (i.e., motor control of the hand). Here we tested the seemingly likely possibility that motor noise contaminates our estimates of visual memory representations in the continuous-report task by simply asking subjects to complete the color wheel continuous-report task using either their dominant or non-dominant hand on different blocks of trials. We found that subjects took longer to complete the task with their non-dominant hand, but this did not affect the precision of their responses. Our findings suggest that this commonly used task to study visual memory may be relatively immune from contamination by motor noise at the output stage.

Dynamic in-flight shifts of working memory resources across saccades

Little is known about how memory resources are allocated in natural vision across sequential eye movements and fixations, as people actively extract information from the visual environment. Here, we used gaze-contingent eye tracking to examine how such resources are dynamically reallocated from old to new information entering working memory. As participants looked sequentially at items, we interrupted the process at different times by extinguishing the display as a saccade was initiated. After a brief interval, participants were probed on one of the items that had been presented. Paradoxically, across all experiments, the final (unfixated) saccade target was recalled more precisely when more items had previously been fixated, that is, with longer rather than shorter saccade sequences. This result is difficult to explain on current models of working memory because recall error, even for the final item, is typically higher as memory load increases. The findings could however be accounted for by a model that describes how resources are dynamically reallocated on a moment-by-moment basis. During each saccade, the target is encoded by consuming a proportion of currently available resources from a limited working memory, as well as by reallocating resources away from previously encoded items. These findings reveal how working memory resources are shifted across memoranda in active vision. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The hippocampus supports high-precision binding in visual working memory

It is well established that the hippocampus is critical for long-term episodic memory, but a growing body of research suggests that it also plays a critical role in supporting memory over very brief delays as measured in tests of working memory (WM). However, the circumstances under which the hippocampus is necessary for WM and the specific processes that it supports remain controversial. We propose that the hippocampus supports WM by binding together high-precision properties of an event, and we test this claim by examining the precision of color-location bindings in a visual WM task in which participants report the precise color of studied items using a continuous color wheel. Amnestic patients with hippocampal damage were significantly impaired at retrieving these colors after a 1-s delay, and these impairments reflected a reduction in the precision of those memories rather than increases in total memory failures or binding errors. Moreover, a parallel fMRI study in healthy subjects revealed that neural activity in the head and body of the hippocampus was directly related to the precision of visual WM decisions. Together, these results indicate that the hippocampus is critical in complex high-precision binding that supports memory over brief delays.

The influence of attentional biases on multiple working memory precision parameters for children and adults

Working memory (WM) improves dramatically during childhood but what drives this improvement is not well understood. One influential account thus far has proposed a simple increase in storage capacity. However, recent findings have shown that multiple factors, such as differences in the ability to use attention to enhance the maintenance of internal representations, as well as changes in WM precision, also interact in influencing age-related differences in WM capacity. We aimed to examine whether and how the developing ability to orient attention retrospectively to internal representations influences WM precision. To do so, we employed a paradigm that combined the continuous-recall WM task with the partial-cueing report task. Specifically, 7-year-olds and young adults were asked to reproduce the colour of a probe item in a colour wheel. The initial memory array, which included the probe item, could be followed by a spatial cue that directed participants' attention to a location in the memory array (a 'retro-cue'). Results showed that attentional biases engendered by retro-cues facilitated overall precision compared to uncued baseline performance, for both age groups, although to a smaller degree in 7-year-olds compared to adults. Importantly, investigation of modelling parameters suggested that children demonstrate lower representational quality of items in WM but that spatial attentional cues improve overall precision by increasing the probability of target storage, maintenance and recall, and by reducing misbinding errors as well as random guessing, not by changing representational quality. These results add significantly to our knowledge on the relation between retrospective attention and WM development.

Visual Short-Term Memory for Coherent and Sequential Motion: A rTMS Investigation

We investigated the role of the human medio-temporal complex (hMT+) in the memory encoding and storage of a sequence of four coherently moving random dot kinematograms (RDKs), by applying repetitive transcranial magnetic stimulation (rTMS) during an early or late phase of the retention interval. Moreover, in a second experiment, we also tested whether disrupting the functional integrity of hMT+ during the early phase impaired the precision of the encoded motion directions. Overall, results showed that both recognition accuracy and precision were worse in middle serial positions, suggesting the occurrence of primacy and recency effects. We found that rTMS delivered during the early (but not the late) phase of the retention interval was able to impair not only recognition of RDKs, but also the precision of the retained motion direction. However, such impairment occurred only for RDKs presented in middle positions along the presented sequence, where performance was already closer to chance level. Altogether these findings suggest an involvement of hMT+ in the memory encoding of visual motion direction. Given that both position sequence and rTMS modulated not only recognition but also the precision of the stored information, these findings are in support of a model of visual short-term memory with a variable resolution of each stored item, consistent with the assigned amount of memory resources, and that such item-specific memory resolution is supported by the functional integrity of area hMT+.

Mechanisms of feature binding in visual working memory are stable over long delays

The ability to accurately retain the binding between the features of different objects is a critical element of visual working memory. The underlying mechanism can be elucidated by analyzing correlations of response errors in dual-report experiments, in which participants have to report two features of a single item from a previously viewed stimulus array. Results from separate previous studies using different cueing conditions have indicated that location takes a privileged role in mediating binding between other features, in that largely independent response errors have been observed when location was used as a cue, but errors were highly correlated when location was one of the reported features. Earlier results from change detection tasks likewise support such a special role of location, but they also suggest that this role is substantially reduced for longer retention intervals in favor of object-based representation. In the present study, we replicated the findings of previous dual-report tasks with different cueing conditions, using matched stimuli and procedures. Moreover, we show that the observed patterns of error correlations remain qualitatively unchanged with longer retention intervals. Fits with neural population models demonstrate that the behavioral results at long, as well as short, delays are best explained by memory representations in independent feature maps, in which an item's features are bound to each other only via their shared location.

Increased functional interaction within frontoparietal network during working memory task in major depressive disorder

Abnormal fronto-parietal activation has been suggested as a neural underpinning of the working memory (WM) deficits in major depressive disorder (MDD). However, the potential interaction within the frontoparietal network during WM processing in MDD remains unclear. This study aimed to examine the role of abnormal functional interactions within frontoparietal network in the neuropathological mechanisms of WM deficits in MDD. A total of 40 MDD patients and 47 demographic matched healthy controls (HCs) were included. Functional magnetic resonance imaging and behavioral data were collected during numeric n-back tasks. The psychophysiological interaction and dynamic causal modelling methods were applied to investigate the connectivity within the frontoparietal network in MDD during n-back tasks. The psychophysiological interaction analysis revealed that MDD patients showed increased functional connectivity between the right inferior parietal lobule (IPL) and the right dorsolateral prefrontal cortex (dlPFC) compared with HCs during the 2-back task. The dynamic causal modelling analysis revealed that MDD patients had significantly increased forward modulation connectivity from the right IPL to the right dlPFC than HCs during the 2-back task. Partial correlation was used to calculate the relationship between connective parameters and psychological variables in the MDD group, which showed that the effective connectivity from right IPL to right dlPFC was correlated negatively with the sensitivity index d' of WM performances and positively with the depressive severity in MDD group. In conclusion, the abnormal functional and effective connectivity between frontal and parietal regions might contribute to explain the neuropathological mechanism of working memory deficits in major depressive disorder.

Across-Area Synchronization Supports Feature Integration in a Biophysical Network Model of Working Memory

Working memory function is severely limited. One key limitation that constrains the ability to maintain multiple items in working memory simultaneously is so-called swap errors. These errors occur when an inaccurate response is in fact accurate relative to a non-target stimulus, reflecting the failure to maintain the appropriate association or "binding" between the features that define one object (e.g., color and location). The mechanisms underlying feature binding in working memory remain unknown. Here, we tested the hypothesis that features are bound in memory through synchrony across feature-specific neural assemblies. We built a biophysical neural network model composed of two one-dimensional attractor networks - one for color and one for location - simulating feature storage in different cortical areas. Within each area, gamma oscillations were induced during bump attractor activity through the interplay of fast recurrent excitation and slower feedback inhibition. As a result, different memorized items were held at different phases of the network's oscillation. These two areas were then reciprocally connected via weak cortico-cortical excitation, accomplishing binding between color and location through the synchronization of pairs of bumps across the two areas. Encoding and decoding of color-location associations was accomplished through rate coding, overcoming a long-standing limitation of binding through synchrony. In some simulations, swap errors arose: "color bumps" abruptly changed their phase relationship with "location bumps." This model, which leverages the explanatory power of similar attractor models, specifies a plausible mechanism for feature binding and makes specific predictions about swap errors that are testable at behavioral and neurophysiological levels.

Transsaccadic integration relies on a limited memory resource

Saccadic eye movements cause large-scale transformations of the image falling on the retina. Rather than starting visual processing anew after each saccade, the visual system combines post-saccadic information with visual input from before the saccade. Crucially, the relative contribution of each source of information is weighted according to its precision, consistent with principles of optimal integration. We reasoned that, if pre-saccadic input is maintained in a resource-limited store, such as visual working memory, its precision will depend on the number of items stored, as well as their attentional priority. Observers estimated the color of stimuli that changed imperceptibly during a saccade, and we examined where reports fell on the continuum between pre- and post-saccadic values. Bias toward the post-saccadic color increased with the set size of the pre-saccadic display, consistent with an increased weighting of the post-saccadic input as precision of the pre-saccadic representation declined. In a second experiment, we investigated if transsaccadic memory resources are preferentially allocated to attentionally prioritized items. An arrow cue indicated one pre-saccadic item as more likely to be chosen for report. As predicted, valid cues increased response precision and biased responses toward the pre-saccadic color. We conclude that transsaccadic integration relies on a limited memory resource that is flexibly distributed between pre-saccadic stimuli.

Allocation of resources in working memory: Theoretical and empirical implications for visual search

Recently, working memory (WM) has been conceptualized as a limited resource, distributed flexibly and strategically between an unlimited number of representations. In addition to improving the precision of representations in WM, the allocation of resources may also shape how these representations act as attentional templates to guide visual search. Here, we reviewed recent evidence in favor of this assumption and proposed three main principles that govern the relationship between WM resources and template-guided visual search. First, the allocation of resources to an attentional template has an effect on visual search, as it may improve the guidance of visual attention, facilitate target recognition, and/or protect the attentional template against interference. Second, the allocation of the largest amount of resources to a representation in WM is not sufficient to give this representation the status of attentional template and thus, the ability to guide visual search. Third, the representation obtaining the status of attentional template, whether at encoding or during maintenance, receives an amount of WM resources proportional to its relevance for visual search. Thus defined, the resource hypothesis of visual search constitutes a parsimonious and powerful framework, which provides new perspectives on previous debates and complements existing models of template-guided visual search.

Working Memory in Unilateral Spatial Neglect: Evidence for Impaired Binding of Object Identity and Object Location

Working memory (WM) is known to be impaired in patients with stroke experiencing unilateral spatial neglect (USN). Here, we examined in a systematic manner three WM components: memory of object identity, memory of object location, and binding between object identity and location. Moreover, we used two different retention intervals to isolate maintenance from other mnemonic and perceptual processes. Fourteen USN first-event stroke patients with right-hemisphere damage were tested in two different WM experiments using long and short retention intervals and an analog response scale. Patients exhibited more identification errors for items displayed on the contralesional side. Localization errors were also more prominent in the contralesional side, especially after a long retention interval. These localization errors were often a result of swap errors, that is, erroneous localizations of correctly identified contralesional objects in correctly memorized locations of ipsilesional objects. We conclude that a key WM deficit in USN is a lateralized impairment in binding between the identity of an object and its spatial tag.

Stochastic sampling provides a unifying account of visual working memory limits

Research into human working memory limits has been shaped by the competition between different formal models, with a central point of contention being whether internal representations are continuous or discrete. Here we describe a sampling approach derived from principles of neural coding as a framework to understand working memory limits. Reconceptualizing existing models in these terms reveals strong commonalities between seemingly opposing accounts, but also allows us to identify specific points of difference. We show that the discrete versus continuous nature of sampling is not critical to model fits, but that, instead, random variability in sample counts is the key to reproducing human performance in both single- and whole-report tasks. A probabilistic limit on the number of items successfully retrieved is an emergent property of stochastic sampling, requiring no explicit mechanism to enforce it. These findings resolve discrepancies between previous accounts and establish a unified computational framework for working memory that is compatible with neural principles.

The two-stage process in visual working memory consolidation

Two hypotheses have been proposed to explain the formation manner for visual working memory (VWM) representations during the consolidation process: an all-or-none process hypothesis and a coarse-to-fine process hypothesis. However, neither the all-or-none process hypothesis nor the coarse-to-fine process hypothesis can stipulate clearly how VWM representations are formed during the consolidation process. In the current study, we propose a two-stage process hypothesis to reconcile these hypotheses. The two-stage process hypothesis suggests that the consolidation of coarse information is an all-or-none process in the early consolidation stage, while the consolidation of detailed information is a coarse-to-fine process in the late consolidation stage. By systematically manipulating the encoding time of memory stimuli, we asked participants to memorize one (Experiment 1) or two (Experiment 2) orientations in different encoding time intervals. We found that the memory rate increased linearly as the encoding time increased. More importantly, VWM precision remained constant when the encoding time was short, while the precision increased linearly as the encoding time increased when the encoding time was sufficient. These results supported the two-stage process hypothesis, which reconciles previous conflicting findings in the literature.

Rapid forgetting of faces in congenital prosopagnosia

Congenital prosopagnosia (CP) is a life-long impairment in face recognition that occurs in the absence of any known brain damage. It is still unclear whether this disorder is related to a visual deficit, or to an impairment in encoding, maintaining or retrieving a face from memory. We tested CPs and matched neurotypical controls using a delayed estimation task in which a target face was shown either upright or inverted. Participants were asked to select the target face out of a cyclic space of morphed faces that could either resemble the target face, or not. The inclusion of upright and inverted faces enabled to examine the extent of the face inversion effect, a well-known face specific effect often associated with holistic processing. To enable disentangling visual from mnemonic processing, reports were required either following 1 and 6 sec retention interval, or simultaneously while the target face was still visible. Controls showed slower forgetting of upright compared to inverted faces. In contrast, CPs exhibited rapid forgetting of upright faces that was comparable to their performance and to performance of controls on inverted faces. Such forgetting was evident in random errors in which the selected faces did not resemble the face in memory, implying a time related decrease in the probability to access the correct face in memory. Importantly, CPs exhibited no inversion effect across all retention intervals, including the simultaneous one, suggesting that their abnormal rapid forgetting could be explained by an impairment in holistic visual processing of upright faces.

An Electrophysiological Dissociation of Encoding vs. Maintenance Failures in Visual-Spatial Working Memory

Working memory (WM) performance varies substantially among individuals but the precise contribution of different WM component processes to these functional limits remains unclear. By analyzing different types of responses in a spatial WM task, we recently demonstrated a functional dissociation between confident and not-confident errors reflecting failures of WM encoding and maintenance, respectively. Here, we use event-related brain potentials to further explore this dissociation. Healthy participants performed a delayed orientation-discrimination task and rated their response confidence for each trial. The encoding-related N2pc component was significantly reduced for confident errors compared to confident correct responses, which is indicative of an encoding failure. In contrast, the maintenance-related contra-lateral delay activity was similar for these response types indicating that in confident error trials, WM representations – potentially the wrong ones – were maintained accurately and with stability throughout the delay interval. However, contra-lateral delay activity measured during the early part of the delay period was decreased for not-confident errors, potentially reflecting compromised maintenance processes. These electrophysiological findings contribute to a refined understanding of the encoding and maintenance processes that contribute to limitations in WM performance and capacity.

Theory of neural coding predicts an upper bound on estimates of memory variability

Observers reproducing elementary visual features from memory after a short delay produce errors consistent with the encoding-decoding properties of neural populations. While inspired by electrophysiological observations of sensory neurons in cortex, the population coding account of these errors is based on a mathematical idealization of neural response functions that abstracts away most of the heterogeneity and complexity of real neuronal populations. Here we examine a more physiologically grounded model based on the tuning of a large set of neurons recorded in macaque V1 and show that key predictions of the idealized model are preserved. Both models predict long-tailed distributions of error when memory resources are taxed, as observed empirically in behavioral experiments and commonly approximated with a mixture of normal and uniform error components. Specifically, for an idealized homogeneous neural population, the width of the fitted normal distribution cannot exceed the average tuning width of the component neurons, and this also holds to a good approximation for more biologically realistic populations. Examining eight published studies of orientation recall, we find a consistent pattern of results suggestive of a median tuning width of approximately 20°, which compares well with neurophysiological observations. The finding that estimates of variability obtained by the normal-plus-uniform mixture method are bounded from above leads us to reevaluate previous studies that interpreted a saturation in width of the normal component as evidence for fundamental limits on the precision of perception, working memory, and long-term memory.

Distinct role of flexible and stable encodings in sequential working memory

The serial-position effect in working memory is considered important for studying how a sequence of sensory information can be retained and manipulated simultaneously in neural memory circuits. Here, via a precise analysis of the primacy and recency effects in human psychophysical experiments, we propose that stable and flexible codings take distinct roles of retaining and updating information in working memory, and that their combination induces serial-position effects spontaneously. We found that stable encoding retains memory to induce the primacy effect, while flexible encoding used for learning new inputs induces the recency effect. A model simulation based on human data, confirmed that a neural network with both flexible and stable synapses could reproduce the major characteristics of serial-position effects. Our new prediction, that the control of resource allocation by flexible-stable coding balance can modulate memory performance in sequence-specific manner, was supported by pre-cued memory performance data in humans.

Error-correcting dynamics in visual working memory

Working memory is critical to cognition, decoupling behavior from the immediate world. Yet, it is imperfect; internal noise introduces errors into memory representations. Such errors have been shown to accumulate over time and increase with the number of items simultaneously held in working memory. Here, we show that discrete attractor dynamics mitigate the impact of noise on working memory. These dynamics pull memories towards a few stable representations in mnemonic space, inducing a bias in memory representations but reducing the effect of random diffusion. Model-based and model-free analyses of human and monkey behavior show that discrete attractor dynamics account for the distribution, bias, and precision of working memory reports. Furthermore, attractor dynamics are adaptive. They increase in strength as noise increases with memory load and experiments in humans show these dynamics adapt to the statistics of the environment, such that memories drift towards contextually-predicted values. Together, our results suggest attractor dynamics mitigate errors in working memory by counteracting noise and integrating contextual information into memories.

Neural representations in working memory are susceptible to internal noise, which scales with memory load. Here, the authors show that attractor dynamics mitigate the influence of internal noise by pulling memories towards a few stable representations.

Perceptual consciousness and cognitive access from the perspective of capacity-unlimited working memory

Theories of consciousness divide over whether perceptual consciousness is rich or sparse in specific representational content and whether it requires cognitive access. These two issues are often treated in tandem because of a shared assumption that the representational capacity of cognitive access is fairly limited. Recent research on working memory challenges this shared assumption. This paper argues that abandoning the assumption undermines post-cue-based 'overflow' arguments, according to which perceptual consciousness is rich and does not require cognitive access. Abandoning it also dissociates the rich/sparse debate from the access question. The paper then explores attempts to reformulate overflow theses in ways that do not require the assumption of limited capacity. Finally, it discusses the problem of relating seemingly non-probabilistic perceptual consciousness to the probabilistic representations posited by the models that challenge conceptions of cognitive access as capacity-limited.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Adaptive allocation of human visual working memory capacity during statistical and categorical learning

Human brains are finite, and thus have bounded capacity. An efficient strategy for a capacity-limited agent is to continuously adapt by dynamically reallocating capacity in a task-dependent manner. Here we study this strategy in the context of visual working memory (VWM). People use their VWM stores to remember visual information over seconds or minutes. However, their memory performances are often error-prone, presumably due to VWM capacity limits. We hypothesize that people attempt to be flexible and robust by strategically reallocating their limited VWM capacity based on two factors: (a) the statistical regularities (e.g., stimulus feature means and variances) of the to-be-remembered items, and (b) the requirements of the task that they are attempting to perform. The latter specifies, for example, which types of errors are costly versus irrelevant for task performance. These hypotheses are formalized within a normative computational modeling framework based on rate-distortion theory, an extension of conventional Bayesian approaches that uses information theory to study rate-limited (or capacity-limited) processes. Using images of plants that are naturalistic and precisely controlled, we carried out two sets of experiments. Experiment 1 found that when a stimulus dimension (the widths of plants' leaves) was assigned a distribution, subjects adapted their VWM performances based on this distribution. Experiment 2 found that when one stimulus dimension (e.g., leaf width) was relevant for distinguishing plant categories but another dimension (leaf angle) was irrelevant, subjects' responses in a memory task became relatively more sensitive to the relevant stimulus dimension. Together, these results illustrate the task-dependent robustness of VWM, thereby highlighting the dependence of memory on learning.

Working memory capacity affects trade-off between quality and quantity only when stimulus exposure duration is sufficient: Evidence for the two-phase model

The relation between visual working memory (VWM) capacity and attention has attracted much interest. In this study, we investigated the correlation between the participants’ VWM capacity and their ability to voluntarily trade off the precision and number of items remembered. The two-phase resource allocation model proposed by Ye et al. (2017) suggests that for a given set size, it takes a certain amount of consolidation time for an individual to control attention to adjust the VWM resources to trade off the precision and number. To verify whether trade-off ability varies across VWM capacity, we measured each individual’s VWM capacity and then conducted a colour recall task to examine their trade-off ability. By manipulating the task requirement, participants were instructed to memorise either more colours in a low-precision way or fewer colours in a high-precision way. We conducted two experiments by adjusting stimulus duration to be longer than predicted critical value (Experiment 1) and duration shorter than predicted critical value (Experiment 2). While the results of Experiment 1 showed a positive correlation between the VWM capacity and trade-off ability, the results of Experiment 2 showed a lack of such correlation. These results are consistent with the prediction from the two-phase model.

Neural mechanisms of attending to items in working memory

Working memory, the ability to keep recently accessed information available for immediate manipulation, has been proposed to rely on two mechanisms that appear difficult to reconcile: self-sustained neural firing, or the opposite-activity-silent synaptic traces. Here we review and contrast models of these two mechanisms, and then show that both phenomena can co-exist within a unified system in which neurons hold information in both activity and synapses. Rapid plasticity in flexibly-coding neurons allows features to be bound together into objects, with an important emergent property being the focus of attention. One memory item is held by persistent activity in an attended or "focused" state, and is thus remembered better than other items. Other, previously attended items can remain in memory but in the background, encoded in activity-silent synaptic traces. This dual functional architecture provides a unified common mechanism accounting for a diversity of perplexing attention and memory effects that have been hitherto difficult to explain in a single theoretical framework.

Encoding differences affect the number and precision of own-race versus other-race faces stored in visual working memory

Other-race faces are discriminated and recognized less accurately than own-race faces. Despite a wealth of research characterizing this other-race effect (ORE), little is known about the nature of the representations of own-race versus other-race faces. This is because traditional measures of this ORE provide a binary measure of discrimination or recognition (correct/incorrect), failing to capture potential variation in the quality of face representations. We applied a novel continuous-response paradigm to independently measure the number of own-race and other-race face representations stored in visual working memory (VWM) and the precision with which they are stored. Participants reported target own-race or other-race faces on a circular face space that smoothly varied along the dimension of identity. Using probabilistic mixture modeling, we found that following ample encoding time, the ORE is attributable to differences in the probability of a face being maintained in VWM. Reducing encoding time, a manipulation that is more sensitive to encoding limitations, caused a loss of precision or an increase in variability of VWM for other-race but not own-race faces. These results suggest that the ORE is driven by the inefficiency with which other-race faces are rapidly encoded in VWM and provide novel insights about how perceptual experience influences the representation of own-race and other-race faces in VWM.

The separable effects of feature precision and item load in visual short-term memory

Visual short-term memory (VSTM) has been described as being limited by the number of discrete visual objects, the aggregate quantity of information across multiple visual objects, or some combination of the two. Many recent studies examining these capacity limitations have shown that increasing the number of items in VSTM increases the frequency and magnitude of errors in a participant's recall of the stimulus. This increase in response dispersion has been interpreted as a loss of precision in an item's representation as the number of items in memory increases, possibly due to a change in the tuning of the underlying representation. However, increased response dispersion can also be caused by a reduction in the total memory strength available for decision making as a consequence of a reduction in the total amount of a fixed resource representing a stimulus. We investigated the effects of load on the precision of memory representations in a fine orientation discrimination task. Accuracy was well captured by extending a simple sample-size model of VSTM, using a tuning function to account for the effect of orientation precision on performance. The best model of the data was one in which the item strength decreased progressively with memory load at all stimulus exposure durations but in which tuning bandwidth was invariant. Our results imply that memory strength and feature precision are experimentally dissociable attributes of VSTM.

Separating memoranda in depth increases visual working memory performance

Visual working memory is the mechanism supporting the continued maintenance of information after sensory inputs are removed. Although the capacity of visual working memory is limited, memoranda that are spaced farther apart on a 2-D display are easier to remember, potentially because neural representations are more distinct within retinotopically organized areas of visual cortex during memory encoding, maintenance, or retrieval. The impact on memory of spatial separability in depth is less clear, even though depth information is essential to guiding interactions with objects in the environment. On one account, separating memoranda in depth may facilitate performance if interference between items is reduced. However, depth information must be inferred indirectly from the 2-D retinal image, and less is known about how visual cortex represents depth. Thus, an alternative possibility is that separation in depth does not attenuate between-items interference; it may even impair performance, as attention must be distributed across a larger volume of 3-D space. We tested these alternatives using a stereo display while participants remembered the colors of stimuli presented either near or far in the 2-D plane or in depth. Increasing separation in-plane and in depth both enhanced performance. Furthermore, participants who were better able to utilize stereo depth cues showed larger benefits when memoranda were separated in depth, particularly for large memory arrays. The observation that spatial separation in the inferred 3-D structure of the environment improves memory performance, as is the case in 2-D environments, suggests that separating memoranda in depth might reduce neural competition by utilizing cortically separable resources.