Variability in the quality of visual working memory

Distinct neural mechanisms underlie the success, precision, and vividness of episodic memory

A network of brain regions have been linked with episodic memory retrieval, but limited progress has been made in identifying the contributions of distinct parts of the network. Here, we utilized continuous measures of retrieval to dissociate three components of episodic memory: retrieval success, precision, and vividness. In the fMRI scanner, participants encoded objects that varied continuously on three features: color, orientation, and location. Participants’ memory was tested by having them recreate the appearance of the object features using a continuous dial, and continuous vividness judgments were recorded. Retrieval success, precision, and vividness were dissociable both behaviorally and neurally: successful versus unsuccessful retrieval was associated with hippocampal activity, retrieval precision scaled with activity in the angular gyrus, and vividness judgments tracked activity in the precuneus. The ability to dissociate these components of episodic memory reveals the benefit afforded by measuring memory on a continuous scale, allowing functional parcellation of the retrieval network.

DOI:http://dx.doi.org/10.7554/eLife.18260.001

Remembering is something we do countless times each day. The detail and vividness with which we can remember is part of what makes memories so precious. Given the significance and complexity of memories, it is perhaps unsurprising that several parts of the brain are needed for us to experience them. Indeed, the brain regions involved in memory all work so closely together that it is a challenge to identify what role each region plays.

Richter, Cooper et al. aimed to design a memory task that could separate key characteristics of remembering, which would allow them to study links between each aspect and the different brain regions involved in memory. The resulting test involved showing people images of different objects whilst they were in an MRI medical imaging scanner. The people taking the test were asked to remember several objects that could vary in color, position and orientation. Participants were asked to rate how vividly they remembered the objects and then tried to precisely recreate their color, orientation and position.

The test allowed Richter, Cooper et al. to link specific parts of the brain to certain aspects of remembering. The hippocampus, an area known to be important in memory processing, indicated whether or not information had been remembered. More vivid memories were linked to greater activity in a region called the precuneus, which plays a role in imagination. Lastly, activity in a third region – the angular gyrus – indicated the precision of each memory.

Being able to study different aspects of memory using tests like this that collect detailed measurements could be important in identifying memory problems, for example, in people with brain diseases or head injuries, or after a stroke. Specifically, the methods developed by Richter, Cooper et al. could provide sensitive tools for detecting memory difficulties at an early stage. This may help more people to get treated sooner, potentially minimizing lasting complications.

DOI:http://dx.doi.org/10.7554/eLife.18260.002

Retrospective Attention Interacts with Stimulus Strength to Shape Working Memory Performance

Orienting attention retrospectively to selective contents in working memory (WM) influences performance. A separate line of research has shown that stimulus strength shapes perceptual representations. There is little research on how stimulus strength during encoding shapes WM performance, and how effects of retrospective orienting might vary with changes in stimulus strength. We explore these questions in three experiments using a continuous-recall WM task. In Experiment 1 we show that benefits of cueing spatial attention retrospectively during WM maintenance (retrocueing) varies according to stimulus contrast during encoding. Retrocueing effects emerge for supraliminal but not sub-threshold stimuli. However, once stimuli are supraliminal, performance is no longer influenced by stimulus contrast. In Experiments 2 and 3 we used a mixture-model approach to examine how different sources of error in WM are affected by contrast and retrocueing. For high-contrast stimuli (Experiment 2), retrocues increased the precision of successfully remembered items. For low-contrast stimuli (Experiment 3), retrocues decreased the probability of mistaking a target with distracters. These results suggest that the processes by which retrospective attentional orienting shape WM performance are dependent on the quality of WM representations, which in turn depends on stimulus strength during encoding.

No fixed item limit in visuospatial working memory

Investigations of working memory capacity in the visual domain have converged on the concept of a limited supply of a representational medium, flexibly distributed between objects. Current debate centers on whether this medium is continuous, or quantized into 2 or 3 memory "slots". The latter model makes the strong prediction that, if an item in memory is probed, behavioral parameters will plateau when the number of items is the same or more than the number of slots. Here we examine short-term memory for object location using a two-dimensional pointing task. We show that recall variability for items in memory increases monotonically from 1 to 8 items. Using a novel method to isolate only those trials on which a participant correctly identifies the target, we show that response latency also increases monotonically from 1 to 8 items. We argue that both these findings are incompatible with a quantized model.

Looking inward and back: Real-time monitoring of visual working memories

Confidence in our memories is influenced by many factors, including beliefs about the perceptibility or memorability of certain kinds of objects and events, as well as knowledge about our skill sets, habits, and experiences. Notoriously, our knowledge and beliefs about memory can lead us astray, causing us to be overly confident in eyewitness testimony or to overestimate the frequency of recent experiences. Here, using visual working memory as a case study, we stripped away all these potentially misleading cues, requiring observers to make confidence judgments by directly assessing the quality of their memory representations. We show that individuals can monitor the status of information in working memory as it degrades over time. Our findings suggest that people have access to information reflecting the existence and quality of their working memories, and furthermore, that they can use this information to guide their behavior. (PsycINFO Database Record

The effects of long-term stress on neural dynamics of working memory processing: An investigation using ERP

This study examined the neural dynamics of working memory (WM) processing under long-term stress. Forty participants who had been exposed to a long period of major exam preparation (six months) and twenty-one control participants performed a numerical n-back task (n = 1, 2) while electroencephalograms were recorded. Psychological and endocrinal measurements confirmed significantly higher levels of long-term stress for participants in the exam group. The exam group showed significantly increased P2 amplitude in the frontal-central sites in the 1-back and 2-back conditions, whereas other ERP components, including the P1, N1 and P3 and behavioral performance, were unchanged. Notably, the P2 effect was most pronounced in participants in the exam group who reported perceiving high levels of stress. The perceived stress scores positively correlated with the P2 amplitude in the 1-back and 2-back conditions. These results suggest that long-term stress has an impact on attention and the initiation of the updating process in WM.

The same type of visual working memory limitations in humans and monkeys

Rhesus monkeys are widely used as an animal model for human memory, including visual working memory (VWM). It is, however, unknown whether the same principles govern VWM in humans and rhesus monkeys. Here, we tested both species in nearly identical change-localization paradigms and formally compared the same set of models of VWM limitations. These models include the classic item-limit model and recent noise-based (resource) models, as well as hybrid models that combine a noise-based representation with an item limit. By varying the magnitude of the change in addition to the typical set size manipulation, we were able to show large differences in goodness of fit among the five models tested. In spite of quantitative performance differences between the species, we find that the variable-precision model--a noise-based model--best describes the behavior of both species. Adding an item limit to this model does not help to account for the data. Our results suggest evolutionary continuity of VWM across primates and help establish the rhesus monkey as a model system for studying the neural substrates of multiple-item VWM.

Do People Take Stimulus Correlations into Account in Visual Search?

In laboratory visual search experiments, distractors are often statistically independent of each other. However, stimuli in more naturalistic settings are often correlated and rarely independent. Here, we examine whether human observers take stimulus correlations into account in orientation target detection. We find that they do, although probably not optimally. In particular, it seems that low distractor correlations are overestimated. Our results might contribute to bridging the gap between artificial and natural visual search tasks.

Strategic trade-offs between quantity and quality in working memory

Is working memory capacity determined by an immutable limit-for example, 4 memory storage slots? The fact that performance is typically unaffected by task instructions has been taken as support for such structural models of memory. Here, we modified a standard working memory task to incentivize participants to remember more items. Participants were asked to remember a set of colors over a short retention interval. In 1 condition, participants reported a random item's color using a color wheel. In the modified task, participants responded to all items and their response was only considered correct if all responses were on the correct half of the color wheel. We looked for a trade-off between quantity and quality-participants storing more items, but less precisely, when required to report them all. This trade-off was observed when tasks were blocked and when task-type was cued after encoding, but not when task-type was cued during the response, suggesting that task differences changed how items were actively encoded and maintained. This strategic control over the contents of working memory challenges models that assume inflexible limits on memory storage. (PsycINFO Database Record

Retrospective Attention Gates Discrete Conscious Access to Past Sensory Stimuli

Cueing attention after the disappearance of visual stimuli biases which items will be remembered best. This observation has historically been attributed to the influence of attention on memory as opposed to subjective visual experience. We recently challenged this view by showing that cueing attention after the stimulus can improve the perception of a single Gabor patch at threshold levels of contrast. Here, we test whether this retro-perception actually increases the frequency of consciously perceiving the stimulus, or simply allows for a more precise recall of its features. We used retro-cues in an orientation-matching task and performed mixture-model analysis to independently estimate the proportion of guesses and the precision of non-guess responses. We find that the improvements in performance conferred by retrospective attention are overwhelmingly determined by a reduction in the proportion of guesses, providing strong evidence that attracting attention to the target’s location after its disappearance increases the likelihood of perceiving it consciously.

Evaluating and excluding swap errors in analogue tests of working memory

When observers retrieve simple visual features from working memory, two kinds of error are typically confounded in their recall. First, responses reflect noise or variability within the feature dimension they were asked to report. Second, responses are corrupted by “swap errors”, in which a different item from the memory set is reported in place of the one that was probed. Independent evaluation of these error sources is vital for understanding the structure of internal representations and their binding. However, previous methods for disentangling these errors have been critically dependent on assumptions about the noise distribution, which is a priori unknown. Here I address this question with novel non-parametric (NP) methods, which estimate swap frequency and feature variability with fewer prior assumptions, and without a fitting procedure. The results suggest that swap errors are considerably more prevalent than previously appreciated (accounting for more than a third of responses at set size 8). These methods also identify which items are swapped in for targets: when the target item is cued by location, the items in closest spatial proximity are most likely to be incorrectly reported, thus implicating noise in the probe feature dimension as a source of swap errors.

Memory strength versus memory variability in visual change detection

Observers made change-detection judgments for colored squares in a paradigm that manipulated the retention interval, the magnitude of change, and objective change probability. The probability of change judgments increased across the retention interval for “same” and “small-change” test items but stayed the same or decreased for “large-change” and “far” test items. A variety of formal models were fitted to the individual-subject data. The modeling results provided evidence that, beyond changes in visual-memory precision, there were decreases in memory strength of individual study items across the retention interval. In addition, the modeling results provided evidence of a zero-information, absence-of-memory state that required guessing. The data were not sufficiently strong to sharply distinguish whether the losses in memory strength across the retention interval were continuous in nature or all-or-none. The authors argue that the construct of memory strength as distinct from memory variability is an important component of the nature of forgetting from visual working memory.

Neurocognitive Architecture of Working Memory

A crucial role for working memory in temporary information processing and guidance of complex behavior has been recognized for many decades. There is emerging consensus that working-memory maintenance results from the interactions among long-term memory representations and basic processes, including attention, that are instantiated as reentrant loops between frontal and posterior cortical areas, as well as sub-cortical structures. The nature of such interactions can account for capacity limitations, lifespan changes, and restricted transfer after working-memory training. Recent data and models indicate that working memory may also be based on synaptic plasticity and that working memory can operate on non-consciously perceived information.

Evidence for Optimal Integration of Visual Feature Representations across Saccades

We explore the visual world through saccadic eye movements, but saccades also present a challenge to visual processing by shifting externally stable objects from one retinal location to another. The brain could solve this problem in two ways: by overwriting preceding input and starting afresh with each fixation or by maintaining a representation of presaccadic visual features in working memory and updating it with new information from the remapped location. Crucially, when multiple objects are present in a scene the planning of eye movements profoundly affects the precision of their working memory representations, transferring limited memory resources from fixation toward the saccade target. Here we show that when humans make saccades, it results in an update of not just the precision of representations but also their contents. When multiple item colors are shifted imperceptibly during a saccade the perceived colors are found to fall between presaccadic and postsaccadic values, with the weight given to each input varying continuously with item location, and fixed relative to saccade parameters. Increasing sensory uncertainty, by adding color noise, biases updating toward the more reliable input, which is consistent with an optimal integration of presaccadic working memory with a postsaccadic updating signal. We recover this update signal and show it to be tightly focused on the vicinity of the saccade target. These results reveal how the nervous system accumulates detailed visual information from multiple views of the same object or scene.

SIGNIFICANCE STATEMENT

This study examines the consequences of saccadic eye movements for the internal representation of visual objects. A saccade shifts the image of a stable visual object from one part of the retina to another. We show that visual representations are built up over these different views of the same object, by combining information obtained before and after each saccade. The weights given to presaccadic and postsaccadic information are determined by the relative reliability of each input. This provides evidence that the visual system combines inputs over time in a statistically optimal way.

Crowding in Visual Working Memory Reveals Its Spatial Resolution and the Nature of Its Representations

Spatial resolution fundamentally limits any image representation. Although this limit has been extensively investigated for perceptual representations by assessing how neighboring flankers degrade the perception of a peripheral target with visual crowding, the corresponding limit for representations held in visual working memory (VWM) is unknown. In the present study, we evoked crowding in VWM and directly compared resolution in VWM and perception. Remarkably, the spatial resolution of VWM proved to be no worse than that of perception. However, mixture modeling of errors caused by crowding revealed the qualitatively distinct nature of these representations. Perceptual crowding errors arose from both increased imprecision in target representations and substitution of flankers for targets. By contrast, VWM crowding errors arose exclusively from substitutions, which suggests that VWM transforms analog perceptual representations into discrete items. Thus, although perception and VWM share a common resolution limit, exceeding this limit reveals distinct mechanisms for perceiving images and holding them in mind.

Spikes not slots: noise in neural populations limits working memory

This opinion article argues that noise (randomness) in neural activity is the limiting factor in visual working memory (WM), determining how accurately we can maintain stable internal representations of external stimuli. Sharing of a fixed amount of neural activity between items in memory explains why WM can be successfully described as a continuous resource. This contrasts with the popular conception of WM as comprising a limited number of memory slots, each holding a representation of one stimulus - I argue that this view is challenged by computational theory and the latest neurophysiological evidence.

The effect of memory and context changes on color matches to real objects

Real-world color identification tasks often require matching the color of objects between contexts and after a temporal delay, thus placing demands on both perceptual and memory processes. Although the mechanisms of matching colors between different contexts have been widely studied under the rubric of color constancy, little research has investigated the role of long-term memory in such tasks or how memory interacts with color constancy. To investigate this relationship, observers made color matches to real study objects that spanned color space, and we independently manipulated the illumination impinging on the objects, the surfaces in which objects were embedded, and the delay between seeing the study object and selecting its color match. Adding a 10-min delay increased both the bias and variability of color matches compared to a baseline condition. These memory errors were well accounted for by modeling memory as a noisy but unbiased version of perception constrained by the matching methods. Surprisingly, we did not observe significant increases in errors when illumination and surround changes were added to the 10-minute delay, although the context changes alone did elicit significant errors.

The number of objects determines visual working memory capacity allocation for complex items

The goal of the present study was to examine whether visual working memory (WM) capacity allocation is determined solely by complexity, with the number of objects being redundant, as suggested by flexible resource models. Participants performed the change detection task with random polygons as stimuli, while we monitored the contralateral delay activity (CDA), an electrophysiological marker whose amplitude rises as WM load increases. In Experiment 1, we compared the WM maintenance of one whole polygon to a single half of the polygon, equating the number of items but varying the complexity level. Additionally, we compared the whole polygon to two halves of a polygon, thus roughly equating perceptual complexity but manipulating the number of items. The results suggested that only the number of objects determined WM capacity allocation: the CDA was identical when comparing one whole polygon to one polygon half, even though these conditions differed in complexity. Furthermore, the CDA amplitude was lower in the whole polygon condition relative to the two halves condition, even though both contained roughly the same amount of information. Experiment 2 extended these results by showing that two polygon halves that moved separately but then met and moved together were gradually integrated to consume similar WM capacity as one polygon half. Additionally, in both experiments we found an object benefit in accuracy, corroborating the important role of objects in WM. Our results demonstrate that WM capacity allocation cannot be explained by complexity alone. Instead, it is highly sensitive to objecthood, as suggested by discrete slot models.

Toward ecologically realistic theories in visual short-term memory research

Recent evidence from neuroimaging and psychophysics suggests common neural and representational substrates for visual perception and visual short-term memory (VSTM).Visual perception is adapted to a rich set of statistical regularities present in the natural visual environment. Common neural and representational substrates for visual perception and VSTM suggest that VSTM is adapted to these same statistical regularities too. This article discusses how the study of VSTM can be extended to stimuli that are ecologically more realistic than those commonly used in standard VSTM experiments and what the implications of such an extension could be for our current view of VSTM. We advocate for the development of unified models of visual perception and VSTM—probabilistic and hierarchical in nature— incorporating prior knowledge of natural scene statistics.

Expertise for upright faces improves the precision but not the capacity of visual working memory

Considerable research has focused on how basic visual features are maintained in working memory, but little is currently known about the precision or capacity of visual working memory for complex objects. How precisely can an object be remembered, and to what extent might familiarity or perceptual expertise contribute to working memory performance? To address these questions, we developed a set of computer-generated face stimuli that varied continuously along the dimensions of age and gender, and we probed participants' memories using a method-of-adjustment reporting procedure. This paradigm allowed us to separately estimate the precision and capacity of working memory for individual faces, on the basis of the assumptions of a discrete capacity model, and to assess the impact of face inversion on memory performance. We found that observers could maintain up to four to five items on average, with equally good memory capacity for upright and upside-down faces. In contrast, memory precision was significantly impaired by face inversion at every set size tested. Our results demonstrate that the precision of visual working memory for a complex stimulus is not strictly fixed but, instead, can be modified by learning and experience. We find that perceptual expertise for upright faces leads to significant improvements in visual precision, without modifying the capacity of working memory.

Focused attention improves working memory: implications for flexible-resource and discrete-capacity models

Performance in working memory (WM) tasks depends on the capacity for storing objects and on the allocation of attention to these objects. Here, we explored how capacity models need to be augmented to account for the benefit of focusing attention on the target of recall. Participants encoded six colored disks (Experiment 1) or a set of one to eight colored disks (Experiment 2) and were cued to recall the color of a target on a color wheel. In the no-delay condition, the recall-cue was presented after a 1,000-ms retention interval, and participants could report the retrieved color immediately. In the delay condition, the recall-cue was presented at the same time as in the no-delay condition, but the opportunity to report the color was delayed. During this delay, participants could focus attention exclusively on the target. Responses deviated less from the target's color in the delay than in the no-delay condition. Mixture modeling assigned this benefit to a reduction in guessing (Experiments 1 and 2) and transposition errors (Experiment 2). We tested several computational models implementing flexible or discrete capacity allocation, aiming to explain both the effect of set size, reflecting the limited capacity of WM, and the effect of delay, reflecting the role of attention to WM representations. Both models fit the data better when a spatially graded source of transposition error is added to its assumptions. The benefits of focusing attention could be explained by allocating to this object a higher proportion of the capacity to represent color.

A probabilistic palimpsest model of visual short-term memory

Working memory plays a key role in cognition, and yet its mechanisms remain much debated. Human performance on memory tasks is severely limited; however, the two major classes of theory explaining the limits leave open questions about key issues such as how multiple simultaneously-represented items can be distinguished. We propose a palimpsest model, with the occurrent activity of a single population of neurons coding for several multi-featured items. Using a probabilistic approach to storage and recall, we show how this model can account for many qualitative aspects of existing experimental data. In our account, the underlying nature of a memory item depends entirely on the characteristics of the population representation, and we provide analytical and numerical insights into critical issues such as multiplicity and binding. We consider representations in which information about individual feature values is partially separate from the information about binding that creates single items out of multiple features. An appropriate balance between these two types of information is required to capture fully the different types of error seen in human experimental data. Our model provides the first principled account of misbinding errors. We also suggest a specific set of stimuli designed to elucidate the representations that subjects actually employ.

Humans can remember several visual items for a few seconds and recall them; however, performance deteriorates surprisingly quickly with the number of items that must be stored. Along with increasingly inaccurate recollection, subjects make association errors, sometimes apparently recalling the wrong item altogether. No current model accounts for these data fully. We discuss a simple model that focuses attention on the population representations that are putatively involved, and thereby on limits to the amount of information that can be stored and recalled. We use theoretical and numerical methods to examine the characteristics and performance of our model.

Sequential dynamics in visual short-term memory

Visual short-term memory (VSTM) is thought to help bridge across changes in visual input, and yet many studies of VSTM employ static displays. Here we investigate how VSTM copes with sequential input. In particular, we characterize the temporal dynamics of several different components of VSTM performance, including: storage probability, precision, variability in precision, guessing, and swapping. We used a variant of the continuous-report VSTM task developed for static displays, quantifying the contribution of each component with statistical likelihood estimation, as a function of serial position and set size. In Experiments 1 and 2, storage probability did not vary by serial position for small set sizes, but showed a small primacy effect and a robust recency effect for larger set sizes; precision did not vary by serial position or set size. In Experiment 3, the recency effect was shown to reflect an increased likelihood of swapping out items from earlier serial positions and swapping in later items, rather than an increased rate of guessing for earlier items. Indeed, a model that incorporated responding to non-targets provided a better fit to these data than alternative models that did not allow for swapping or that tried to account for variable precision. These findings suggest that VSTM is updated in a first-in-first-out manner, and they bring VSTM research into closer alignment with classical working memory research that focuses on sequential behavior and interference effects.

"Plateau"-related summary statistics are uninformative for comparing working memory models

Performance on visual working memory tasks decreases as more items need to be remembered. Over the past decade, a debate has unfolded between proponents of slot models and slotless models of this phenomenon (Ma, Husain, Bays (Nature Neuroscience 17, 347-356, 2014). Zhang and Luck (Nature 453, (7192), 233-235, 2008) and Anderson, Vogel, and Awh (Attention, Perception, Psychophys 74, (5), 891-910, 2011) noticed that as more items need to be remembered, "memory noise" seems to first increase and then reach a "stable plateau." They argued that three summary statistics characterizing this plateau are consistent with slot models, but not with slotless models. Here, we assess the validity of their methods. We generated synthetic data both from a leading slot model and from a recent slotless model and quantified model evidence using log Bayes factors. We found that the summary statistics provided at most 0.15 % of the expected model evidence in the raw data. In a model recovery analysis, a total of more than a million trials were required to achieve 99 % correct recovery when models were compared on the basis of summary statistics, whereas fewer than 1,000 trials were sufficient when raw data were used. Therefore, at realistic numbers of trials, plateau-related summary statistics are highly unreliable for model comparison. Applying the same analyses to subject data from Anderson et al. (Attention, Perception, Psychophys 74, (5), 891-910, 2011), we found that the evidence in the summary statistics was at most 0.12 % of the evidence in the raw data and far too weak to warrant any conclusions. The evidence in the raw data, in fact, strongly favored the slotless model. These findings call into question claims about working memory that are based on summary statistics.

Central and peripheral components of working memory storage

This study reexamines the issue of how much of working memory storage is central, or shared across sensory modalities and verbal and nonverbal codes, and how much is peripheral, or specific to a modality or code. In addition to the exploration of many parameters in 9 new dual-task experiments and reanalysis of some prior evidence, the innovations of the present work compared to previous studies of memory for 2 stimulus sets include (a) use of a principled set of formulas to estimate the number of items in working memory and (b) a model to dissociate central components, which are allocated to very different stimulus sets depending on the instructions, from peripheral components, which are used for only 1 kind of material. We consistently find that the central contribution is smaller than was suggested by Saults and Cowan (2007) and that the peripheral contribution is often much larger when the task does not require the binding of features within an object. Previous capacity estimates are consistent with the sum of central plus peripheral components observed here. We consider the implications of the data as constraints on theories of working memory storage and maintenance.

Modulation of alpha power at encoding and retrieval tracks the precision of visual short-term memory

Our ability to hold information in mind is strictly limited. We sought to understand the relationship between oscillatory brain activity and the allocation of resources within visual short-term memory (VSTM). Participants attempted to remember target arrows embedded among distracters and used a continuous method of responding to report their memory for a cued target item. Trial-to-trial variability in the absolute circular accuracy with which participants could report the target was predicted by event-related alpha synchronization during initial processing of the memoranda and by alpha desynchronization during the retrieval of those items from VSTM. Using a model-based approach, we were also able to explore further which parameters of VSTM-guided behavior were most influenced by alpha band changes. Alpha synchronization during item processing enhanced the precision with which an item could be retained without affecting the likelihood of an item being represented per se (as indexed by the guessing rate). Importantly, our data outline a neural mechanism that mirrors the precision with which items are retained; the greater the alpha power enhancement during encoding, the greater the precision with which that item can be retained.

Factorial comparison of working memory models

Three questions have been prominent in the study of visual working memory limitations: (a) What is the nature of mnemonic precision (e.g., quantized or continuous)? (b) How many items are remembered? (c) To what extent do spatial binding errors account for working memory failures? Modeling studies have typically focused on comparing possible answers to a single one of these questions, even though the result of such a comparison might depend on the assumed answers to both others. Here, we consider every possible combination of previously proposed answers to the individual questions. Each model is then a point in a 3-factor model space containing a total of 32 models, of which only 6 have been tested previously. We compare all models on data from 10 delayed-estimation experiments from 6 laboratories (for a total of 164 subjects and 131,452 trials). Consistently across experiments, we find that (a) mnemonic precision is not quantized but continuous and not equal but variable across items and trials; (b) the number of remembered items is likely to be variable across trials, with a mean of 6.4 in the best model (median across subjects); (c) spatial binding errors occur but explain only a small fraction of responses (16.5% at set size 8 in the best model). We find strong evidence against all 6 documented models. Our results demonstrate the value of factorial model comparison in working memory.

Oscillatory brain state predicts variability in working memory

Our capacity to remember and manipulate objects in working memory (WM) is severely limited. However, this capacity limitation is unlikely to be fixed because behavioral models indicate variability from trial to trial. We investigated whether fluctuations in neural excitability at stimulus encoding, as indexed by low-frequency oscillations (in the alpha band, 8-14 Hz), contribute to this variability. Specifically, we hypothesized that the spontaneous state of alpha band activity would correlate with trial-by-trial fluctuations in visual WM. Electroencephalography recorded from human observers during a visual WM task revealed that the prestimulus desynchronization of alpha oscillations predicts the accuracy of memory recall on a trial-by-trial basis. A model-based analysis indicated that this effect arises from a modulation in the precision of memorized items, but not the likelihood of remembering them (the recall rate). The phase of posterior alpha oscillations preceding the memorized item also predicted memory accuracy. Based on correlations between prestimulus alpha levels and stimulus-related visual evoked responses, we speculate that the prestimulus state of the visual system prefigures a cascade of state-dependent processes, ultimately affecting WM-guided behavior. Overall, our results indicate that spontaneous changes in cortical excitability can have profound consequences for higher visual cognition.

Modulation of alpha and gamma oscillations related to retrospectively orienting attention within working memory

Selective attention mechanisms allow us to focus on information that is relevant to the current behavior and, equally important, ignore irrelevant information. An influential model proposes that oscillatory neural activity in the alpha band serves as an active functional inhibitory mechanism. Recent studies have shown that, in the same way that attention can be selectively oriented to bias sensory processing in favor of relevant stimuli in perceptual tasks, it is also possible to retrospectively orient attention to internal representations held in working memory. However, these studies have not explored the associated oscillatory phenomena. In the current study, we analysed the patterns of neural oscillatory activity recorded with magnetoencephalography while participants performed a change detection task, in which a spatial retro-cue was presented during the maintenance period, indicating which item or items were relevant for subsequent retrieval. Participants benefited from retro-cues in terms of accuracy and reaction time. Retro-cues also modulated oscillatory activity in the alpha and gamma frequency bands. We observed greater alpha activity in a ventral visual region ipsilateral to the attended hemifield, thus supporting its suppressive role, i.e. a functional disengagement of task-irrelevant regions. Accompanying this modulation, we found an increase in gamma activity contralateral to the attended hemifield, which could reflect attentional orienting and selective processing. These findings suggest that the oscillatory mechanisms underlying attentional orienting to representations held in working memory are similar to those engaged when attention is oriented in the perceptual space.

Noise in neural populations accounts for errors in working memory

Errors in short-term memory increase with the quantity of information stored, limiting the complexity of cognition and behavior. In visual memory, attempts to account for errors in terms of allocation of a limited pool of working memory resources have met with some success, but the biological basis for this cognitive architecture is unclear. An alternative perspective attributes recall errors to noise in tuned populations of neurons that encode stimulus features in spiking activity. I show that errors associated with decreasing signal strength in probabilistically spiking neurons reproduce the pattern of failures in human recall under increasing memory load. In particular, deviations from the normal distribution that are characteristic of working memory errors and have been attributed previously to guesses or variability in precision are shown to arise as a natural consequence of decoding populations of tuned neurons. Observers possess fine control over memory representations and prioritize accurate storage of behaviorally relevant information, at a cost to lower priority stimuli. I show that changing the input drive to neurons encoding a prioritized stimulus biases population activity in a manner that reproduces this empirical tradeoff in memory precision. In a task in which predictive cues indicate stimuli most probable for test, human observers use the cues in an optimal manner to maximize performance, within the constraints imposed by neural noise.

Changing concepts of working memory

Working memory is widely considered to be limited in capacity, holding a fixed, small number of items, such as Miller's 'magical number' seven or Cowan's four. It has recently been proposed that working memory might better be conceptualized as a limited resource that is distributed flexibly among all items to be maintained in memory. According to this view, the quality rather than the quantity of working memory representations determines performance. Here we consider behavioral and emerging neural evidence for this proposal.

The attentional blink reveals the probabilistic nature of discrete conscious perception

Attention and awareness are two tightly coupled processes that have been the subject of the same enduring debate: Are they allocated in a discrete or in a graded fashion? Using the attentional blink paradigm and mixture-modeling analysis, we show that awareness arises at central stages of information processing in an all-or-none manner. Manipulating the temporal delay between two targets affected subjects' likelihood of consciously perceiving the second target, but did not affect the precision of its representation. Furthermore, these results held across stimulus categories and paradigms, and they were dependent on attention having been allocated to the first target. The findings distinguish the fundamental contributions of attention and awareness at central stages of visual cognition: Conscious perception emerges in a quantal manner, with attention serving to modulate the probability that representations reach awareness.

Working memory retrieval differences between medial temporal lobe epilepsy patients and controls: a three memory layer approach

Multi-store models of working memory (WM) have given way to more dynamic approaches that conceive WM as an activated subset of long-term memory (LTM). The resulting framework considers that memory representations are governed by a hierarchy of accessibility. The activated part of LTM holds representations in a heightened state of activation, some of which can reach a state of immediate accessibility according to task demands. Recent neuroimaging studies have studied the neural basis of retrieval information with different states of accessibility. It was found that the medial temporal lobe (MTL) was involved in retrieving information within immediate access store and outside this privileged zone. In the current study we further explored the contribution of MTL to WM retrieval by analyzing the consequences of MTL damage to this process considering the state of accessibility of memory representations. The performance of a group of epilepsy patients with left hippocampal sclerosis in a 12-item recognition task was compared with that of a healthy control group. We adopted an embedded model of WM that distinguishes three components: the activated LTM, the region of direct access, and a single-item focus of attention. Groups did not differ when retrieving information from single-item focus, but patients were less accurate retrieving information outside focal attention, either items from LTM or items expected to be in the WM range. Analyses focused on items held in the direct access buffer showed that consequences of MTL damage were modulated by the level of accessibility of memory representations, producing a reduced capacity.

Modeling visual working memory with the MemToolbox

The MemToolbox is a collection of MATLAB functions for modeling visual working memory. In support of its goal to provide a full suite of data analysis tools, the toolbox includes implementations of popular models of visual working memory, real and simulated data sets, Bayesian and maximum likelihood estimation procedures for fitting models to data, visualizations of data and fit, validation routines, model comparison metrics, and experiment scripts. The MemToolbox is released under the permissive BSD license and is available at http://memtoolbox.org.

Distributed patterns of activity in sensory cortex reflect the precision of multiple items maintained in visual short-term memory

Traditionally, load sensitivity of sustained, elevated activity has been taken as an index of storage for a limited number of items in visual short-term memory (VSTM). Recently, studies have demonstrated that the contents of a single item held in VSTM can be decoded from early visual cortex, despite the fact that these areas do not exhibit elevated, sustained activity. It is unknown, however, whether the patterns of neural activity decoded from sensory cortex change as a function of load, as one would expect from a region storing multiple representations. Here, we use multivoxel pattern analysis to examine the neural representations of VSTM in humans across multiple memory loads. In an important extension of previous findings, our results demonstrate that the contents of VSTM can be decoded from areas that exhibit a transient response to visual stimuli, but not from regions that exhibit elevated, sustained load-sensitive delay-period activity. Moreover, the neural information present in these transiently activated areas decreases significantly with increasing load, indicating load sensitivity of the patterns of activity that support VSTM maintenance. Importantly, the decrease in classification performance as a function of load is correlated with within-subject changes in mnemonic resolution. These findings indicate that distributed patterns of neural activity in putatively sensory visual cortex support the representation and precision of information in VSTM.