A bilateral advantage for storage in visual working memory

Influence of presentation duration on filtering of irrelevant stimuli in visual working memory

In environments teeming with distractions, the ability to selectively focus on relevant information is crucial for advanced cognitive processing. Existing research using event-related potential (ERP) technology has shown active suppression of irrelevant stimuli during the consolidation phase of visual working memory (VWM). In previous studies, participants have always been given sufficient time to consolidate VWM, while suppressing distracting information. However, it remains unclear whether the suppression of irrelevant distractors requires continuous effort throughout their presence or whether this suppression is only necessary after the consolidation of task-relevant information. To address this question, our study examines whether distractor suppression is necessary in scenarios where consolidation time is limited. This research investigates the effect of varying presentation durations on the filtering of distractors in VWM. We tasked participants with memorizing two color stimuli and ignoring four distractors, presented for either 50 ms or 200 ms. Using ERP technology, we discovered that the distractor-induced distractor positivity (PD) amplitude is larger during longer presentation durations compared to shorter ones. These findings underscore the significant impact of presentation duration on the efficacy of distractor suppression in VWM, as prolonged exposure results in a stronger suppression effect on distractors. This study sheds light on the temporal dynamics of attention and memory, emphasizing the critical role of stimulus timing in cognitive tasks. These findings provide valuable insights into the mechanisms underlying VWM and have significant implications for models of attention and memory.

The differential impact of face distractors on visual working memory across encoding and delay stages

External distractions often occur when information must be retained in visual working memory (VWM)-a crucial element in cognitive processing and everyday activities. However, the distraction effects can differ if they occur during the encoding rather than the delay stages. Previous research on these effects used simple stimuli (e.g., color and orientation) rather than considering distractions caused by real-world stimuli on VWM. In the present study, participants performed a facial VWM task under different distraction conditions across the encoding and delay stages to elucidate the mechanisms of distraction resistance in the context of complex real-world stimuli. VWM performance was significantly impaired by delay-stage but not encoding-stage distractors (Experiment 1). In addition, the delay distraction effect arose primarily due to the absence of distractor process at the encoding stage rather than the presence of a distractor during the delay stage (Experiment 2). Finally, the impairment in the delay-distraction condition was not due to the abrupt appearance of distractors (Experiment 3). Taken together, these findings indicate that the processing mechanisms previously established for resisting distractions in VWM using simple stimuli can be extended to more complex real-world stimuli, such as faces.

Contralateral delay activity and alpha lateralization reflect retinotopic and screen-centered reference frames in visual memory

The visual system represents objects in a lateralized manner, with contralateral cortical hemispheres responsible for left and right visual hemifields. This organization extends to visual short-term memory (VSTM), as evidenced by electrophysiological indices of VSTM maintenance: contralateral delay activity (CDA) and alpha-band lateralization. However, it remains unclear if VSTM represents object locations in gaze-centered (retinotopic) or screen-centered (spatiotopic) coordinates, especially after eye movements. In two experiments, participants encoded the colors of target objects and made a lateral saccade during the maintenance interval, thereby shifting the object's location on the retina. A non-lateralized probe stimulus was then presented at the new fixation for a change detection task. The CDA maintained lateralization towards the target's original retinotopic location, unaffected by subsequent saccades, and did not invert polarity even when a saccade brought that location into the opposite hemifield. We also found conventional alpha lateralization towards the target's location before a saccade. After a saccade, however, alpha was lateralized towards the screen center regardless of the target's original location, even in a control condition without any memory requirements. This suggests that post-saccadic alpha-band lateralization reflects attentional processes unrelated to memory, while pre- and post-saccade CDA reflect VSTM maintenance in a retinotopic reference frame.

Testing hemifield independence for divided attention in visual object tasks

In this study, we asked to what degree hemifields contribute to divided attention effects observed in tasks with object-based judgments. If object recognition processes in the two hemifields were fully independent, then placing stimuli in separate hemifields would eliminate divided attention effects; in the alternative extreme, if object recognition processes in the two hemifields were fully integrated, then placing stimuli in separate hemifields would not modulate divided attention effects. Using a dual-task paradigm, we compared performance in a semantic categorization task for relevant stimuli arranged in the same hemifield to performance for relevant stimuli arranged in separate left and right hemifields. In two experiments, there was a reliable decrease in divided attention effects when stimuli were shown in separate hemifields compared to the same hemifield. However, the effect of divided attention was not eliminated. These results reject both the independent and integrated hypotheses, and instead support a third alternative - that object recognition processes in the two hemifields are partially dependent. More specifically, the magnitude of modulation by hemifields was closer to the prediction of the integrated hypothesis, suggesting that for dual tasks with objects, dependent processing is mostly shared across the visual field.

Cross-hemispheric recruitment during action planning with increasing task demand

The recruitment of cross-hemispheric counterparts of lateralized prefrontal brain regions with increasing processing demand is thought to increase memory performance despite cognitive aging, but was recently reported to be present also in young adults working at their capacity limit. Here we ask if cross-hemispheric recruitment is a general strategy of the adult brain in that executive task demand would modulate bilateral activation beyond prefrontal cortex and across cognitive tasks. We analyzed data sets from two fMRI experiments investigating retrospective working memory maintenance and prospective action planning. We confirmed a cross-hemispheric recruitment of prefrontal cortex across tasks and experiments. Changes in lateralization due to planning further surfaced in the cerebellum, dorsal premotor and posterior parietal cortex. Parietal cortex thereby exhibited cross-hemispheric recruitment also during spatial but not verbal working memory maintenance. Our results confirm a domain-general role of prefrontal cortex in cross-hemispheric recruitment. They further suggest that other task-specific brain regions also recruit their idling cross-hemispheric counterparts to relocate executive processing power.

Alterations in working memory maintenance of fearful face distractors in depressed participants: An ERP study

Task-irrelevant threatening faces (e.g., fearful) are difficult to filter from visual working memory (VWM), but the difficulty in filtering non-threatening negative faces (e.g., sad) is not known. Depressive symptoms could also potentially affect the ability to filter different emotional faces. We tested the filtering of task-irrelevant sad and fearful faces by depressed and control participants performing a color-change detection task. The VWM storage of distractors was indicated by contralateral delay activity, a specific event-related potential index for the number of objects stored in VWM during the maintenance phase. The control group did not store sad face distractors, but they automatically stored fearful face distractors, suggesting that threatening faces are specifically difficult to filter from VWM in non-depressed individuals. By contrast, depressed participants showed no additional consumption of VWM resources for either the distractor condition or the non-distractor condition, possibly suggesting that neither fearful nor sad face distractors were maintained in VWM. Our control group results confirm previous findings of a threat-related filtering difficulty in the normal population while also suggesting that task-irrelevant non-threatening negative faces do not automatically load into VWM. The novel finding of the lack of negative distractors within VWM storage in participants with depressive symptoms may reflect a decreased overall responsiveness to negative facial stimuli. Future studies should investigate the mechanisms underlying distractor filtering in depressed populations.

The facilitating effect of identical objects in visual working memory

According to the associative network of memory representations proposed by embedded processes models, the links between related memory representations were automatically established, which rendered these representations more easily activated. The present study adopted color recall tasks to explore whether the memory performance of identical objects was enhanced via the strengthening links between them, producing facilitating effect of identical objects. In Experiment 1, the number of identical items was manipulated. The results evidenced the facilitating effect, which was positively related to the number of identical objects. Experiment 2 modulated the spatial location of identical objects, which suggested that the facilitating effect was absent when two pairs of identical objects were located diagonally. Furthermore, Experiment 3 suggested that the facilitating effect was observed for the identical items which were presented in the second and fourth quadrants, rather than the first and third quadrants. Together, these results evidenced the facilitating effect of identical objects, which, however, was affected by spatial bias.

Encoding specificity instead of online integration of real-world spatial regularities for objects in working memory

Most objects show high degrees of spatial regularity (e.g. beach umbrellas appear above, not under, beach chairs). The spatial regularities of real-world objects benefit visual working memory (VWM), but the mechanisms behind this spatial regularity effect remain unclear. The "encoding specificity" hypothesis suggests that spatial regularity will enhance the visual encoding process but will not facilitate the integration of information online during VWM maintenance. The "perception-alike" hypothesis suggests that spatial regularity will function in both visual encoding and online integration during VWM maintenance. We investigated whether VWM integrates sequentially presented real-world objects by focusing on the existence of the spatial regularity effect. Throughout five experiments, we manipulated the presentation (simultaneous vs. sequential) and regularity (with vs. without regularity) of memory arrays among pairs of real-world objects. The spatial regularity of memory objects presented simultaneously, but not sequentially, improved VWM performance. We also examined whether memory load, verbal suppression and masking, and memory array duration hindered the spatial regularity effect in sequential presentation. We found a stable absence of the spatial regularity effect, suggesting that the participants were unable to integrate real-world objects based on spatial regularities online. Our results support the encoding specificity hypothesis, wherein the spatial regularity of real-world objects can enhance the efficiency of VWM encoding, but VWM cannot exploit spatial regularity to help organize sampled sequential information into meaningful integrations.

Unified Visual Working Memory without the Anterior Corpus Callosum

One of the most fundamental, and most studied, human cognitive functions is working memory. Yet, it is currently unknown how working memory is unified. In other words, why does a healthy human brain have one integrated capacity of working memory, rather than one capacity per visual hemifield, for instance. Thus, healthy subjects can memorize roughly as many items, regardless of whether all items are presented in one hemifield, rather than throughout two visual hemifields. In this current research, we investigated two patients in whom either most, or the entire, corpus callosum has been cut to alleviate otherwise untreatable epilepsy. Crucially, in both patients the anterior parts connecting the frontal and most of the parietal cortices, are entirely removed. This is essential, since it is often posited that working memory resides in these areas of the cortex. We found that despite the lack of direct connections between the frontal cortices in these patients, working memory capacity is similar regardless of whether stimuli are all presented in one visual hemifield or across two visual hemifields. This indicates that in the absence of the anterior parts of the corpus callosum working memory remains unified. Moreover, it is important to note that memory performance was not similar across visual fields. In fact, capacity was higher when items appeared in the left visual hemifield than when they appeared in the right visual hemifield. Visual information in the left hemifield is processed by the right hemisphere and vice versa. Therefore, this indicates that visual working memory is not symmetric, with the right hemisphere having a superior visual working memory. Nonetheless, a (subcortical) bottleneck apparently causes visual working memory to be integrated, such that capacity does not increase when items are presented in two, rather than one, visual hemifield.

Insights into visual working memory precision at the feature- and object-level from a hemispheric encoding manipulation

Mnemonic precision is an important aspect of visual working memory (WM). Here, we probed mechanisms that affect precision for spatial (size) and non-spatial (colour) features of an object, and whether these features are encoded and/or stored separately in WM. We probed precision at the feature-level—that is, whether different features of a single object are represented separately or together in WM—and the object-level—that is, whether different features across a set of sequentially presented objects are represented in the same or different WM stores. By manipulating whether stimuli were encoded by the left and/or right hemisphere, we gained further insights into how objects are represented in WM. At the feature-level, we tested whether recall fidelity for the two features of an object fluctuated in tandem from trial to trial. We observed no significant coupling under either central or lateralized encoding, supporting the claim of parallel feature channels at encoding. At the level of WM storage of a set of objects, we found asymmetric feature interference under central encoding, whereby an increase in colour load led to a decrease in size precision. When objects were encoded by a single hemisphere, however, we found largely independent feature stores. Precision for size was more resistant to interference from the size of another object under right-hemisphere encoding; by contrast, precision for colour did not differ across hemispheres, suggesting a more distributed WM store. These findings suggest that distinct features of a single object are represented separately but are then partially integrated during maintenance of a set of sequentially presented objects.

Hemifield-specific control of spatial attention and working memory: Evidence from hemifield crossover costs

Attentional tracking and working memory tasks are often performed better when targets are divided evenly between the left and right visual hemifields, rather than contained within a single hemifield (Alvarez & Cavanagh, 2005; Delvenne, 2005). However, this bilateral field advantage does not provide conclusive evidence of hemifield-specific control of attention and working memory, because it can be explained solely from hemifield-limited spatial interference at early stages of visual processing. If control of attention and working memory is specific to each hemifield, maintaining target information should become more difficult as targets move between the two hemifields. Observers in the present study maintained targets that moved either within or between the left and right hemifields, using either attention (Experiment 1) or working memory (Experiment 2). Maintaining spatial information was more difficult when target items moved between the hemifields compared with when target items moved within their original hemifields, consistent with hemifield-specific control of spatial attention and working memory. However, this pattern was not found for maintaining identity information (e.g., color) in working memory (Experiment 3). Together, these results provide evidence that control of spatial attention and working memory is specific to each hemifield, and that hemifield-specific control is a unique signature of spatial processing.

Gray Matter Volume in Different Cortical Structures Dissociably Relates to Individual Differences in Capacity and Precision of Visual Working Memory

Visual working memory (VWM) refers to our ability to selectively maintain visual information in a mental representation. While cognitive limits of VWM greatly influence a variety of mental operations, it remains controversial whether the quantity or quality of representations in mind constrains VWM. Here, we examined behavior-to-brain anatomical relations as well as brain activity to brain anatomy associations with a "neural" marker specific to the retention interval of VWM. Our results consistently indicated that individuals who maintained a larger number of items in VWM tended to have a larger gray matter (GM) volume in their left lateral occipital region. In contrast, individuals with a superior ability to retain with high precision tended to have a larger GM volume in their right parietal lobe. These results indicate that individual differences in quantity and quality of VWM may be associated with regional GM volumes in a dissociable manner, indicating willful integration of information in VWM may recruit separable cortical subsystems.

Theory of neural coding predicts an upper bound on estimates of memory variability

Observers reproducing elementary visual features from memory after a short delay produce errors consistent with the encoding-decoding properties of neural populations. While inspired by electrophysiological observations of sensory neurons in cortex, the population coding account of these errors is based on a mathematical idealization of neural response functions that abstracts away most of the heterogeneity and complexity of real neuronal populations. Here we examine a more physiologically grounded model based on the tuning of a large set of neurons recorded in macaque V1 and show that key predictions of the idealized model are preserved. Both models predict long-tailed distributions of error when memory resources are taxed, as observed empirically in behavioral experiments and commonly approximated with a mixture of normal and uniform error components. Specifically, for an idealized homogeneous neural population, the width of the fitted normal distribution cannot exceed the average tuning width of the component neurons, and this also holds to a good approximation for more biologically realistic populations. Examining eight published studies of orientation recall, we find a consistent pattern of results suggestive of a median tuning width of approximately 20°, which compares well with neurophysiological observations. The finding that estimates of variability obtained by the normal-plus-uniform mixture method are bounded from above leads us to reevaluate previous studies that interpreted a saturation in width of the normal component as evidence for fundamental limits on the precision of perception, working memory, and long-term memory.

Eye movement desensitization and reprocessing as a treatment for PTSD: current neurobiological theories and a new hypothesis

Eye movement desensitization and reprocessing (EMDR), a form of psychotherapy for individuals with post-traumatic stress disorder (PTSD), has long been a controversial topic, hampered in part by a lack of understanding of the neural mechanisms that contribute to its remedial effect. Here, we review current theories describing EMDR's potential neurobiological mechanisms of action involving working memory, interhemispheric communication, de-arousal, and memory reconsolidation. We then discuss recent studies describing the temporal and spatial aspects of smooth pursuit and predictive saccades, which resemble those made during EMDR, and their neural correlates within the default mode network (DMN) and cerebellum. We hypothesize that if the production of bilateral predictive eye movements is supportive of DMN and cerebellum activation, then therapies that shift the brain towards this state correspondingly would benefit the processes regulated by these structures (i.e., memory retrieval, relaxation, and associative learning), all of which are essential components for PTSD recovery. We propose that the timing of sensory stimulation may be relevant to treatment effect and could be adapted across different patients depending on their baseline saccade metrics. Empirical data in support of this model are reviewed and experimental predictions are discussed.

Parallel consolidation into visual working memory results in reduced precision representations

Information can be consolidated into visual working memory in parallel, i.e. two items can be consolidated in the same time required to consolidate one. However, while motion direction items consolidated in parallel are encoded at a reduced precision, no such reduction has been reported for colour. Here we examine two possible explanations for the inconsistency between the phenomena associated with consolidating these features in parallel: i) that reduced precision can only be detected when more than two colour items are consolidated in parallel, or ii) that the exposure duration used in previous studies was too long, allowing observers serially consolidate items. Our results show that (like motion direction) colour items consolidated in parallel are encoded at a reduced precision and the critical feature for detecting this phenomenon is the exposure duration. Furthermore, we demonstrate that this process is limited to two items. These findings indicate a general principle of consolidation into visual working memory, that is, a trade-off between the number of items consolidated in parallel and the precision at which they are encoded.

The bilateral field advantage effect in memory precision

Previous research has demonstrated that visual working memory performance is better when visual items are allocated in both left and right visual fields than within only one hemifield. This phenomenon is called the bilateral field advantage (BFA). The BFA is thought to be driven by an enhanced probability of storage, rather than by greater precision. In the present experiments, we sought to test whether the BFA can also extend to precision when the parameters of the task are modified. Using a moderate number of to-be-remembered items and 400 ms presentation time, we found better precision in the bilateral condition than in the unilateral condition. The classic BFA was still found in the form of an enhanced probability of storage, when presentation time was 200 ms. Thus, the BFA appears to convey both enhanced precision and greater probability of storage. The BFA is most likely due to the allocation of more attentional resources, when items are presented in both left and right visual fields.

Lateralization of Executive Function: Working Memory Advantage for Same Hemifield Stimuli in the Monkey

Working memory capacity, the amount of information that may be maintained in mind over a period of seconds, is extremely limited, to a handful of items. Some evidence exists that the number of visual items that may be maintained in working memory is independent for the two hemifields. To test this idea, we trained monkeys to perform visual working memory tasks that required maintenance in memory of the locations and/or shapes of 3–5 visual stimuli. We then tested whether systematic performance differences were present for stimuli concentrated in the same hemifield, vs. distributed across hemifields. We found little evidence to support the expectation that working memory capacity is independent in the two hemifields. Instead, when an advantage of stimulus arrangement was present, it involved multiple stimuli presented in the same hemifield. This conclusion was consistent across variations of the task, performance levels, and apparent strategies adopted by individual subjects. This result suggests that factors such as grouping that favor processing of stimuli in relative proximity may counteract the benefits of independent processing in the two hemispheres. Our results reveal an important property of working memory and place constraints on models of working memory capacity.

The impact of top-down spatial attention on laterality and hemispheric asymmetry in the human parietal cortex

The human parietal cortex exhibits a preference to contralaterally presented visual stimuli (i.e., laterality) as well as an asymmetry between the two hemispheres with the left parietal cortex showing greater laterality than the right. Using visual short-term memory and perceptual tasks and varying target location predictability, this study examined whether hemispheric laterality and asymmetry are fixed characteristics of the human parietal cortex or whether they are dynamic and modulated by the deployment of top-down attention to the target present hemifield. Two parietal regions were examined here that have previously been shown to be involved in visual object individuation and identification and are located in the inferior and superior intraparietal sulcus (IPS), respectively. Across three experiments, significant laterality was found in both parietal regions regardless of attentional modulation with laterality being greater in the inferior than superior IPS, consistent with their roles in object individuation and identification, respectively. Although the deployment of top-down attention had no effect on the superior IPS, it significantly increased laterality in the inferior IPS. The deployment of top-down spatial attention can thus amplify the strength of laterality in the inferior IPS. Hemispheric asymmetry, on the other hand, was absent in both brain regions and only emerged in the inferior but not the superior IPS with the deployment of top-down attention. Interestingly, the strength of hemispheric asymmetry significantly correlated with the strength of laterality in the inferior IPS. Hemispheric asymmetry thus seems to only emerge when there is a sufficient amount of laterality present in a brain region.

Spikes not slots: noise in neural populations limits working memory

This opinion article argues that noise (randomness) in neural activity is the limiting factor in visual working memory (WM), determining how accurately we can maintain stable internal representations of external stimuli. Sharing of a fixed amount of neural activity between items in memory explains why WM can be successfully described as a continuous resource. This contrasts with the popular conception of WM as comprising a limited number of memory slots, each holding a representation of one stimulus - I argue that this view is challenged by computational theory and the latest neurophysiological evidence.

A bilateral advantage for maintaining objects in visual short term memory

Research has shown that attentional pre-cues can subsequently influence the transfer of information into visual short term memory (VSTM) (Schmidt, B., Vogel, E., Woodman, G., & Luck, S. (2002). Voluntary and automatic attentional control of visual working memory. Perception & Psychophysics, 64(5), 754-763). However, studies also suggest that those effects are constrained by the hemifield alignment of the pre-cues (Holt, J. L., & Delvenne, J.-F. (2014). A bilateral advantage in controlling access to visual short-term memory. Experimental Psychology, 61(2), 127-133), revealing better recall when distributed across hemifields relative to within a single hemifield (otherwise known as a bilateral field advantage). By manipulating the duration of the retention interval in a colour change detection task (1s, 3s), we investigated whether selective pre-cues can also influence how information is later maintained in VSTM. The results revealed that the pre-cues influenced the maintenance of the colours in VSTM, promoting consistent performance across retention intervals (Experiments 1 & 4). However, those effects were only shown when the pre-cues were directed to stimuli displayed across hemifields relative to stimuli within a single hemifield. Importantly, the results were not replicated when participants were required to memorise colours (Experiment 2) or locations (Experiment 3) in the absence of spatial pre-cues. Those findings strongly suggest that attentional pre-cues have a strong influence on both the transfer of information in VSTM and its subsequent maintenance, allowing bilateral items to better survive decay.

TMS over the right precuneus reduces the bilateral field advantage in visual short term memory capacity

BACKGROUND

Several studies have demonstrated a bilateral field advantage (BFA) in early visual attentional processing, that is, enhanced visual processing when stimuli are spread across both visual hemifields. The results are reminiscent of a hemispheric resource model of parallel visual attentional processing, suggesting more attentional resources on an early level of visual processing for bilateral displays [e.g. Sereno AB, Kosslyn SM. Discrimination within and between hemifields: a new constraint on theories of attention. Neuropsychologia 1991;29(7):659-75.]. Several studies have shown that the BFA extends beyond early stages of visual attentional processing, demonstrating that visual short term memory (VSTM) capacity is higher when stimuli are distributed bilaterally rather than unilaterally.

OBJECTIVE/HYPOTHESIS

Here we examine whether hemisphere-specific resources are also evident on later stages of visual attentional processing.

METHODS

Based on the Theory of Visual Attention (TVA) [Bundesen C. A theory of visual attention. Psychol Rev 1990;97(4):523-47.] we used a whole report paradigm that allows investigating visual attention capacity variability in unilateral and bilateral displays during navigated repetitive transcranial magnetic stimulation (rTMS) of the precuneus region.

RESULTS

A robust BFA in VSTM storage capacity was apparent after rTMS over the left precuneus and in the control condition without rTMS. In contrast, the BFA diminished with rTMS over the right precuneus.

CONCLUSION

This finding indicates that the right precuneus plays a causal role in VSTM capacity, particularly in bilateral visual displays.

A Bilateral Advantage in Controlling Access to Visual Short-Term Memory

Recent research on visual short-term memory (VSTM) has revealed the existence of a bilateral field advantage (BFA – i.e., better memory when the items are distributed in the two visual fields than if they are presented in the same hemifield) for spatial location and bar orientation, but not for color ( Delvenne, 2005 ; Umemoto, Drew, Ester, & Awh, 2010 ). Here, we investigated whether a BFA in VSTM is constrained by attentional selective processes. It has indeed been previously suggested that the BFA may be a general feature of selective attention ( Alvarez & Cavanagh, 2005 ; Delvenne, 2005 ). Therefore, the present study examined whether VSTM for color benefits from bilateral presentation if attentional selective processes are particularly engaged. Participants completed a color change detection task whereby target stimuli were presented either across both hemifields or within one single hemifield. In order to engage attentional selective processes, some trials contained irrelevant stimuli that needed to be ignored. Targets were selected based on spatial locations (Experiment 1) or on a salient feature (Experiment 2). In both cases, the results revealed a BFA only when irrelevant stimuli were presented among the targets. Overall, the findings strongly suggest that attentional selective processes at encoding can constrain whether a BFA is observed in VSTM.

Noise in neural populations accounts for errors in working memory

Errors in short-term memory increase with the quantity of information stored, limiting the complexity of cognition and behavior. In visual memory, attempts to account for errors in terms of allocation of a limited pool of working memory resources have met with some success, but the biological basis for this cognitive architecture is unclear. An alternative perspective attributes recall errors to noise in tuned populations of neurons that encode stimulus features in spiking activity. I show that errors associated with decreasing signal strength in probabilistically spiking neurons reproduce the pattern of failures in human recall under increasing memory load. In particular, deviations from the normal distribution that are characteristic of working memory errors and have been attributed previously to guesses or variability in precision are shown to arise as a natural consequence of decoding populations of tuned neurons. Observers possess fine control over memory representations and prioritize accurate storage of behaviorally relevant information, at a cost to lower priority stimuli. I show that changing the input drive to neurons encoding a prioritized stimulus biases population activity in a manner that reproduces this empirical tradeoff in memory precision. In a task in which predictive cues indicate stimuli most probable for test, human observers use the cues in an optimal manner to maximize performance, within the constraints imposed by neural noise.

Changing concepts of working memory

Working memory is widely considered to be limited in capacity, holding a fixed, small number of items, such as Miller's 'magical number' seven or Cowan's four. It has recently been proposed that working memory might better be conceptualized as a limited resource that is distributed flexibly among all items to be maintained in memory. According to this view, the quality rather than the quantity of working memory representations determines performance. Here we consider behavioral and emerging neural evidence for this proposal.

The frontal eye fields limit the capacity of visual short-term memory in rhesus monkeys

The frontal eye fields (FEF) in rhesus monkeys have been implicated in visual short-term memory (VSTM) as well as control of visual attention. Here we examined the importance of the area in the VSTM capacity and the relationship between VSTM and attention, using the chemical inactivation technique and multi-target saccade tasks with or without the need of target-location memory. During FEF inactivation, serial saccades to targets defined by color contrast were unaffected, but saccades relying on short-term memory were impaired when the target count was at the capacity limit of VSTM. The memory impairment was specific to the FEF-coded retinotopic locations, and subject to competition among targets distributed across visual fields. These results together suggest that the FEF plays a crucial role during the entry of information into VSTM, by enabling attention deployment on targets to be remembered. In this view, the memory capacity results from the limited availability of attentional resources provided by FEF: The FEF can concurrently maintain only a limited number of activations to register the targets into memory. When lesions render part of the area unavailable for activation, the number would decrease, further reducing the capacity of VSTM.

Flexible cognitive resources: competitive content maps for attention and memory

The brain has finite processing resources so that, as tasks become harder, performance degrades. Where do the limits on these resources come from? We focus on a variety of capacity-limited buffers related to attention, recognition, and memory that we claim have a two-dimensional 'map' architecture, where individual items compete for cortical real estate. This competitive format leads to capacity limits that are flexible, set by the nature of the content and their locations within an anatomically delimited space. We contrast this format with the standard 'slot' architecture and its fixed capacity. Using visual spatial attention and visual short-term memory as case studies, we suggest that competitive maps are a concrete and plausible architecture that limits cognitive capacity across many domains.

Visual attention capacity parameters covary with hemifield alignment

The theory of visual attention (TVA; Bundesen, 1990. Psychological Review, 97(4), 523-547), allows one to measure distinct visual attention parameters, such as the temporal threshold for visual perception, visual processing capacity, and visual short-term memory (VSTM) capacity. It has long been assumed that visual processing capacity and VSTM capacity parameters are nearly constant from trial to trial. However, Dyrholm, Kyllingsbæk, Espeseth, and Bundesen (2011). Journal of Mathematical Psychology, 55(6), 416-429, found evidence of considerable trial-by-trial variability of VSTM capacity. Here we show that one cause of trial-by-trial variation is that some parameters depend on whether processing of relevant information occurs in only one hemifield or in both hemifields. Our results show that VSTM and visual processing capacities are higher when stimuli are distributed across the hemifields rather than located in the same hemifield. This corresponds to previous suggestions that parallel processing is more efficient across hemifields than within a single hemifield because both hemispheres are involved (e.g., Alvarez & Cavanagh, 2005. Psychological Science, 16(8), 637-643; Kraft et al., 2005. Cognitive Brain Research, 24(1), 453-463). We argue that the established view of a fixed visual attentional capacity must be relativized by taking hemifield distribution into account.

What Does Ipsilateral Delay Activity Reflect? Inferences from Slow Potentials in a Lateralized Visual Working Memory Task

In the lateralized change detection task, two item arrays are presented, one on each side of the display. Participants have to remember the items in the relevant hemifield and ignore the items in the irrelevant hemifield. A difference wave between contralateral and ipsilateral slow potentials with respect to the relevant items, the contralateral delay activity, can be calculated. As its amplitude varies with the number of items held in working memory (WM) and reaches its asymptote with WM capacity, it is considered a pure neural correlate of visual WM load. However, in addition to this contralateral delay activity, load-dependent activity has also been observed over the hemisphere ipsilateral to the relevant hemifield, suggesting that the ipsilateral hemisphere is also involved in memory-related processes. This ipsilateral activity might either reflect a bilateral processing of relevant or else a lateralized processing of irrelevant, to-be-filtered-out items. As in the lateralized change detection task, the number of items on both sides of the display is typically identical, it was not possible to decide between these alternatives yet. To disentangle the influence of relevant and irrelevant items, we orthogonally varied the number of both types of items. Processing of relevant items caused purely contralateral load-dependent activity. Ipsilateral slow potentials were influenced by the number of irrelevant items only if visual WM load was low, but not if it was high. This suggests that whether irrelevant items are processed or filtered out depends on visual WM load.

Precision in visual working memory reaches a stable plateau when individual item limits are exceeded

Multiple studies have demonstrated that resolution in working memory (WM) declines as the number of stored items increases. Discrete-resource models predict that this decline should reach a stable plateau at relatively small set sizes because item limits prevent additional information from being encoded into WM at larger set sizes. By contrast, flexible-resource models predict that the monotonic declines in precision will continue indefinitely as set size increases and resources are distributed without any fixed item limit. In the present work, we found that WM resolution exhibited monotonic declines until set size reached three items, after which resolution achieved a clear asymptote. Moreover, analyses of individual differences showed a strong correlation between each observer's item limit and the set size at which WM resolution achieved asymptote. These behavioral observations were corroborated by measurements of contralateral delay activity (CDA), an event-related potential waveform that tracks the number of items maintained during the delay period. CDA activity rose monotonically and achieved asymptote at a set size that predicted individual WM capacity. Moreover, this neural measure of on-line storage also predicted the set size at which mnemonic resolution reached a stable plateau for each observer. Thus, independent behavioral and neural measures of WM capacity support a clear prediction of discrete-resource models. Precision in visual WM reaches asymptote when individual item limits are exceeded.

The temporal evolution of electromagnetic markers sensitive to the capacity limits of visual short-term memory

An electroencephalographic (EEG) marker of the limited contents of human visual short-term memory (VSTM) has previously been described. Termed contralateral delay activity, this consists of a sustained, posterior, negative potential that correlates with memory load and is greatest contralateral to the remembered hemifield. The current investigation replicates this finding and uses magnetoencephalography (MEG) to characterize its magnetic counterparts and their neural generators as they evolve throughout the memory delay. A parametric manipulation of memory load, within and beyond capacity limits, allows separation of signals that asymptote with behavioral VSTM performance from additional responses that contribute to a linear increase with set-size. Both EEG and MEG yielded bilateral signals that track the number of objects held in memory, and contralateral signals that are independent of memory load. In MEG, unlike EEG, the contralateral interaction between hemisphere and item load is much weaker, suggesting that bilateral and contralateral markers of memory load reflect distinct sources to which EEG and MEG are differentially sensitive. Nonetheless, source estimation allowed both the bilateral and the weaker contralateral capacity-limited responses to be localized, along with a load-independent contralateral signal. Sources of global and hemisphere-specific signals all localized to the posterior intraparietal sulcus during the early delay. However the bilateral load response peaked earlier and its generators shifted later in the delay. Therefore the hemifield-specific response may be more closely tied to memory maintenance while the global load response may be involved in initial processing of a limited number of attended objects, such as their individuation or consolidation into memory.