Clear evidence for item limits in visual working memory

The multicomponent model of working memory fifty years on

We provide a broad overview of our original investigation of working memory; how the multicomponent model followed from our use of a dissociative methodology; and our intention that it should be simple, robust, and applicable. We describe how subsequent development of the model has increased its scope, depth, and applications while at the same time retaining its core features. Comparisons with the growing number of alternative models suggest agreement on the basic phenomena to be explained and more similarities than differences. While differences between models attract interest, we caution that they do not necessarily reflect the most important issues for future research, which we suggest relate principally to the nature of executive control. The longevity of the multicomponent model reflects not only the importance of working memory in cognition but also the usefulness of a simple, robust framework for further theoretical development and applications.

Discrimination of mnemonic similarity is associated with short-term and long-term memory precision

Remembering specific memories with precision relies on the differentiation of similar memory contents - a process commonly referred to as pattern separation and behaviorally operationalized as lure discrimination in the mnemonic similarity task. Although pattern separation is typically investigated in the context of long-term memory (LTM), recent research extends these findings to short-term memory (STM) within a mixture model framework, emphasizing the distinction between memory quality and quantity. According to this framework, pattern separation is associated with memory precision across STM and LTM, regardless of the overall memory likelihood. However, these associations among memory quality measures may persist without the mixture model assumption. In an alternative model, a unitary memory strength measure quantified as a discrimination score (d') may also capture the association between pattern separation and memory quality, as pattern separation has been previously linked with strength-based memory performance. We tested these possibilities based on individual differences among 132 participants who underwent tasks measuring mnemonic pattern separation and STM/LTM quality. We found that behavioral estimates of pattern separation are significantly correlated with STM and LTM precision, irrespective of the likelihood of STM/LTM recall success. However, these associations are absent when considering the correlation between pattern separation and memory strength under a unitary model framework. By leveraging individual differences to constrain our understanding of cognitive models, our data unravel the intricate relationship between pattern separation and memory quality across timescales. These findings may therefore contribute to identifying sensitive behavioral measures for detecting subtle memory deficits in older adults or clinical populations.

The influence of categorical stimuli on relational memory binding

Binding of arbitrary information into distinct memory representations that can be used to guide behavior is a hallmark of relational memory. What is and is not bound into a memory representation and how those things influence the organization of that representation remain topics of interest. While some information is intentionally and effortfully bound-often the information that is consistent with task goals or expectations about what information may be required later-other information appears to be bound automatically. The present set of experiments sought to investigate whether spatial memory would be systematically influenced by the presence and absence of distinct categories of stimuli on a spatial reconstruction task. In this task, participants must learn multiple item-location bindings and place each item back in its studied location after a short delay. Across three experiments, participants made significantly more within-category errors (i.e., misassigning one item to the location of a different item from the same category) than between-category errors (i.e., misassigning one item to the location of an item from a different category) when categories were perceptually or semantically distinct. These data reveal that category information contributed to the organization of the memory representation and influenced spatial reconstruction performance. Together, these results suggest that categorical information can influence memory organization, and not always to the benefit of overall task performance.

Zooming in on what counts as core and auxiliary: A case study on recognition models of visual working memory

Research on best practices in theory assessment highlights that testing theories is challenging because they inherit a new set of assumptions as soon as they are linked to a specific methodology. In this article, we integrate and build on this work by demonstrating the breadth of these challenges. We show that tracking auxiliary assumptions is difficult because they are made at different stages of theory testing and at multiple levels of a theory. We focus on these issues in a reanalysis of a seminal study and its replications, both of which use a simple working-memory paradigm and a mainstream computational modeling approach. These studies provide the main evidence for "all-or-none" recognition models of visual working memory and are still used as the basis for how to measure performance in popular visual working-memory tasks. In our reanalysis, we find that core practical auxiliary assumptions were unchecked and violated; the original model comparison metrics and data were not diagnostic in several experiments. Furthermore, we find that models were not matched on "theory general" auxiliary assumptions, meaning that the set of tested models was restricted, and not matched in theoretical scope. After testing these auxiliary assumptions and identifying diagnostic testing conditions, we find evidence for the opposite conclusion. That is, continuous resource models outperform all-or-none models. Together, our work demonstrates why tracking and testing auxiliary assumptions remains a fundamental challenge, even in prominent studies led by careful, computationally minded researchers. Our work also serves as a conceptual guide on how to identify and test the gamut of auxiliary assumptions in theory assessment, and we discuss these ideas in the context of contemporary approaches to scientific discovery.

Correlative comparison of visual working memory paradigms and associated models

When studying the working memory (WM), the 'slot model' and the 'resource model' are two main theories used to describe how information retention occurs. The slot model shows that WM capacity consists of a certain number of predefined slots available for information storage. This theory explains that there is a binary condition during information recall in which information is either wholly maintained within a slot or forgotten. The resource model has a resolution-based approach, suggesting a continuous resource able to be distributed among a number of items in WM capacity. Recently hybrid models have been introduced, suggesting that WM may not strictly conform to only one model. Accordingly, to understand the relationship between two of the most widely used paradigms in WM evaluation, we implemented a correlational assessment in two different psychophysics tasks, an analog recall paradigm with sequential bar presentation and a delayed match-to-sample (DMS) task with checkerboard stimuli. Our study revealed significant correlations between WM performance in the DMS task and recall error, precision, and sources of errors in the sequential paradigm. Overall, the findings emphasize the importance of considering both tasks in understanding WM processes, as they shed light on the debate between the slot and resource models by revealing overlapping elements in both theories and the tasks used to evaluate WM capacity.

Learning to Move and Plan like the Knight: Sequential Decision Making with a Novel Motor Mapping

Many skills that humans acquire throughout their lives, such as playing video games or sports, require substantial motor learning and multi-step planning. While both processes are typically studied separately, they are likely to interact during the acquisition of complex motor skills. In this work, we studied this interaction by assessing human performance in a sequential decision-making task that requires the learning of a non-trivial motor mapping. Participants were tasked to move a cursor from start to target locations in a grid world, using a standard keyboard. Notably, the specific keys were arbitrarily mapped to a movement rule resembling the Knight chess piece. In Experiment 1, we showed the learning of this mapping in the absence of planning, led to significant improvements in the task when presented with sequential decisions at a later stage. Computational modeling analysis revealed that such improvements resulted from an increased learning rate about the state transitions of the motor mapping, which also resulted in more flexible planning from trial to trial (less perseveration or habitual responses). In Experiment 2, we showed that incorporating mapping learning into the planning process, allows us to capture (1) differential task improvements for distinct planning horizons and (2) overall lower performance for longer horizons. Additionally, model analysis suggested that participants may limit their search to three steps ahead. We hypothesize that this limitation in planning horizon arises from capacity constraints in working memory, and may be the reason complex skills are often broken down into individual subroutines or components during learning.

Mixing and mingling in visual working memory: Inter-item competition is feature-specific during encoding and feature-general during maintenance

Visual working memory (WM) is a central cognitive ability but is capacity-limited due to competition between remembered items. Understanding whether inter-item competition depends on the similarity of the features being remembered has important implications for determining if competition occurs in sensory or post-sensory stages of processing. Experiment 1 compared the precision of WM across homogeneous displays, where items belonged to the same feature type (e.g., colorful circles), and heterogeneous displays (e.g., colorful circles and oriented bars). Performance was better for heterogeneous displays, suggesting a feature-specific component of interference. However, Experiment 2 used a retro-cueing task to isolate encoding from online maintenance and revealed that inter-item competition during storage was not feature-specific. The data support recent models of WM in which inter-item interference - and hence capacity limits in WM - occurs in higher-order structures that receive convergent input from a diverse array of feature-specific representations.

Working memory constraints for visuomotor retrieval strategies

Recent work has shown the fundamental role that cognitive strategies play in visuomotor adaptation. Although algorithmic strategies, such as mental rotation, are flexible and generalizable, they are computationally demanding. To avoid this computational cost, people can instead rely on memory retrieval of previously successful visuomotor solutions. However, such a strategy is likely subject to stimulus-response associations and rely heavily on working memory. In a series of five experiments, we sought to estimate the constraints in terms of capacity and precision of working memory retrieval for visuomotor adaptation. This was accomplished by leveraging different variations of visuomotor item-recognition and visuomotor rotation tasks where we associated unique rotations with specific targets in the workspace and manipulated the set size (i.e., number of rotation-target associations). Notably, from experiment 1 to 4, we found key signatures of working memory retrieval and not mental rotation. In particular, participants were less accurate and slower for larger set sizes and less recent items. Using a Bayesian latent-mixture model, we found that such decrease in performance was the result of increasing guessing behavior and less precise memories. In addition, we estimated that participants' working memory capacity was limited to two to five items, after which guessing increasingly dominated performance. Finally, in experiment 5, we showed how the constraints observed across experiments 1 to 4 can be overcome when relying on long-term memory retrieval. Our results point to the opportunity of studying other sources of memories where visuomotor solutions can be stored (e.g., episodic memories) to achieve successful adaptation.NEW & NOTEWORTHY We show that humans can adapt to feedback perturbations in different variations of the visuomotor rotation task by retrieving the successful solutions from working memory. In addition, using a Bayesian latent-mixture model, we reveal that guessing and low-precision memories are both responsible for the decrease in participants' performance as the number of solutions to memorize increases. These constraints can be overcome by relying on long-term memory retrieval resulting from extended practice with the visuomotor solutions.

Visual working memory for natural scenes: challenges and opportunities

Visual working memory is a fundamental cognitive process that people use thousands of times each day as they engage in visually guided behavior. Thus, it is important to understand how the natural visual input-which consists of complex, spatially organized, continuously varying features-is represented in visual working memory. However, most research has used arrays of discrete, artificial objects defined by simple features, and existing formal models of visual working memory cannot be applied to natural scenes. In this paper, we identify 3 key aspects of natural scenes that are not captured by existing formal models of visual working memory, along with 2 distinct types of attention that must be considered. The goal is to clearly define the challenges and opportunities for moving models of visual working memory from arrays of artificial objects to natural scenes.

Selectively maintaining an object's feature in visual working memory: A comparison between highly discriminable and fine-grained features

Selectively maintaining information is an essential function of visual working memory (VWM). Recent VWM studies have mainly focused on selective maintenance of objects, leaving the mechanisms of selectively maintaining an object's feature in VWM unknown. Based on the interactive model of perception and VWM, we hypothesized that there are distinct selective maintenance mechanisms for objects containing fine-grained features versus objects containing highly discriminable features. To test this hypothesis, we first required participants to memorize a dual-feature object (colored simple shapes vs. colored polygons), and informed them about the target feature via a retro-cue. Then a visual search task was added to examine the fate of the irrelevant feature. The selective maintenance of an object's feature predicted that the irrelevant feature should be removed from the active state of VWM and should not capture attention when presented as a distractor in the visual search task. We found that irrelevant simple shapes impaired performance in the visual search task (Experiment 1). However, irrelevant polygons did not affect visual search performance (Experiment 2), and this could not be explained by decay of polygons (Experiment 3) or by polygons not capturing attention (Experiment 4). These findings suggest that VWM adopts dissociable mechanisms to selectively maintain an object's feature, depending on the feature's perceptual characteristics.

The combination operation of grouping and ensemble coding for structured biological motion crowds in working memory

Massive studies have explored biological motion (BM) crowds processing for their remarkable social significance, primarily focused on uniformly distributed ones. However, real-world BM crowds often exhibit hierarchical structures rather than uniform arrangements. How such structured BM crowds are processed remains a subject of inquiry. This study investigates the representation of structured BM crowds in working memory (WM), recognizing the pivotal role WM plays in our social interactions involving BM. We propose the group-based ensemble hypothesis and test it through a member identification task. Participants were required to discern whether a presented BM belonged to a prior memory display of eight BM, each with distinct walking directions. Drawing on prominent Gestalt principles as organizational cues, we constructed structured groups within BM crowds by applying proximity and similarity cues in Experiments 1 and 2, respectively. In Experiment 3, we deliberately weakened the visibility of stimuli structures by increasing the similarity between subsets, probing the robustness of results. Consistently, our findings indicate that BM aligned with the mean direction of the subsets was more likely to be recognized as part of the memory stimuli. This suggests that WM inherently organizes structured BM crowds into separate ensembles based on organizational cues. In essence, our results illuminate the simultaneous operation of grouping and ensemble encoding mechanisms for BM crowds within WM.

Visual working memory models of delayed estimation do not generalize to whole-report tasks

Whole-report working memory tasks provide a measure of recall for all stimuli in a trial and afford single-trial analyses that are not possible with single-report delayed estimation tasks. However, most whole-report studies assume that trial stimuli are encoded and reported independently, and they do not consider the relationships between stimuli presented and reported within the same trial. Here, we present the results of two independently conducted whole-report experiments. The first dataset was recorded by Adam, Vogel, and Awh (2017) and required participants to report color and orientation stimuli using a continuous response wheel. We recorded the second dataset, which required participants to report color stimuli using a set of discrete buttons. We found that participants often group their reports by color similarity, contradicting the assumption of independence implicit in most encoding models of working memory. Next, we showed that this behavior was consistent across participants and experiments when reporting color but not orientation, two circular variables often assumed to be equivalent.Finally, we implemented an alternative to independent encoding where stimuli are encoded as a hierarchical Bayesian ensemble and found that this model predicts biases that are not present in either dataset. Our results suggest that assumptions made by both independent and hierarchical ensemble encoding models-which were developed in the context of single-report delayed estimation tasks-do not hold for the whole-report task. This failure to generalize highlights the need to consider variations in task structure when inferring fundamental principles of visual working memory.

Working memory limitations constrain visual episodic long-term memory at both specific and gist levels of representation

Limitations in one's capacity to encode information in working memory (WM) constrain later access to that information in long-term memory (LTM). The present study examined whether these WM constraints on episodic LTM are limited to specific representations of past episodes or also extend to gist representations. Across three experiments, young adult participants (n = 40 per experiment) studied objects in set sizes of two or six items, either sequentially (Experiments 1a and 1b) or simultaneously (Experiment 2). They then completed old/new recognition tests immediately after each sequence (WM tests). After a long study phase, participants completed LTM conjoint recognition tests, featuring old but untested items from the WM phase, lures that were similar to studied items at gist but not specific levels of representation, and new items unrelated to studied items at both specific and gist levels of representation. Results showed that LTM estimates of specific and gist memory representations from a multinomial-processing-tree model were reduced for items encoded under supra-capacity set sizes (six items) relative to within-capacity set sizes (two items). These results suggest that WM encoding capacity limitations constrain episodic LTM at both specific and gist levels of representation, at least for visual objects. The ability to retrieve from LTM each type of representation for a visual item is contingent on the degree to which the item could be encoded in WM.

Representation and computation in visual working memory

The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.

Neural mechanisms of resource allocation in working memory

To mitigate capacity limits of working memory, people allocate resources according to an item's relevance. However, the neural mechanisms supporting such a critical operation remain unknown. Here, we developed computational neuroimaging methods to decode and demix neural responses associated with multiple items in working memory with different priorities. In striate and extrastriate cortex, the gain of neural responses tracked the priority of memoranda. Higher-priority memoranda were decoded with smaller error and lower uncertainty. Moreover, these neural differences predicted behavioral differences in memory prioritization. Remarkably, trialwise variability in the magnitude of delay activity in frontal cortex predicted differences in decoded precision between low and high-priority items in visual cortex. These results suggest a model in which feedback signals broadcast from frontal cortex sculpt the gain of memory representations in visual cortex according to behavioral relevance, thus, identifying a neural mechanism for resource allocation.

Just-in-Time Encoding Into Visual Working Memory Is Contingent Upon Constant Availability of External Information

Humans maintain an intricate balance between storing information in visual working memory (VWM) and just-in-time sampling of the external world, rooted in a trade-off between the cost of maintaining items in VWM versus retrieving information as it is needed. Previous studies have consistently shown that one prerequisite of just-in-time sampling is a high degree of availability of external information, and that introducing a delay before being able to access information led participants to rely less on the external world and more on VWM. However, these studies manipulated availability in such a manner that the cost of sampling was stable and predictable. It is yet unclear whether participants become less reliant on external information when it is more difficult to factor in the cost of sampling that information. In two experiments, participants copied an example layout from the left to the right side of the screen. In Experiment 1, intermittent occlusion of the example layout led participants to attempt to encode more items per inspection than when the layout was constantly available, but this did not consistently result in more correct placements. However, these findings could potentially be explained by inherent differences in how long the example layout could be viewed. Therefore in Experiment 2, the example layout only became available after a gaze-contingent delay, which could be constant or variable. Here, the introduction of any delay led to increased VWM load compared to no delay, although the degree of variability in the delay did not alter behaviour. These results reaffirm that the nature of when we engage VWM is dynamical, and suggest that any disruption to the continuous availability of external information is the main driver of increased VWM usage relative to whether availability is predictable or not.

Hearing fearful prosody impairs visual working memory maintenance

Interference by distractors has been associated multiple times with diminished visual and auditory working memory (WM) performance. Negative emotional distractors in particular lead to detrimental effects on WM. However, these associations have only been seen when distractors and items to maintain in WM are from the same sensory modality. In this study, we investigate cross-modal interference on WM. We invited 20 participants to complete a visual change-detection task, assessing visual WM (VWM), while hearing emotional (fearful) and neutral auditory distractors. Electrophysiological activity was recorded to measure contralateral delay activity (CDA) and auditory P2 event-related potentials (ERP), indexing WM maintenance and distractor salience respectively. At the behavioral level, fearful prosody didn't decrease significantly working memory accuracy, compared to neutral prosody. Regarding ERPs, fearful distractors evoked a greater P2 amplitude than neutral distractors. Correlations between the two ERP potentials indicated that P2 amplitude difference between the two types of prosody was associated with the difference in CDA amplitude for fearful and neutral trials. This association suggests that cognitive resources required to process fearful prosody detrimentally impact VWM maintenance. That result provides a piece of additional evidence that negative emotional stimuli produce greater interference than neutral stimuli and that the cognitive resources used to process stimuli from different modalities come from a common pool.

The voluntary utilization of visual working memory

While a vast amount of research has focused on understanding the capacity limits of visual working memory (VWM), little is known about how VWM resources are employed in unforced behavior and how they correlate with individual capacity constraints. We present a novel, openly available, and easy-to-administer paradigm enabling participants to freely utilize their VWM capacity. Participants had to reconstruct an array of colored squares. In each trial, they were allowed to alternate between the memory array and the reconstruction screen as many times as they wished, each time choosing how many items to reconstruct. This approach allowed us to estimate the number of utilized items, as well as the accuracy of the reconstruction. In addition, VWM capacity was measured using a change detection task. In two experiments, we show that participants tend to under-utilize their VWM resources, performing well below their capacity limits. Surprisingly, while the extent to which participants utilized their VWM was highly reliable, it was uncorrelated with VWM capacity, suggesting that VWM utilization is limited due to strategic considerations rather than capacity limits.

Perceptual similarity judgments do not predict the distribution of errors in working memory

Population coding models provide a quantitative account of visual working memory (VWM) retrieval errors with a plausible link to the response characteristics of sensory neurons. Recent work has provided an important new perspective linking population coding to variables of signal detection, including d-prime, and put forward a new hypothesis: that the distribution of recall errors on, for example, a color wheel, is a consequence of the psychological similarity between points in that stimulus space, such that the exponential-like psychophysical distance scaling function can fulfil the role of population tuning and obviate the need to fit a tuning width parameter to recall data. Using four different visual feature spaces, we measured psychophysical similarity and memory errors in the same participants. Our results revealed strong evidence for a common source of variability affecting similarity judgments and recall estimates but did not support any consistent relationship between psychophysical similarity functions and VWM errors. At the group level, the responsiveness functions obtained from the psychophysical similarity task diverged strongly from those that provided the best fit to working memory errors. At the individual level, we found convincing evidence against an association between observed and best-fitting similarity functions. Finally, our results show that the newly proposed exponential-like responsiveness function has in general no advantage over the canonical von Mises (circular normal) function assumed by previous population coding models. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Mapping visual working memory models to a theoretical framework

The body of research on visual working memory (VWM)-the system often described as a limited memory store of visual information in service of ongoing tasks-is growing rapidly. The discovery of numerous related phenomena, and the many subtly different definitions of working memory, signify a challenge to maintain a coherent theoretical framework to discuss concepts, compare models and design studies. A lack of robust theory development has been a noteworthy concern in the psychological sciences, thought to be a precursor to the reproducibility crisis (Oberauer & Lewandowsky, Psychonomic Bulletin & Review, 26, 1596-1618, 2019). I review the theoretical landscape of the VWM field by examining two prominent debates-whether VWM is object-based or feature-based, and whether discrete-slots or variable-precision best describe VWM limits. I share my concerns about the dualistic nature of these debates and the lack of clear model specification that prevents fully determined empirical tests. In hopes of promoting theory development, I provide a working theory map by using the broadly encompassing memory for latent representations model (Hedayati et al., Nature Human Behaviour, 6, 5, 2022) as a scaffold for relevant phenomena and current theories. I illustrate how opposing viewpoints can be brought into accordance, situating leading models of VWM to better identify their differences and improve their comparison. The hope is that the theory map will help VWM researchers get on the same page-clarifying hidden intuitions and aligning varying definitions-and become a useful device for meaningful discussions, development of models, and definitive empirical tests of theories.

Comparing memory capacity across stimuli requires maximally dissimilar foils: Using deep convolutional neural networks to understand visual working memory capacity for real-world objects

The capacity of visual working and visual long-term memory plays a critical role in theories of cognitive architecture and the relationship between memory and other cognitive systems. Here, we argue that before asking the question of how capacity varies across different stimuli or what the upper bound of capacity is for a given memory system, it is necessary to establish a methodology that allows a fair comparison between distinct stimulus sets and conditions. One of the most important factors determining performance in a memory task is target/foil dissimilarity. We argue that only by maximizing the dissimilarity of the target and foil in each stimulus set can we provide a fair basis for memory comparisons between stimuli. In the current work we focus on a way to pick such foils objectively for complex, meaningful real-world objects by using deep convolutional neural networks, and we validate this using both memory tests and similarity metrics. Using this method, we then provide evidence that there is a greater capacity for real-world objects relative to simple colors in visual working memory; critically, we also show that this difference can be reduced or eliminated when non-comparable foils are used, potentially explaining why previous work has not always found such a difference. Our study thus demonstrates that working memory capacity depends on the type of information that is remembered and that assessing capacity depends critically on foil dissimilarity, especially when comparing memory performance and other cognitive systems across different stimulus sets.

Precision in spatial working memory examined with mouse pointing

The capacity of visuospatial working memory (VSWM) is limited. However, there is continued debate surrounding the nature of this capacity limitation. The resource model (Bays et al., 2009) proposes that VSWM capacity is limited by the precision with which visuospatial features can be retained. In one of the few studies of spatial working memory, Schneegans and Bays (2016) report that memory guided pointing responses show a monotonic decrease in precision as set size increases, consistent with resource models. Here we report two conceptual replications of this study that use mouse responses rather than pointing responses. Overall results are consistent with the resource model, as there was an exponential increase in localisation error and monotonic increases in the probability of misbinding and guessing with increases in set size. However, an unexpected result of Experiment One was that, unlike Schneegans and Bays (2016), imprecision did not increase between set sizes of 2 and 8. Experiment Two replicated this effect and ruled out the possibility that the invariance of imprecision at set sizes greater than 2 was a product of oculomotor strategies during recall. We speculate that differences in imprecision are related to additional visuomotor transformations required for memory-guided mouse localisation compared to memory-guided manual pointing localisation. These data demonstrate the importance of considering the nature of the response modality when interpreting VSWM data.

Object-based encoding constrains storage in visual working memory

The fundamental unit of visual working memory (WM) has been debated for decades. WM could be object-based, such that capacity is set by the number of individuated objects, or feature-based, such that capacity is determined by the total number of feature values stored. The present work examined whether object- or feature-based models would best explain how multifeature objects (i.e., color/orientation or color/shape) are encoded into visual WM. If maximum capacity is limited by the number of individuated objects, then above-chance performance should be restricted to the same number of items as in a single-feature condition. By contrast, if the capacity is determined by independent storage resources for distinct features-without respect to the objects that contain those features-then successful storage of feature values could be distributed across a larger number of objects than when only a single feature is relevant. We conducted four experiments using a whole-report task in which subjects reported both features from every item in a six-item array. The crucial finding was that above-chance recall-for both single- and multifeatured objects-was restricted to the first three or four responses, while the later responses were best modeled as guesses. Thus, whole-report with multifeature objects reveals a distribution of recalled features that indicates an object-based limit on WM capacity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The dynamics of attentional guidance by working memory contents

Working memory (WM) contents can guide attention toward matching sensory information in the environment, but there are mixed findings regarding whether only a single prioritized item or multiple items held in WM can guide attention. The present study examines the limit of WM-guided attention with a novel task procedure and mouse trajectory analysis. Specifically, we introduced a perceptual-matching task utilizing the continuous estimation procedure within the maintenance interval of a WM task for one or two colors. We found that the overall perceptual matching mouse trajectory were robustly biased toward the location of WM-match color on the color-wheel (i.e., attraction bias), but only at memory set size one. However, the analysis of circular mouse trajectory distributions, through hierarchical Bayesian modeling, revealed two separable central peaks at both memory set sizes. Furthermore, model-free analysis demonstrated that the perceptual matching mouse trajectory patterns were similar regardless of memory set sizes. Together, these results support the single-item account and highlight the utility of mouse trajectory analyses in hypothesis testing in experimental psychology.

Transcranial magnetic stimulation combined with endogenous human hippocampal and motor cortical activity enhances memory

The hippocampus is a fundamental cortical structure in the memory process of encoding, retaining, and recalling information. Transcranial Magnetic Stimulation (TMS) following a Paired Associative Stimulation (PAS) enhances nervous system excitability and promotes cortical plasticity mechanisms by synchronizing two stimuli in the same neural pathway. However, PAS has not been shown to improve memorization capacity yet. Here, we present an innovative protocol stemming from the PAS paradigm, which combines single-pulse TMS to the hippocampus with endogenous hippocampal activity during a working memory (WM) task. 96 volunteers were randomized across one experimental group and three parallel groups (motor cortex stimulation, sham stimulation, and no stimulation) in a single session. This combined-stimuli configuration resulted in an increased memorization capacity in the WM task, which was dependent on the stimulated brain location and subjects' basal memory performance. These results are potentially significant for clinical research on memory dysfunction and its related neurological disorders. Future research on paired associative or combined stimulation is required to unveil stimulation-derived neural mechanisms that enhance the ability to memorize.

Probabilistic and rich individual working memories revealed by a betting game

When asked to remember a color, do people remember a point estimate (e.g., a particular shade of red), a point estimate plus an uncertainty estimate, or are memory representations rich probabilistic distributions over feature space? We asked participants to report the color of a circle held in working memory. Rather than collecting a single report per trial, we had participants place multiple bets to create trialwise uncertainty distributions. Bet dispersion correlated with performance, indicating that internal uncertainty guided bet placement. While the first bet was on average the most precisely placed, the later bets systematically shifted the distribution closer to the target, resulting in asymmetrical distributions about the first bet. This resulted in memory performance improvements when averaging across bets, and overall suggests that memory representations contain more information than can be conveyed by a single response. The later bets contained target information even when the first response would generally be classified as a guess or report of an incorrect item, suggesting that such failures are not all-or-none. This paradigm provides multiple pieces of evidence that memory representations are rich and probabilistic. Crucially, standard discrete response paradigms underestimate the amount of information in memory representations.

Disentangling Processing and Storage Accounts of Working Memory Development in Childhood

Researchers have been asking the question of what drives the development of working memory (WM) during childhood for decades. This question is particularly challenging because so many aspects of cognition develop with age that it is difficult to disentangle them and find out which factors are causal or fundamental. In this review, we first prepare to discuss this issue by inquiring whether increases in storage, processing, or both are the fundamental driving factor(s) of the age-related increase in WM capability in childhood. We contend that by experimentally manipulating either factor and observing changes in the other, it is possible to learn about causal roles in WM development. We discuss research on school-aged children that seems to suggest, by means of such an approach, that the growth of storage is causal for some phases or steps in WM tasks, but that the growth of processing is causal for other steps. In our theoretical proposal, storage capacity of the focus of attention determines earlier steps of information processing by constraining the selective encoding of information into WM, whereas processing dependent on the focus of attention determines later steps, like the detection of patterns that can simplify the effective memory load and adoption of a proactive stance of maintenance in dual-task settings. Future directions for research are discussed.

Perceptual Awareness Occurs Along a Graded Continuum: No Evidence of All-or-None Failures in Continuous Reproduction Tasks

Does sensory information reach conscious awareness in a discrete, all-or-nothing manner or a gradual, continuous manner? To answer this question, we examined behavioral performance across four different paradigms that manipulate visual awareness: the attentional blink, backward masking, the Sperling iconic memory paradigm, and retro-cuing. We then asked how well we could account for participants' (N = 112 adults) behavior using a signal detection framework that factors in psychophysical scaling to model participants' responses along a single continuum. We found that this model easily accounted for the data from each of these diverse paradigms. Moreover, we reanalyzed the data from prior studies that had posited a discrete view of perceptual awareness and found that our continuous signal detection model outperformed the models that had been used to support an all-or-nothing view of consciousness. This set of data is consistent with the idea that conscious awareness occurs along a graded continuum.

A spatially continuous diffusion model of visual working memory

We present results from five visual working memory (VWM) experiments in which participants were briefly shown between 2 and 6 colored squares. They were then cued to recall the color of one of the squares and they responded by choosing the color on a continuous color wheel. The experiments provided response proportions and response time (RT) measures as a function of angle for the choices. Current VWM models for this task include discrete models that assume an item is either within working memory or not and resource models that assume that memory strength varies as a function of the number of items. Because these models do not include processes that allow them to account for RT data, we implemented them within the spatially continuous diffusion model (SCDM, Ratcliff, 2018) and use the experimental data to evaluate these combined models. In the SCDM, evidence retrieved from memory is represented as a spatially continuous normal distribution and this drives the decision process until a criterion (represented as a 1-D line) is reached, which produces a decision. Noise in the accumulation process is represented by continuous Gaussian process noise over spatial position. The models that fit best from the discrete and resource-based classes converged on a common model that had a guessing component and that allowed the height of the normal memory-strength distribution to vary with number of items. The guessing component was implemented as a regular decision process driven by a flat evidence distribution, a zero-drift process. The combination of choice and RT data allows models that were not identifiable based on choice data alone to be discriminated.

When Does Episodic Memory Contribute to Performance in Tests of Working Memory?

Both the experimental and the psychometric investigation of the WM capacity limit depend critically on the assumption that performance in our tests of WM reflects that capacity limit to a good approximation. Most tasks to measure WM rely on testing memory after a short time during which participants are asked to maintain information in WM. In these tests, episodic long-term memory is likely to also lay down a trace of the memory set. Therefore, participants can draw on two sources of information when memory is tested, making it difficult to separate the contributions of WM and episodic LTM to the performance on immediate-memory tests. Here we use proactive interference to distinguish between these two sources of remembered information, building on the fact that episodic memory is vulnerable to proactive interference, whereas WM is protected against it. We use a release-from-PI paradigm to determine the extent to which commonly used WM tasks reflect contributions from episodic LTM. We focus on memory for serial order of verbal lists, but also include visual and spatial WM tasks. The results of five experiments demonstrate that although some tasks used to investigate WM are heavily contaminated by episodic LTM, other popular paradigms such as serial and probed recall, and the standard version of the continuous color-reproduction task, are not. Measuring proactive interference can help researchers determine the extent to which WM and episodic LTM contribute to performance in immediate-memory tasks.

Don't hide the instruction manual: A dynamic trade-off between using internal and external templates during visual search

Visual search is typically studied by requiring participants to memorize a template initially, for which they subsequently search in a crowded display. Search in daily life, however, often involves templates that remain accessible externally, and may therefore be (re)attended for just-in-time encoding or to refresh internal template representations. Here, we show that participants indeed use external templates during search when given the chance. This behavior was observed during both simple and complex search, scaled with task difficulty, and was associated with improved performance. Furthermore, we show that participants used external sampling not only to offload memory, but also as a means of verifying whether the template was remembered correctly at the end of trials. We conclude that the external world may not only provide the challenge (e.g., distractors), but may dynamically ease search. These results argue for extensions of state-of-the-art models of search, because external sampling seems to be used frequently, in at least two ways and is actually beneficial for task performance. Our findings support a model of visual working memory that emphasizes a resource-efficient trade-off between storing and (re)attending external information.

Distinguishing guesses from fuzzy memories: Further evidence for item limits in visual working memory

There is consistent debate over whether capacity in working memory (WM) is subject to an item limit, or whether an unlimited number of items can be held in this online memory system. The item limit hypothesis clearly predicts guessing responses when capacity is exceeded, and proponents of this view have highlighted evidence for guessing in visual working memory tasks. Nevertheless, various models that deny item limits can explain the same empirical patterns by asserting extremely low fidelity representations that cannot be distinguished from guesses. To address this ambiguity, we employed a task for which guess responses elicited a qualitatively distinct pattern from low fidelity memories. Inspired by work from Rouder et al. (2014), we employed an orientation WM task that required subjects to recall the precise orientation of each of six memoranda presented 1 s earlier. The orientation stimuli were created by rotating the position of a "clock hand" inside a circular region that was demarcated by four colored quadrants. Critically, when observers guess with these stimuli, the distribution of responses is biased towards the center of these quadrants, creating a "banded" pattern that cannot be explained by a low precision memory. We confirmed the presence of this guessing pattern using formal model comparisons, and we show that the prevalence of this pattern matches observers' own reports of when they thought they were guessing. Thus, these findings provide further evidence for guessing behaviors predicted by item limit models of WM capacity.

Effortfulness of visual working memory: Gauged by physical exertion

Active maintenance of information in working memory (WM) is an essential but effortful cognitive process. Yet, the effortful nature of WM remains poorly understood. Here, we constructed a model to evaluate how perceived effort of WM is directly compared to that of physical exertion. In Experiment 1, participants freely chose to either remember a certain number of colors in a visual WM task or hold a hand dynamometer to a required percentage of maximal voluntary contraction (%MVC) to obtain a fixed task credit upon successful task completion. We found that participants discounted WM-related effort in the same way as they discounted handgrip-related effort based on a computation of expected choice outcomes (hence utility) associated with different task loads. This rationality in an observer's prospective choice in Experiment 1 was generalized to retrospective choice in Experiment 2 where participants reported which task was more effortful immediately after they had performed both tasks in a randomized order without any reward or feedback. Experiment 3 further probed this shared mechanism using a dual-task paradigm. As predicted by our model, we found that physical exertion could disrupt the performance in the concurrent WM task, proportional to the iso-effort relationship between WM and physical exertion when task loads were high for both tasks. Collectively, our findings converge on a shared computational principle connecting task load, perceived effort, and choice utility across physical and cognitive domains. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Working Memory Constrains Long-Term Memory in Children and Adults: Memory of Objects and Bindings

We explored how individual and age-related differences in working memory (WM) capacity affected subsequent long-term memory (LTM) retrieval. Unlike past studies, we tested WM and LTM not only for items, but also for item-color bindings. Our sample included 82 elementary school children and 42 young adults. The participants performed a WM task with images of unique everyday items presented sequentially at varying set sizes in different colors. Later, we tested LTM for items and item-color bindings from the WM task. The WM load during encoding constrained LTM, and participants with a higher WM capacity retrieved more items in the LTM test. Even when accounting for young children's poor item memory by considering only the items that they did remember, they exhibited an exacerbated difficulty with remembering item-color bindings in WM. Their LTM binding performance, however, as a proportion of remembered objects, was comparable to that of older children and adults. The WM binding performance was better during sub-span encoding loads, but with no clear transfer of this benefit to LTM. Overall, LTM item memory performance was constrained by individual and age-related WM limitations, but with mixed consequences for binding. We discuss the theoretical, practical, and developmental implications of this WM-to-LTM bottleneck.

Partial recall: Implications for the discrete slot limit of working memory capacity

The nature of working memory capacity (WMC) has been a highly contested topic among cognitive scientists. Some advocate for the discrete nature of this construct, fixed to a set number of independent slots, each capable of storing a single chunk of bound information. Others advocate for a continuous limit, guided by a pool of immediately available resources spent across the to-be-remembered items. To understand the nature of WMC, it was first essential to separate capacity from other factors, such as performance consistency, which may impact overall WM performance. Recent work by Schor et al., (2020, Psychonomic Bulletin & Review, 27[5], 1006-1013) has provided a method for separating these constructs within a single visual array task. The present study used this statistical model to extract partial information, defined as accurate recall of a correct color, but not location, at a rate greater than expected through guessing. The successful memory of this information would demonstrate that capacity does not rely on the existence of empty slots, which discrete slot model advocates argue, are necessary for successful storage and recall of items. The present study found that participants were able to successfully recall partial information at a rate significantly greater than chance, but not beyond the individual working memory capacity limit. These findings help provide additional support for the discrete resource slot model, while simultaneously casting doubt on its strong object slot model alternative.

Measuring memory is harder than you think: How to avoid problematic measurement practices in memory research

We argue that critical areas of memory research rely on problematic measurement practices and provide concrete suggestions to improve the situation. In particular, we highlight the prevalence of memory studies that use tasks (like the "old/new" task: "have you seen this item before? yes/no") where quantifying performance is deeply dependent on counterfactual reasoning that depends on the (unknowable) distribution of underlying memory signals. As a result of this difficulty, different literatures in memory research (e.g., visual working memory, eyewitness identification, picture memory, etc.) have settled on a variety of fundamentally different metrics to get performance measures from such tasks (e.g., A', corrected hit rate, percent correct, d', diagnosticity ratios, K values, etc.), even though these metrics make different, contradictory assumptions about the distribution of latent memory signals, and even though all of their assumptions are frequently incorrect. We suggest that in order for the psychology and neuroscience of memory to become a more cumulative, theory-driven science, more attention must be given to measurement issues. We make a concrete suggestion: The default memory task for those simply interested in performance should change from old/new ("did you see this item'?") to two-alternative forced-choice ("which of these two items did you see?"). In situations where old/new variants are preferred (e.g., eyewitness identification; theoretical investigations of the nature of memory signals), receiver operating characteristic (ROC) analysis should be performed rather than a binary old/new task.

Negative emotion reduces visual working memory recall variability: A meta-analytical review

Negative emotion is often hypothesized to trigger a more deliberate processing mode. This effect can manifest as increased precision of information maintained in working memory (WM) captured by reduced WM recall variability under an induced negative emotional state. However, some recent evidence shows that WM representations are immune to any emotional influences. Here, we meta-analyze existing evidence based on data from 13 experiments across 491 participants who performed a delay-estimation WM task under negative and neutral emotional states. We find that induced negative emotional state modestly reduces WM recall variability and increases recall failures relative to the neutral condition. These effects are moderated by participants' self-report negative experiences during emotion induction. Collectively, these data suggest that negative emotion influences how much and how well one can remember in WM. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Why does visual working memory ability improve with age: More objects, more feature detail, or both? A registered report

We investigated how visual working memory (WM) develops with age across the early elementary school period (6-7 years), early adolescence (11-13 years), and early adulthood (18-25 years). The work focuses on changes in two parameters: the number of objects retained at least in part, and the amount of feature-detail remembered for such objects. Some evidence suggests that, while infants can remember up to three objects, much like adults, young children only remember around two objects. This curious, nonmonotonic trajectory might be explained by differences in the level of feature-detail required for successful performance in infant versus child/adult memory paradigms. Here, we examined if changes in one of two parameters (the number of objects, and the amount of detail retained for each object) or both of them together can explain the development of visual WM ability as children grow older. To test it, we varied the amount of feature-detail participants need to retain. In the baseline condition, participants saw an array of objects and simply were to indicate whether an object was present in a probed location or not. This phase begun with a titration procedure to adjust each individual's array size to yield about 80% correct. In other conditions, we tested memory of not only location but also additional features of the objects (color, and sometimes also orientation). Our results suggest that capacity growth across ages is expressed by both improved location-memory (whether there was an object in a location) and feature completeness of object representations.

Visual Short-Term Memory Persists Across Multiple Fixations: An n-Back Approach to Quantifying Capacity in Infants and Adults

Visual short-term memory (STM) is a foundational component of general cognition that develops rapidly during the first year of life. Although previous research has revealed important relations between overt visual fixation and memory formation, it is unknown whether infants can maintain distinct memories for sequentially fixated items or remember nonfixated array items. Participants (5-month-olds, 11-month-olds, and adults; n = 24 at each age) from the United States were tested in a passive change-detection paradigm with an n-back manipulation to examine memory for the last fixated item (one-back), second-to-last fixated item (two-back), or nonfixated item (change-other). Eye tracking was used to measure overt fixation while participants passively viewed arrays of colored circles. Results for all ages revealed convergent evidence of memory for up to two sequentially fixated objects (i.e., one-back, two-back), with moderate evidence for nonfixated array items (change-other). A permutation analysis examining change preference over time suggested that differences could not be explained by perseverative looking or location biases.

The spatiotemporal gradient of intrusion errors in continuous outcome source memory: Source retrieval is affected by both guessing and intrusions

Previous research has characterized source retrieval as a thresholded process, which fails on a proportion of trials and leads to guessing, as opposed to a continuous process, in which response precision varies across trials but is never zero. The thresholded view of source retrieval is largely based on the observation of heavy tailed distributions of response errors, thought to reflect a large proportion of "memoryless" trials. In this study, we investigate whether these errors might instead reflect systematic intrusions from other list items which can mimic source guessing. Using the circular diffusion model of decision making, which accounts for both response errors and RTs we found that intrusions account for some, but not all, errors in a continuous-report source memory task. We found that intrusion errors were more likely to come from items studied in nearby locations and times, and were well-described by a spatiotemporal gradient model, but not from semantically or perceptually similar cues. Our findings support a thresholded view of source retrieval but suggest that previous work has overestimated the proportion of guesses which have been conflated with intrusions.

The contribution of episodic long-term memory to working memory for bindings

The present experiments support two conclusions about the capacity limit of working memory (WM). First, they provide evidence for the Binding Hypothesis, WM capacity is limited by interference between bindings but not items. Second, they show that episodic LTM contributes substantially to binding memory when the capacity of WM is stretched to the limit by larger set sizes. We tested immediate memory for sets of word-picture pairs. With increasing set size, memory for bindings declined more precipitously than memory for items, as predicted from the binding hypothesis. Yet, at higher set sizes performance was more stable than expected from a capacity limited memory, suggesting a contribution of episodic long-term memory (LTM) to circumvent the WM capacity limit. In support of that hypothesis, we show a double dissociation of contributions of WM and episodic LTM to binding memory: Performance at set sizes larger than 3 was specifically affected by proactive interference - but were immune to influences from a distractor-filled delay. In contrast, performance at set size 2 was unaffected by proactive interference but harmed by a distractor-filled delay.

Awareness of the relative quality of spatial working memory representations

Working memory (WM) is the ability to maintain and manipulate information no longer accessible in the environment. The brain maintains WM representations over delay periods in noisy population-level activation patterns, resulting in variability in WM representations across items and trials. It is established that participants can introspect aspects of the quality of WM representations, and that they can accurately compare which of several WM representations of stimulus features like orientation or color is better on each trial. However, whether this ability to evaluate and compare the quality of multiple WM representations extends to spatial WM tasks remains unknown. Here, we employed a memory-guided saccade task to test recall errors for remembered spatial locations when participants were allowed to choose the most precise representation to report. Participants remembered either one or two spatial locations over a delay and reported one item's location with a saccade. On trials with two spatial locations, participants reported either the spatial location of a randomly cued item, or the location of the stimulus they remembered best. We found a significant improvement in recall error and increase in response time (RT) when participants reported their best-remembered item compared with trials in which they were randomly cued. These results demonstrate that participants can accurately introspect the relative quality of neural WM representations for spatial position, consistent with previous observations for other stimulus features, and support a model of WM coding involving noisy representations across items and trials.

Chunking in Visual Working Memory: Are Visual Features of Real-World Objects Stored in Chunks?

Are visual features of real-world objects stored as bound units? Previous research has shown that simple visual features (e.g., colored squares or geometric shapes) can be effectively bound together when forming predictable pairs in memory tasks. Through a "memory compression" process, observers can take advantage of these features to compress them into a chunk. However, a recent study found that visual features in real-world objects are stored independently. In the present study, we explored this issue by using drawings of fruits as memory stimuli, presenting four pictures of fruit in separate test trials in which we required observers to remember eight total features (i.e., four colors and four shapes). In the congruent trials, the color of the fruit matched its natural appearance (e.g., a red apple), while in incongruent trials, the color of the fruit mismatched its natural appearance (e.g., a red banana). We paired the shape of the fruits randomly with a color (without replacement). According to chunking theory, if visual features of real-world objects are stored in a chunk, the highest memory capacity should be accompanied by the longest response time in congruent trials due to an extra decoding process required from the chunk. We did find that participants had the highest memory capacity in the congruent condition, but their response times in the congruent condition were significantly faster than in the incongruent condition. Thus, observers did not undergo a decoding process in the congruent condition, and we concluded that visual features in real-world objects are not stored in a chunk.

Task Demands Differentially Affect Processing of Intrinsic and Extrinsic Object Features in Working Memory

Some argue that visual working memory operates on integrated object representations. Here, we contend that obligatory feature integration occurs with intrinsic but not extrinsic object features. Working memory for shapes and colors was assessed using a change-detection task with a central test probe, while recording event-related potentials (ERPs). Color was either an intrinsic surface feature of a shape or connected to the shape via a proximal but spatially disjunct extrinsic frame. There were two types of test: The direct test required memory for shape and color; the indirect test required only shape memory. Study-test changes of color were therefore either task-relevant or task-irrelevant. We assessed performance costs and event-related potential (ERP) effects arising from color changes. In the direct test, performance was poorer for extrinsic than intrinsic stimuli; task-relevant color changes elicited enhanced frontal negativity (N2, FN400) for both intrinsic and extrinsic stimuli. In the indirect test, performance costs and ERP effects associated with irrelevant color change were larger for intrinsic than extrinsic stimuli. This suggests intrinsic information is more readily integrated into the working-memory representation and evaluated against the test probe. Findings imply that feature integration is not obligatory under all conditions but influenced by stimulus-driven and task-related focus of attention.

Aging and feature binding in visual working memory

Older adults have reduced performance in visual working memory tasks in comparison to young adults, but the precipitators of the age-related impairment are not fully understood. The most common interpretation of this difference is that older adults are incapable of maintaining the same amount of object representations as young adults over short intervals (in line with the fixed-slot model of working memory). However, it has remained largely unexplored whether the age-related decline is only due to the number of representations that older individuals can retain in visual working memory, or whether the content of the representation(s) may have an effect as well (in line with the flexible-resource model of working memory). Feature binding studies represent an interesting research line to examine the content of older adults' representations. In this mini-review, we present the main results across feature binding studies in aging, as well as highlight the importance of manipulating both the representation content and number to have a stress test of the various models of working memory and their contribution to aging. Overall, feature binding studies, together with the simultaneous manipulation of set size, will allow us to better understand the nature of the age-related decline of visual working memory.

An adaptive perspective on visual working memory distortions

When holding multiple items in visual working memory, representations of individual items are often attracted to, or repelled from, each other. While this is empirically well-established, existing frameworks do not account for both types of distortions, which appear to be in opposition. Here, we demonstrate that both types of memory distortion may confer functional benefits under different circumstances. When there are many items to remember and subjects are near their capacity to accurately remember each item individually, memories for each item become more similar (attraction). However, when remembering smaller sets of highly similar but discernible items, memory for each item becomes more distinct (repulsion), possibly to support better discrimination. Importantly, this repulsion grows stronger with longer delays, suggesting that it dynamically evolves in memory and is not just a differentiation process that occurs during encoding. Furthermore, both attraction and repulsion occur even in tasks designed to mitigate response bias concerns, suggesting they are genuine changes in memory representations. Together, these results are in line with the theory that attraction biases act to stabilize memory signals by capitalizing on information about an entire group of items, whereas repulsion biases reflect a tradeoff between maintaining accurate but distinct representations. Both biases suggest that human memory systems may sacrifice veridical representations in favor of representations that better support specific behavioral goals. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The eyes don’t have it: Eye movements are unlikely to reflect refreshing in working memory

There is a growing interest in specifying the mechanisms underlying refreshing, i.e., the use of attention to keep working memory (WM) contents accessible. Here, we examined whether participants’ visual fixations during the retention interval of a WM task indicate the current focus of internal attention, thereby serving as an online measure of refreshing. Eye movements were recorded while participants studied and maintained an array of colored dots followed by probed recall of one (Experiments 1A and 1B) or all (Experiment 2) of the memoranda via a continuous color wheel. Experiments 1A and 2 entailed an unfilled retention interval in which refreshing is assumed to occur spontaneously, and Experiment 1B entailed a retention interval embedded with cues prompting the sequential refreshment of a subset of the memoranda. During the retention interval, fixations revisited the locations occupied by the memoranda, consistent with a looking-at-nothing phenomenon in WM, but the pattern was only evident when placeholders were onscreen in Experiment 2, indicating that most of these fixations may largely reflect random gaze. Furthermore, spontaneous fixations did not predict recall precision (Experiments 1A and 2), even when ensuring that they did not reflect random gaze (Experiment 2). In Experiment 1B, refreshing cues increased fixations to the eventually tested target and predicted better recall precision, which interacted with an overall benefit of target fixations, such that the benefit of fixations decreased as the number of refreshing cues increased. Thus, fixations under spontaneous conditions had no credible effect on recall precision, whereas the beneficial effect of fixations under instructed refreshing conditions may indicate situations in which cues were disregarded. Consequently, we conclude that eye movements do not seem suitable as an online measure of refreshing.

Little Support for Discrete Item Limits in Visual Working Memory

Some theorists argue that working memory is limited to a discrete number of items and that additional items are not encoded at all. Adam et al. (2017) presented evidence supporting this hypothesis: Participants reproduced visual features of up to six items in a self-chosen order. After the third or fourth response, error distributions were indistinguishable from guessing. I present four experiments with young adults (each N = 24) reexamining this finding. Experiment 1 presented items slowly and sequentially. Experiment 2 presented them simultaneously but longer than in the experiments of Adam et al. Experiments 3 and 4 exactly replicated one original experiment of Adam et al. All four experiments failed to replicate the evidence for guessing-like error distributions. Modeling data from individuals revealed a mixture of some who do and others who do not produce guessing-like distributions. This heterogeneity increases the credibility of an alternative to the item-limit hypothesis: Some individuals decide to guess on hard trials even when they have weak information in memory.

Trial-by-trial mouse trajectory predicts variance in precision across working memory representations: A critical reanalysis of Hao et al. (2021)

Multiple representations in visual working memory (VWM) can vary in mnemonic precision. This inhomogeneity of VWM precision has received some support from recent studies with the whole-report procedure, in which all memory items are recalled in free or forced orders. Recently, Hao et al. (2021, Cognition, 214, 104739) added a novel item-selection stage before each memory recall and found smaller between-trial variance in mouse trajectory during the selection stage in free-recall condition as compared with forced recall, which was taken as evidence for less between-item interference and the resulting precision benefit under free recall. Here, we reanalyzed the original dataset with a different analytic approach and attempted independent hypothesis testing focusing on within-trial trajectory deviations. We found that the direction of trial-by-trial trajectory bias for the first to-be-recalled item was predictive of the relative mnemonic precision of the remaining items. Critically, this relationship was only present for forced recall but not for free recall. Hierarchical Bayesian modeling of recall errors further identified that this relationship was selectively driven by VWM precision. Together, our reanalysis provides evidence for the source of between-item interference and its direct association with variable precision of VWM representations, and further highlights the novel methodological benefits of probing memory decisional processes using mouse trajectory data.

Effects of Attention Direction and Perceptual Distraction Within Visual Working Memory

Although substantial evidence demonstrates that directing attention to specific items is important for improving the performance of visual working memory (VWM), it is still not clear whether the attended items were better protected. The present study, thus, adopted a pre-cueing paradigm to examine the effect of attention direction and perceptual distractor on VWM. The results showed that a valid visual cue improved the individuals’ VWM performances and reduced their reaction time compared to the invalid and neutral cues. However, the VWM performances in the valid and neutral cue conditions were more disrupted by a post-stimuli distractor compared to the invalid cue condition. The findings suggest that although directing attention can improve the VWM performance, it is not efficient in protecting information from being distracted.