The reliability and internal consistency of one-shot and flicker change detection for measuring individual differences in visual working memory capacity

Change localization: A highly reliable and sensitive measure of capacity in visual working memory

The change detection paradigm has been a widely used approach for measuring capacity in visual working memory (WM). In this task, subjects see an array of visual items, followed by a short blank delay and a single test item. Their task is to indicate whether that test item changed relative to the item in the sample array. This task provides reliable measurements of WM capacity that exhibit robust correlations with many outcome variables of interest. Here, we offer a new variant of this task that we call "change localization." This task is closely modeled after the change detection task described above, except that the test array contains the same number of items as the sample array, and one item has always changed in each trial. The subject's task is to select the changed item in the test array. Using both color and shape stimuli, scores in the change localization task were highly correlated with those in the change detection task, suggesting that change localization taps into the same variance in WM ability. Moreover, the change localization task was far more reliable than change detection, such that only half the number of trials were required to achieve robust reliability. To further validate the approach, we replicated known effects from the literature, demonstrating that they could be detected with far fewer trials than with change detection. Thus, change localization provides a highly reliable and sensitive approach for measuring visual working memory capacity.

Music reading expertise affects visual change detection: Evidence from a music-related flicker paradigm

To study the mechanisms and boundary conditions of expertise effects on change detection, we introduced a novel music-related variant of the flicker paradigm. Specifically, we monitored the eye movements of expert musicians (with 10 years of music experience) and non-musicians (who could not read music) while they located changes across two rapidly alternating versions of a music score, with a blank screen presented between each screen change. Relative to the non-musicians, experts were faster at change detection, with shorter fixations and larger saccade amplitudes. Expertise effects on accuracy and saccade amplitude were magnified for visually complex relative to simple music scores. Consistent with the assumptions of chunking and template theories of expertise, our results suggest that expert musicians can use chunking (i.e., perceptual grouping) mechanisms to facilitate perceptual encoding during change detection.

A Disruption in the Balance of Attentional Systems Plays a Role in Trait Anxiety

Elevated levels of anxiety are associated with attentional threat biases and inefficient attentional control, with the latter requiring sustained cognitive effort. The current study assessed self-reported and behavioral evidence of attentional functioning, along with electrodermal activity (EDA; measured via changes in skin conductance level [SCL reactivity]) as an index of sympathetic arousal, to examine whether these vulnerabilities are evident among individuals with elevated trait anxiety (non-clinical). Fifty-nine participants completed a working memory span task measuring attentional control under high cognitive load. A visual change detection task assessed stimulus-driven attention as an indicator of vigilance to non-threatening visual information. Trait anxiety was self-reported. SCL was captured at rest and during the working memory task. Results revealed that trait anxiety was positively related to speed of visual change detection, without accuracy costs, suggesting enhanced vigilance for neutral visual information among those higher in trait anxiety. Trait anxiety also moderated the relation between change detection speed and attentional control, such that attentional vigilance was not associated with variation in attentional control for individuals higher in trait anxiety. However, for individuals lower in trait anxiety, vigilance was negatively associated with attention control. The relationship between vigilance and attentional control was also moderated by SCL reactivity such that the association was only significant at lower SCL reactivity levels. Taken together, results suggest that individuals higher in trait anxiety demonstrate greater attentional control in the service of visual detection, but greater attentional control may come at the cost of increased sympathetic arousal.

Δ9-Tetrahydrocannabinol (THC) impairs visual working memory performance: a randomized crossover trial

With the increasing prevalence of legal cannabis use and availability, there is an urgent need to identify cognitive impairments related to its use. It is widely believed that cannabis, or its main psychoactive component Δ9-tetrahydrocannabinol (THC), impairs working memory, i.e., the ability to temporarily hold information in mind. However, our review of the literature yielded surprisingly little empirical support for an effect of THC or cannabis on working memory. We thus conducted a study with three main goals: (1) quantify the effect of THC on visual working memory in a well-powered sample, (2) test the potential role of cognitive effects (mind wandering and metacognition) in disrupting working memory, and (3) demonstrate how insufficient sample size and task duration reduce the likelihood of detecting a drug effect. We conducted two double-blind, randomized crossover experiments in which healthy adults (N = 23, 23) performed a reliable and validated visual working memory task (the "Discrete Whole Report task", 90 trials) after administration of THC (7.5 and/or 15 mg oral) or placebo. We also assessed self-reported "mind wandering" (Exp 1) and metacognitive accuracy about ongoing task performance (Exp 2). THC impaired working memory performance (d = 0.65), increased mind wandering (Exp 1), and decreased metacognitive accuracy about task performance (Exp 2). Thus, our findings indicate that THC does impair visual working memory, and that this impairment may be related to both increased mind wandering and decreased monitoring of task performance. Finally, we used a down-sampling procedure to illustrate the effects of task length and sample size on power to detect the acute effect of THC on working memory.

Indexing Early Visual Memory Durability in Infancy

The goal was to examine the scope and development of early visual memory durability. We investigated individual- and age-related differences across three unique tasks in 6- to 12-month-olds (M_age  = 8.87, N = 49) by examining the effect of increased delay on memory performance. Results suggest longer-term memory processes are quantifiable by 8 months using a modified Change Detection paradigm and spatial-attention cueing processes are quantifiable by 10 months using a modified Delayed Response paradigm, utilizing 500-1,250 ms delays. Performance improved from 6 to 12 months and longer delays impaired performance. We found no evidence for success on the Delayed Match Retrieval task at any age. These outcomes help inform our understanding of infant visual memory durability and its emergence throughout early development.

Age and Species Comparisons of Visual Mental Manipulation Ability as Evidence for its Development and Evolution

Intelligent behavior is shaped by the abilities to store and manipulate information in visual working memory. Although humans and various non-human animals demonstrate similar storage capacities, the evolution of manipulation ability remains relatively unspecified. To what extent are manipulation limits unique to humans versus shared across species? Here, we compare behavioral signatures of manipulation ability demonstrated by human adults and 6-to-8-year-old children with that of an animal separated from humans by over 300 million years of evolution: a Grey parrot (Psittacus erithacus). All groups of participants completed a variant of the “Shell Game”, which required mentally updating the locations of varying set sizes of occluded objects that swapped places a number of times. The parrot not only demonstrated above-chance performance, but also outperformed children across all conditions. Indeed, the parrot’s accuracy was comparable to (and slightly better than) human adults’ over 12/14 set-size/number-of-swaps combinations, until four items were manipulated with 3–4 swaps, where performance decreased toward that of 6- to 8-year-olds. These results suggest that manipulation of visual working memory representations is an evolutionarily ancient ability. An important next step in this research program is establishing variability across species, and identifying the evolutionary origins (analogous or homologous) of manipulation mechanisms.

Now you see me, now you don't: detecting sexual objectification through a change blindness paradigm

The goal of this work is to provide evidence for the cognitive objectification of sexualized targets via a change blindness paradigm. Since sexual objectification involves a fragmented perception of the target in which individuating features (i.e., the face) have less information potential than sexualized features (i.e., body parts), we hypothesized that changes in faces of sexualized targets would be detected with less accuracy than changes in faces of nonsexualized targets. Conversely, we expected that changes in body parts would be detected with higher accuracy for sexualized than nonsexualized targets. These hypotheses were supported by the results of two studies that employed a change blindness task in which stimuli with changes both to faces and bodies of sexualized and nonsexualized images were presented. Unexpectedly, the hypothesized effects emerged both for female and male targets.

Using the flicker task to estimate visual working memory storage capacity

Studies of visual working memory (VWM) typically have used a "one-shot" change detection task to arrive at a capacity estimate of three to four objects, with additional limits imposed by the precision of the information needed for each object. Unlike the one-shot task, the flicker change detection task permits measurement of VWM capacity over time and with larger numbers of objects present in the scene, but it has rarely been used to assess the capacity of VWM. We used the flicker task to examine (a) whether capacity is close to the typical three to four items when using subtly different stimuli; (b) which dependent measure provides the most meaningful estimate of the capacity of VWM in the flicker task (response time or number of changes viewed); (c) whether capacity remains fixed at three to four items for displays containing many more objects; and (d) how VWM operates over time, with repeated opportunities to encode, retain, and compare elements in a display. Four experiments using grids of simple items varying only in luminance or color revealed a range for VWM capacity limits that was largely impervious to changes in display duration, interstimulus intervals, and array size. This estimate of VWM capacity was correlated with an estimate from the more typical one-shot task, further validating the flicker task as a tool for measuring the capacity of VWM.

The reliability and stability of visual working memory capacity

Because of the central role of working memory capacity in cognition, many studies have used short measures of working memory capacity to examine its relationship to other domains. Here, we measured the reliability and stability of visual working memory capacity, measured using a single-probe change detection task. In Experiment 1, the participants (N = 135) completed a large number of trials of a change detection task (540 in total, 180 each of set sizes 4, 6, and 8). With large numbers of both trials and participants, reliability estimates were high (α > .9). We then used an iterative down-sampling procedure to create a look-up table for expected reliability in experiments with small sample sizes. In Experiment 2, the participants (N = 79) completed 31 sessions of single-probe change detection. The first 30 sessions took place over 30 consecutive days, and the last session took place 30 days later. This unprecedented number of sessions allowed us to examine the effects of practice on stability and internal reliability. Even after much practice, individual differences were stable over time (average between-session r = .76).

The reliability of estimating visual working memory capacity

The reliability of estimations of working memory capacity has not been thoroughly examined. The present study examined the test-retest reliability for working memory capacity as estimated in a lateralized change detection task, which is frequently used in studies involving electroencephalography. The test-retest correlations between K values for each set size in the two tests varied from 0.502 to 0.757, with test-retest correlations rising as set size increased. The results indicate that individual visual working memory capacity can be reliably estimated in a change detection task. Furthermore, test-retest reliability was higher when the two tests occurred at the same time of day than at different times of day.

Two good reasons to say 'change!' - ensemble representations as well as item representations impact standard measures of VWM capacity

Visual working memory (VWM) is a central bottleneck in human information processing. Its capacity is most often measured in terms of how many individual-item representations VWM can hold (k). In the standard task employed to estimate k, an array of highly discriminable colour patches is maintained and, after a short retention interval, compared to a test display (change detection). Recent research has shown that with more complex, structured displays, change-detection performance is, in addition to individual-item representations, supported by ensemble representations formed as a result of spatial subgroupings. Here, by asking participants to additionally localize the change, we reveal indication for an influence of ensemble representations even in the very simple, unstructured displays of the colour-patch change-detection task. Critically, pure-item models from which standard formulae of k are derived do not consider ensemble representations and, therefore, potentially overestimate k. To gauge this overestimation, we develop an item-plus-ensemble model of change detection and change localization. Estimates of k from this new model are about 1 item (~30%) lower than the estimates from traditional pure-item models, even if derived from the same data sets.

Using Hierarchical Linear Models to Examine Approximate Number System Acuity: The Role of Trial-Level and Participant-Level Characteristics

The ability to intuitively and quickly compare the number of items in collections without counting is thought to rely on the Approximate Number System (ANS). To assess individual differences in the precision of peoples' ANS representations, researchers often use non-symbolic number comparison tasks in which participants quickly choose the numerically larger of two arrays of dots. However, some researchers debate whether this task actually measures the ability to discriminate approximate numbers or instead measures the ability to discriminate other continuous magnitude dimensions that are often confounded with number (e.g., the total surface area of the dots or the convex hull of the dot arrays). In this study, we used hierarchical linear models (HLMs) to predict 132 adults' accuracy on each trial of a non-symbolic number comparison task from a comprehensive set of trial-level characteristics (including numerosity ratio, surface area, convex hull, and temporal and spatial variations in presentation format) and participant-level controls (including cognitive abilities such as visual-short term memory, working memory, and math ability) in order to gain a more nuanced understanding of how individuals complete this task. Our results indicate that certain trial-level characteristics of the dot arrays contribute to our ability to compare numerosities, yet numerosity ratio, the critical marker of the ANS, remains a highly significant predictor of accuracy above and beyond trial-level characteristics and across individuals with varying levels of math ability and domain-general cognitive abilities.

Visual working memory capacity increases between ages 3 and 8 years, controlling for gains in attention, perception, and executive control

Research in adults has aimed to characterize constraints on the capacity of Visual Working Memory (VWM), in part because of the system's broader impacts throughout cognition. However, less is known about how VWM develops in childhood. Existing work has reached conflicting conclusions as to whether VWM storage capacity increases after infancy, and if so, when and by how much. One challenge is that previous studies did not control for developmental changes in attention and executive processing, which also may undergo improvement. We investigated the development of VWM storage capacity in children from 3 to 8 years of age, and in adults, while controlling for developmental change in exogenous and endogenous attention and executive control. Our results reveal that, when controlling for improvements in these abilities, VWM storage capacity increases across development and approaches adult-like levels between ages 6 and 8 years. More generally, this work highlights the value of estimating working memory, attention, perception, and decision-making components together.

The development of real-time stability supports visual working memory performance: Young children's feature binding can be improved through perceptual structure

Working memory is a basic cognitive process that predicts higher-level skills. A central question in theories of working memory development is the generality of the mechanisms proposed to explain improvements in performance. Prior theories have been closely tied to particular tasks and/or age groups, limiting their generalizability. The cognitive dynamics theory of visual working memory development has been proposed to overcome this limitation. From this perspective, developmental improvements arise through the coordination of cognitive processes to meet demands of different behavioral tasks. This notion is described as real-time stability, and can be probed through experiments that assess how changing task demands impact children's performance. The current studies test this account by probing visual working memory for colors and shapes in a change detection task that compares detection of changes to new features versus swaps in color-shape binding. In Experiment 1, 3- to 4-year-old children showed impairments specific to binding swaps, as predicted by decreased real-time stability early in development; 5- to 6-year-old children showed a slight advantage on binding swaps, but 7- to 8-year-old children and adults showed no difference across trial types. Experiment 2 tested the proposed explanation of young children's binding impairment through added perceptual structure, which supported the stability and precision of feature localization in memory-a process key to detecting binding swaps. This additional structure improved young children's binding swap detection, but not new-feature detection or adults' performance. These results provide further evidence for the cognitive dynamics and real-time stability explanation of visual working memory development. (PsycINFO Database Record

Perspectives on working memory: introduction to the special issue

More than 40 years ago, Baddeley and Hitch (1974) published an article with a wealth of experimentation and theorization on working memory, the small amount of information held in mind and often used within cognitive processes such as language comprehension and production, reasoning, and problem solving. We honor this seminal accomplishment in the present special issue, and take this opportunity to provide an introduction to our perspectives on the origin of the theory of working memory, how it has affected our work, what may be coming in the near future, and how the research articles in the present issue contribute to several related themes within the clearly thriving field of working memory.