Where to attend next: guiding refreshing of visual, spatial, and verbal representations in working memory

Putting the "Return" Back in the Inhibition of Return Effect in Working Memory

The inhibition of return effect in perception refers to the observation that one is slower to re-attend a location that was attended right before, compared to a location that was not attended right before. Johnson et al. (2013, Psych. Sc., 24, 1104-1112, doi:10.1177/0956797612466414) observed a similar inhibitory effect for an attended item in working memory, which the authors referred to as an inhibition-of-return-like effect. However, testing an inhibition of return effect requires attention to be disengaged from the attended item, before testing whether participants are slower to return to said item. This was assumed but not experimentally manipulated in the paradigm by Johnson and colleagues. In the current study, we investigated whether an inhibition of return effect can be observed in working memory when attention is experimentally disengaged from the attended item before measuring whether responses are slower for the item in question. Participants were indeed slower to respond to a memory probe that matched the item that was attended right before, compared to a memory probe that matched the item that was not attended right before. Thus, our test with more experimental control did result in an inhibition of return effect in working memory.

The interaction of top-down and bottom-up attention in visual working memory

Understanding the interplay between top-down and bottom-up attention in visual working memory (VWM) is crucial, although the specific challenges arising from this interaction remain ambiguous. In this study, we address this complexity by examining how cue informativeness and probe status of the salient items influence this interaction. Through three experiments, we manipulated top-down attention by varying probe frequencies using pre-cues and bottom-up attention by varying the visual salience of memory items. Experiment 1 explored cue informativeness at 100% and 50%, while Experiments 2 and 3 maintained cue informativeness at 80% and 50%. Additionally, Experiment 1 tested a few of the salient items, Experiment 2 excluded them, and Experiment 3 tested half of them in each cue condition. Across all experiments, we consistently observed cueing benefits for cue-directed items, albeit with costs to non-cued items. Furthermore, cue informativeness and the probe status of salient items emerged as critical factors influencing the interaction between top-down and bottom-up attention in VWM. These findings underscore the pivotal roles of cue informativeness and salient item relevance in shaping the dynamics of top-down and bottom-up attention within VWM.

Hanging on the telephone: Maintaining visuospatial bootstrapping over time in working memory

Visuospatial bootstrapping (VSB) refers to the phenomenon in which performance on a verbal working memory task can be enhanced by presenting the verbal material within a familiar visuospatial configuration. This effect is part of a broader literature concerning how working memory is influenced by use of multimodal codes and contributions from long-term memory. The present study aimed to establish whether the VSB effect extends over a brief (5-s) delay period, and to explore the possible mechanisms operating during retention. The VSB effect, as indicated by a verbal recall advantage for digit sequences presented within a familiar visuospatial configuration (modelled on the T-9 keypad) relative to a single-location display, was observed across four experiments. The presence and size of this effect changed with the type of concurrent task activity applied during the delay. Articulatory suppression (Experiment 1) increased the visuospatial display advantage, while spatial tapping (Experiment 2) and a visuospatial judgment task (Experiment 3) both removed it. Finally, manipulation of the attentional demands placed by a verbal task also reduced (but did not abolish) this effect (Experiment 4). This pattern of findings demonstrates how provision of familiar visuospatial information at encoding can continue to support verbal working memory over time, with varying demands on modality-specific and general processing resources.

Visual working memory phenomena based on categorical tasks replicate using a continuous measure: A simple interpretation and some methodological considerations

An increasingly popular method for investigating visuospatial working memory assumes stored features of objects such as color and orientation vary along continua subject to internal noise. It adapts the stimulus adjustment procedure from perceptual psychophysics to assess the precision with which stored features are represented in memory. This contrasts with methods using discrete, categorical measures of feature retention. The current study examined the replicability of some phenomena documented using conventional methodology when assessed using a continuous measure of feature recall. These concern memory for a short series of objects and include effects of recency, prioritizing an individual object, and presenting an irrelevant additional object after the last item (a poststimulus 'suffix'). In two experiments we find broadly similar results using a continuous measure of color-orientation binding to those obtained previously using categorical measures, with small differences we regard as minor. We interpret the convergence between methods in terms of a simple analogy between categorical memory and categorical perception whereby categorical retrieval involves the application of a discrete criterion to an underlying continuum of stored feature information. We conclude by discussing some of the advantages and limitations of continuous and categorical measures of retention.

The eyes don’t have it: Eye movements are unlikely to reflect refreshing in working memory

There is a growing interest in specifying the mechanisms underlying refreshing, i.e., the use of attention to keep working memory (WM) contents accessible. Here, we examined whether participants’ visual fixations during the retention interval of a WM task indicate the current focus of internal attention, thereby serving as an online measure of refreshing. Eye movements were recorded while participants studied and maintained an array of colored dots followed by probed recall of one (Experiments 1A and 1B) or all (Experiment 2) of the memoranda via a continuous color wheel. Experiments 1A and 2 entailed an unfilled retention interval in which refreshing is assumed to occur spontaneously, and Experiment 1B entailed a retention interval embedded with cues prompting the sequential refreshment of a subset of the memoranda. During the retention interval, fixations revisited the locations occupied by the memoranda, consistent with a looking-at-nothing phenomenon in WM, but the pattern was only evident when placeholders were onscreen in Experiment 2, indicating that most of these fixations may largely reflect random gaze. Furthermore, spontaneous fixations did not predict recall precision (Experiments 1A and 2), even when ensuring that they did not reflect random gaze (Experiment 2). In Experiment 1B, refreshing cues increased fixations to the eventually tested target and predicted better recall precision, which interacted with an overall benefit of target fixations, such that the benefit of fixations decreased as the number of refreshing cues increased. Thus, fixations under spontaneous conditions had no credible effect on recall precision, whereas the beneficial effect of fixations under instructed refreshing conditions may indicate situations in which cues were disregarded. Consequently, we conclude that eye movements do not seem suitable as an online measure of refreshing.

Why does the probe value effect emerge in working memory? Examining the biased attentional refreshing account

People are able to prioritize more valuable information in working memory. The current study examined whether this value effect is due to the items of greater value being refreshed more than lower-value items during maintenance. To assess this possibility, we combined a probe value manipulation with a guided-refreshing procedure. Arrays of colored shapes were presented, and after a brief delay, participants reported the color of one randomly probed shape on a continuous color wheel. To manipulate probe value, one item was indicated as more valuable than the rest prior to encoding (i.e., worth more notional points), or all items were indicated as equally valuable. To guide refreshing, in some trials, two arrows were presented during maintenance, each arrow cueing the spatial location of one item. Participants were told to "think of" (i.e., refresh) the cued item. If value boosts are driven by attentional refreshing, cueing an item to be refreshed should enhance performance for items that are of low or equal value, but not items of high value, as these items would be refreshed regardless of the cue. This pattern of outcomes was observed, providing support for the hypothesis that attentional refreshing at least partially accounts for probe value effects in working memory.

Tracking attentional states: Assessing the relationship between sustained and selective focused attention in visual working memory

Attention has multiple influences on visual working memory (VWM). Fluctuations in sustained attention predict VWM performance. Furthermore, focusing selective attention in VWM by retro-cuing the to-be-tested item during maintenance boosts retrieval. So far, we lack knowledge how the ability to focus selective attention relates to the state of sustained attention during the VWM trial. Here, we combined a retro-cue task and a self-rated attention protocol to test whether focusing selective attention via retro-cues: (1) mitigates spontaneous attention fluctuations, in which case retro-cues should be more helpful under low levels of self-rated attention; (2) depends on an optimal state of sustained attention, in which case retro-cue benefits should be largest under high levels of self-rated attention; or (3) is independent of sustained attention, in which case retro-cue benefits and self-rated attention effects should be additive. Our data supported the additive hypothesis. Across four experiments, self-rated attention levels predicted continuous reproduction of colors. Retro-cue trials produced better recall and higher rated attention. Critically, retro-cues improved recall to a similar extent across all levels of self-rated attention. This indicates that attention has multi-faceted and independent contributions to VWM.

Persistent neuronal firing in the medial temporal lobe supports performance and workload of visual working memory in humans

The involvement of the medial temporal lobe (MTL) in working memory is controversially discussed. Recent findings suggest that persistent neural firing in the hippocampus during maintenance in verbal working memory is associated with workload. Here, we recorded single neuron firing in 13 epilepsy patients (7 male) while they performed a visual working memory task. The number of coloured squares in the stimulus set determined the workload of the trial. Performance was almost perfect for low workload (1 and 2 squares) and dropped at high workload (4 and 6 squares), suggesting that high workload exceeded working memory capacity. We identified maintenance neurons in MTL neurons that showed persistent firing during the maintenance period. More maintenance neurons were found in the hippocampus for trials with correct compared to incorrect performance. Maintenance neurons increased and decreased firing in the hippocampus and increased firing in the entorhinal cortex for high compared to low workload. Population firing predicted workload particularly during the maintenance period. Prediction accuracy of workload based on single-trial activity during maintenance was strongest for neurons in the entorhinal cortex and hippocampus. The data suggest that persistent neural firing in the MTL reflects a domain-general process of maintenance supporting performance and workload of multiple items in working memory below and beyond working memory capacity. Persistent neural firing during maintenance in the entorhinal cortex may be associated with its preference to process visual-spatial arrays.

An application of activity theory to the "problem of e-books"

The “problem of e-books” is defined as the difficulty improving the adoption rates of e-books by students. The adoption rates of e-books for academic use remain low, and research into the reasons for this have resulted in inconclusive findings. Factors such as student perception, and variations in experimental methodology and technology, contribute to difficulties in generalising findings and establishing conclusive causes for this problem. To better understand the causal factors for low adoption rates and the student's experience with ereaders and digital text, an investigation was conducted by the lead researcher as a student enrolled in a postgraduate course. The experiment was designed using e-book and digital text documents on an ereader for academic study and the results analysed with the framework of Activity Theory. This methodology allowed exploration of the problem within the authentic experience of a student to examine the effects of this social environment on ereader and e-book use.

Analysis of the work domain was conducted and a comparative assessment of the observed effect of using the digital documents on an ereader compared with the paper book. Findings show that attempts to apply self-regulation and metacognitive learning techniques within the activity using the ereader were abandoned due to breakdowns in operations, and that this resulted in a perceived lower quality of achievement. The effect on the processes used by the student were extreme and were observed to be highly dependent on the student's use of specific learning strategies. The experimental methodology employed in this investigation enabled identification of the role of the social environment in the use of course documents on an ereader for academic study. The functionality of the ereader was such an extremely poor fit with the observed academic processes that a redesign approach for ereader and e-book technology is proposed as a solution to the low adoption rates of e-books.

How fast can people refresh and rehearse information in working memory?

Refreshing - briefly attending to an item in working memory - has been proposed as a domain-general maintenance process. According to the time-based resource-sharing (TBRS) theory, people refresh the contents of working memory sequentially at high speed. We measured the speed of refreshing by asking participants to sequentially refresh a small set of items in sync with a metronome, and to adjust the metronome to the fastest speed at which they could refresh. Refreshing speeds converged on about 0.2 s per item for several verbal and visual materials. This time was shorter than the speed of articulatory rehearsal measured with the same method, and - in contrast to rehearsal - did not depend on word length. We sought evidence for people refreshing in sync with the metronome by presenting recognition probes at unpredictable times. We expected that probes matching the just-refreshed item should be recognized faster and more accurately than probes matching other items. This was not the case. A parallel experiment with overt articulatory rehearsal showed poor synchronization of rehearsal with the metronome, suggesting by analogy that refreshing was equally out of sync. The results support the assumption that people can attend sequentially to items in working memory, and monitor this process. This refreshing process is probably faster than rehearsal, but it is unlikely to be as fast as the refreshing process assumed in the TBRS theory.

Working Memory and Attention - A Conceptual Analysis and Review

There is broad agreement that working memory is closely related to attention. This article delineates several theoretical options for conceptualizing this link, and evaluates their viability in light of their theoretical implications and the empirical support they received. A first divide exists between the concept of attention as a limited resource, and the concept of attention as selective information processing. Theories conceptualizing attention as a resource assume that this resource is responsible for the limited capacity of working memory. Three versions of this idea have been proposed: Attention as a resource for storage and processing, a shared resource for perceptual attention and memory maintenance, and a resource for the control of attention. The first of these three is empirically well supported, but the other two are not. By contrast, when attention is understood as a selection mechanism, it is usually not invoked to explain the capacity limit of working memory - rather, researchers ask how different forms of attention interact with working memory, in two areas. The first pertains to attentional selection of the contents of working memory, controlled by mechanisms of filtering out irrelevant stimuli, and removing no-longer relevant representations from working memory. Within working memory contents, a single item is often selected into the focus of attention for processing. The second area pertains to the role of working memory in cognitive control. Working memory contributes to controlling perceptual attention - by holding templates for targets of perceptual selection - and controlling action - by holding task sets to implement our current goals.