Beyond a mask and against the bottleneck: retroactive dual-task interference during working memory consolidation of a masked visual target

While studies on visual memory commonly assume that the consolidation of a visual stimulus into working memory is interrupted by a trailing mask, studies on dual-task interference suggest that the consolidation of a stimulus can continue for several hundred milliseconds after a mask. As a result, estimates of the time course of working memory consolidation differ more than an order of magnitude. Here, we contrasted these opposing views by examining if and for how long the processing of a masked display of visual stimuli can be disturbed by a trailing 2-alternative forced choice task (2-AFC; a color discrimination task or a visual or auditory parity judgment task). The results showed that the presence of the 2-AFC task produced a pronounced retroactive interference effect that dissipated across stimulus onset asynchronies of 250-1,000 ms, indicating that the processing elicited by the 2-AFC task interfered with the gradual consolidation of the earlier shown stimuli. Furthermore, this interference effect occurred regardless of whether the to-be-remembered stimuli comprised a string of letters or an unfamiliar complex visual shape, and it occurred regardless of whether these stimuli were masked. Conversely, the interference effect was reduced when the memory load for the 1st task was reduced, or when the 2nd task was a color detection task that did not require decision making. Taken together, these findings show that the formation of a durable and consciously accessible working memory trace for a briefly shown visual stimulus can be disturbed by a trailing 2-AFC task for up to several hundred milliseconds after the stimulus has been masked. By implication, the current findings challenge the common view that working memory consolidation involves an immutable central processing bottleneck, and they also make clear that consolidation does not stop when a stimulus is masked.

Attentional episodes in visual perception

Is one's temporal perception of the world truly as seamless as it appears? This article presents a computationally motivated theory suggesting that visual attention samples information from temporal episodes (episodic simultaneous type/serial token model; Wyble, Bowman, & Nieuwenstein, 2009). Breaks between these episodes are punctuated by periods of suppressed attention, better known as the attentional blink (Raymond, Shapiro, & Arnell, 1992). We test predictions from this model and demonstrate that participants were able to report more letters from a sequence of 4 targets presented in a dense temporal cluster than from a sequence of 4 targets interleaved with nontargets. However, this superior report accuracy comes at a cost in impaired temporal order perception. Further experiments explore the dynamics of multiple episodes and the boundary conditions that trigger episodic breaks. Finally, we contrast the importance of attentional control, limited resources, and memory capacity constructs in the model.

The attentional blink provides episodic distinctiveness: sparing at a cost

The attentional blink (J. E. Raymond, K. L. Shapiro, & K. M. Arnell, 1992) refers to an apparent gap in perception observed when a second target follows a first within several hundred milliseconds. Theoretical and computational work have provided explanations for early sets of blink data, but more recent data have challenged these accounts by showing that the blink is attenuated when subjects encode strings of stimuli (J. Kawahara, T. Kumada, & V. Di Lollo, 2006; M. R. Nieuwenstein & M. C. Potter, 2006; C. N. Olivers, 2007) or are distracted (C. N. Olivers & S. Nieuwenhuis, 2005) while viewing the rapid serial visual presentation stream. The authors describe the episodic simultaneous type, serial token model, a computational account of encoding visual stimuli into working memory that suggests that the attentional blink is a cognitive strategy rather than a resource limitation. This model is composed of neurobiologically plausible elements and simulates the attentional blink with a competitive attentional mechanism that facilitates the formation of episodically distinct representations within working memory. In addition to addressing the blink, the model addresses the phenomena of repetition blindness and whole report superiority, producing predictions that are supported by experimental work.

Whole Report versus Partial Report in RSVP Sentences

A sentence is readily understood and recalled when presented 1 word at a time using rapid serial visual presentation (RSVP) at 10 words/s (Potter, 1984). In contrast, selecting just 2 colored letters at 10 letters/s results in easy detection of the first target but poor recall for the second when it appears 200-500 ms later. This attentional blink disappears when all letters must be reported; instead, performance drops more gradually over serial position (Nieuwenstein & Potter, 2006). Would target words in sentences escape an attentional blink? Subjects either reported 2 target words (in red or uppercase) or the whole 10-word sentence. There was a blink for Target 2 in partial report, but that target was easily remembered in whole report. With scrambled sentences whole report dropped but partial report was unaffected, again showing a blink. The attentional blink is not due to memory processing of Target 1, but to target selection, which is incompatible with sentence processing.

Temporal selection is suppressed, delayed, and diffused during the attentional blink

How does temporal selection work, and along what dimensions does it vary from one instance to the next? We explored these questions using a phenomenon in which temporal selection goes awry. In the attentional blink, subjects fail to report the second of a pair of targets (T1 and T2) when they are presented at stimulus onset asynchronies (SOAs) of roughly 200 to 500 ms. We directly tested the properties of temporal selection during the blink by analyzing distractor intrusions at a fast rate of item presentation. Our analysis shows that attentional selection is (a) suppressed, (b) delayed, and (c) diffused in time during the attentional blink. These effects are dissociated by their time course: The measure of each effect returns to the baseline value at a different SOA. Our results constrain theories of the attentional blink and indicate that temporal selection varies along at least three dissociable dimensions: efficacy, latency, and precision.