Can the focus of attention accommodate multiple, separate items?

The Relation Between Attention and Memory

The relation between attention and memory has long been deemed important for understanding cognition, and it was heavily researched even in the first experimental psychology laboratory by Wilhelm Wundt and his colleagues. Since then, the importance of the relation between attention and memory has been explored in myriad subdisciplines of psychology, and we incorporate a wide range of these diverse fields. Here, we examine some of the practical consequences of this relation and summarize work with various methodologies relating attention to memory in the fields of working memory, long-term memory, individual differences, life-span development, typical brain function, and neuropsychological conditions. We point out strengths and unanswered questions for our own embedded processes view of information processing, which is used to organize a large body of evidence. Last, we briefly consider the relation of the evidence to a range of other theoretical views before drawing conclusions about the state of the field.

The association of targets modulates the search efficiency in multitarget searches

Previous studies have found that distractors can affect visual search efficiency when associated with the target in a single-target search. However, multitarget searches are frequently necessary in daily life. In the present study, we examined how the association of targets in a multitarget search affected performance when searching for two targets simultaneously (Experiment 1). In addition, we explored whether the association affected switch cost (Experiment 2) and preparation cost (Experiment 3). Participants were required to learn associations between different colors or shapes and then performed feature search and conjunction search tasks. For all experiments, the results of search efficiency showed that for conjunction search, the search efficiency under the associated condition was significantly higher than that under the neutral condition. Similarly, the response times in the associated condition were significantly faster than those in the neutral condition under the conjunction search condition in Experiments 1 and 2. However, in Experiment 3, the response times in the associated condition were longer than those in the neutral condition. These results indicate that the association between targets can improve the efficiency of multitarget searches. Furthermore, associations can reduce the time spent searching for individual targets and the switch cost; however, the preparation cost increases.

Allocation of resources in working memory: Theoretical and empirical implications for visual search

Recently, working memory (WM) has been conceptualized as a limited resource, distributed flexibly and strategically between an unlimited number of representations. In addition to improving the precision of representations in WM, the allocation of resources may also shape how these representations act as attentional templates to guide visual search. Here, we reviewed recent evidence in favor of this assumption and proposed three main principles that govern the relationship between WM resources and template-guided visual search. First, the allocation of resources to an attentional template has an effect on visual search, as it may improve the guidance of visual attention, facilitate target recognition, and/or protect the attentional template against interference. Second, the allocation of the largest amount of resources to a representation in WM is not sufficient to give this representation the status of attentional template and thus, the ability to guide visual search. Third, the representation obtaining the status of attentional template, whether at encoding or during maintenance, receives an amount of WM resources proportional to its relevance for visual search. Thus defined, the resource hypothesis of visual search constitutes a parsimonious and powerful framework, which provides new perspectives on previous debates and complements existing models of template-guided visual search.

Prioritization within visual working memory reflects a flexible focus of attention

When motivated, people can keep nonrecent items in a list active during the presentation of new items, facilitating fast and accurate recall of the earlier items. It has been proposed that this occurs by flexibly orienting attention to a single prioritized list item, thus increasing the amount of attention-based maintenance directed toward this item at the expense of other items. This is manipulated experimentally by associating a single distinct feature with a higher reward value, such as a single red item in a list of black items. These findings may be more parsimoniously explained under a distinctiveness of encoding framework rather than a flexible attention allocation framework. The retrieval advantage for the prioritized list position may be because the incongruent feature stands out in the list perceptually and causes it to become better encoded. Across three visual working memory experiments, we contrast a flexible attention theory against a distinctiveness of encoding theory by manipulating the reward value associated with the incongruent feature. Findings from all three experiments show strong support in favor of the flexible attention theory and no support for the distinctiveness of encoding theory. We also evaluate and find no evidence that strategy use, motivation, or tiredness/fatigue associated with reward value can adequately explain flexible prioritization of attention. Flexible attentional prioritization effects may be best understood under the context of an online attentional refreshing mechanism.

The architecture of working memory: Features from multiple remembered objects produce parallel, coactive guidance of attention in visual search

Theories of working memory (WM) differ in their claims about the number of items that can be maintained in a state that directly interacts with other, ongoing cognitive operations (termed the focus of attention). A similar debate has arisen in the literature on visual working memory (VWM), focused on the number of items that can simultaneously interact with attentional priority. In 3 experiments, we used a redundancy-gain paradigm to provide a comprehensive test of the latter question. Participants searched for 2 cued features (e.g., a color and a shape) within a search array. The cued feature values changed on a trial-by-trial basis, requiring VWM. The target (when present) could match 1 of the cued features (single-target trials) or both cued features (redundant-target trials). We tested whether response time distributions contained a substantial proportion of trials with redundant-target responses that were faster than predicted by 2 independent guidance processes operating in parallel (i.e., violations of the race-model inequality). Violations are consistent with a coactive architecture in which both cued values guide attention in parallel and sum on the priority map. Robust violations were observed in all cases predicted by the hypothesis that multiple items in VWM can guide attention simultaneously, and these results were inconsistent with the hypothesis that guidance is limited to a single item simultaneously. When considered in the larger context of the literature on VWM and attention, the present results are consistent with a model of WM architecture in which the focus of attention can maintain multiple, independent representations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Working Memory and Attention - A Conceptual Analysis and Review

There is broad agreement that working memory is closely related to attention. This article delineates several theoretical options for conceptualizing this link, and evaluates their viability in light of their theoretical implications and the empirical support they received. A first divide exists between the concept of attention as a limited resource, and the concept of attention as selective information processing. Theories conceptualizing attention as a resource assume that this resource is responsible for the limited capacity of working memory. Three versions of this idea have been proposed: Attention as a resource for storage and processing, a shared resource for perceptual attention and memory maintenance, and a resource for the control of attention. The first of these three is empirically well supported, but the other two are not. By contrast, when attention is understood as a selection mechanism, it is usually not invoked to explain the capacity limit of working memory - rather, researchers ask how different forms of attention interact with working memory, in two areas. The first pertains to attentional selection of the contents of working memory, controlled by mechanisms of filtering out irrelevant stimuli, and removing no-longer relevant representations from working memory. Within working memory contents, a single item is often selected into the focus of attention for processing. The second area pertains to the role of working memory in cognitive control. Working memory contributes to controlling perceptual attention - by holding templates for targets of perceptual selection - and controlling action - by holding task sets to implement our current goals.

Short-term memory based on activated long-term memory: A review in response to Norris (2017)

Short-term memory (STM), the limited information temporarily in a state of heightened accessibility, includes just-presented events and recently retrieved information. Norris (2017) argued for a prominent class of theories in which STM depends on the brain keeping a separate copy of new information, and against alternatives in which the information is held only in a portion of long-term memory (LTM) that is currently activated (aLTM). Here I question premises of Norris' case for separate-copy theories in the following ways. (a) He did not allow for implications of the common assumption (e.g., Cowan, 1999; Cowan & Chen, 2009) that aLTM can include new, rapidly formed LTM records of a trial within an STM task. (b) His conclusions from pathological cases of impaired STM along with intact LTM are tenuous; these rare cases can be explained by impairments in encoding, processing, or retrieval related to LTM rather than passive maintenance. (c) Although Norris reasonably allowed structured pointers to aLTM instead of separate copies of the actual item representations in STM, the same structured pointers may well be involved in long-term learning. (d) Last, models of STM storage can serve as the front end of an LTM learning system rather than being separate. I summarize evidence for these premises and an updated version of an alternative theory in which storage depends on aLTM (newly clarified), and, embedded within it, information enhanced by the current focus of attention (Cowan, 1988, 1999), with no need for a separate STM copy. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

What do people typically do between list items? The nature of attention-based mnemonic activities depends on task context

It is commonly assumed that attention-demanding postencoding processes take place during the free time immediately following encoding of each memory item in a list. These processes are thought to prevent loss of information from working memory (WM). We tested whether interitem pauses during presentation of a list are used to focus attention (a) on the last-presented memory item or (b) on all items currently in WM, and (c) whether this changes over time. Here, we presented black probe letters between to-be-remembered red letters. Participants judged whether each probe letter corresponded to the last-presented memory item (last-item match group) or to any of the memory items presented up to that point in the list (any-item match group). To examine mnemonic processing as a function of time, the delay between the to-be-remembered letter and the following probe was manipulated in three experiments. When preprobe delays and interitem intervals were relatively short (Experiment 1), recall performance was observed to be better in the last-item match group and this did not change as a function of the duration of the delay before the probe. When preprobe delays and interitem intervals were longer however (Experiment 2), this disruptive effect of Any-item match instructions was no longer observed. This pattern was found again in Experiment 3 and suggests that the nature of the attention-demanding postencoding processes taking place in between memory items depends on task context in a systematic manner. The results are discussed in terms of previously proposed attention-demanding processes; specifically, consolidation and refreshing. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Attention in working memory: attention is needed but it yearns to be free

Recent theoretical development of working memory has emphasized the role of attention in several active processes supporting maintenance. Although this development is certainly welcome and has accounted for a number of phenomena, there are findings that cannot be readily accounted for through the active use of attention in refreshing or removal of information. We review these findings and suggest that, whenever the circumstances allow, participants attempt to reduce the load on attention by making use of stored concepts in long-term memory (LTM) or off-loading new configurations, forming new long-term memories. Newly formed groups and configurations in LTM constitute a list- or array-wide version of the consolidation of information into memory to prevent forgetting in a manner that reduces the need for continued attention to the material. This suggestion leads to a number of interesting questions at the behavioral and neural levels, which we also discuss.

Focus Switching in Working Memory

Abstract. Focus switching in working memory involves accessing an object in the focus of attention in order to retrieve its content. Objects in working memory can be viewed as consisting of two types of information: contents (e.g., numerical information) and contexts (e.g., cues to retrieve the contents). This study examined the extent to which content retrieval and context access may be separated. Three experiments were carried out in which object switching and content retrieval were manipulated. In addition, the alternation between the retrieval operations was also manipulated. The main result was that content retrieval required time over and above that needed to access the object. This finding supports the idea that contexts and their contents may be accessed independently when an object is brought into the focus.

Competition for the focus of attention in visual working memory: perceptual recency versus executive control

Previous research on memory for a short sequence of visual stimuli indicates that access to the focus of attention (FoA) can be achieved in either of two ways. The first is automatic and is indexed by the recency effect, the enhanced retention of the final item. The second is strategic and based on instructions to prioritize items differentially, a process that draws on executive capacity and boosts retention of information deemed important. In both cases, the increased level of retention can be selectively reduced by presenting a poststimulus distractor (or suffix). We manipulated these variables across three experiments. Experiment 1 generalized previous evidence that prioritizing a single item enhances its retention and increases its vulnerability to interference from a poststimulus suffix. A second experiment showed that the enhancement from prioritizing one or two items comes at a cost to the recency effect. A third experiment showed that prioritizing two items renders memory for both vulnerable to interference from an irrelevant suffix. The results suggest that some but not all items in working memory compete to occupy a narrow FoA and that this competition is determined by a combination of perceptually driven recency and internal executive control.

Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity

In "hybrid search" tasks, such as finding items on a grocery list, one must search the scene for targets while also searching the list in memory. How is the representation of a visual item compared with the representations of items in the memory set? Predominant theories would propose a role for visual working memory (VWM) either as the site of the comparison or as a conduit between visual and memory systems. In seven experiments, we loaded VWM in different ways and found little or no effect on hybrid search performance. However, the presence of a hybrid search task did reduce the measured capacity of VWM by a constant amount regardless of the size of the memory or visual sets. These data are broadly consistent with an account in which VWM must dedicate a fixed amount of its capacity to passing visual representations to long-term memory for comparison to the items in the memory set. The data cast doubt on models in which the search template resides in VWM or where memory set item representations are moved from LTM through VWM to earlier areas for comparison to visual items.

Selection in spatial working memory is independent of perceptual selective attention, but they interact in a shared spatial priority map

We examined the relationship between the attentional selection of perceptual information and of information in working memory (WM) through four experiments, using a spatial WM-updating task. Participants remembered the locations of two objects in a matrix and worked through a sequence of updating operations, each mentally shifting one dot to a new location according to an arrow cue. Repeatedly updating the same object in two successive steps is typically faster than switching to the other object; this object switch cost reflects the shifting of attention in WM. In Experiment 1, the arrows were presented in random peripheral locations, drawing perceptual attention away from the selected object in WM. This manipulation did not eliminate the object switch cost, indicating that the mechanisms of perceptual selection do not underlie selection in WM. Experiments 2a and 2b corroborated the independence of selection observed in Experiment 1, but showed a benefit to reaction times when the placement of the arrow cue was aligned with the locations of relevant objects in WM. Experiment 2c showed that the same benefit also occurs when participants are not able to mark an updating location through eye fixations. Together, these data can be accounted for by a framework in which perceptual selection and selection in WM are separate mechanisms that interact through a shared spatial priority map.

On the Use of Response Chunking as a Tool to Investigate Strategies

In this perspective we suggest that chunking can be used as an investigative tool to determine the characteristics of other cognitive phenomena. We present an example of the usefulness of chunking multiple responses to aid in understanding object switch costs. Switch costs refer to the shorter response times for manipulation of the same item on two trials in a row compared to a switch between items. It is presently unclear if this result is due to structural or strategic processes. We provide a short review of past literature on switch costs and a proof-of-concept example that chunking may shed new light on this topic. We examined this question with boxes filled with numbers to be arithmetically updated and memorized. A situation in which there were two response items to be manipulated per trial eliminated or reversed the switch cost effect. We suggest that participants use a strategy in which the two output responses were chunked together, making it unfeasible to prepare separately for a repetition of the most recent item as participants do in other circumstances. Our data suggest that even a well-studied phenomenon can benefit theoretically from the use of chunking as a research tool.

Working memory units are all in your head: Factors that influence whether features or objects are the favored units

We compared two contrasting hypotheses of how multifeatured objects are stored in visual working memory (vWM); as integrated objects or as independent features. A new procedure was devised to examine vWM representations of several concurrently held objects and their features and our main measure was reaction time (RT), allowing an examination of the real-time search through features and/or objects in an array in vWM. Response speeds to probes with color, shape, or both were studied as a function of the number of memorized colored shapes. Four testing groups were created by varying the instructions and the way in which probes with both color and shape were presented. The instructions explicitly either encouraged or discouraged the use of binding information and the task-relevance of binding information was further suggested by presenting probes with both color and shapes as either integrated objects or independent features. Our results show that the unit used for retrieval from vWM depends on the testing situation. Search was fully object-based only when all factors support that basis of search, in which case retrieving 2 features took no longer than retrieving a single feature. Otherwise, retrieving 2 features took longer than retrieving a single feature. Additional analyses of change detection latency suggested that, even though different testing situations can result in a stronger emphasis on either the feature dimension or the object dimension, neither one disappears from the representation and both concurrently affect change detection performance.

Central and peripheral components of working memory storage

This study reexamines the issue of how much of working memory storage is central, or shared across sensory modalities and verbal and nonverbal codes, and how much is peripheral, or specific to a modality or code. In addition to the exploration of many parameters in 9 new dual-task experiments and reanalysis of some prior evidence, the innovations of the present work compared to previous studies of memory for 2 stimulus sets include (a) use of a principled set of formulas to estimate the number of items in working memory and (b) a model to dissociate central components, which are allocated to very different stimulus sets depending on the instructions, from peripheral components, which are used for only 1 kind of material. We consistently find that the central contribution is smaller than was suggested by Saults and Cowan (2007) and that the peripheral contribution is often much larger when the task does not require the binding of features within an object. Previous capacity estimates are consistent with the sum of central plus peripheral components observed here. We consider the implications of the data as constraints on theories of working memory storage and maintenance.

Introduction to the special issue on visual working memory

Visual working memory is a volatile, limited-capacity memory that appears to play an important role in our impression of a visual world that is continuous in time. It also mediates between the contents of the mind and the contents of that visual world. Research on visual working memory has become increasingly prominent in recent years. The articles in this special issue of Attention, Perception, & Psychophysics describe new empirical findings and theoretical understandings of the topic.

A list-length constraint on incidental item-to-item associations

We investigated the possibility that item-to-item associations form between items concurrently included in a capacity-limited region of working memory, but not outside of that region. Many studies indicate a central capacity limit of three to five items (e.g., Cowan Neuropsychologia 49:1401-1406, 2001). Participants received lists of three, six, or nine words along with an orienting task, selecting the most interesting word from each list. Consistent with expectations, a subsequent, unexpected test showed that memory of whether two words came from the same list or not was superior for three-word lists, as compared with six- and nine-word lists, which did not differ. This effect occurred even though the separation between the list positions of the two probe words was controlled across list lengths. The study demonstrates a source of implicit learning that depends upon a limited-capacity working memory faculty, a finding that should inspire further research on the function of working memory in long-term learning.

The exception does not rule: attention constrains form preparation in word production

Form preparation in word production, the benefit of exploiting a useful common sound (such as the first phoneme) of iteratively spoken small groups of words, is notoriously fastidious, exhibiting a seemingly categorical, all-or-none character and a corresponding susceptibility to "killers" of preparation. In particular, the presence of a single exception item in a group of otherwise phonologically consistent words has been found to eliminate the benefit of knowing a majority characteristic. This has been interpreted to mean that form preparation amounts to partial production and thus provides a window on fundamental processes of phonological word encoding (e.g., Levelt, Roelofs, & Meyer, 1999). However, preparation of only fully distributed properties appears to be nonoptimal and is difficult to reconcile with the sensitivity of cognitive responses to probabilities in other domains. We show here that the all-or-none characteristic of form preparation is specific to task format. Preparation for sets that included an exception item occurred in ecologically valid production tasks, picture naming (Experiment 1), and word naming (Experiment 2). Preparation failed only in the commonly used, but indirect and resource-intensive, associative cuing task (Experiment 3). We outline an account of form preparation in which anticipation of word-initial phonological fragments uses a limited-capacity, sustained attentional capability that points to rather than enacts possibilities for imminent speech.

Long-term memory guidance of visuospatial attention in a change-detection paradigm

Visual task performance is generally stronger in familiar environments. One reason for this familiarity benefit is that we learn where to direct our visual attention and effective attentional deployment enhances performance. Visual working memory plays a central role in supporting long-term memory guidance of visuospatial attention. We modified a change detection task to create a new paradigm for investigating long-term memory guidance of attention. During the training phase, subjects viewed images in a flicker paradigm and were asked to detect between one and three changes in the images. The test phase required subjects to detect a single change in a one-shot change detection task in which they held all possible locations of changes in visual working memory and deployed attention to those locations to determine if a change occurred. Subjects detected significantly more changes in images for which they had been trained to detect the changes, demonstrating that memory of the images guided subjects in deploying their attention. Moreover, capacity to detect changes was greater for images that had multiple changes during the training phase. In Experiment 2, we observed that capacity to detect changes for the 3-studied change condition increased significantly with more study exposures and capacity was significantly higher than 1, indicating that subjects were able to attend to more than one location. Together, these findings suggest memory and attentional systems interact via working memory such that long-term memory can be used to direct visual spatial attention to multiple locations based on previous experience.

But consider the alternative: the influence of positive affect on overconfidence

Three studies find evidence that positive affect reduces comparative overconfidence (overplacement). This occurs because positive affect attenuates focalism via decreasing people's tendency to overweight information regarding themselves in the light of information concerning others. Specifically, Study 1 provides evidence that positive affect leads to more realistic estimates of comparative ability and that other-focus partially mediates this effect. Then, Study 2 provides causal evidence that positive affect independently influences other-focus and that other-focus, in turn, influences overplacement. Additionally, Study 2 uses an indirect measure of focalism to better capture this attentional process. Finally, Study 3 explores the influence of negative affect on overplacement. In addition, each study finds that positive affect does not influence overconfidence regarding participant's raw performances (overestimation) as this type of overconfidence is not dependent on self-other comparisons.

Trisecting representational states in short-term memory

The ability to hold information briefly in mind in the absence of external stimulation forms the core of much of higher-order cognition. This ability is referred to as short-term memory (STM). However, single-term labels such as this belie the complexity of the underlying construct. Here, we review evidence that STM is an amalgamation of three qualitatively distinct states. We argue that these distinct states emerge from the combination of frontal selection mechanisms (often considered the domain of attention and cognitive control), medial temporal binding mechanisms (often considered the domain of long-term memory, LTM), and synaptic plasticity. These various contributions lead to a single representation amenable to elaborated processing (focus of attention), a limited set of active representations among which attention can be flexibly switched (direct-access region), and passive representations whose residual traces facilitate re-activation (activated LTM). We suggest that selection and binding mechanisms are typically engaged simultaneously, providing multiple forms and routes of short-term maintenance. We propose that such a framework can resolve discrepancies among recent studies that have attempted to understand the relationship between attention and STM on the one hand, and between LTM and STM on the other. We anticipate that recent advances in neuroimaging and neurophysiology will elucidate the mechanisms underlying shifts and transformations among these representational states, providing a window into the dynamic processes of higher-order cognition.

The focus of attention in working memory-from metaphors to mechanisms

Many verbal theories describe working memory (WM) in terms of physical metaphors such as information flow or information containers. These metaphors are often useful but can also be misleading. This article contrasts the verbal version of the author's three-embedded-component theory with a computational implementation of the theory. The analysis focuses on phenomena that have been attributed to the focus of attention in WM. The verbal theory characterizes the focus of attention by a container metaphor, which gives rise to questions such as: how many items fit into the focus? The computational model explains the same phenomena mechanistically through a combination of strengthened bindings between items and their retrieval cues, and priming of these cues. The author applies the computational model to three findings that have been used to argue about how many items can be held in the focus of attention (Oberauer and Bialkova, 2009; Gilchrist and Cowan, 2011; Oberauer and Bialkova, 2011). The modeling results imply a new interpretation of those findings: The different patterns of results across those studies don't imply different capacity estimates for the focus of attention; they rather reflect to what extent retrieval from WM is parallel or serial.

Models of verbal working memory capacity: what does it take to make them work?

Theories of working memory (WM) capacity limits will be more useful when we know what aspects of performance are governed by the limits and what aspects are governed by other memory mechanisms. Whereas considerable progress has been made on models of WM capacity limits for visual arrays of separate objects, less progress has been made in understanding verbal materials, especially when words are mentally combined to form multiword units or chunks. Toward a more comprehensive theory of capacity limits, we examined models of forced-choice recognition of words within printed lists, using materials designed to produce multiword chunks in memory (e.g., leather brief case). Several simple models were tested against data from a variety of list lengths and potential chunk sizes, with test conditions that only imperfectly elicited the interword associations. According to the most successful model, participants retained about 3 chunks on average in a capacity-limited region of WM, with some chunks being only subsets of the presented associative information (e.g., leather brief case retained with leather as one chunk and brief case as another). The addition to the model of an activated long-term memory component unlimited in capacity was needed. A fixed-capacity limit appears critical to account for immediate verbal recognition and other forms of WM. We advance a model-based approach that allows capacity to be assessed despite other important processing contributions. Starting with a psychological-process model of WM capacity developed to understand visual arrays, we arrive at a more unified and complete model.

Attention to Information in Working Memory

Working memory retains information and makes it available for processing. People often need to hold several chunks of information available while concentrating on only one of them. This process requires selective attention to the contents of working memory. In this article, we summarize evidence for both a broad focus of attention with a capacity of approximately four chunks and a narrow focus of attention that selects a single chunk at a time.

Lost thoughts: implicit semantic interference impairs reflective access to currently active information

Why do we lose, or have trouble accessing, an idea that was in the focus of attention only a moment ago, especially in the absence of any apparent distraction? We tested the hypothesis that accessing a single item that is already active is affected by implicit interference (interference of which we have little or no awareness). We presented masked words that were semantically related or unrelated to a single visible target word that participants were cued to think of (refresh) a half second after its offset. Masked related but not unrelated words increased time to refresh the target but did not influence time required to read a target that was physically present. These findings provide novel evidence that an item in the focus of attention is subject to semantic interference. We suggest that such implicit semantic interference may contribute to the common "lost thought" experience and to cognitive deficits in populations in which refreshing is impaired.