Visual Search Does Not Remain Efficient When Executive Working Memory Is Working

Attenuation of spatial bias with target template variation

This study investigated the impact of target template variation or consistency on attentional bias in location probability learning. Participants conducted a visual search task to find a heterogeneous shape among a homogeneous set of distractors. The target and distractor shapes were either fixed throughout the experiment (target-consistent group) or unpredictably varied on each trial (target-variant group). The target was often presented in one possible search region, unbeknownst to the participants. When the target template was consistent throughout the biased visual search, spatial attention was persistently biased toward the frequent target location. However, when the target template was inconsistent and varied during the biased search, the spatial bias was attenuated so that attention was less prioritized to a frequent target location. The results suggest that the alternative use of target templates may interfere with the emergence of a persistent spatial bias. The regularity-based spatial bias depends on the number of attentional shifts to the frequent target location, but also on search-relevant contexts.

Spatial Attention in Visual Working Memory Strengthens Feature-Location Binding

There is a debate about whether working memory (WM) representations are individual features or bound objects. While spatial attention is reported to play a significant role in feature binding, little is known about the role of spatial attention in WM. To address this gap, the current study required participants to maintain multiple items in their WM and employed a memory-driven attention capture paradigm. Spatial attention in WM was manipulated by presenting an exogenous cue at one of the locations that memory items had occupied. The effects of spatial attention on attention guidance in visual search (Experiment 1) and memory performance (Experiments 1 and 2) were explored. The results show that WM-driven attention guidance did not vary based on whether the search features came from the same object in WM; instead, it depended on the number of features, regardless of their source object. In memory tasks, the cued object outperformed the uncued object. Specifically, the test item was better rejected when the features were mis-bound in the cued location than in the uncued location. These findings suggest that memory-driven attention guidance is feature-based, and spatial attention in WM helps bind features into object structures based on location.

Examining the exposure-reception-retention link in realistic communication environments via VR and eye-tracking: The VR billboard paradigm

Exposure is key to message effects. No effects can ensue if a health, political, or commercial message is not noticed. Yet, existing research in communication, advertising, and related disciplines often measures 'opportunities for exposure' at an aggregate level, whereas knowing whether recipients were 'actually exposed' to a message requires a micro-level approach. Micro-level research, on the other hand, focuses on message processing and retention, takes place under highly controlled laboratory conditions with forced message exposure, and largely ignores how recipients attend selectively to messages under more natural conditions. Eye-tracking enables us to assess actual exposure, but its previous applications were restricted to screen-based reading paradigms lacking ecological validity or field studies that suffer from limited experimental control. Our solution is to measure eye-tracking within an immersive VR environment that creates the message delivery and reception context. Specifically, we simulate a car ride down a highway alongside which billboards are placed. The VR headset (HP Omnicept Pro) provides an interactive 3D view of the environment and holds a seamlessly integrated binocular eye tracker that records the drivers' gaze and detects all fixations on the billboards. This allows us to quantify the nexus between exposure and reception rigorously, and to link our measures to subsequent memory, i.e., whether messages were remembered, forgotten, or not even encoded. An empirical study shows that incidental memory for messages differs based on participants' gaze behavior while passing the billboards. The study further shows how an experimental manipulation of attentional demands directly impacts drivers' gaze behavior and memory. We discuss the large potential of this paradigm to quantify exposure and message reception in realistic communication environments and the equally promising applications in new media contexts (e.g., the Metaverse).

The impact of different distractions on outdoor visual search and object memory

We investigated whether and how different types of search distractions affect visual search behavior and target memory while participants searched in a real-world environment. They searched either undistracted (control condition), listened to a podcast (auditory distraction), counted down aloud at intervals of three while searching (executive working memory load), or were forced to stop the search on half of the trials (time pressure). In line with findings from laboratory settings, participants searched longer but made fewer errors when the target was absent than when it was present, regardless of distraction condition. Furthermore, compared to the auditory distraction condition, the executive working memory load led to higher error rates (but not longer search times). In a surprise memory test after the end of the search tasks, recognition was better for previously present targets than for absent targets. Again, this was regardless of the previous distraction condition, although significantly fewer targets were remembered by the participants in the executive working memory load condition than by those in the control condition. The findings suggest that executive working memory load, but likely not auditory distraction and time pressure affected visual search performance and target memory in a real-world environment.

Sources of variation in search and foraging: A theoretical perspective

Search-the problem of exploring a space of alternatives to identify target goals-is a fundamental behaviour for many species. Although its foundation lies in foraging, most studies of human search behaviour have been directed towards understanding the attentional mechanisms that underlie the efficient visual exploration of two-dimensional (2D) scenes. With this review, we aim to characterise how search behaviour can be explained across a wide range of contexts, environments, spatial scales, and populations, both typical and atypical. We first consider the generality of search processes across psychological domains. We then review studies of interspecies differences in search. Finally, we explore in detail the individual and contextual variables that affect visual search and related behaviours in established experimental psychology paradigms. Despite the heterogeneity of the findings discussed, we identify that variations in control processes, along with the ability to regulate behaviour as a function of the structure of search space and the sampling processes adopted, to be central to explanations of variations in search behaviour. We propose a tentative theoretical model aimed at integrating these notions and close by exploring questions that remain unaddressed.

Role of aging and working memory in performance on a naturalistic visual search task

Studying age-related changes in working memory (WM) and visual search can provide insights into mechanisms of visuospatial attention. In visual search, WM is used to remember previously inspected objects/locations and to maintain a mental representation of the target to guide the search. We sought to extend this work, using aging as a case of reduced WM capacity. The present study tested whether various domains of WM would predict visual search performance in both young (n = 47; aged 18-35 yrs) and older (n = 48; aged 55-78) adults. Participants completed executive and domain-specific WM measures, and a naturalistic visual search task with (single) feature and triple-conjunction (three-feature) search conditions. We also varied the WM load requirements of the search task by manipulating whether a reference picture of the target (i.e., target template) was displayed during the search, or whether participants needed to search from memory. In both age groups, participants with better visuospatial executive WM were faster to locate complex search targets. Working memory storage capacity predicted search performance regardless of target complexity; however, visuospatial storage capacity was more predictive for young adults, whereas verbal storage capacity was more predictive for older adults. Displaying a target template during search diminished the involvement of WM in search performance, but this effect was primarily observed in young adults. Age-specific interactions between WM and visual search abilities are discussed in the context of mechanisms of visuospatial attention and how they may vary across the lifespan.

Visual search strategies in children: A reflection of working memory processes?

Visual search is not only less accurate but also less organized in children than in adults. However, visual search strategies in children have not been extensively studied and they are not evaluated in clinical practice. Working memory could play a critical role for the execution and the maintaining of a visual search strategy. Few studies if any have explored the links between visual search organization and working memory in children. In the present study, 54 primary school children performed a cancellation task (Bells test) and working memory tests (span tasks). Our results suggested that, contrary to visual search accuracy, visual search organization was significantly linked to working memory and, more specifically, to the efficiency of the central executive component. There is, thus, a real need to better understand the visual search process and to improve its assessment with cancellation tests in clinical practice.

Visual working memory load does not affect the overall stimulus processing time in visual search

The dual-task paradigm is widely used in studying the interaction between visual search and working memory. A number of studies showed that holding items in working memory delays the overall response time (RT) in visual search, but it does not affect the efficiency of search (i.e., the slope of the RT × set size function). Why the memory load merely affects the overall RT? Some researchers proposed that this load-effect on overall RT may be caused by factors that only affect response selection processes, while others argued that it may reflect the effect of visual working memory load on visual search. This study investigated the two competing hypotheses by measuring the threshold stimulus exposure duration (TSED) for successfully fulfilling a search task. Experiment 1 replicated the large overall RT difference with the RT method but only found a small though reliable overall TSED difference with the TSED method. Experiment 2, with better controls, found no TSED difference by manipulating the visual working memory load. Experiment 3 showed that the TSED is not influenced by processes in the response selection stage. The present findings suggest that the overall stimulus processing time in visual search is not affected by visual working memory load and that the effect of memory load on overall RT is largely due to factors affecting response selection alone.

Exposure to infant images enhances attention control in mothers

Viewing cute images has been reported to promote performance on tasks requiring carefulness, possibly related to an enhanced positive emotional state. However, it is unclear whether viewing infant images also enhances attention control in mothers. Therefore, this experimental study examined whether exposure to images of infants affected mothers' performance on a visual search task, studying associations with happy facial expressivity. Mothers (N = 101, M_age  = 30.88) were randomly assigned to one of two conditions in which they either viewed images of infants or images of adults. Before and after viewing images, mothers performed a visual search task. Mothers' happy facial expressions at baseline and when viewing images were analysed. Viewing images of infants, in contrast to viewing images of adults, improved task performance indexed by accurateness, but not the number of correct responses. Images of infants elicited happy facial expressivity, which was associated with the number of correct responses on the visual search task. This study showed that viewing images of infants evokes happy facial expressions in mothers and can improve mothers' performance on a perceptual-cognitive task requiring attention control. Mothers' responses to infant images may be explained as an attentional preparedness for caregiving.

Executive working memory involved in the learning of contextual cueing effect

Implicit learning of spatial layouts occurs when target-distractor configurations repeat during a visual search task [contextual cueing; Chun and Jiang in Cogn Psychol 36(1): 28-17, 1998]. This study addressed the extent to which contextual cueing depends on executive working memory (WM). In three experiments, participants performed a contextual cueing visual search task concurrently with a WM task. The WM task was either executive (subtract 3 from each digit in WM) or non-executive (hold digits in WM), and was either low load (Experiment 1) or high load (Experiment 2). Contextual cueing was attenuated in the high-load executive WM condition. Experiment 3 replicated our findings using a within-subjects design, and confirmed the interpretation that executive functions of WM are required in contextual learning.

Motivational intensity and visual word search: Layout matters

Motivational intensity has been previously linked to information processing. In particular, it has been argued that affects which are high in motivational intensity tend to narrow cognitive scope. A similar effect has been attributed to negative affect, which has been linked to narrowing of cognitive scope. In this paper, we investigated how these phenomena manifest themselves during visual word search. We conducted three studies in which participants were instructed to perform word category identification. We manipulated motivational intensity by controlling reward expectations and affect via reward outcomes. Importantly, we altered visual search paradigms, assessing the effects of affective manipulations as modulated by information arrangement. We recorded multiple physiological signals (EEG, EDA, ECG and eye tracking) to assess whether motivational states can be predicted by physiology. Across the three studies, we found that high motivational intensity narrowed visual attentional scope by altering visual search strategies, especially when information was displayed sparsely. Instead, when information was vertically listed, approach-directed motivational intensity appeared to improve memory encoding. We also observed that physiology, in particular eye tracking, may be used to detect biases induced by motivational intensity, especially when information is sparsely organised.

Active Listening Delays Attentional Disengagement and Saccadic Eye Movements

Successful goal-directed visual behavior depends on efficient disengagement of attention. Attention must be withdrawn from its current focus before being redeployed to a new object or internal process. Previous research has demonstrated that occupying cognitive processes with a secondary cellular phone conversation impairs attentional functioning and driving behavior. For example, attentional processing is significantly impacted by concurrent cell phone use, resulting in decreased explicit memory for on-road information. Here, we examined the impact of a critical component of cell-phone use-active listening-on the effectiveness of attentional disengagement. In the gap task-a saccadic manipulation of attentional disengagement-we measured saccade latencies while participants performed a secondary active listening task. Saccadic latencies significantly increased under an active listening load only when attention needed to be disengaged, indicating that active listening delays a disengagement operation. Simple dual-task interference did not account for the observed results. Rather, active cognitive engagement is required for measurable disengagement slowing to be observed. These results have implications for investigations of attention, gaze behavior, and distracted driving. Secondary tasks such as active listening or cell-phone conversations can have wide-ranging impacts on cognitive functioning, potentially impairing relatively elementary operations of attentional function, including disengagement.

Texting during stair negotiation and implications for fall risk

BACKGROUND/AIM

Walking requires the integration of the sensory and motor systems. Cognitive distractions have been shown to interfere with negotiation of complex walking environments, especially in populations at greater risk for falls (e.g. the elderly). With the pervasiveness of mobile messaging and the recent introduction of augmented reality mobile gaming, it is increasingly important to understand how distraction associated with the simultaneous use of a mobile device impacts navigation of the complex walking environments experienced in daily life. In this study, we investigated how gait kinematics were altered when participants performed a texting task during step negotiation.

METHODS

Twenty participants (13 female, 7 males) performed a series of walking trials involving a step-deck obstacle, consisting of at least 3 texting trials and 3 non-texting trials.

RESULTS

When texting, participants ascended more slowly and demonstrated reduced dual-step foot toe clearance. Participants similarly descended more slowly when texting and demonstrated reduced single-step foot heel clearance as well as reduced dual-step foot fore-aft heel clearance.

CONCLUSION

These data support the conclusion that texting during stair negotiation results in changes to gait kinematics that may increase the potential for gait disruptions, falls, and injury. Further research should examine the effect texting has on performing other common complex locomotor tasks, actual fall risk, and the patterns of resulting injury rate and severity when negotiating complex environments.

Independent operation of implicit working memory under cognitive load

Implicit working memory (WM) has been known to operate non-consciously and unintentionally. The current study investigated whether implicit WM is a discrete mechanism from explicit WM in terms of cognitive resource. To induce cognitive resource competition, we used a conjunction search task (Experiment 1) and imposed spatial WM load (Experiment 2a and 2b). Each trial was composed of a set of five consecutive search displays. The location of the first four displays appeared as per pre-determined patterns, but the fifth display could follow the same pattern or not. If implicit WM can extract the moving pattern of stimuli, response times for the fifth target would be faster when it followed the pattern compared to when it did not. Our results showed implicit WM can operate when participants are searching for the conjunction target and even while maintaining spatial WM information. These results suggest that implicit WM is independent from explicit spatial WM.

The Effect of Central Executive Load on Fourth and Sixth Graders' Use of Arithmetic Strategies

In the present study, we set out to investigate whether and how central executive load constrains the strategies that children use during arithmetic processing. Using a dual-task paradigm accompanied by the choice/no-choice method, we tested 233 children (115 6^th graders, 118 4^th graders). Results showed that the impact of central executive load on reaction times and accuracy scores related to strategy use increased with the magnitude of the demands of the central executive, with central executive load playing an important role in strategy use. Sixth graders performed better than 4^th graders in the application of appropriate strategies. Children's adaptability with respect to strategy choice was affected by the type and magnitude of the central executive load; children showed better adaptability under the no-load condition and the inconsistent/low load condition than under conditions with greater load. Grade level affected children's adaptability with respect to strategy choice, with 6^th graders exhibiting significantly better performance than 4^th graders. These results confirm that the development of central executive skills contributes to children's overall strategy use and adaptability. These findings have important implications for understanding the category specificity of central executive working memory in arithmetic cognition and the mechanisms of strategy development in childhood.

Executive and perceptual distraction in visual working memory

The contents of visual working memory are likely to reflect the influence of both executive control resources and information present in the environment. We investigated whether executive attention is critical in the ability to exclude unwanted stimuli by introducing concurrent potentially distracting irrelevant items to a visual working memory paradigm, and manipulating executive load using simple or more demanding secondary verbal tasks. Across 7 experiments varying in presentation format, timing, stimulus set, and distractor number, we observed clear disruptive effects of executive load and visual distraction, but relatively minimal evidence supporting an interactive relationship between these factors. These findings are in line with recent evidence using delay-based interference, and suggest that different forms of attentional selection operate relatively independently in visual working memory.

This study demonstrates that the ability to encode and temporarily hold visual information depends both on how active (executive) attentional control is allocated, and whether there are (perceptual) distracting stimuli present in the visual environment. Across seven experiments, memory accuracy was always reduced when participants performed a more demanding task at the same time, and when to-be-remembered targets were accompanied by additional irrelevant items. These two forms of attentional interference appear to have relatively distinct impacts, indicating that we do not necessarily become more vulnerable to perceptual distraction when our executive attention is preoccupied by other tasks. This work provides new insights for the current debate on how working memory and attention might interact.

Manipulation of working memory contents selectively impairs metacognitive sensitivity in a concurrent visual discrimination task

What are the cognitive mechanisms underlying perceptual metacognition? Prior research indicates that prefrontal cortex (PFC) contributes to metacognitive performance, suggesting that metacognitive judgments are supported by high-level cognitive operations. We explored this hypothesis by investigating metacognitive performance for a visual discrimination task in the context of a concurrent working memory (WM) task. We found that, overall, high WM load caused a nonspecific decrease in visual discrimination performance as well as metacognitive performance. However, active manipulation of WM contents caused a selective decrease in metacognitive performance without impairing visual discrimination performance. These behavioral findings are consistent with previous neuroscience findings that high-level PFC is engaged by and necessary for (i) visual metacognition, and (ii) active manipulation of WM contents, but not mere maintenance. The selective interference of WM manipulation on metacognition suggests that these seemingly disparate cognitive functions in fact recruit common cognitive mechanisms. The common cognitive underpinning of these tasks may consist in (i) higher-order re-representation of lower-level sensory information, and/or (ii) application of decision rules in order to transform representations in PFC into definite cognitive/motor responses.

Working memory as internal attention: toward an integrative account of internal and external selection processes

Working memory (WM) and attention have been studied as separate cognitive constructs, although it has long been acknowledged that attention plays an important role in controlling the activation, maintenance, and manipulation of representations in WM. WM has, conversely, been thought of as a means of maintaining representations to voluntarily guide perceptual selective attention. It has more recently been observed, however, that the contents of WM can capture visual attention, even when such internally maintained representations are irrelevant, and often disruptive, to the immediate external task. Thus, the precise relationship between WM and attention remains unclear, but it appears that they may bidirectionally impact one another, whether or not internal representations are consistent with the external perceptual goals. This reciprocal relationship seems, further, to be constrained by limited cognitive resources to handle demands in either maintenance or selection. We propose here that the close relationship between WM and attention may be best described as a give-and-take interdependence between attention directed toward either actively maintained internal representations (traditionally considered WM) or external perceptual stimuli (traditionally considered selective attention), underpinned by their shared reliance on a common cognitive resource. Put simply, we argue that WM and attention should no longer be considered as separate systems or concepts, but as competing and influencing one another because they rely on the same limited resource. This framework can offer an explanation for the capture of visual attention by irrelevant WM contents, as well as a straightforward account of the underspecified relationship between WM and attention.

The development of organized visual search

Visual search plays an important role in guiding behavior. Children have more difficulty performing conjunction search tasks than adults. The present research evaluates whether developmental differences in children's ability to organize serial visual search (i.e., search organization skills) contribute to performance limitations in a typical conjunction search task. We evaluated 134 children between the ages of 2 and 17 on separate tasks measuring search for targets defined by a conjunction of features or by distinct features. Our results demonstrated that children organize their visual search better as they get older. As children's skills at organizing visual search improve they become more accurate at locating targets with conjunction of features amongst distractors, but not for targets with distinct features. Developmental limitations in children's abilities to organize their visual search of the environment are an important component of poor conjunction search in young children. In addition, our findings provide preliminary evidence that, like other visuospatial tasks, exposure to reading may influence children's spatial orientation to the visual environment when performing a visual search.

Saved by a log: how do humans perform hybrid visual and memory search?

Could you find 1 of your 1,000 Facebook friends in a crowd of 100? Even at a rate of 25 ms per comparison, determining that no friends were in the crowd would take more than 40 min if memory and visual search interacted linearly. In the experiment reported here, observers memorized pictures of 1 to 100 targets and then searched for any of these targets in visual displays of 1 to 16 objects. Response times varied linearly with visual set size but logarithmically with memory set size. Data from memory set sizes of 1 through 16 accurately predicted response times for different observers holding 100 objects in memory. The results would be consistent with a binary coding of visual objects in memory and are relevant to applied searches in which experts look for any of many items of interest (e.g., a radiologist running through a mental checklist of what might be wrong in a car-crash victim or an airport screener looking for any of a list of prohibited items in a carry-on bag).

Memory: enduring traces of perceptual and reflective attention

Attention and memory are typically studied as separate topics, but they are highly intertwined. Here we discuss the relation between memory and two fundamental types of attention: perceptual and reflective. Memory is the persisting consequence of cognitive activities initiated by and/or focused on external information from the environment (perceptual attention) and initiated by and/or focused on internal mental representations (reflective attention). We consider three key questions for advancing a cognitive neuroscience of attention and memory: to what extent do perception and reflection share representational areas? To what extent are the control processes that select, maintain, and manipulate perceptual and reflective information subserved by common areas and networks? During perception and reflection, to what extent are common areas responsible for binding features together to create complex, episodic memories and for reviving them later? Considering similarities and differences in perceptual and reflective attention helps integrate a broad range of findings and raises important unresolved issues.

A load on my mind: evidence that anhedonic depression is like multi-tasking

Multi-tasking can increase susceptibility to distraction, affecting whether irrelevant objects capture attention. Similarly, people with depression often struggle to concentrate when performing cognitively demanding tasks. This parallel suggests that depression is like multi-tasking. To test this idea, we examined relations between self-reported levels of anhedonic depression (a dimension that reflects the unique aspects of depression not shared with anxiety or other forms of distress) and attention capture by salient items in a visual search task. Furthermore, we compared these relations to the effects of performing a concurrent auditory task on attention capture. Strikingly, both multi-tasking and elevated levels of anhedonic depression were associated with increased capture by uniquely colored items, but decreased capture by abruptly appearing items. At least with respect to attention capture and distraction, depression seems to be functionally comparable to juggling a second, unrelated cognitive task.

Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.

Dual-task conditions modulate the efficiency of selective attention mechanisms in Alzheimer's disease

Given previous demonstrations of both selective and divided attention deficits in Alzheimer's disease (AD) patients, understanding how declines in the integrity of component processes of selective attention in these patients interact with impairments to executive processes mediating dual-task performance has both theoretical and practical relevance. To address this issue, healthy elderly and AD patients performed computerized tasks of spatial orienting, Simon response interference, and visual search both in isolation and while simultaneously engaged in a visuomotor tracking task (i.e., maintaining car position within a simulated driving environment). Results from the single-task conditions confirmed previous demonstrations of selective attention deficits in AD. Dual-task conditions produced in AD patients (but not healthy elderly) a change in the efficiency of the selective attention mechanisms themselves, as reflected in differential effects on cue or display conditions within each task. Rather than exacerbating the selective attention deficits observed under single-task conditions, however, dual-task conditions produced an apparent diminution of these deficits. We suggest this diminution is due to the combination of deficient top-down inhibitory processes along with a decrease in the attention-capturing properties of cue information under dual-task conditions in AD patients. These findings not only increase our understanding of the nature of the attentional deficits in AD patients, but also have implications for understanding the processes mediating attention in neurologically intact individuals.

Binding across space and time in visual working memory

Recent studies of visual short-term memory have suggested that the binding of features such as color and shape into remembered objects is relatively automatic. A series of seven experiments broadened this investigation by comparing the immediate retention of colored shapes with performance when color and shape were separated either spatially or temporally, with participants required actively to form the bound object. Attentional load was manipulated with a demanding concurrent task, and retention in working memory was then tested using a single recognition probe. Both spatial and temporal separation of features tended to impair performance, as did the concurrent task. There was, however, no evidence for greater attentional disruption of performance as a result of either spatial or temporal separation of features. Implications for the process of binding in visual working memory are discussed, and an interpretation is offered in terms of the episodic buffer component of working memory, which is assumed to be a passive store capable of holding bound objects, but not of performing the binding.

Executive working memory load does not compromise perceptual processing during visual search: evidence from additive factors analysis

Executive working memory (WM) load reduces the efficiency of visual search, but the mechanisms by which this occurs are not fully known. In the present study, we assessed the effect of executive load on perceptual processing during search. Participants performed a serial oculomotor search task, looking for a circle target among gapped-circle distractors. The participants performed the task under high and low executive WM load, and the visual quality (Experiment 1) or discriminability of targets and distractors (Experiment 2) was manipulated across trials. By the logic of the additive factors method (Sternberg, 1969, 1998), if WM load compromises the quality of perceptual processing during visual search, manipulations of WM load and perceptual processing difficulty should produce nonadditive effects. Contrary to this prediction, the effects of WM load and perceptual difficulty were additive. The results imply that executive WM load does not degrade perceptual analysis during visual search.

Functional compensation of visual field deficits in hemianopic patients under the influence of different task demands

We investigated the task-specific role of eye and head movements as a compensatory strategy in patients with homonymous visual field deficits (HVFDs) and in age-matched normal controls. All participants were tested in two tasks, i.e. a dot counting (DC) task requiring mostly simple visual scanning and a cognitively more demanding comparative visual search (CVS) task. The CVS task involved recognition and memory of geometrical objects and their configuration in two test fields. Based on task performance, patients were assigned to one of two groups, "adequate" (HVFD(A)) and "inadequate" (HVFD(I)); the group definitions based on either task turned out to be identical. With respect to the gaze related parameters in the DC task we obtained results in agreement with previous studies: the gaze pattern of HVFD(A) patients and normal controls did not differ significantly, while HVFD(I) patients showed increased gaze movement activity. In contrast, for the more complex CVS task we identified a deviating pattern of compensatory strategy use. Adequately performing subjects, who had used the same gaze strategies as normals in the DC task, now changed to increased gaze movement activity that allowed coping with the increasing task demands. Inadequately performing patients switched to a novel pattern of compensatory behavior in the CVS task. Different compensatory strategies are discussed with respect to the task-specific demands (in particular working memory involvement), the specific behavioral deficits of the patients, and the corresponding brain lesions.

Overlapping functional anatomy for working memory and visual search

Recent behavioural findings using dual-task paradigms demonstrate the importance of both spatial and non-spatial working memory processes in inefficient visual search (Anderson et al. in Exp Psychol 55:301–312, 2008). Here, using functional magnetic resonance imaging (fMRI), we sought to determine whether brain areas recruited during visual search are also involved in working memory. Using visually matched spatial and non-spatial working memory tasks, we confirmed previous behavioural findings that show significant dual-task interference effects occur when inefficient visual search is performed concurrently with either working memory task. Furthermore, we find considerable overlap in the cortical network activated by inefficient search and both working memory tasks. Our findings suggest that the interference effects observed behaviourally may have arisen from competition for cortical processes subserved by these overlapping regions. Drawing on previous findings (Anderson et al. in Exp Brain Res 180:289–302, 2007), we propose that the most likely anatomical locus for these interference effects is the inferior and middle frontal cortex of the right hemisphere. These areas are associated with attentional selection from memory as well as manipulation of information in memory, and we propose that the visual search and working memory tasks used here compete for common processing resources underlying these mechanisms.

Dual-task interference in visual working memory: a limitation in storage capacity but not in encoding or retrieval

The concurrent maintenance of two visual working memory (VWM) arrays can lead to profound interference. It is unclear, however, whether these costs arise from limitations in VWM storage capacity (Fougnie & Marois, 2006) or from interference between the storage of one visual array and encoding or retrieval of another visual array (Cowan & Morey, 2007). Here, we show that encoding a VWM array does not interfere with maintenance of another VWM array unless the two displays exceed maintenance capacity (Experiments 1 and 2). Moreover, manipulating the extent to which encoding and maintenance can interfere with one another had no discernable effect on dual-task performance (Experiment 2). Finally, maintenance of a VWM array was not affected by retrieval of information from another VWM array (Experiment 3). Taken together, these findings demonstrate that dual-task interference between two concurrent VWM tasks is due to a capacity-limited store that is independent from encoding and retrieval processes.

Spatial working memory maintenance: does attention play a role? A visual search study

Recent studies have proposed that a common mechanism may underlie spatial attention and spatial working memory. One proposal is that spatial working memory is maintained by attention-based rehearsal [Awh, E., Jonides, J., & Reuter-Lorenz, P. A. (1998). Rehearsal in spatial working memory. Journal of Experimental Psychology: Human Perception and Performance, 24(3), 780-790], and so a spatial attention shift during the retention interval of a spatial location should impair its memory performance. In the present study, participants engaged in single-item, parallel or serial search tasks while remembering a spatial location. Although memory tended to bias all searches, the need for an attentional shift during the retention interval impaired memory performance only in single-item search, but not in other searches. These findings suggest that previous evidence for the attention-based rehearsal account does not generalize to visual search. Results are discussed with regard to the relationship between spatial attention and spatial working memory.

A taxonomy of external and internal attention

Attention is a core property of all perceptual and cognitive operations. Given limited capacity to process competing options, attentional mechanisms select, modulate, and sustain focus on information most relevant for behavior. A significant problem, however, is that attention is so ubiquitous that it is unwieldy to study. We propose a taxonomy based on the types of information that attention operates over--the targets of attention. At the broadest level, the taxonomy distinguishes between external attention and internal attention. External attention refers to the selection and modulation of sensory information. External attention selects locations in space, points in time, or modality-specific input. Such perceptual attention can also select features defined across any of these dimensions, or object representations that integrate over space, time, and modality. Internal attention refers to the selection, modulation, and maintenance of internally generated information, such as task rules, responses, long-term memory, or working memory. Working memory, in particular, lies closest to the intersection between external and internal attention. The taxonomy provides an organizing framework that recasts classic debates, raises new issues, and frames understanding of neural mechanisms.

Rule-dependent prefrontal cortex activity across episodic and perceptual decisions: an fMRI investigation of the criterial classification account

Although lateral prefrontal cortex (LPFC) is clearly involved in decision-making, competing functional characterizations exist. One characterization posits that activation reflects the need to select among competing representations. In contrast, recent fMRI research suggests that activation is driven by the criterial classification of representations, even with minimal competition. To adjudicate between these hypotheses, we used event-related fMRI and contrasted tasks that required different numbers of criterial classifications prior to response in both perceptual and memory domains. Additionally, we manipulated the level of interstimulus competition by increasing the number of probes. Experiment 1 demonstrated that LPFC activation tracked the number of intermediate classifications during trials yet was insensitive to the number of competing probes and the behavioral decline accompanying competition. Furthermore, Experiment 2 demonstrated equivalent increases in LPFC activation for a task requiring two overt criterial classifications (independent classification) and one requiring two covert criterial classifications prior to the single overt response (same-different judgment). As found in Experiment 1, both tasks showed greater activation than a judgment requiring only one classification act (forced choice). These data indicate that LPFC responses reflect the number of executed criterial classifications or judgments, independent of the number of competing stimuli and the overt response demands of the decision task.

The contents of perceptual hypotheses: evidence from rapid resumption of interrupted visual search

Observers can resume a previously interrupted visual search trial significantly more quickly than they can start a new search trial (Lleras, Rensink, & Enns, 2005). This rapid resumption of search is possible because evidence accumulated during the previous exposure, a perceptual hypothesis, can carry over to a subsequent presentation. We present four interrupted visual search experiments in which the content of the perceptual hypotheses used during visual search trials was characterized. These experiments suggest that prior to explicit target identification, observers have accumulated evidence about the locations, but not the identities, of local, task-relevant distractors, as well as preliminary evidence for the identity of the target. Our results characterize the content of perceptual search hypotheses and highlight the utility of interrupted search for studying online search processing prior to target identification.

Attentive Tracking Disrupts Feature Binding in Visual Working Memory

One of the most influential theories in visual cognition proposes that attention is necessary to bind different visual features into coherent object percepts (Treisman & Gelade, 1980). While considerable evidence supports a role for attention in perceptual feature binding, whether attention plays a similar function in visual working memory (VWM) remains controversial. To test the attentional requirements of VWM feature binding, here we gave participants an attention-demanding multiple object tracking task during the retention interval of a VWM task. Results show that the tracking task disrupted memory for color-shape conjunctions above and beyond any impairment to working memory for object features, and that this impairment was larger when the VWM stimuli were presented at different spatial locations. These results demonstrate that the role of visuospatial attention in feature binding is not unique to perception, but extends to the working memory of these perceptual representations as well.