1
|
Wagner J, Zurlo A, Rusconi E. Individual differences in visual search: A systematic review of the link between visual search performance and traits or abilities. Cortex 2024; 178:51-90. [PMID: 38970898 DOI: 10.1016/j.cortex.2024.05.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Revised: 05/29/2024] [Accepted: 05/30/2024] [Indexed: 07/08/2024]
Abstract
Visual search (VS) comprises a class of tasks that we typically perform several times during a day and requires intentionally scanning (with or without moving the eyes) the environment for a specific target (be it an object or a feature) among distractor stimuli. Experimental research in lab-based or real-world settings has offered insight into its underlying neurocognitive mechanisms from a nomothetic point of view. A lesser-known but rapidly growing body of quasi-experimental and correlational research has explored the link between individual differences and VS performance. This combines different research traditions and covers a wide range of individual differences in studies deploying a vast array of VS tasks. As such, it is a challenge to determine whether any associations highlighted in single studies are robust when considering the wider literature. However, clarifying such relationships systematically and comprehensively would help build more accurate models of VS, and it would highlight promising directions for future research. This systematic review provides an up to date and comprehensive synthesis of the existing literature investigating associations between common indices of performance in VS tasks and measures of individual differences mapped onto four categories of cognitive abilities (short-term working memory, fluid reasoning, visual processing and processing speed) and seven categories of traits (Big Five traits, trait anxiety and autistic traits). Consistent associations for both traits (in particular, conscientiousness, autistic traits and trait anxiety - the latter limited to emotional stimuli) and cognitive abilities (particularly visual processing) were identified. Overall, however, informativeness of future studies would benefit from checking and reporting the reliability of all measurement tools, applying multiplicity correction, using complementary techniques, study preregistration and testing why, rather than only if, a robust relation between certain individual differences and VS performance exists.
Collapse
Affiliation(s)
- Jennifer Wagner
- Department of Psychology and Cognitive Sciences, University of Trento, Rovereto, Italy
| | - Adriana Zurlo
- Department of Psychology and Cognitive Sciences, University of Trento, Rovereto, Italy
| | - Elena Rusconi
- Department of Psychology and Cognitive Sciences, University of Trento, Rovereto, Italy; Centre of Security and Crime Sciences, University of Trento - University of Verona, Trento, Italy.
| |
Collapse
|
2
|
Contralateral delay activity, but not alpha lateralization, indexes prioritization of information for working memory storage. Atten Percept Psychophys 2023; 85:718-733. [PMID: 36917354 PMCID: PMC10066168 DOI: 10.3758/s13414-023-02681-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/14/2023] [Indexed: 03/16/2023]
Abstract
Working memory is inherently limited, which makes it important to select and maintain only task-relevant information and to protect it from distraction. Previous research has suggested the contralateral delay activity (CDA) and lateralized alpha oscillations as neural candidates for such a prioritization process. While most of this work focused on distraction during encoding, we examined the effect of external distraction presented during memory maintenance. Participants memorized the orientations of three lateralized objects. After an initial distraction-free maintenance interval, distractors appeared in the same location as the targets or in the opposite hemifield. This distraction was followed by another distraction-free interval. Our results show that CDA amplitudes were stronger in the interval before compared with the interval after the distraction (i.e., CDA amplitudes were stronger in response to targets compared with distractors). This amplitude reduction in response to distractors was more pronounced in participants with higher memory accuracy, indicating prioritization and maintenance of relevant over irrelevant information. In contrast, alpha lateralization did not change from the interval before distraction compared with the interval after distraction, and we found no correlation between alpha lateralization and memory accuracy. These results suggest that alpha lateralization plays no direct role in either selective maintenance of task-relevant information or inhibition of distractors. Instead, alpha lateralization reflects the current allocation of spatial attention to the most salient information regardless of task-relevance. In contrast, CDA indicates flexible allocation of working memory resources depending on task-relevance.
Collapse
|
3
|
Internal attention is the only retroactive mechanism for controlling precision in working memory. Atten Percept Psychophys 2022:10.3758/s13414-022-02628-7. [PMID: 36536206 PMCID: PMC10371937 DOI: 10.3758/s13414-022-02628-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/20/2022] [Indexed: 12/23/2022]
Abstract
AbstractRecent research has suggested that humans can assert control over the precision of working memory (WM) items. However, the mechanisms that enable this control are unclear. While some studies suggest that internal attention improves precision, it may not be the only factor, as previous work also demonstrated that WM storage is disentangled from attention. To test whether there is a precision control mechanism beyond internal attention, we contrasted internal attention and precision requirements within the same trial in three experiments. In every trial, participants memorized two items briefly. Before the test, a retro-cue indicated which item would be tested first, thus should be attended. Importantly, we encouraged participants to store the unattended item with higher precision by testing it using more similar lure colors at the probe display. Accuracy was analyzed on a small proportion of trials where the target-lure similarity, hence the task difficulty, was equal for attended and unattended items. Experiments 2 and 3 controlled for output interference by the first test and involuntary precision boost by the retro-cue, respectively. In all experiments, the unattended item had lower accuracy than the attended item, suggesting that individuals were not able to remember it more precisely than the attended item. Thus, we conclude that there is no precision control mechanism beyond internal attention, highlighting the close relationship between attentional and qualitative prioritization within WM. We discuss the important implications of these findings for our understanding of the fundamentals of WM and WM-driven behaviors.
Collapse
|
4
|
Adamo SH, Gereke BJ, Shomstein S, Schmidt J. From "satisfaction of search" to "subsequent search misses": a review of multiple-target search errors across radiology and cognitive science. Cogn Res Princ Implic 2021; 6:59. [PMID: 34455466 PMCID: PMC8403090 DOI: 10.1186/s41235-021-00318-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 07/15/2021] [Indexed: 11/10/2022] Open
Abstract
For over 50 years, the satisfaction of search effect has been studied within the field of radiology. Defined as a decrease in detection rates for a subsequent target when an initial target is found within the image, these multiple target errors are known to underlie errors of omission (e.g., a radiologist is more likely to miss an abnormality if another abnormality is identified). More recently, they have also been found to underlie lab-based search errors in cognitive science experiments (e.g., an observer is more likely to miss a target 'T' if a different target 'T' was detected). This phenomenon was renamed the subsequent search miss (SSM) effect in cognitive science. Here we review the SSM literature in both radiology and cognitive science and discuss: (1) the current SSM theories (i.e., satisfaction, perceptual set, and resource depletion theories), (2) the eye movement errors that underlie the SSM effect, (3) the existing efforts tested to alleviate SSM errors, and (4) the evolution of methodologies and analyses used when calculating the SSM effect. Finally, we present the attentional template theory, a novel mechanistic explanation for SSM errors, which ties together our current understanding of SSM errors and the attentional template literature.
Collapse
Affiliation(s)
- Stephen H Adamo
- Department of Cognitive Psychology, University of Central Florida, Orlando, USA.
| | - Brian J Gereke
- Department of Neuroscience, University of Texas at Austin, Austin, USA
| | - Sarah Shomstein
- Department of Cognitive Neuroscience, The George Washington University, Washington, USA
| | - Joseph Schmidt
- Department of Cognitive Psychology, University of Central Florida, Orlando, USA
| |
Collapse
|
5
|
Foraging behavior in visual search: A review of theoretical and mathematical models in humans and animals. PSYCHOLOGICAL RESEARCH 2021; 86:331-349. [PMID: 33745028 DOI: 10.1007/s00426-021-01499-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2020] [Accepted: 03/02/2021] [Indexed: 10/21/2022]
Abstract
Visual search (VS) is a fundamental task in daily life widely studied for over half a century. A variant of the classic paradigm-searching one target among distractors-requires the observer to look for several (undetermined) instances of a target (so-called foraging) or several targets that may appear an undefined number of times (recently named as hybrid foraging). In these searches, besides looking for targets, the observer must decide how much time is needed to exploit the area, and when to quit the search to eventually explore new search options. In fact, visual foraging is a very common search task in the real world, probably involving additional cognitive functions than typical VS. It has been widely studied in natural animal environments, for which several mathematical models have been proposed, and just recently applied to humans: Lévy processes, composite and area-restricted search models, marginal value theorem, and Bayesian learning (among others). We conducted a systematic search in the literature to understand those mathematical models and study its applicability in human visual foraging. The review suggests that these models might be the first step, but they seem to be limited to fully comprehend foraging in visual search. There are essential variables involving human visual foraging still to be established and understood. Indeed, a jointly theoretical interpretation based on the different models reviewed could better account for its understanding. In addition, some other relevant variables, such as certain individual differences or time perception might be crucial to understanding visual foraging in humans.
Collapse
|
6
|
Yokoyama T, Kato R, Inoue K, Takeda Y. Cuing Effects by Biologically and Behaviorally Relevant Symbolic Cues. JAPANESE PSYCHOLOGICAL RESEARCH 2020. [DOI: 10.1111/jpr.12318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
| | | | | | - Yuji Takeda
- National Institute of Advanced Industrial Science and Technology
| |
Collapse
|
7
|
Oculomotor capture by search-irrelevant features in visual working memory: on the crucial role of target-distractor similarity. Atten Percept Psychophys 2020; 82:2379-2392. [PMID: 32166644 PMCID: PMC7343749 DOI: 10.3758/s13414-020-02007-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
When searching for varying targets in the environment, a target template has to be maintained in visual working memory (VWM). Recently, we showed that search-irrelevant features of a VWM template bias attention in an object-based manner, so that objects sharing such features with a VWM template capture the eyes involuntarily. Here, we investigated whether target-distractor similarity modulates capture strength. Participants saccaded to a target accompanied by a distractor. A single feature (e.g., shape) defined the target in each trial indicated by a cue, and the cue also varied in one irrelevant feature (e.g., color). The distractor matched the cue's irrelevant feature in half of the trials. Nine experiments showed that target-distractor similarity consistently influenced the degree of oculomotor capture. High target-distractor dissimilarity in the search-relevant feature reduced capture by the irrelevant feature (Experiments 1, 3, 6, 7). However, capture was reduced by high target-distractor similarity in the search-irrelevant feature (Experiments 1, 4, 5, 8). Strong oculomotor capture was observed if target-distractor similarity was reasonably low in the relevant and high in the irrelevant feature, irrespective of whether color or shape were relevant (Experiments 2 and 5). These findings argue for involuntary and object-based, top-down control by VWM templates, whereas its manifestation in oculomotor capture depends crucially on target-distractor similarity in relevant and irrelevant feature dimensions of the search object.
Collapse
|
8
|
Bocincova A, Olivers CNL, Stokes MG, Manohar SG. A common neural network architecture for visual search and working memory. VISUAL COGNITION 2020. [DOI: 10.1080/13506285.2020.1825142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Andrea Bocincova
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Christian N. L. Olivers
- Department of Experimental and Applied Psychology, Institute for Brain and Behaviour Amsterdam, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Mark G. Stokes
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Sanjay G. Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| |
Collapse
|
9
|
Hakim N, Feldmann-Wüstefeld T, Awh E, Vogel EK. Perturbing Neural Representations of Working Memory with Task-irrelevant Interruption. J Cogn Neurosci 2019; 32:558-569. [PMID: 31617823 DOI: 10.1162/jocn_a_01481] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Working memory maintains information so that it can be used in complex cognitive tasks. A key challenge for this system is to maintain relevant information in the face of task-irrelevant perturbations. Across two experiments, we investigated the impact of task-irrelevant interruptions on neural representations of working memory. We recorded EEG activity in humans while they performed a working memory task. On a subset of trials, we interrupted participants with salient but task-irrelevant objects. To track the impact of these task-irrelevant interruptions on neural representations of working memory, we measured two well-characterized, temporally sensitive EEG markers that reflect active, prioritized working memory representations: the contralateral delay activity and lateralized alpha power (8-12 Hz). After interruption, we found that contralateral delay activity amplitude momentarily sustained but was gone by the end of the trial. Lateralized alpha power was immediately influenced by the interrupters but recovered by the end of the trial. This suggests that dissociable neural processes contribute to the maintenance of working memory information and that brief irrelevant onsets disrupt two distinct online aspects of working memory. In addition, we found that task expectancy modulated the timing and magnitude of how these two neural signals responded to task-irrelevant interruptions, suggesting that the brain's response to task-irrelevant interruption is shaped by task context.
Collapse
|
10
|
Oberauer K. Working Memory and Attention - A Conceptual Analysis and Review. J Cogn 2019; 2:36. [PMID: 31517246 PMCID: PMC6688548 DOI: 10.5334/joc.58] [Citation(s) in RCA: 149] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2018] [Accepted: 02/14/2019] [Indexed: 12/23/2022] Open
Abstract
There is broad agreement that working memory is closely related to attention. This article delineates several theoretical options for conceptualizing this link, and evaluates their viability in light of their theoretical implications and the empirical support they received. A first divide exists between the concept of attention as a limited resource, and the concept of attention as selective information processing. Theories conceptualizing attention as a resource assume that this resource is responsible for the limited capacity of working memory. Three versions of this idea have been proposed: Attention as a resource for storage and processing, a shared resource for perceptual attention and memory maintenance, and a resource for the control of attention. The first of these three is empirically well supported, but the other two are not. By contrast, when attention is understood as a selection mechanism, it is usually not invoked to explain the capacity limit of working memory - rather, researchers ask how different forms of attention interact with working memory, in two areas. The first pertains to attentional selection of the contents of working memory, controlled by mechanisms of filtering out irrelevant stimuli, and removing no-longer relevant representations from working memory. Within working memory contents, a single item is often selected into the focus of attention for processing. The second area pertains to the role of working memory in cognitive control. Working memory contributes to controlling perceptual attention - by holding templates for targets of perceptual selection - and controlling action - by holding task sets to implement our current goals.
Collapse
|
11
|
Towards identifying and preventing behavioral side channel attack on recording attack resilient unaided authentication services. Comput Secur 2019. [DOI: 10.1016/j.cose.2019.03.019] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
12
|
Yokoyama T, Kato R, Inoue K, Takeda Y. Joint attention is intact even when visuospatial working memory is occupied. Vision Res 2018; 154:54-59. [PMID: 30414850 DOI: 10.1016/j.visres.2018.10.011] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2018] [Revised: 10/04/2018] [Accepted: 10/23/2018] [Indexed: 11/16/2022]
Abstract
The gaze of another modulates and shifts an observer's spatial attention toward this gaze direction. This phenomenon is termed joint attention. Although previous studies found joint attention was induced during a spatial working memory task, it remains an open question whether spatial working memory interferes with joint attention. To address this question, we conducted a dual task paradigm consisting of gaze cuing and spatial working memory tasks. The gaze cuing task requires that participants respond to the location of an abrupt onset of a target while ignoring the gaze of a facial image located at the center of the display. In the spatial working memory task, participants memorized two or three locations of small dots and judged whether these locations changed in the probe screen. In the dual task condition, while participants were maintaining spatial information of the spatial working memory task, they performed the gaze cuing task. In Experiment 1, maintaining spatial information did not impair the magnitude of joint attention. In Experiment 2, we increased load of spatial working memory task, and still observed results similar to Experiment 1. In Experiment 3, we replicated the findings in Experiment 1 when an identification task was conducted. In addition, we measured electrooculographic signals to investigate eye movements of participants during the task. The study provides that joint attention is intact even if spatial working memory is occupied.
Collapse
Affiliation(s)
- Takemasa Yokoyama
- Automotive Human Factors Research Center, National Institute of Advanced Industrial Science and Technology, Tsukuba, Japan.
| | - Ryosuke Kato
- Automotive Human Factors Research Center, National Institute of Advanced Industrial Science and Technology, Tsukuba, Japan; Graduate School of Comprehensive Human Science, University of Tsukuba, Tsukuba, Japan
| | - Kazuya Inoue
- Faculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, Japan
| | - Yuji Takeda
- Automotive Human Factors Research Center, National Institute of Advanced Industrial Science and Technology, Tsukuba, Japan; Graduate School of Comprehensive Human Science, University of Tsukuba, Tsukuba, Japan
| |
Collapse
|
13
|
Zhang B, Liu S, Doro M, Galfano G. Attentional Guidance from Multiple Working Memory Representations: Evidence from Eye Movements. Sci Rep 2018; 8:13876. [PMID: 30224710 PMCID: PMC6141570 DOI: 10.1038/s41598-018-32144-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Accepted: 08/31/2018] [Indexed: 11/10/2022] Open
Abstract
Recent studies have shown that the representation of an item in visual working memory (VWM) can bias the deployment of attention to stimuli in the visual scene possessing the same features. When multiple item representations are simultaneously held in VWM, whether these representations, especially those held in a non-prioritized or accessory status, are able to bias attention, is still controversial. In the present study we adopted an eye tracking technique to shed light on this issue. In particular, we implemented a manipulation aimed at prioritizing one of the VWM representation to an active status, and tested whether attention could be guided by both the prioritized and the accessory representations when they reappeared as distractors in a visual search task. Notably, in Experiment 1, an analysis of first fixation proportion (FFP) revealed that both the prioritized and the accessory representations were able to capture attention suggesting a significant attentional guidance effect. However, such effect was not present in manual response times (RT). Most critically, in Experiment 2, we used a more robust experimental design controlling for different factors that might have played a role in shaping these findings. The results showed evidence for attentional guidance from the accessory representation in both manual RTs and FFPs. Interestingly, FFPs showed a stronger attentional bias for the prioritized representation than for the accessory representation across experiments. The overall findings suggest that multiple VWM representations, even the accessory representation, can simultaneously interact with visual attention.
Collapse
Affiliation(s)
- Bao Zhang
- Department of Psychology and the Center for Mind and Brain, Guangzhou University, Guangzhou, China.
| | - Shuhui Liu
- Department of Psychology and the Center for Mind and Brain, Guangzhou University, Guangzhou, China
| | - Mattia Doro
- Department of Developmental and Social Psychology, University of Padova, Padova, Italy
| | - Giovanni Galfano
- Department of Developmental and Social Psychology, University of Padova, Padova, Italy.
| |
Collapse
|
14
|
Mallett R, Lewis-Peacock JA. Behavioral decoding of working memory items inside and outside the focus of attention. Ann N Y Acad Sci 2018; 1424:256-267. [PMID: 29604084 DOI: 10.1111/nyas.13647] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Revised: 01/25/2018] [Accepted: 01/30/2018] [Indexed: 11/29/2022]
Abstract
How we attend to our thoughts affects how we attend to our environment. Holding information in working memory can automatically bias visual attention toward matching information. By observing attentional biases on reaction times to visual search during a memory delay, it is possible to reconstruct the source of that bias using machine learning techniques and thereby behaviorally decode the content of working memory. Can this be done when more than one item is held in working memory? There is some evidence that multiple items can simultaneously bias attention, but the effects have been inconsistent. One explanation may be that items are stored in different states depending on the current task demands. Recent models propose functionally distinct states of representation for items inside versus outside the focus of attention. Here, we use behavioral decoding to evaluate whether multiple memory items-including temporarily irrelevant items outside the focus of attention-exert biases on visual attention. Only the single item in the focus of attention was decodable. The other item showed a brief attentional bias that dissipated until it returned to the focus of attention. These results support the idea of dynamic, flexible states of working memory across time and priority.
Collapse
Affiliation(s)
- Remington Mallett
- Department of Psychology, University of Texas at Austin, Austin, Texas
| | | |
Collapse
|
15
|
Memory guidance in distractor suppression is governed by the availability of cognitive control. Atten Percept Psychophys 2018; 80:1157-1168. [PMID: 29582389 DOI: 10.3758/s13414-018-1511-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Information stored in the memory systems can affect visual search. Previous studies have shown that holding the to-be-ignored features of distractors in working memory (WM) could accelerate target selection. However, such facilitation effect was only observed when the cued to-be-ignored features remained unchanged within an experimental block (i.e., the fixed cue condition). No search benefit was obtained if the to-be-ignored features varied from trial to trial (i.e., the varied cue condition). In the present study, we conducted three behavioral experiments to investigate whether the WM and long-term memory (LTM) representations of the to-be-ignored features could facilitate visual search in the fixed cue (Experiment 1) and varied cue (Experiments 2 and 3) conditions. Given the importance of the processing time of cognitive control in distractor suppression, we divided visual search trials into five quintiles based on their reaction times (RTs) and examined the temporal characteristics of the suppression effect. Results showed that both the WM and LTM representations of the to-be-ignored features could facilitate distractor suppression in the fixed cue condition, and the facilitation effects were evident across the quintiles in the RT distribution. However, in the varied cue condition, the RT benefits of the WM-matched distractors occurred only in the trials with the longest RTs, whereas no advantage of the LTM-matched distractors was observed. These results suggest that the effective WM-guided distractor suppression depends on the availability of cognitive control and the LTM-guided suppression occurs only if sufficient WM resource is accessible by LTM reactivation.
Collapse
|
16
|
Chen D, Hutchinson JB. What Is Memory-Guided Attention? How Past Experiences Shape Selective Visuospatial Attention in the Present. Curr Top Behav Neurosci 2018; 41:185-212. [PMID: 30584646 DOI: 10.1007/7854_2018_76] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
What controls our attention? It is historically thought that there are two primary factors that determine selective attention: the perceptual salience of the stimuli and the goals based on the task at hand. However, this distinction doesn't neatly capture the varied ways our past experience can influence our ongoing mental processing. In this chapter, we aim to describe how past experience can be systematically characterized by different types of memory, and we outline experimental evidence suggesting how attention can then be guided by each of these different memory types. We highlight findings from human behavioral, neuroimaging, and neuropsychological work from the perspective of two related frameworks of human memory: the multiple memory systems (MMS) framework and the neural processing (NP) framework. The MMS framework underscores how memory can be separated based on consciousness (declarative and non-declarative memory), while the NP framework emphasizes different forms of memory as reflective of different brain processing modes (rapid encoding of flexible associations, slow encoding of rigid associations, and rapid encoding of single or unitized items). We describe how memory defined by these frameworks can guide our attention, even when they do not directly relate to perceptual salience or the goals concerning the current task. We close by briefly discussing theoretical implications as well as some interesting avenues for future research.
Collapse
|
17
|
Foerster RM, Schneider WX. Involuntary top-down control by search-irrelevant features: Visual working memory biases attention in an object-based manner. Cognition 2017; 172:37-45. [PMID: 29223864 DOI: 10.1016/j.cognition.2017.12.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Revised: 11/08/2017] [Accepted: 12/02/2017] [Indexed: 11/18/2022]
Abstract
Many everyday tasks involve successive visual-search episodes with changing targets. Converging evidence suggests that these targets are retained in visual working memory (VWM) and bias attention from there. It is unknown whether all or only search-relevant features of a VWM template bias attention during search. Bias signals might be configured exclusively to task-relevant features so that only search-relevant features bias attention. Alternatively, VWM might maintain objects in the form of bound features. Then, all template features will bias attention in an object-based manner, so that biasing effects are ranked by feature relevance. Here, we investigated whether search-irrelevant VWM template features bias attention. Participants had to saccade to a target opposite a distractor. A colored cue depicted the target prior to each search trial. The target was predefined only by its identity, while its color was irrelevant. When target and cue matched not only in identity (search-relevant) but also in color (search-irrelevant), saccades went more often and faster directly to the target than without any color match (Experiment 1). When introducing a cue-distractor color match (Experiment 2), direct target saccades were most likely when target and cue matched in the search-irrelevant color and least likely in case of a cue-distractor color match. When cue and target were never colored the same (Experiment 3), cue-colored distractors still captured the eyes more often than different-colored distractors despite color being search-irrelevant. As participants were informed about the misleading color, the result argues against a strategical and voluntary usage of color. Instead, search-irrelevant features biased attention obligatorily arguing for involuntary top-down control by object-based VWM templates.
Collapse
Affiliation(s)
- Rebecca M Foerster
- Neuro-Cognitive Psychology, Bielefeld University, Germany; 'Cognitive Interaction Technology' Cluster of Excellence CITEC, Bielefeld University, Germany.
| | - Werner X Schneider
- Neuro-Cognitive Psychology, Bielefeld University, Germany; 'Cognitive Interaction Technology' Cluster of Excellence CITEC, Bielefeld University, Germany
| |
Collapse
|
18
|
A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots. SENSORS 2017; 17:s17020353. [PMID: 28208671 PMCID: PMC5335998 DOI: 10.3390/s17020353] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2016] [Revised: 01/30/2017] [Accepted: 02/08/2017] [Indexed: 11/17/2022]
Abstract
Object detection and classification have countless applications in human-robot interacting systems. It is a necessary skill for autonomous robots that perform tasks in household scenarios. Despite the great advances in deep learning and computer vision, social robots performing non-trivial tasks usually spend most of their time finding and modeling objects. Working in real scenarios means dealing with constant environment changes and relatively low-quality sensor data due to the distance at which objects are often found. Ambient intelligence systems equipped with different sensors can also benefit from the ability to find objects, enabling them to inform humans about their location. For these applications to succeed, systems need to detect the objects that may potentially contain other objects, working with relatively low-resolution sensor data. A passive learning architecture for sensors has been designed in order to take advantage of multimodal information, obtained using an RGB-D camera and trained semantic language models. The main contribution of the architecture lies in the improvement of the performance of the sensor under conditions of low resolution and high light variations using a combination of image labeling and word semantics. The tests performed on each of the stages of the architecture compare this solution with current research labeling techniques for the application of an autonomous social robot working in an apartment. The results obtained demonstrate that the proposed sensor architecture outperforms state-of-the-art approaches.
Collapse
|
19
|
Kim S, Cho YS. Memory-based attentional capture by colour and shape contents in visual working memory. VISUAL COGNITION 2016. [DOI: 10.1080/13506285.2016.1184734] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
20
|
Abstract
Objects in visual working memory (VWM) that are only prospectively relevant can nevertheless affect the guidance of attention in an ongoing visual search task. Here we investigated whether learning changes the attentional status of such prospective memories. Observers performed a visual search while holding an item in memory for a later memory test. This prospective memory was then repeated for several trials. When the memory was new, it interfered with the ongoing search task. However, with repetition, memory performance increased but memory-based interference rapidly diminished, suggesting that observers learned to shield the prospective memory from the ongoing task. This contrasts with earlier findings showing stronger attentional biases from learned memories when these are immediately task-relevant. Interestingly, interference resurfaced again in anticipation of a new memory, suggesting a reactivation of VWM. These effects were sensitive to task context, indicating that the attentional status of prospective memories is flexible.
Collapse
|
21
|
Enhancing long-term memory with stimulation tunes visual attention in one trial. Proc Natl Acad Sci U S A 2014; 112:625-30. [PMID: 25548192 DOI: 10.1073/pnas.1417259112] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Scientists have long proposed that memory representations control the mechanisms of attention that focus processing on the task-relevant objects in our visual field. Modern theories specifically propose that we rely on working memory to store the object representations that provide top-down control over attentional selection. Here, we show that the tuning of perceptual attention can be sharply accelerated after 20 min of noninvasive brain stimulation over medial-frontal cortex. Contrary to prevailing theories of attention, these improvements did not appear to be caused by changes in the nature of the working memory representations of the search targets. Instead, improvements in attentional tuning were accompanied by changes in an electrophysiological signal hypothesized to index long-term memory. We found that this pattern of effects was reliably observed when we stimulated medial-frontal cortex, but when we stimulated posterior parietal cortex, we found that stimulation directly affected the perceptual processing of the search array elements, not the memory representations providing top-down control. Our findings appear to challenge dominant theories of attention by demonstrating that changes in the storage of target representations in long-term memory may underlie rapid changes in the efficiency with which humans can find targets in arrays of objects.
Collapse
|
22
|
van Kampen HS. Violated expectancies: Cause and function of exploration, fear, and aggression. Behav Processes 2014; 117:12-28. [PMID: 24878517 DOI: 10.1016/j.beproc.2014.05.005] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2014] [Revised: 05/16/2014] [Accepted: 05/19/2014] [Indexed: 12/27/2022]
Abstract
To be able to reproduce, animals need to survive and interact with an ever changing environment. Therefore, they create a cognitive representation of that environment, from which they derive expectancies regarding current and future events. These expected events are compared continuously with information gathered through exploration, to guide behaviour and update the existing representation. When a moderate discrepancy between perceived and expected events is detected, exploration is employed to update the internal representation so as to alter the expectancy and make it match the perceived event. When the discrepancy is relatively large, exploration is inhibited, and animals will try to alter the perceived event utilizing aggression or fear. The largest discrepancies are associated with a tendency to flee. When an exploratory, fear, or aggressive behaviour pattern proofs to be the optimal solution for a particular discrepancy, the response will become conditioned to events that previously preceded the occurrence of that discrepancy. When primary needs are relatively low, animals will actively look for or create moderately violated expectancies in order to learn about objects, behaviour patterns, and the environment. In those situations, exploratory tendencies will summate with ongoing behaviour and, when all primary needs are satiated, may even be performed exclusively. This results in behavioural variability, play, and active information-seeking. This article is part of a Special Issue entitled: In Honor of Jerry Hogan.
Collapse
Affiliation(s)
- Hendrik S van Kampen
- Cognitive Neurobiology and Helmholtz Institute, Departments of Psychology and Biology, Utrecht University, Padualaan 8, 3584 CH Utrecht, The Netherlands.
| |
Collapse
|
23
|
Buttaccio DR, Lange ND, Hahn S, Thomas RP. Explicit awareness supports conditional visual search in the retrieval guidance paradigm. Acta Psychol (Amst) 2014; 145:44-53. [PMID: 24291120 DOI: 10.1016/j.actpsy.2013.10.014] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2013] [Revised: 08/20/2013] [Accepted: 10/30/2013] [Indexed: 10/26/2022] Open
Abstract
In four experiments we explored whether participants would be able to use probabilistic prompts to simplify perceptually demanding visual search in a task we call the retrieval guidance paradigm. On each trial a memory prompt appeared prior to (and during) the search task and the diagnosticity of the prompt(s) was manipulated to provide complete, partial, or non-diagnostic information regarding the target's color on each trial (Experiments 1-3). In Experiment 1 we found that the more diagnostic prompts was associated with faster visual search performance. However, similar visual search behavior was observed in Experiment 2 when the diagnosticity of the prompts was eliminated, suggesting that participants in Experiment 1 were merely relying on base rate information to guide search and were not utilizing the prompts. In Experiment 3 participants were informed of the relationship between the prompts and the color of the target and this was associated with faster search performance relative to Experiment 1, suggesting that the participants were using the prompts to guide search. Additionally, in Experiment 3 a knowledge test was implemented and performance in this task was associated with qualitative differences in search behavior such that participants that were able to name the color(s) most associated with the prompts were faster to find the target than participants who were unable to do so. However, in Experiments 1-3 diagnosticity of the memory prompt was manipulated via base rate information, making it possible that participants were merely relying on base rate information to inform search in Experiment 3. In Experiment 4 we manipulated diagnosticity of the prompts without manipulating base rate information and found a similar pattern of results as Experiment 3. Together, the results emphasize the importance of base rate and diagnosticity information in visual search behavior. In the General discussion section we explore how a recent computational model of hypothesis generation (HyGene; Thomas, Dougherty, Sprenger, & Harbison, 2008), linking attention with long-term and working memory, accounts for the present results and provides a useful framework of cued recall visual search.
Collapse
|
24
|
Schneider WX. Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory. Philos Trans R Soc Lond B Biol Sci 2013; 368:20130060. [PMID: 24018722 PMCID: PMC3758203 DOI: 10.1098/rstb.2013.0060] [Citation(s) in RCA: 59] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
The goal of this review is to introduce a theory of task-driven visual attention and working memory (TRAM). Based on a specific biased competition model, the ‘theory of visual attention’ (TVA) and its neural interpretation (NTVA), TRAM introduces the following assumption. First, selective visual processing over time is structured in competition episodes. Within an episode, that is, during its first two phases, a limited number of proto-objects are competitively encoded—modulated by the current task—in activation-based visual working memory (VWM). In processing phase 3, relevant VWM objects are transferred via a short-term consolidation into passive VWM. Second, each time attentional priorities change (e.g. after an eye movement), a new competition episode is initiated. Third, if a phase 3 VWM process (e.g. short-term consolidation) is not finished, whereas a new episode is called, a protective maintenance process allows its completion. After a VWM object change, its protective maintenance process is followed by an encapsulation of the VWM object causing attentional resource costs in trailing competition episodes. Viewed from this perspective, a new explanation of key findings of the attentional blink will be offered. Finally, a new suggestion will be made as to how VWM items might interact with visual search processes.
Collapse
Affiliation(s)
- Werner X Schneider
- Department of Psychology, Neuro-Cognitive Psychology, Bielefeld University, , PO Box 10 01 31, 33501 Bielefeld, Germany
| |
Collapse
|
25
|
Dziemianko M, Keller F. Memory modulated saliency: A computational model of the incremental learning of target locations in visual search. VISUAL COGNITION 2013. [DOI: 10.1080/13506285.2013.784717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
26
|
How do we use the past to predict the future in oculomotor search? Vision Res 2012; 74:93-101. [DOI: 10.1016/j.visres.2012.08.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2012] [Revised: 05/26/2012] [Accepted: 08/01/2012] [Indexed: 11/18/2022]
|
27
|
Manginelli AA, Geringswald F, Pollmann S. Visual search facilitation in repeated displays depends on visuospatial working memory. Exp Psychol 2012; 59:47-54. [PMID: 21768068 DOI: 10.1027/1618-3169/a000125] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
When distractor configurations are repeated over time, visual search becomes more efficient, even if participants are unaware of the repetition. This contextual cueing is a form of incidental, implicit learning. One might therefore expect that contextual cueing does not (or only minimally) rely on working memory resources. This, however, is debated in the literature. We investigated contextual cueing under either a visuospatial or a nonspatial (color) visual working memory load. We found that contextual cueing was disrupted by the concurrent visuospatial, but not by the color working memory load. A control experiment ruled out that unspecific attentional factors of the dual-task situation disrupted contextual cueing. Visuospatial working memory may be needed to match current display items with long-term memory traces of previously learned displays.
Collapse
|
28
|
Attention problems, phonological short-term memory, and visuospatial short-term memory: Differential effects on near- and long-term scholastic achievement. LEARNING AND INDIVIDUAL DIFFERENCES 2012. [DOI: 10.1016/j.lindif.2011.09.010] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
29
|
Kim J, Kim MS, Chun MM. Predictive spatial working memory content guides visual search. VISUAL COGNITION 2010. [DOI: 10.1080/13506280902928860] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
30
|
Greater frontal-parietal synchrony at low gamma-band frequencies for inefficient than efficient visual search in human EEG. Int J Psychophysiol 2009; 73:350-4. [PMID: 19481120 DOI: 10.1016/j.ijpsycho.2009.05.011] [Citation(s) in RCA: 53] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2009] [Revised: 04/30/2009] [Accepted: 05/19/2009] [Indexed: 11/22/2022]
Abstract
In a study on monkeys, [Buschman, T.J., Miller, E.K., 2007. Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315 (5820), 1860-1862.] reported more frontal-parietal neuronal synchrony in a low gamma-band (22-34 Hz) for inefficient than efficient visual search, but a reverse effect in a higher gamma-band (36-56 Hz). We examine whether this difference in top-down versus bottom-up influence on visual search also occurs in humans using scalp EEG. Ten participants identified the location of a target item (coloured, oriented rectangular bar) in search displays also containing similar distractors. For the efficient search condition, in which response time was less dependent on set size (two or four items), distractors had no feature in common with the target. For the inefficient search condition, in which response time increased with set size, distractors shared one feature with the target. Analysis of phase-locking values revealed significantly greater synchronization between frontal-parietal electrode pairs in the lower frequency band around 160-480 ms post-stimulus for inefficient search. No significant difference was observed in the higher frequency band. These results partly correspond to [Buschman, T.J., Miller, E.K., 2007. Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315 (5820), 1860-1862.], suggesting that top-down control is mediated by neuronal synchrony at lower frequencies. The failure to observe a bottom-up effect may be due to stimulus familiarity - monkeys require weeks of training in contrast to the few minutes given to humans.
Collapse
|
31
|
The contents of perceptual hypotheses: evidence from rapid resumption of interrupted visual search. Atten Percept Psychophys 2009; 71:681-9. [PMID: 19429951 DOI: 10.3758/app.71.4.681] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Observers can resume a previously interrupted visual search trial significantly more quickly than they can start a new search trial (Lleras, Rensink, & Enns, 2005). This rapid resumption of search is possible because evidence accumulated during the previous exposure, a perceptual hypothesis, can carry over to a subsequent presentation. We present four interrupted visual search experiments in which the content of the perceptual hypotheses used during visual search trials was characterized. These experiments suggest that prior to explicit target identification, observers have accumulated evidence about the locations, but not the identities, of local, task-relevant distractors, as well as preliminary evidence for the identity of the target. Our results characterize the content of perceptual search hypotheses and highlight the utility of interrupted search for studying online search processing prior to target identification.
Collapse
|
32
|
Rodríguez Holguín S, Doallo S, Vizoso C, Cadaveira F. N2pc and attentional capture by colour and orientation-singletons in pure and mixed visual search tasks. Int J Psychophysiol 2009; 73:279-86. [PMID: 19409424 DOI: 10.1016/j.ijpsycho.2009.04.006] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2008] [Revised: 04/17/2009] [Accepted: 04/22/2009] [Indexed: 11/24/2022]
Abstract
The capture of attention by singleton stimuli in visual search is a matter of contention. Some authors propose that singletons capture attention in a bottom-up fashion if they are salient. Others propose that capture is contingent upon whether or not the stimuli share task-relevant attributes with the target. This study assessed N2pc elicited by colour and orientation singletons in a mixed task (the singleton defined as target changed block-to-block), and a pure task (the target was the same across the whole task). Both singletons elicited N2pc when acting as targets; when acting as non-targets, orientation singletons elicited N2pc only in the mixed task. The results suggest that the singletons were not salient enough to engage attention in a purely bottom-up fashion. Elicitation of N2pc by non-targets in the mixed task should be attributed to top-down processes associated with the current task. Stimuli that act as targets in part of the blocks become not completely irrelevant when non-targets.
Collapse
Affiliation(s)
- Socorro Rodríguez Holguín
- Department of Clinical Psychology and Psychobiology, University of Santiago de Compostela, Campus Universitario Sur s/n, Santiago de Compostela, E-15782 Galicia, Spain.
| | | | | | | |
Collapse
|
33
|
Hollingworth A. Visual memory for natural scenes: Evidence from change detection and visual search. VISUAL COGNITION 2006. [DOI: 10.1080/13506280500193818] [Citation(s) in RCA: 40] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|