1
|
Makarov I, Unnthorsson R, Kristjánsson Á, Thornton IM. The effects of visual and auditory synchrony on human foraging. Atten Percept Psychophys 2024; 86:909-930. [PMID: 38253985 DOI: 10.3758/s13414-023-02840-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/21/2023] [Indexed: 01/24/2024]
Abstract
Can synchrony in stimulation guide attention and aid perceptual performance? Here, in a series of three experiments, we tested the influence of visual and auditory synchrony on attentional selection during a novel human foraging task. Human foraging tasks are a recent extension of the classic visual search paradigm in which multiple targets must be located on a given trial, making it possible to capture a wide range of performance metrics. Experiment 1 was performed online, where the task was to forage for 10 (out of 20) vertical lines among 60 randomly oriented distractor lines that changed color between yellow and blue at random intervals. The targets either changed colors in visual synchrony or not. In another condition, a non-spatial sound additionally occurred synchronously with the color change of the targets. Experiment 2 was run in the laboratory (within-subjects) with the same design. When the targets changed color in visual synchrony, foraging times were significantly shorter than when they randomly changed colors, but there was no additional benefit for the sound synchrony, in contrast to predictions from the so-called "pip-and-pop" effect (Van der Burg et al., Journal of Experimental Psychology, 1053-1065, 2008). In Experiment 3, task difficulty was increased as participants foraged for as many 45° rotated lines as possible among lines of different orientations within 10 s, with the same synchrony conditions as in Experiments 1 and 2. Again, there was a large benefit of visual synchrony but no additional benefit for sound synchronization. Our results provide strong evidence that visual synchronization can guide attention during multiple target foraging. This likely reflects the local grouping of the synchronized targets. Importantly, there was no additional benefit for sound synchrony, even when the foraging task was quite difficult (Experiment 3).
Collapse
Affiliation(s)
- Ivan Makarov
- Faculty of Psychology, School of Health Sciences, University of Iceland, Reykjavik, Iceland.
- Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, University of Iceland, Reykjavik, Iceland.
| | - Runar Unnthorsson
- Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, University of Iceland, Reykjavik, Iceland
| | - Árni Kristjánsson
- Faculty of Psychology, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Ian M Thornton
- Department of Cognitive Science Faculty of Media & Knowledge Science, University of Malta, Msida, Malta
| |
Collapse
|
2
|
Bella-Fernández M, Suero Suñé M, Gil-Gómez de Liaño B. The time course of visual foraging in the lifespan: Spatial scanning, organization search, and target processing. Psychon Bull Rev 2024; 31:325-339. [PMID: 37620634 PMCID: PMC10867067 DOI: 10.3758/s13423-023-02345-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/19/2023] [Indexed: 08/26/2023]
Abstract
Visual foraging is a variant of visual search, consisting of searching for an undetermined number of targets among distractors (e.g., looking for various LEGO pieces in a box). Under non-exhaustive tasks, the observer scans the display, picking those targets needed, not necessarily all of them, before leaving the search. To understand how the organization of such natural foraging tasks works, several measures of spatial scanning and organization have been proposed in the exhaustive foraging literature: best-r, intertarget distances, PAO, and target intersections. In the present study, we apply these measures and new Bayesian indexes to determine how the time course of visual foraging is organized in a dynamic non-exhaustive paradigm. In a large sample of observers (279 participants, 4-25 years old), we compare feature and conjunction foraging and explore how factors like set size and time course, not previously tested in exhaustive foraging, might affect search organization in non-exhaustive dynamic tasks. The results replicate previous findings showing younger observers' searching being less organized, feature conditions being more organized than conjunction conditions, and organization leading to a more effective search. Interestingly, observers tend to be less organized as set size increases, and search is less organized within a patch as it advances in time: Search organization decreases when search termination is coming, suggesting organization measures as potential clues to understand quitting rules in search. Our results highlight the importance of studying search organization in foraging as a critical source of understanding complex cognitive processes in visual search.
Collapse
Affiliation(s)
- Marcos Bella-Fernández
- Facultad de Psicología, Universidad Autónoma de Madrid, C/ Ivan Pavlov 6, 28029, Madrid, Spain.
- Universidad Pontificia de Comillas, Madrid, Spain.
| | - Manuel Suero Suñé
- Facultad de Psicología, Universidad Autónoma de Madrid, C/ Ivan Pavlov 6, 28029, Madrid, Spain
| | | |
Collapse
|
3
|
Liang X, Wu Z, Yue Z. The association of targets modulates the search efficiency in multitarget searches. Atten Percept Psychophys 2023; 85:1888-1904. [PMID: 37568033 DOI: 10.3758/s13414-023-02771-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/24/2023] [Indexed: 08/13/2023]
Abstract
Previous studies have found that distractors can affect visual search efficiency when associated with the target in a single-target search. However, multitarget searches are frequently necessary in daily life. In the present study, we examined how the association of targets in a multitarget search affected performance when searching for two targets simultaneously (Experiment 1). In addition, we explored whether the association affected switch cost (Experiment 2) and preparation cost (Experiment 3). Participants were required to learn associations between different colors or shapes and then performed feature search and conjunction search tasks. For all experiments, the results of search efficiency showed that for conjunction search, the search efficiency under the associated condition was significantly higher than that under the neutral condition. Similarly, the response times in the associated condition were significantly faster than those in the neutral condition under the conjunction search condition in Experiments 1 and 2. However, in Experiment 3, the response times in the associated condition were longer than those in the neutral condition. These results indicate that the association between targets can improve the efficiency of multitarget searches. Furthermore, associations can reduce the time spent searching for individual targets and the switch cost; however, the preparation cost increases.
Collapse
Affiliation(s)
- Xinxian Liang
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou, 510006, China
| | - Zehua Wu
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou, 510006, China
| | - Zhenzhu Yue
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou, 510006, China.
| |
Collapse
|
4
|
|
5
|
Gil-Gómez de Liaño B, Wolfe JM. The FORAGEKID Game: Hybrid-Foraging as a new way to study aspects of executive function in development. COGNITIVE DEVELOPMENT 2022. [DOI: 10.1016/j.cogdev.2022.101233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
6
|
Priming effects in inefficient visual search: Real, but transient. Atten Percept Psychophys 2022; 84:1417-1431. [PMID: 35578002 PMCID: PMC9109951 DOI: 10.3758/s13414-022-02503-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/27/2022] [Indexed: 12/02/2022]
Abstract
In visual search tasks, responses to targets on one trial can influence responses on the next trial. Most typically, target repetition speeds response while switching to a different target slows response. Such “priming” effects have sometimes been given very significant roles in theories of search (e.g., Theeuwes, Philosophical Transactions of the Royal Society B: Biological Sciences, 368, 1628, 2013). Most work on priming has involved “singleton” or “popout” tasks. In non-popout priming tasks, observers must often perform a task-switching operation because the guiding template for one target (e.g., a red vertical target in a conjunction task) is incompatible with efficient search for the other target (green horizontal, in this example). We examined priming in inefficient search where the priming feature (Color: Experiments 1–3, Shape: Experiments 4–5) was irrelevant to the task of finding a T among Ls. We wished to determine if finding a red T on one trial helped observers to be more efficient if the next T was also red. In all experiments, we found additive priming effects. The reaction time (RT) for the second trial was shorter if the color of the T was repeated. However, there was no interaction with set size. The slope of the RT × Set Size function was not shallower for runs of the same target color, compared to trials where the target color switched. We propose that priming might produce transient guidance of the earliest deployments of attention on the next trial or it might speed decisions about a selected target. Priming does not appear to guide attention over the entire search.
Collapse
|
7
|
Thornton IM, Nguyen TT, Kristjánsson Á. Foraging tempo: Human run patterns in multiple-target search are constrained by the rate of successive responses. Q J Exp Psychol (Hove) 2022; 75:297-312. [PMID: 32933424 DOI: 10.1177/1747021820961640] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Human foraging tasks are beginning to provide new insights into the roles of vision, attention, and working memory during complex, multiple-target search. Here, we test the idea that "foraging tempo"-the rate of successive target selections-helps determine patterns of behaviour in these tasks. Previously, we established that the majority of target selections during unconstrained foraging happen at regular, rapid intervals, forming the "cruise phase" of a foraging trial. Furthermore, we noted that when the temporal interval between cruise phase responses was longer, the tendency to switch between target categories increased. To directly explore this relationship, we modified our standard iPad foraging task so that observers had to synchronise each response with an auditory metronome signal. Across trials, we increased the tempo and examined how this changed patterns of foraging when targets were defined either by a single feature or by a conjunction of features. The results were very clear. Increasing tempo systematically decreased the tendency for participants to switch between target categories. Although this was true for both feature and conjunction trials, there was also evidence that time constraints and target complexity interacted. As in our previous work, we also observed clear individual differences in how participants responded to changes in task difficulty. Overall, our results show that foraging tempo does influence the way participants respond, and we suggest this parameter may prove to be useful in further explorations of group and individual strategies during multiple-target search.
Collapse
Affiliation(s)
- Ian M Thornton
- Department of Cognitive Science, Faculty of Media and Knowledge Sciences, University of Malta, Msida, Malta
| | - Tram Tn Nguyen
- Department of Cognitive Science, Faculty of Media and Knowledge Sciences, University of Malta, Msida, Malta
| | - Árni Kristjánsson
- Faculty of Psychology, School of Health Sciences, University of Iceland, Reykjavik, Iceland
- School of Psychology, National Research University Higher School of Economics, Moscow, Russian Federation
| |
Collapse
|
8
|
Foraging as sampling without replacement: A Bayesian statistical model for estimating biases in target selection. PLoS Comput Biol 2022; 18:e1009813. [PMID: 35073315 PMCID: PMC8812991 DOI: 10.1371/journal.pcbi.1009813] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Revised: 02/03/2022] [Accepted: 01/06/2022] [Indexed: 11/28/2022] Open
Abstract
Foraging entails finding multiple targets sequentially. In humans and other animals, a key observation has been a tendency to forage in 'runs' of the same target type. This tendency is context-sensitive, and in humans, it is strongest when the targets are difficult to distinguish from the distractors. Many important questions have yet to be addressed about this and other tendencies in human foraging, and a key limitation is a lack of precise measures of foraging behaviour. The standard measures tend to be run statistics, such as the maximum run length and the number of runs. But these measures are not only interdependent, they are also constrained by the number and distribution of targets, making it difficult to make inferences about the effects of these aspects of the environment on foraging. Moreover, run statistics are underspecified about the underlying cognitive processes determining foraging behaviour. We present an alternative approach: modelling foraging as a procedure of generative sampling without replacement, implemented in a Bayesian multilevel model. This allows us to break behaviour down into a number of biases that influence target selection, such as the proximity of targets and a bias for selecting targets in runs, in a way that is not dependent on the number of targets present. Our method thereby facilitates direct comparison of specific foraging tendencies between search environments that differ in theoretically important dimensions. We demonstrate the use of our model with simulation examples and re-analysis of existing data. We believe our model will provide deeper insights into visual foraging and provide a foundation for further modelling work in this area.
Collapse
|
9
|
Tagu J, Kristjánsson Á. The selection balance: Contrasting value, proximity and priming in a multitarget foraging task. Cognition 2021; 218:104935. [PMID: 34673302 DOI: 10.1016/j.cognition.2021.104935] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 10/05/2021] [Accepted: 10/07/2021] [Indexed: 11/18/2022]
Abstract
A critical question in visual foraging concerns the mechanisms driving the next target selection. Observers first identify a set of candidate targets, and then select the best option among these candidates. Recent evidence suggests that target selection relies on internal biases towards proximity (nearest target from the last selection), priming (target from the same category as the last selection) and value (target associated with high value). Here, we tested the role of eye movements in target selection, and notably whether disabling eye movements during target selection could affect search strategy. We asked observers to perform four foraging tasks differing by selection modality and target value. During gaze foraging, participants had to accurately fixate the targets to select them and could not anticipate the next selection with their eyes, while during mouse foraging they selected the targets with mouse clicks and were free to move their eyes. We moreover manipulated both target value and proximity. Our results revealed notable individual differences in search strategy, confirming the existence of internal biases towards value, proximity and priming. Critically, there were no differences in search strategy between mouse and gaze foraging, suggesting that disabling eye movements during target selection did not affect foraging behaviour. These results importantly suggest that overt orienting is not necessary for target selection. This study provides fundamental information for theoretical conceptions of attentional selection, and emphasizes the importance of covert attention for target selection during visual foraging.
Collapse
Affiliation(s)
- Jérôme Tagu
- Icelandic Vision Lab, Faculty of Psychology, School of Health Sciences, University of Iceland, Reykjavík, Iceland; Laboratory of Psychology (LabPsy, EA 4139), University of Bordeaux, Bordeaux, France.
| | - Árni Kristjánsson
- Icelandic Vision Lab, Faculty of Psychology, School of Health Sciences, University of Iceland, Reykjavík, Iceland; School of Psychology, National Research University Higher School of Economics, Moscow, Russian Federation
| |
Collapse
|
10
|
Abstract
This paper describes Guided Search 6.0 (GS6), a revised model of visual search. When we encounter a scene, we can see something everywhere. However, we cannot recognize more than a few items at a time. Attention is used to select items so that their features can be "bound" into recognizable objects. Attention is "guided" so that items can be processed in an intelligent order. In GS6, this guidance comes from five sources of preattentive information: (1) top-down and (2) bottom-up feature guidance, (3) prior history (e.g., priming), (4) reward, and (5) scene syntax and semantics. These sources are combined into a spatial "priority map," a dynamic attentional landscape that evolves over the course of search. Selective attention is guided to the most active location in the priority map approximately 20 times per second. Guidance will not be uniform across the visual field. It will favor items near the point of fixation. Three types of functional visual field (FVFs) describe the nature of these foveal biases. There is a resolution FVF, an FVF governing exploratory eye movements, and an FVF governing covert deployments of attention. To be identified as targets or rejected as distractors, items must be compared to target templates held in memory. The binding and recognition of an attended object is modeled as a diffusion process taking > 150 ms/item. Since selection occurs more frequently than that, it follows that multiple items are undergoing recognition at the same time, though asynchronously, making GS6 a hybrid of serial and parallel processes. In GS6, if a target is not found, search terminates when an accumulating quitting signal reaches a threshold. Setting of that threshold is adaptive, allowing feedback about performance to shape subsequent searches. Simulation shows that the combination of asynchronous diffusion and a quitting signal can produce the basic patterns of response time and error data from a range of search experiments.
Collapse
Affiliation(s)
- Jeremy M Wolfe
- Ophthalmology and Radiology, Brigham & Women's Hospital/Harvard Medical School, Cambridge, MA, USA.
- Visual Attention Lab, 65 Landsdowne St, 4th Floor, Cambridge, MA, 02139, USA.
| |
Collapse
|
11
|
Wiegand I, Wolfe JM. Target value and prevalence influence visual foraging in younger and older age. Vision Res 2021; 186:87-102. [PMID: 34062375 DOI: 10.1016/j.visres.2021.05.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 05/04/2021] [Accepted: 05/07/2021] [Indexed: 01/13/2023]
Abstract
The prevalence and reward-value of targets have an influence on visual search. The strength of the effect of an item's reward-value on attentional selection varies substantially between individuals and is potentially sensitive to aging. We investigated individual and age differences in a hybrid foraging task, in which the prevalence and value of multiple target types was varied. Using optimal foraging theory measures, foraging was more efficient overall in younger than older observers. However, the influence of prevalence and value on target selections was similar across age groups, suggesting that the underlying cognitive mechanisms are preserved in older age. When prevalence was varied but target value was balanced, younger and older observers preferably selected the most frequent target type and were biased to select another instance of the previously selected target type. When value was varied, younger and older observers showed a tendency to select high-value targets, but preferences were more diverse between individuals. When value and prevalence were inversely related, some observers showed particularly strong preferences for high-valued target types, while others showed a preference for high-prevalent, albeit low-value, target types. In younger adults, individual differences in the selection choices correlated with a personality index, suggesting that avoiding selections of low-value targets may be related to reward-seeking behaviour.
Collapse
Affiliation(s)
- Iris Wiegand
- Donders Institute for Brain, Cognition and Behavior, Department of Neuropsychology and Rehabilitation Psychology, Radboud University, Nijmegen, Netherlands; Visual Attention Lab, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA.
| | - Jeremy M Wolfe
- Visual Attention Lab, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA; Departments of Ophthalmology & Radiology, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
12
|
Lee J, Jung K, Han SW. Serial, self-terminating search can be distinguished from others: Evidence from multi-target search data. Cognition 2021; 212:104736. [PMID: 33887651 DOI: 10.1016/j.cognition.2021.104736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Revised: 04/10/2021] [Accepted: 04/12/2021] [Indexed: 10/21/2022]
Abstract
How do people find a target among multiple stimuli? The process of searching for a target among distractors has been a fundamental issue in human perception and cognition, evoking raging debates. Some researchers argued that search should be carried out by serially allocating focal attention to each item until the target is found. Others claimed that multiple stimuli, sharing a finite amount of processing resource, could be processed in parallel. This strict serial/parallel dichotomy in visual search has been challenged and many recent theories suggest that visual search tasks involve both serial and parallel processes. However, some search tasks should primarily depend on serial processing, while others would rely upon parallel processing to a greater extent. Here, by simple innovation of an experimental paradigm, we were able to identify a specific behavioral pattern associated with serial, self-terminating search and clarified which tasks depend on serial processing to a greater extent than others. Using this paradigm, we provide insights regarding under which condition the search becomes more serial or parallel. We also discuss several recent models of visual search that are capable of accommodating these findings and reconciling the extant controversy.
Collapse
Affiliation(s)
- Jongmin Lee
- Department of Psychology, Chungnam National University, Daejeon, Republic of Korea
| | - Koeun Jung
- Institute of Basic Science, Daejeon, Republic of Korea.
| | - Suk Won Han
- Department of Psychology, Chungnam National University, Daejeon, Republic of Korea.
| |
Collapse
|
13
|
Foraging behavior in visual search: A review of theoretical and mathematical models in humans and animals. PSYCHOLOGICAL RESEARCH 2021; 86:331-349. [PMID: 33745028 DOI: 10.1007/s00426-021-01499-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2020] [Accepted: 03/02/2021] [Indexed: 10/21/2022]
Abstract
Visual search (VS) is a fundamental task in daily life widely studied for over half a century. A variant of the classic paradigm-searching one target among distractors-requires the observer to look for several (undetermined) instances of a target (so-called foraging) or several targets that may appear an undefined number of times (recently named as hybrid foraging). In these searches, besides looking for targets, the observer must decide how much time is needed to exploit the area, and when to quit the search to eventually explore new search options. In fact, visual foraging is a very common search task in the real world, probably involving additional cognitive functions than typical VS. It has been widely studied in natural animal environments, for which several mathematical models have been proposed, and just recently applied to humans: Lévy processes, composite and area-restricted search models, marginal value theorem, and Bayesian learning (among others). We conducted a systematic search in the literature to understand those mathematical models and study its applicability in human visual foraging. The review suggests that these models might be the first step, but they seem to be limited to fully comprehend foraging in visual search. There are essential variables involving human visual foraging still to be established and understood. Indeed, a jointly theoretical interpretation based on the different models reviewed could better account for its understanding. In addition, some other relevant variables, such as certain individual differences or time perception might be crucial to understanding visual foraging in humans.
Collapse
|
14
|
Kosovicheva A, Alaoui-Soce A, Wolfe JM. Looking ahead: When do you find the next item in foraging visual search? J Vis 2020; 20:3. [PMID: 32040162 PMCID: PMC7343403 DOI: 10.1167/jov.20.2.3] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Many real-world visual tasks involve searching for multiple instances of a target (e.g., picking ripe berries). What strategies do observers use when collecting items in this type of search? Do they wait to finish collecting the current item before starting to look for the next target, or do they search ahead for future targets? We utilized behavioral and eye-tracking measures to distinguish between these two possibilities in foraging search. Experiment 1 used a color wheel technique in which observers searched for T shapes among L shapes while all items independently cycled through a set of colors. Trials were abruptly terminated, and observers reported both the color and location of the next target that they intended to click. Using observers’ color reports to infer target-finding times, we demonstrate that observers found the next item before the time of the click on the current target. We validated these results in Experiment 2 by recording fixation locations around the time of each click. Experiment 3 utilized a different procedure, in which all items were intermittently occluded during the trial. We then calculated a distribution of when targets were visible around the time of each click, allowing us to infer when they were most likely found. In a fourth and final experiment, observers indicated the locations of multiple future targets after the search was abruptly terminated. Together, our results provide converging evidence to demonstrate that observers can find the next target before collecting the current target and can typically forage one to two items ahead.
Collapse
|
15
|
Kristjánsson T, Draschkow D, Pálsson Á, Haraldsson D, Jónsson PÖ, Kristjánsson Á. Moving foraging into three dimensions: Feature- versus conjunction-based foraging in virtual reality. Q J Exp Psychol (Hove) 2020; 75:313-327. [PMID: 32519926 DOI: 10.1177/1747021820937020] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Visual attention evolved in a three-dimensional (3D) world, yet studies on human attention in three dimensions are sparse. Here we present findings from a human foraging study in immersive 3D virtual reality. We used a foraging task introduced in Kristjánsson et al. to examine how well their findings generalise to more naturalistic settings. The second goal was to examine what effect the motion of targets and distractors has on inter-target times (ITTs), run patterns, and foraging organisation. Observers foraged for 50 targets among 50 distractors in four different conditions. Targets were distinguished from distractors by either a single feature (feature foraging) or a conjunction of features (conjunction foraging). Furthermore, those conditions were performed both with static and moving targets and distractors. Our results replicate previous foraging studies in many aspects, with constant ITTs during a "cruise-phase" within foraging trials and response time peaks at the end of foraging trials. Some key differences emerged, however, such as more frequent switches between target types during conjunction foraging than previously seen and a lack of clear mid-peaks during conjunction foraging, possibly reflecting that differences between feature and conjunction processing are smaller within 3D environments. Observers initiated their foraging in the bottom part of the visual field and motion did not have much of an effect on selection times between different targets (ITTs) or run behaviour patterns except for the end-peaks. Our results cast new light upon visual attention in 3D environments and highlight how 3D virtual reality studies can provide important extensions to two-dimensional studies of visual attention.
Collapse
Affiliation(s)
- Tómas Kristjánsson
- Icelandic Vision Laboratory, School of Health Sciences, University of Iceland, Reykjavík, Iceland
| | - Dejan Draschkow
- Department of Psychiatry, Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
| | - Ágúst Pálsson
- Icelandic Vision Laboratory, School of Health Sciences, University of Iceland, Reykjavík, Iceland
| | - Davíð Haraldsson
- Icelandic Vision Laboratory, School of Health Sciences, University of Iceland, Reykjavík, Iceland
| | - Pétur Örn Jónsson
- Icelandic Vision Laboratory, School of Health Sciences, University of Iceland, Reykjavík, Iceland
| | - Árni Kristjánsson
- Icelandic Vision Laboratory, School of Health Sciences, University of Iceland, Reykjavík, Iceland.,School of Psychology, National Research University Higher School of Economics, Moscow, Russian Federation
| |
Collapse
|
16
|
Affiliation(s)
- Eduard Ort
- Biological Psychology of Decision Making, Institute of Experimental Psychology, Heinrich-Heine University Düsseldorf, Düsseldorf Germany
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Christian N. L. Olivers
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- Institute for Brain and Behavior Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
17
|
Li A, Wolfe JM, Chen Z. Implicitly and explicitly encoded features can guide attention in free viewing. J Vis 2020; 20:8. [PMID: 32531062 PMCID: PMC7416890 DOI: 10.1167/jov.20.6.8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2019] [Accepted: 02/15/2020] [Indexed: 11/29/2022] Open
Abstract
It is well known that priming, probably by the contents of working memory, can influence subsequent visual task performance. How ubiquitous is this effect? Can incidental exposure to visual stimuli influence the deployment of attention when there is no explicit visual task? Results of two experiments show that a preceding stimulus can influence free-viewing eye movements. A simple change detection task was used as the cover task. The initial memory display was the priming display, while subsequent filler display constituted the free-viewing display of our interest. In Experiment 1, subjects were asked to memorize the number of items in the priming display. Subjects were not explicitly instructed to attend to features, but these might still be implicitly encoded. In Experiment 2, a more complex change detection task required subjects to memorize the number, color, and shape of priming items. Here, prime features were attended and, presumably, explicitly encoded. We were interested to know whether incidentally or explicitly encoded features of prime items would influence attention distribution in the filler display. In both experiments, items sharing color and shape with the prime were attended more often than predicted by chance. Items sharing neither color nor shape were attended less often. Items sharing either color or shape (not both) could also attract attention showing that the priming need not be based on a bound representation of the primed item. Effects were stronger in Experiment 2. No intention or top-down control appears to be needed to produce this priming.
Collapse
Affiliation(s)
- Aoqi Li
- School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, PR China
| | - Jeremy M. Wolfe
- Brigham & Women's Hospital, Cambridge, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Zhenzhong Chen
- School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, PR China
| |
Collapse
|
18
|
Gorbunova E. Prospects for using visual search tasks in modern cognitive psychology. СОВРЕМЕННАЯ ЗАРУБЕЖНАЯ ПСИХОЛОГИЯ 2020. [DOI: 10.17759/jmfp.2020090209] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The article describes the main results of modern foreign studies with modifications of classical visual search tasks, as well as proposed classification of such modifications. The essence of visual search is to find target stimuli among the distracters, and the standard task involves finding one target stimulus, which is usually a simple object. Modifications to the standard task may include the presence of more than one target on the screen, the search for more than one type of target, and options that combine both of these modifications. Proposed modifications of the standard task allow not only to study new aspects of visual attention, but also to approach real-life tasks within laboratory studies.
Collapse
Affiliation(s)
- E.S. Gorbunova
- School of Psychology, National Research University Higher School of Economics
| |
Collapse
|
19
|
Abstract
In hybrid foraging tasks, observers search visual displays, so called patches, for multiple instances of any of several types of targets with the goal of collecting targets as quickly as possible. Here, targets were photorealistic objects. Younger and older adults collected targets by mouse clicks. They could move to the next patch whenever they decided to do so. The number of targets held in memory varied between 8 and 64 objects, and the number of items (targets and distractors) in the patches varied between 60 and 105 objects. Older adults foraged somewhat less efficiently than younger adults due to a more exploitative search strategy. When target items became depleted in a patch and search slowed down, younger adults acted according to the optimal foraging theory and moved on to the next patch when the instantaneous rate of collection was close to their average rate of collection. Older adults, by contrast, were more likely to stay longer and spend time searching for the last few targets. Within a patch, both younger and older adults tended to collect the same type of target in "runs." This behavior is more efficient than continual switching between target types. Furthermore, after correction for general age-related slowing, RT × set size functions revealed largely preserved attention and memory functions in older age. Hybrid foraging tasks share features with important real-world search tasks. Differences between younger and older observers on this task may therefore help to explain age differences in many complex search tasks of daily life. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
Affiliation(s)
- Iris Wiegand
- Visual Attention Lab, Brigham and Women's Hospital
| | | | - Jeremy Wolfe
- Visual Attention Lab, Brigham and Women's Hospital
| |
Collapse
|
20
|
Thornton IM, de’Sperati C, Kristjánsson Á. The influence of selection modality, display dynamics and error feedback on patterns of human foraging. VISUAL COGNITION 2019. [DOI: 10.1080/13506285.2019.1658001] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Ian M. Thornton
- Department of Cognitive Science, Faculty of Media and Knowledge Sciences, University of Malta, Msida, Malta
| | - Claudio de’Sperati
- Laboratory of Action, Perception and Cognition, Università Vita-Salute San Raffaele, Milano, Italy
- Experimental Psychology Unit, Division of Neuroscience, San Raffaele Scientific Institute, Milano, Italy
| | - Árni Kristjánsson
- Faculty of Psychology, School of Health Sciences, University of Iceland, Reykjavik, Iceland
- School of Psychology, National Research University, Higher School of Economics, Moscow, Russian Federation
| |
Collapse
|
21
|
Williams LH, Drew T. What do we know about volumetric medical image interpretation?: a review of the basic science and medical image perception literatures. Cogn Res Princ Implic 2019; 4:21. [PMID: 31286283 PMCID: PMC6614227 DOI: 10.1186/s41235-019-0171-6] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2019] [Accepted: 05/19/2019] [Indexed: 11/26/2022] Open
Abstract
Interpretation of volumetric medical images represents a rapidly growing proportion of the workload in radiology. However, relatively little is known about the strategies that best guide search behavior when looking for abnormalities in volumetric images. Although there is extensive literature on two-dimensional medical image perception, it is an open question whether the conclusions drawn from these images can be generalized to volumetric images. Importantly, volumetric images have distinct characteristics (e.g., scrolling through depth, smooth-pursuit eye-movements, motion onset cues, etc.) that should be considered in future research. In this manuscript, we will review the literature on medical image perception and discuss relevant findings from basic science that can be used to generate predictions about expertise in volumetric image interpretation. By better understanding search through volumetric images, we may be able to identify common sources of error, characterize the optimal strategies for searching through depth, or develop new training and assessment techniques for radiology residents.
Collapse
|
22
|
Donnelly N, Muhl-Richardson A, Godwin HJ, Cave KR. Using Eye Movements to Understand how Security Screeners Search for Threats in X-Ray Baggage. Vision (Basel) 2019; 3:vision3020024. [PMID: 31735825 PMCID: PMC6802782 DOI: 10.3390/vision3020024] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Revised: 05/17/2019] [Accepted: 06/01/2019] [Indexed: 12/01/2022] Open
Abstract
There has been an increasing drive to understand failures in searches for weapons and explosives in X-ray baggage screening. Tracking eye movements during the search has produced new insights into the guidance of attention during the search, and the identification of targets once they are fixated. Here, we review the eye-movement literature that has emerged on this front over the last fifteen years, including a discussion of the problems that real-world searchers face when trying to detect targets that could do serious harm to people and infrastructure.
Collapse
Affiliation(s)
- Nick Donnelly
- Department of Psychology, Liverpool Hope University, Liverpool L16 9JD, UK
| | | | - Hayward J. Godwin
- Psychology, University of Southampton, Southampton SO17 1BJ, UK
- Correspondence:
| | - Kyle R. Cave
- Department of Psychological and Brain Sciences, University of Massachusetts Amherst, Amherst, MA 01003, USA
| |
Collapse
|
23
|
Abstract
In Hybrid Foraging tasks, observers search for multiple instances of several types of target. Collecting all the dirty laundry and kitchenware out of a child's room would be a real-world example. How are such foraging episodes structured? A series of four experiments shows that selection of one item from the display makes it more likely that the next item will be of the same type. This pattern holds if the targets are defined by basic features like color and shape but not if they are defined by their identity (e.g., the letters p & d). Additionally, switching between target types during search is expensive in time, with longer response times between successive selections if the target type changes than if they are the same. Finally, the decision to leave a screen/patch for the next screen in these foraging tasks is imperfectly consistent with the predictions of optimal foraging theory. The results of these hybrid foraging studies cast new light on the ways in which prior selection history guides subsequent visual search in general.
Collapse
Affiliation(s)
- Jeremy M Wolfe
- Visual Attention Laboratory, Department of Surgery, Brigham and Women's Hospital, Boston, MA, USA.
- Department of Ophthalmology and Radiology, Harvard Medical School, Boston, MA, USA.
- Visual Attention Laboratory, Department of Surgery, Brigham and Women's Hospital, 64 Sidney St. Suite. 170, Cambridge, MA, 02139-4170, USA.
| | - Matthew S Cain
- Development, and Engineering Center, US Army Natick Soldier Research, Natick, MA, USA
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, USA
| | - Avigael M Aizenman
- Vision Science Department, University of California Berkeley, Berkeley, CA, USA
| |
Collapse
|
24
|
Abstract
For some real-world color searches, the target colors are not precisely known, and any item within a range of color values should be attended. Thus, a target representation that captures multiple similar colors would be advantageous. If such a multicolor search is possible, then search for two targets (e.g., Stroud, Menneer, Cave, and Donnelly, Journal of Experimental Psychology: Human Perception and Performance, 38(1): 113-122, 2012) might be guided by a target representation that included the target colors as well as the continuum of colors that fall between the targets within a contiguous region in color space. Results from Stroud, Menneer, Cave, and Donnelly, Journal of Experimental Psychology: Human Perception and Performance, 38(1): 113-122, (2012) suggest otherwise, however. The current set of experiments show that guidance for a set of colors that are all from a single region of color space can be reasonably effective if targets are depicted as specific discrete colors. Specifically, Experiments 1-3 demonstrate that a search can be guided by four and even eight colors given the appropriate conditions. However, Experiment 5 gives evidence that guidance is sometimes sensitive to how informative the target preview is to search. Experiments 6 and 7 show that a stimulus showing a continuous range of target colors is not translated into a search target representation. Thus, search can be guided by multiple discrete colors that are from a single region in color space, but this approach was not adopted in a search for two targets with intervening distractor colors.
Collapse
|
25
|
Wolfe JM. Everything is Foreseen, Yet Free will is Given (Mishna Avot 3:15). J Cogn 2018; 1:22. [PMID: 31517196 PMCID: PMC6634609 DOI: 10.5334/joc.27] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2018] [Accepted: 03/15/2018] [Indexed: 11/25/2022] Open
Abstract
Jan Theeuwes' review of visual selection shines a useful spotlight on the role of selection history in determining subsequent deployments of attention. However, he blurs an important distinction between volition and top-down guidance of attention and he underplays the role of both of those factors in the control of attention.
Collapse
|
26
|
Getting satisfied with "satisfaction of search": How to measure errors during multiple-target visual search. Atten Percept Psychophys 2018; 79:1352-1365. [PMID: 28353059 DOI: 10.3758/s13414-017-1300-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Visual search studies are common in cognitive psychology, and the results generally focus upon accuracy, response times, or both. Most research has focused upon search scenarios where no more than 1 target will be present for any single trial. However, if multiple targets can be present on a single trial, it introduces an additional source of error because the found target can interfere with subsequent search performance. These errors have been studied thoroughly in radiology for decades, although their emphasis in cognitive psychology studies has been more recent. One particular issue with multiple-target search is that these subsequent search errors (i.e., specific errors which occur following a found target) are measured differently by different studies. There is currently no guidance as to which measurement method is best or what impact different measurement methods could have upon various results and conclusions. The current investigation provides two efforts to address these issues. First, the existing literature is reviewed to clarify the appropriate scenarios where subsequent search errors could be observed. Second, several different measurement methods are used with several existing datasets to contrast and compare how each method would have affected the results and conclusions of those studies. The evidence is then used to provide appropriate guidelines for measuring multiple-target search errors in future studies.
Collapse
|
27
|
Hybrid value foraging: How the value of targets shapes human foraging behavior. Atten Percept Psychophys 2017; 80:609-621. [DOI: 10.3758/s13414-017-1471-x] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
28
|
Cave KR, Menneer T, Nomani MS, Stroud MJ, Donnelly N. Dual Target Search is Neither Purely Simultaneous nor Purely Successive. Q J Exp Psychol (Hove) 2017; 71:1-29. [PMID: 28856981 DOI: 10.1080/17470218.2017.1307425] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
Previous research shows that visual search for two different targets is less efficient than search for a single target. Stroud, Menneer, Cave and Donnelly (2012) concluded that two target colours are represented separately based on modeling the fixation patterns. Although those analyses provide evidence for two separate target representations, they do not show whether participants search simultaneously for both targets, or first search for one target and then the other. Some studies suggest that multiple target representations are simultaneously active, while others indicate that search can be voluntarily simultaneous, or switching, or a mixture of both. Stroud et al.'s participants were not explicitly instructed to use any particular strategy. These data were revisited to determine which strategy was employed. Each fixated item was categorised according to whether its colour was more similar to one target or the other. Once an item similar to one target is fixated, the next fixated item is more likely to be similar to that target than the other, showing that at a given moment during search, one target is generally favoured. However, the search for one target is not completed before search for the other begins. Instead, there are often short runs of one or two fixations to distractors similar to one target, with each run followed by a switch to the other target. Thus, the results suggest that one target is more highly weighted than the other at any given time, but not to the extent that search is purely successive.
Collapse
Affiliation(s)
- Kyle R Cave
- a Department of Psychological and Brain Sciences , University of Massachusetts
| | - Tamaryn Menneer
- b Centre for Vision and Cognition, Psychology , University of Southampton , UK
| | - Mohammad S Nomani
- a Department of Psychological and Brain Sciences , University of Massachusetts
| | | | - Nick Donnelly
- b Centre for Vision and Cognition, Psychology , University of Southampton , UK
| |
Collapse
|
29
|
Jóhannesson ÓI, Kristjánsson Á, Thornton IM. Are Foraging Patterns in Humans Related to Working Memory and Inhibitory Control? JAPANESE PSYCHOLOGICAL RESEARCH 2017. [DOI: 10.1111/jpr.12152] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
30
|
Rajsic J, Wilson DE, Pratt J. The price of information: Increased inspection costs reduce the confirmation bias in visual search. Q J Exp Psychol (Hove) 2017; 71:832-849. [PMID: 28056636 DOI: 10.1080/17470218.2016.1278249] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
In visual search, there is a confirmation bias such that attention is biased towards stimuli that match a target template, which has been attributed to covert costs of updating the templates that guide search [Rajsic, Wilson, & Pratt, 2015. Confirmation bias in visual search. Journal of Experimental Psychology: Human Perception and Performance. Advance online publication. doi:10.1037/xhp0000090]. In order to provide direct evidence for this speculation, the present study increased the cost of inspections in search by using gaze- and mouse-contingent searches, which restrict the manner in which information in search displays can be accrued, and incur additional motor costs (in the case of mouse-contingent searches). In a fourth experiment, we rhythmically mask elements in the search display to induce temporal inspection costs. Our results indicated that confirmation bias is indeed attenuated when inspection costs are increased. We conclude that confirmation bias results from the low-cost strategy of matching information to a single, concrete visual template, and that more sophisticated guidance strategies will be used when sufficiently beneficial. This demonstrates that search guidance itself comes at a cost, and that the form of guidance adopted in a given search depends on a comparison between guidance costs and the expected benefits of their implementation.
Collapse
Affiliation(s)
- Jason Rajsic
- 1 Department of Psychology, University of Toronto, Toronto, ON, Canada
| | - Daryl E Wilson
- 2 Department of Psychology, Queen's University, Kingston, ON, Canada
| | - Jay Pratt
- 1 Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|