When is it time to move to the next raspberry bush? Foraging rules in human visual search

Behavioral Bias for Exploration Is Associated with Enhanced Signaling in the Lateral and Medial Frontopolar Cortex

Should we keep doing what we know works for us, or should we risk trying something new as it could work even better? The exploration-exploitation dilemma is ubiquitous in daily life decision-making, and balancing between the two is crucial for adaptive behavior. Yet, we only have started to unravel the neurocognitive mechanisms that help us to find this balance in practice. Analyzing BOLD signals of healthy young adults during virtual foraging, we could show that a behavioral tendency for prolonged exploitation was associated with weakened signaling during exploration in central node points of the frontoparietal attention network, plus the frontopolar cortex. These results provide an important link between behavioral heuristics that we use to balance between exploitation and exploration and the brain function that supports shifts from one tendency to the other. Importantly, they stress that interindividual differences in behavioral strategies are reflected in differences in brain activity during exploration and should thus be more in the focus of basic research that aims at delineating general laws governing visual attention.

Foreground bias: Semantic consistency effects modulated when searching across depth

When processing visual scenes, we tend to prioritize information in the foreground, often at the expense of background information. The foreground bias has been supported by data demonstrating that there are more fixations to foreground, and faster and more accurate detection of targets embedded in foreground. However, it is also known that semantic consistency is associated with more efficient search. Here, we examined whether semantic context interacts with foreground prioritization, either amplifying or mitigating the effect of target semantic consistency. For each scene, targets were placed in the foreground or background and were either semantically consistent or inconsistent with the context of immediately surrounding depth region. Results indicated faster response times (RTs) for foreground and semantically consistent targets, replicating established effects. More importantly, we found the magnitude of the semantic consistency effect was significantly smaller in the foreground than background region. To examine the robustness of this effect, in Experiment 2, we strengthened the reliability of semantics by increasing the proportion of targets consistent with the scene region to 80%. We found the overall results pattern to replicate the incongruous effect of semantic consistency across depth observed in Experiment 1. This suggests foreground bias modulates the effects of semantics so that performance is less impacted in near space.

Research on re-searching: interrupted foraging is not disrupted foraging

In classic visual search, observers typically search for the presence of a target in a scene or display. In foraging tasks, there may be multiple targets in the same display (or "patch"). Observers typically search for and collect these target items in one patch until they decide to leave that patch and move to the next one. This is a highly rule-governed behavior. The current study investigated whether these rules are disrupted when the foraging is interrupted in various manners. In Experiment 1, the foraging was briefly interrupted and then resumed in the same patch. In Experiments 2 and 3, the foraging in each patch either ended voluntarily or compulsorily after a fixed amount of time. In these cases, foraging resumed in a patch only after all patches were visited. Overall, the rules of foraging remained largely intact, though Experiment 2 shows that foraging rules can be overridden by the demand characteristics of the task. The results show that participants tended to perform approximately consistently despite interruptions. The results suggest that foraging behavior in a relatively simple foraging environment is resilient and not easily disrupted by interruption.

Hierarchical control over foraging behavior by anterior cingulate cortex

Foraging is a natural behavior that involves making sequential decisions to maximize rewards while minimizing the costs incurred when doing so. The prevalence of foraging across species suggests that a common brain computation underlies its implementation. Although anterior cingulate cortex is believed to contribute to foraging behavior, its specific role has been contentious, with predominant theories arguing either that it encodes environmental value or choice difficulty. Additionally, recent attempts to characterize foraging have taken place within the reinforcement learning framework, with increasingly complex models scaling with task complexity. Here we review reinforcement learning foraging models, highlighting the hierarchical structure of many foraging problems. We extend this literature by proposing that ACC guides foraging according to principles of model-based hierarchical reinforcement learning. This idea holds that ACC function is organized hierarchically along a rostral-caudal gradient, with rostral structures monitoring the status and completion of high-level task goals (like finding food), and midcingulate structures overseeing the execution of task options (subgoals, like harvesting fruit) and lower-level actions (such as grabbing an apple).

Joint contributions of preview and task instructions on visual search strategy selection

People tend to employ suboptimal attention control strategies during visual search. Here we question why people are suboptimal, specifically investigating how knowledge of the optimal strategies and the time available to apply such strategies affect strategy use. We used the Adaptive Choice Visual Search (ACVS), a task designed to assess attentional control optimality. We used explicit strategy instructions to manipulate explicit strategy knowledge, and we used display previews to manipulate time to apply the strategies. In the first two experiments, the strategy instructions increased optimality. However, the preview manipulation did not significantly boost optimality for participants who did not receive strategy instruction. Finally, in Experiments 3A and 3B, we jointly manipulated preview and instruction with a larger sample size. Preview and instruction both produced significant main effects; furthermore, they interacted significantly, such that the beneficial effect of instructions emerged with greater preview time. Taken together, these results have important implications for understanding the strategic use of attentional control. Individuals with explicit knowledge of the optimal strategy are more likely to exploit relevant information in their visual environment, but only to the extent that they have the time to do so.

Effects of reward and effort history on decision making and movement vigor during foraging

During foraging, animals explore a site and harvest reward and then abandon that site and travel to the next opportunity. One aspect of this behavior involves decision making, and the other involves movement control. These two aspects of behavior may be linked via an underlying desire to maximize a single normative utility: the sum of all rewards acquired, minus all efforts expended, divided by time. According to this theory, the history of rewards, and not just its immediate availability, should dictate how long one should stay and harvest reward and how vigorously one should travel to the next opportunity. We tested this theory in a series of experiments in which humans used their hand to harvest tokens at a reward patch and then used their arm to reach toward another patch. After a history of high rewards, the subjects not only shortened their harvest duration but also moved more vigorously toward the next reward opportunity. In contrast, after a history of high effort they lengthened their harvest duration but reduced their movement vigor, reaching more slowly to the next reward site. Thus, a history of high reward or low effort biased decisions by promoting early abandonment of the reward site and biased movements by promoting vigor.NEW & NOTEWORTHY Much of life is spent foraging. Whereas previous work has focused on the decision regarding time spent harvesting from a reward patch, here we test the idea that both decision making and movement control are tuned to optimize the net rate of reward in an environment. Our results show that movement patterns reflect not just immediate expectations but also past experiences in the environment, providing fundamental insight into the factors governing volitional control of arm movements.

The time course of visual foraging in the lifespan: Spatial scanning, organization search, and target processing

Visual foraging is a variant of visual search, consisting of searching for an undetermined number of targets among distractors (e.g., looking for various LEGO pieces in a box). Under non-exhaustive tasks, the observer scans the display, picking those targets needed, not necessarily all of them, before leaving the search. To understand how the organization of such natural foraging tasks works, several measures of spatial scanning and organization have been proposed in the exhaustive foraging literature: best-r, intertarget distances, PAO, and target intersections. In the present study, we apply these measures and new Bayesian indexes to determine how the time course of visual foraging is organized in a dynamic non-exhaustive paradigm. In a large sample of observers (279 participants, 4-25 years old), we compare feature and conjunction foraging and explore how factors like set size and time course, not previously tested in exhaustive foraging, might affect search organization in non-exhaustive dynamic tasks. The results replicate previous findings showing younger observers' searching being less organized, feature conditions being more organized than conjunction conditions, and organization leading to a more effective search. Interestingly, observers tend to be less organized as set size increases, and search is less organized within a patch as it advances in time: Search organization decreases when search termination is coming, suggesting organization measures as potential clues to understand quitting rules in search. Our results highlight the importance of studying search organization in foraging as a critical source of understanding complex cognitive processes in visual search.

Exploration versus exploitation decisions in the human brain: A systematic review of functional neuroimaging and neuropsychological studies

Thoughts and actions are often driven by a decision to either explore new avenues with unknown outcomes, or to exploit known options with predictable outcomes. Yet, the neural mechanisms underlying this exploration-exploitation trade-off in humans remain poorly understood. This is attributable to variability in the operationalization of exploration and exploitation as psychological constructs, as well as the heterogeneity of experimental protocols and paradigms used to study these choice behaviours. To address this gap, here we present a comprehensive review of the literature to investigate the neural basis of explore-exploit decision-making in humans. We first conducted a systematic review of functional magnetic resonance imaging (fMRI) studies of exploration-versus exploitation-based decision-making in healthy adult humans during foraging, reinforcement learning, and information search. Eleven fMRI studies met inclusion criterion for this review. Adopting a network neuroscience framework, synthesis of the findings across these studies revealed that exploration-based choice was associated with the engagement of attentional, control, and salience networks. In contrast, exploitation-based choice was associated with engagement of default network brain regions. We interpret these results in the context of a network architecture that supports the flexible switching between externally and internally directed cognitive processes, necessary for adaptive, goal-directed behaviour. To further investigate potential neural mechanisms underlying the exploration-exploitation trade-off we next surveyed studies involving neurodevelopmental, neuropsychological, and neuropsychiatric disorders, as well as lifespan development, and neurodegenerative diseases. We observed striking differences in patterns of explore-exploit decision-making across these populations, again suggesting that these two decision-making modes are supported by independent neural circuits. Taken together, our review highlights the need for precision-mapping of the neural circuitry and behavioural correlates associated with exploration and exploitation in humans. Characterizing exploration versus exploitation decision-making biases may offer a novel, trans-diagnostic approach to assessment, surveillance, and intervention for cognitive decline and dysfunction in normal development and clinical populations.

Effort Foraging Task reveals positive correlation between individual differences in the cost of cognitive and physical effort in humans

Effort-based decisions, in which people weigh potential future rewards against effort costs required to achieve those rewards involve both cognitive and physical effort, though the mechanistic relationship between them is not yet understood. Here, we use an individual differences approach to isolate and measure the computational processes underlying effort-based decisions and test the association between cognitive and physical domains. Patch foraging is an ecologically valid reward rate maximization problem with well-developed theoretical tools. We developed the Effort Foraging Task, which embedded cognitive or physical effort into patch foraging, to quantify the cost of both cognitive and physical effort indirectly, by their effects on foraging choices. Participants chose between harvesting a depleting patch, or traveling to a new patch that was costly in time and effort. Participants' exit thresholds (reflecting the reward they expected to receive by harvesting when they chose to travel to a new patch) were sensitive to cognitive and physical effort demands, allowing us to quantify the perceived effort cost in monetary terms. The indirect sequential choice style revealed effort-seeking behavior in a minority of participants (preferring high over low effort) that has apparently been missed by many previous approaches. Individual differences in cognitive and physical effort costs were positively correlated, suggesting that these are perceived and processed in common. We used canonical correlation analysis to probe the relationship of task measures to self-reported affect and motivation, and found correlations of cognitive effort with anxiety, cognitive function, behavioral activation, and self-efficacy, but no similar correlations with physical effort.

Testing a relational account of search templates in visual foraging

Search templates guide human visual attention toward relevant targets. Templates are often seen as encoding exact target features, but recent studies suggest that templates rather contain "relational properties" (e.g., they facilitate "redder" stimuli instead of specific hues of red). Such relational guidance seems helpful in naturalistic searches where illumination or perspective renders exact feature values unreliable. So far relational guidance has only been demonstrated in rather artificial single-target search tasks with briefly flashed displays. Here, we investigate whether relational guidance also occurs when humans interact with the search environment for longer durations to collect multiple target elements. In a visual foraging task, participants searched for and collected multiple targets among distractors of different relationships to the target colour. Distractors whose colour differed from the environment in the same direction as the targets reduced foraging efficiency to the same amount as distractors whose colour matched the target colour. Distractors that differed by the same colour distance but in the opposite direction of the target colour did not reduce efficiency. These findings provide evidence that search templates encode relational target features in naturalistic search tasks and suggest that attention guidance based on relational features is a common mode in dynamic, real-world search environments.

The association of targets modulates the search efficiency in multitarget searches

Previous studies have found that distractors can affect visual search efficiency when associated with the target in a single-target search. However, multitarget searches are frequently necessary in daily life. In the present study, we examined how the association of targets in a multitarget search affected performance when searching for two targets simultaneously (Experiment 1). In addition, we explored whether the association affected switch cost (Experiment 2) and preparation cost (Experiment 3). Participants were required to learn associations between different colors or shapes and then performed feature search and conjunction search tasks. For all experiments, the results of search efficiency showed that for conjunction search, the search efficiency under the associated condition was significantly higher than that under the neutral condition. Similarly, the response times in the associated condition were significantly faster than those in the neutral condition under the conjunction search condition in Experiments 1 and 2. However, in Experiment 3, the response times in the associated condition were longer than those in the neutral condition. These results indicate that the association between targets can improve the efficiency of multitarget searches. Furthermore, associations can reduce the time spent searching for individual targets and the switch cost; however, the preparation cost increases.

Never Gonna Give You Up Even When It Is Suboptimal

Previous research showed that animals adopt different foraging strategies in different environment settings. However, research on whether humans adapt their foraging strategies to the foraging environment has shown little evidence of a change in strategies. This study aims to investigate whether humans will adapt their foraging strategies when performance differences between strategies are large and why participants may fixate on a single strategy. We conducted two foraging experiments and identified the strategies used by the participants. Most participants used the Give-Up Time (GUT) strategy regardless of the environment they encountered. GUT was used even in environments where other strategies such as the Fixed-Time strategy or the Fixed-Number strategy performed better. Using computer simulations, we further examined the conditions under which the GUT strategy will perform well compared to the other strategies. We found that even though the GUT strategy is not always the best strategy, it performs consistently on a satisfactory level and had an advantage when variance in the quality of patches was introduced. The consistently good performance of the GUT strategy could thus explain participants' lack of strategy switching.

Mountains of memory in a sea of uncertainty: Sampling the external world despite useful information in visual working memory

A large part of research on visual working memory (VWM) has traditionally focused on estimating its maximum capacity. Yet, humans rarely need to load up their VWM maximally during natural behavior, since visual information often remains accessible in the external world. Recent work, using paradigms that take into account the accessibility of information in the outside world, has indeed shown that observers utilize only one or two items in VWM before sampling from the external world again. One straightforward interpretation of this finding is that, in daily behavior, much fewer items are memorized than the typically reported capacity limits. Here, we first investigate whether this lower reliance on VWM when information is externally accessible might instead reflect resampling before VWM is actually depleted. To this aim we devised an online task, in which participants copied a model (six items in a 4x4 grid; always accessible) in an adjacent empty 4x4 grid. A key aspect of our paradigm is that we (unpredictably) interrupted participants just before inspection of the model with a 2-alternative-forced-choice (2-AFC) question, probing their VWM content. Critically, we observed above-chance performance on probes appearing just before model inspection. This finding shows that the external world was resampled, despite VWM still containing relevant information. We then asked whether increasing the cost of sampling causes participants to load up more information in VWM or, alternatively, to squeeze out more information from VWM (at the cost of making more errors). To manipulate the cost of resampling, we made it more difficult (specifically, more time-consuming) to access the model. We show that with increased cost of accessing the model (which lead to fewer, but longer model inspections), participants could place more items correctly immediately after sampling, and they kept attempting to place items for longer after their first error. These findings demonstrate that participants both encoded more information in VWM and made attempts to squeeze out more information from VWM when sampling became more costly. We argue that human observers constantly evaluate how certain they are of their VWM contents, and only use that VWM content of which their certainty exceeds a context-dependent "action threshold". This threshold, in turn, depends on the trade-off between the cost of resampling and the benefits of making an action. We argue that considering the interplay between the available VWM contents and a context-dependent action threshold, is key for reconciling the traditional VWM literature with VWM use in our day-to-day behavior.

Maladaptive explore/exploit trade-offs in schizophrenia

Schizophrenia is a complex disorder that remains poorly understood, particularly at the systems level. In this opinion article we argue that the explore/exploit trade-off concept provides a holistic and ecologically valid framework to resolve some of the apparent paradoxes that have emerged within schizophrenia research. We review recent evidence suggesting that fundamental explore/exploit behaviors may be maladaptive in schizophrenia during physical, visual, and cognitive foraging. We also describe how theories from the broader optimal foraging literature, such as the marginal value theorem (MVT), could provide valuable insight into how aberrant processing of reward, context, and cost/effort evaluations interact to produce maladaptive responses.

Bayesian approximations to the theory of visual attention (TVA) in a foraging task

Foraging as a natural visual search for multiple targets has increasingly been studied in humans in recent years. Here, we aimed to model the differences in foraging strategies between feature and conjunction foraging tasks found by Á. Kristjánsson et al. Bundesen proposed the theory of visual attention (TVA) as a computational model of attentional function that divides the selection process into filtering and pigeonholing. The theory describes a mechanism by which the strength of sensory evidence serves to categorise elements. We combined these ideas to train augmented Naïve Bayesian classifiers using data from Á. Kristjánsson et al. as input. Specifically, we attempted to answer whether it is possible to predict how frequently observers switch between different target types during consecutive selections (switches) during feature and conjunction foraging using Bayesian classifiers. We formulated 11 new parameters that represent key sensory and bias information that could be used for each selection during the foraging task and tested them with multiple Bayesian models. Separate Bayesian networks were trained on feature and conjunction foraging data, and parameters that had no impact on the model's predictability were pruned away. We report high accuracy for switch prediction in both tasks from the classifiers, although the model for conjunction foraging was more accurate. We also report our Bayesian parameters in terms of their theoretical associations with TVA parameters, πj (denoting the pertinence value), and βi (denoting the decision-making bias).

Using Gaze for Behavioural Biometrics

A principled approach to the analysis of eye movements for behavioural biometrics is laid down. The approach grounds in foraging theory, which provides a sound basis to capture the uniqueness of individual eye movement behaviour. We propose a composite Ornstein-Uhlenbeck process for quantifying the exploration/exploitation signature characterising the foraging eye behaviour. The relevant parameters of the composite model, inferred from eye-tracking data via Bayesian analysis, are shown to yield a suitable feature set for biometric identification; the latter is eventually accomplished via a classical classification technique. A proof of concept of the method is provided by measuring its identification performance on a publicly available dataset. Data and code for reproducing the analyses are made available. Overall, we argue that the approach offers a fresh view on either the analyses of eye-tracking data and prospective applications in this field.

Visuospatial information foraging describes search behavior in learning latent environmental features

In the real world, making sequences of decisions to achieve goals often depends upon the ability to learn aspects of the environment that are not directly perceptible. Learning these so-called latent features requires seeking information about them. Prior efforts to study latent feature learning often used single decisions, used few features, and failed to distinguish between reward-seeking and information-seeking. To overcome this, we designed a task in which humans and monkeys made a series of choices to search for shapes hidden on a grid. On our task, the effects of reward and information outcomes from uncovering parts of shapes could be disentangled. Members of both species adeptly learned the shapes and preferred to select tiles expected to be informative earlier in trials than previously rewarding ones, searching a part of the grid until their outcomes dropped below the average information outcome-a pattern consistent with foraging behavior. In addition, how quickly humans learned the shapes was predicted by how well their choice sequences matched the foraging pattern, revealing an unexpected connection between foraging and learning. This adaptive search for information may underlie the ability in humans and monkeys to learn latent features to support goal-directed behavior in the long run.

Satisfaction of Search Can Be Ameliorated by Perceptual Learning: A Proof-of-Principle Study

When searching a visual image that contains multiple target objects of interest, human subjects often show a satisfaction of search (SOS) effect, whereby if the subjects find one target, they are less likely to find additional targets in the image. Reducing SOS or, equivalently, subsequent search miss (SSM), is of great significance in many real-world situations where it is of paramount importance to find all targets in a given image, not just one. However, studies have shown that even highly trained and experienced subjects, such as expert radiologists, are subject to SOS. Here, using the detection of camouflaged objects (or camouflage-breaking) as an illustrative case, we demonstrate that when naïve subjects are trained to detect camouflaged objects more effectively, it has the side effect of reducing subjects’ SOS. We tested subjects in the SOS task before and after they were trained in camouflage-breaking. During SOS testing, subjects viewed naturalistic scenes that contained zero, one, or two targets, depending on the image. As expected, before camouflage-training, subjects showed a strong SOS effect, whereby if they had found a target with relatively high visual saliency in a given image, they were less likely to have also found a lower-saliency target when one existed in the image. Subjects were then trained in the camouflage-breaking task to criterion using non-SOS images, i.e., camouflage images that contained zero or one target. Surprisingly, the trained subjects no longer showed significant levels of SOS. This reduction was specific to the particular background texture in which the subjects received camouflage training; subjects continued to show significant SOS when tested using a different background texture in which they did not receive camouflage training. A separate experiment showed that the reduction in SOS was not attributable to non-specific exposure or practice effects. Together, our results demonstrate that perceptual expertise can, in principle, reduce SOS, even when the perceptual training does not specifically target SOS reduction.

Advances in the application of a computational Theory of Visual Attention (TVA): Moving towards more naturalistic stimuli and game-like tasks

The theory of visual attention, “TVA”, is an influential and formal theory of attentional selection. It is widely applied in clinical assessment of attention and fundamental attention research. However, most TVA-based research is based on accuracy data from letter report experiments performed in controlled laboratory environments. While such basic approaches to questions regarding attentional selection are undoubtedly useful, recent technological advances have enabled the use of increasingly sophisticated experimental paradigms involving more realistic scenarios. Notably, these studies have in many cases resulted in different estimates of capacity limits than those found in studies using traditional TVA-based assessment. Here we review recent developments in TVA-based assessment of attention that goes beyond the use of letter report experiments and experiments performed in controlled laboratory environments. We show that TVA can be used with other tasks and new stimuli, that TVA-based parameter estimation can be embedded into complex scenarios, such as games that can be used to investigate particular problems regarding visual attention, and how TVA-based simulations of “visual foraging” can elucidate attentional control in more naturalistic tasks. We also discuss how these developments may inform future advances of TVA.

Foraging tempo: Human run patterns in multiple-target search are constrained by the rate of successive responses

Human foraging tasks are beginning to provide new insights into the roles of vision, attention, and working memory during complex, multiple-target search. Here, we test the idea that "foraging tempo"-the rate of successive target selections-helps determine patterns of behaviour in these tasks. Previously, we established that the majority of target selections during unconstrained foraging happen at regular, rapid intervals, forming the "cruise phase" of a foraging trial. Furthermore, we noted that when the temporal interval between cruise phase responses was longer, the tendency to switch between target categories increased. To directly explore this relationship, we modified our standard iPad foraging task so that observers had to synchronise each response with an auditory metronome signal. Across trials, we increased the tempo and examined how this changed patterns of foraging when targets were defined either by a single feature or by a conjunction of features. The results were very clear. Increasing tempo systematically decreased the tendency for participants to switch between target categories. Although this was true for both feature and conjunction trials, there was also evidence that time constraints and target complexity interacted. As in our previous work, we also observed clear individual differences in how participants responded to changes in task difficulty. Overall, our results show that foraging tempo does influence the way participants respond, and we suggest this parameter may prove to be useful in further explorations of group and individual strategies during multiple-target search.

Dynamics of attentional and oculomotor orienting in visual foraging tasks

A vast amount of research has been carried out to understand how humans visually search for targets in their environment. However, this research has typically involved search for one unique target among several distractors. Although this line of research has yielded important insights into the basic characteristics of how humans explore their visual environment, this may not be a very realistic model for everyday visual orientation. Recently, researchers have used multi-target displays to assess orienting in the visual field. Eye movements in such tasks are, however, less well understood. Here, we investigated oculomotor dynamics during four visual foraging tasks differing in target crypticity (feature-based foraging vs. conjunction-based foraging) and the effector type being used for target selection (mouse foraging vs. gaze foraging). Our results show that both target crypticity and effector type affect foraging strategies. These changes are reflected in oculomotor dynamics, feature foraging being associated with focal exploration (long fixations and short-amplitude saccades), and conjunction foraging with ambient exploration (short fixations and high-amplitude saccades). These results provide important new information for existing accounts of visual attention and oculomotor control and emphasise the usefulness of foraging tasks for a better understanding of how humans orient in the visual environment.

Foraging as sampling without replacement: A Bayesian statistical model for estimating biases in target selection

Foraging entails finding multiple targets sequentially. In humans and other animals, a key observation has been a tendency to forage in 'runs' of the same target type. This tendency is context-sensitive, and in humans, it is strongest when the targets are difficult to distinguish from the distractors. Many important questions have yet to be addressed about this and other tendencies in human foraging, and a key limitation is a lack of precise measures of foraging behaviour. The standard measures tend to be run statistics, such as the maximum run length and the number of runs. But these measures are not only interdependent, they are also constrained by the number and distribution of targets, making it difficult to make inferences about the effects of these aspects of the environment on foraging. Moreover, run statistics are underspecified about the underlying cognitive processes determining foraging behaviour. We present an alternative approach: modelling foraging as a procedure of generative sampling without replacement, implemented in a Bayesian multilevel model. This allows us to break behaviour down into a number of biases that influence target selection, such as the proximity of targets and a bias for selecting targets in runs, in a way that is not dependent on the number of targets present. Our method thereby facilitates direct comparison of specific foraging tendencies between search environments that differ in theoretically important dimensions. We demonstrate the use of our model with simulation examples and re-analysis of existing data. We believe our model will provide deeper insights into visual foraging and provide a foundation for further modelling work in this area.

The selection balance: Contrasting value, proximity and priming in a multitarget foraging task

A critical question in visual foraging concerns the mechanisms driving the next target selection. Observers first identify a set of candidate targets, and then select the best option among these candidates. Recent evidence suggests that target selection relies on internal biases towards proximity (nearest target from the last selection), priming (target from the same category as the last selection) and value (target associated with high value). Here, we tested the role of eye movements in target selection, and notably whether disabling eye movements during target selection could affect search strategy. We asked observers to perform four foraging tasks differing by selection modality and target value. During gaze foraging, participants had to accurately fixate the targets to select them and could not anticipate the next selection with their eyes, while during mouse foraging they selected the targets with mouse clicks and were free to move their eyes. We moreover manipulated both target value and proximity. Our results revealed notable individual differences in search strategy, confirming the existence of internal biases towards value, proximity and priming. Critically, there were no differences in search strategy between mouse and gaze foraging, suggesting that disabling eye movements during target selection did not affect foraging behaviour. These results importantly suggest that overt orienting is not necessary for target selection. This study provides fundamental information for theoretical conceptions of attentional selection, and emphasizes the importance of covert attention for target selection during visual foraging.

Sources of variation in search and foraging: A theoretical perspective

Search-the problem of exploring a space of alternatives to identify target goals-is a fundamental behaviour for many species. Although its foundation lies in foraging, most studies of human search behaviour have been directed towards understanding the attentional mechanisms that underlie the efficient visual exploration of two-dimensional (2D) scenes. With this review, we aim to characterise how search behaviour can be explained across a wide range of contexts, environments, spatial scales, and populations, both typical and atypical. We first consider the generality of search processes across psychological domains. We then review studies of interspecies differences in search. Finally, we explore in detail the individual and contextual variables that affect visual search and related behaviours in established experimental psychology paradigms. Despite the heterogeneity of the findings discussed, we identify that variations in control processes, along with the ability to regulate behaviour as a function of the structure of search space and the sampling processes adopted, to be central to explanations of variations in search behaviour. We propose a tentative theoretical model aimed at integrating these notions and close by exploring questions that remain unaddressed.

How to Read an Abdominal CT: Insights from the Visual and Cognitive Sciences Translated for Clinical Practice

When first learning abdominal CT studies, residents are often given little concrete, practical direction. There is, however, a large literature from the visual and cognitive sciences that can provide guidance towards search strategies that maximize efficiency and comprehensiveness. This literature has not penetrated radiology teaching to any great extent. In this article, we will examine the current pedagogy (and why that falls short), why untutored search fails, where misses occur in abdomen/pelvis CT, why these misses occur where they do, how expert radiologists search 3d image stacks, and how novices might expedite the acquisition of expertise.

Visualization as a stimulus domain for vision science

Traditionally, vision science and information/data visualization have interacted by using knowledge of human vision to help design effective displays. It is argued here, however, that this interaction can also go in the opposite direction: the investigation of successful visualizations can lead to the discovery of interesting new issues and phenomena in visual perception. Various studies are reviewed showing how this has been done for two areas of visualization, namely, graphical representations and interaction, which lend themselves to work on visual processing and the control of visual operations, respectively. The results of these studies have provided new insights into aspects of vision such as grouping, attentional selection and the sequencing of visual operations. More generally yet, such results support the view that the perception of visualizations can be a useful domain for exploring the nature of visual cognition, inspiring new kinds of questions as well as casting new light on the limits to which information can be conveyed visually.

Guided Search 6.0: An updated model of visual search

This paper describes Guided Search 6.0 (GS6), a revised model of visual search. When we encounter a scene, we can see something everywhere. However, we cannot recognize more than a few items at a time. Attention is used to select items so that their features can be "bound" into recognizable objects. Attention is "guided" so that items can be processed in an intelligent order. In GS6, this guidance comes from five sources of preattentive information: (1) top-down and (2) bottom-up feature guidance, (3) prior history (e.g., priming), (4) reward, and (5) scene syntax and semantics. These sources are combined into a spatial "priority map," a dynamic attentional landscape that evolves over the course of search. Selective attention is guided to the most active location in the priority map approximately 20 times per second. Guidance will not be uniform across the visual field. It will favor items near the point of fixation. Three types of functional visual field (FVFs) describe the nature of these foveal biases. There is a resolution FVF, an FVF governing exploratory eye movements, and an FVF governing covert deployments of attention. To be identified as targets or rejected as distractors, items must be compared to target templates held in memory. The binding and recognition of an attended object is modeled as a diffusion process taking > 150 ms/item. Since selection occurs more frequently than that, it follows that multiple items are undergoing recognition at the same time, though asynchronously, making GS6 a hybrid of serial and parallel processes. In GS6, if a target is not found, search terminates when an accumulating quitting signal reaches a threshold. Setting of that threshold is adaptive, allowing feedback about performance to shape subsequent searches. Simulation shows that the combination of asynchronous diffusion and a quitting signal can produce the basic patterns of response time and error data from a range of search experiments.

What do experts look at and what do experts find when reading mammograms?

Purpose: Radiologists sometimes fail to report clearly visible, clinically significant findings. Eye tracking can provide insight into the causes of such errors. Approach: We tracked eye movements of 17 radiologists, searching for masses in 80 mammograms (60 with masses). Results: Errors were classified using the Kundel et al. (1978) taxonomy: search errors (target never fixated), recognition errors (fixated < 500    ms ), or decision errors (fixated > 500    ms ). Error proportions replicated Krupinski (1996): search 25%, recognition 25%, and decision 50%. Interestingly, we found few differences between experts and residents in accuracy or eye movement metrics. Error categorization depends on the definition of the useful field of view (UFOV) around fixation. We explored different UFOV definitions, based on targeting saccades and search saccades. Targeting saccades averaged slightly longer than search saccades. Of most interest, we found that the probability that the eyes would move to the target on the next saccade or even on one of the next three saccades was strikingly low ( ∼ 33 % , even when the eyes were < 2    deg from the target). This makes it clear that observers do not fully process everything within a UFOV. Using a probabilistic UFOV, we find, unsurprisingly, that observers cover more of the image when no target is present than when it is found. Interestingly, we do not find evidence that observers cover too little of the image on trials when they miss the target. Conclusions: These results indicate that many errors in mammography reflect failed deployment of attention; not failure to fixate clinically significant locations.

The development of foraging organization

In foraging tasks, multiple targets must be found within a single display. The targets can be of one or more types, typically surrounded by numerous distractors. Visual attention has traditionally been studied with single target search tasks, but adding more targets to the search display results in several additional measures of interest, such as how attention is oriented to different features and locations over time. We measured foraging among five age groups: Children in Grades 1, 4, 7, and 10, as well as adults, using both simple feature foraging tasks and more challenging conjunction foraging tasks, with two target types per task. We assessed participants' foraging organization, or systematicity when selecting all the targets within the foraging display, on four measures: Intertarget distance, number of intersections, best-r, and the percentage above optimal path length (PAO). We found that foraging organization increases with age, in both simple feature-based foraging and more complex foraging for targets defined by feature conjunctions, and that feature foraging was more organized than conjunction foraging. Separate analyses for different target types indicated that children's, and to some extent adults', conjunction foraging consisted of two relatively organized foraging paths through the display where one target type is exhaustively selected before the other target type is selected. Lastly, we found that the development of foraging organization is closely related to the development of other foraging measures. Our results suggest that measuring foraging organization is a promising avenue for further research into the development of visual orienting.

The exploration-exploitation trade-off in a foraging task is affected by mood-related arousal and valence

The exploration-exploitation trade-off shows conceptual, functional, and neural analogies with the persistence-flexibility trade-off. We investigated whether mood, which is known to modulate the persistence-flexibility balance, would similarly affect the exploration-exploitation trade-off in a foraging task. More specifically, we tested whether interindividual differences in foraging behavior can be predicted by mood-related arousal and valence. In 119 participants, we assessed mood-related interindividual differences in exploration-exploitation using a foraging task that included minimal task constraints to reduce paradigm-induced biases of individual control tendencies. We adopted the marginal value theorem as a model-based analysis approach, which approximates optimal foraging behavior by tackling the patch-leaving problem. To assess influences of mood on foraging, participants underwent either a positive or negative mood induction. Throughout the experiment, we assessed arousal and valence levels as predictors for explorative/exploitative behavior. Our mood manipulation affected participants' arousal and valence ratings as expected. Moreover, mood-related arousal was found to predict exploration while valence predicted exploitation, which only partly matched our expectations and thereby the proposed conceptual overlap with flexibility and persistence, respectively. The current study provides a first insight into how processes related to arousal and valence differentially modulate foraging behavior. Our results imply that the relationship between exploration-exploitation and flexibility-persistence is more complicated than the semantic overlap between these terms might suggest, thereby calling for further research on the functional, neural, and neurochemical underpinnings of both trade-offs.

The Flows of Nature to People, and of People to Nature: Applying Movement Concepts to Ecosystem Services

To date, the provision of ecosystem services has largely been estimated based on spatial patterns of land cover alone, using benefit transfer analysis. Although it is increasingly being recognised that the distribution of the human population affects whether a potential service translates into a realised service, this misses key steps in the process and assumes that everyone accesses ecosystem services in the same way. Here we describe a conceptual approach to ecosystem services in terms of movement and flows. We highlight that ecosystem service flows can be broken down into ‘nature to people’ (the movement of nature towards beneficiaries) and ‘people to nature’ (the movement of beneficiaries towards nature). The former has been relatively well described. Here, we explore the latter by reviewing research on human migration, animal foraging and landscape connectivity. We assess if and how existing theories might be useful in describing how people seek out ecosystem services. We consider some of the ways in which flows of people to nature can be measured. Such measurements may reveal which movement theories best represent how people seek out and access ecosystem services. Overall, our review aims to improve the future modelling of ecosystem services by more explicitly considering how people access potential services and therefore realise them.

Target value and prevalence influence visual foraging in younger and older age

The prevalence and reward-value of targets have an influence on visual search. The strength of the effect of an item's reward-value on attentional selection varies substantially between individuals and is potentially sensitive to aging. We investigated individual and age differences in a hybrid foraging task, in which the prevalence and value of multiple target types was varied. Using optimal foraging theory measures, foraging was more efficient overall in younger than older observers. However, the influence of prevalence and value on target selections was similar across age groups, suggesting that the underlying cognitive mechanisms are preserved in older age. When prevalence was varied but target value was balanced, younger and older observers preferably selected the most frequent target type and were biased to select another instance of the previously selected target type. When value was varied, younger and older observers showed a tendency to select high-value targets, but preferences were more diverse between individuals. When value and prevalence were inversely related, some observers showed particularly strong preferences for high-valued target types, while others showed a preference for high-prevalent, albeit low-value, target types. In younger adults, individual differences in the selection choices correlated with a personality index, suggesting that avoiding selections of low-value targets may be related to reward-seeking behaviour.

The Predation Game: Does dividing attention affect patterns of human foraging?

Attention is known to play an important role in shaping the behaviour of both human and animal foragers. Here, in three experiments, we built on previous interactive tasks to create an online foraging game for studying divided attention in human participants exposed to the (simulated) risk of predation. Participants used a "sheep" icon to collect items from different target categories randomly distributed across the display. Each trial also contained "wolf" objects, whose movement was inspired by classic studies of multiple object tracking. When participants needed to physically avoid the wolves, foraging patterns changed, with an increased tendency to switch between target categories and a decreased ability to prioritise high reward targets, relative to participants who could safely ignore them. However, when the wolves became dangerous by periodically changing form (briefly having big eyes) instead of by approaching the sheep, foraging patterns were unaffected. Spatial disruption caused by the need to rapidly shift position-rather the cost of reallocating attention-therefore appears to influence foraging in this context. These results thus confirm that participants can efficiently alternate between target selection and tracking moving objects, replicating earlier single-target search findings. Future studies may need to increase the perceived risk or potential costs associated with simulated danger, in order to elicit the extended run behaviour predicted by animal models of foraging, but absent in the current data.

Keeping it real: Looking beyond capacity limits in visual cognition

Research within visual cognition has made tremendous strides in uncovering the basic operating characteristics of the visual system by reducing the complexity of natural vision to artificial but well-controlled experimental tasks and stimuli. This reductionist approach has for example been used to assess the basic limitations of visual attention, visual working memory (VWM) capacity, and the fidelity of visual long-term memory (VLTM). The assessment of these limits is usually made in a pure sense, irrespective of goals, actions, and priors. While it is important to map out the bottlenecks our visual system faces, we focus here on selected examples of how such limitations can be overcome. Recent findings suggest that during more natural tasks, capacity may be higher than reductionist research suggests and that separable systems subserve different actions, such as reaching and looking, which might provide important insights about how pure attentional or memory limitations could be circumvented. We also review evidence suggesting that the closer we get to naturalistic behavior, the more we encounter implicit learning mechanisms that operate "for free" and "on the fly." These mechanisms provide a surprisingly rich visual experience, which can support capacity-limited systems. We speculate whether natural tasks may yield different estimates of the limitations of VWM, VLTM, and attention, and propose that capacity measurements should also pass the real-world test within naturalistic frameworks. Our review highlights various approaches for this and suggests that our understanding of visual cognition will benefit from incorporating the complexities of real-world cognition in experimental approaches.

Gazing at Social Interactions Between Foraging and Decision Theory

Finding the underlying principles of social attention in humans seems to be essential for the design of the interaction between natural and artificial agents. Here, we focus on the computational modeling of gaze dynamics as exhibited by humans when perceiving socially relevant multimodal information. The audio-visual landscape of social interactions is distilled into a number of multimodal patches that convey different social value, and we work under the general frame of foraging as a tradeoff between local patch exploitation and landscape exploration. We show that the spatio-temporal dynamics of gaze shifts can be parsimoniously described by Langevin-type stochastic differential equations triggering a decision equation over time. In particular, value-based patch choice and handling is reduced to a simple multi-alternative perceptual decision making that relies on a race-to-threshold between independent continuous-time perceptual evidence integrators, each integrator being associated with a patch.

Eating disorder symptoms and foraging for food related items

BACKGROUND

Foraging tasks have recently been increasingly used to investigate visual attention. Visual attention can be biased when certain stimuli capture our attention, especially threatening or anxiety-provoking stimuli, but such effects have not been addressed in foraging studies.

METHODS

We measured potential attentional bias associated with eating disorder symptoms to food related stimuli with our previously developed iPad foraging task. Forty-four participants performed a foraging task where they were instructed to tap predesignated food related targets (healthy and unhealthy) and other non-food objects and completed four self-report questionnaires measuring symptoms of eating disorders. Participants were split into two groups based on their questionnaire scores, a symptom group and no symptom group.

RESULTS

The foraging results suggest that there are differences between the groups on switch costs and target selection times (intertarget times) but they were only statistically significant when extreme-group analyses (EGA) were used. There were also notable food versus non-food category effects in the foraging patterns.

CONCLUSIONS

The results suggest that foraging tasks of this sort can be used to assess attentional biases and we also speculate that they may eventually be used to treat them through attention bias modification. Additionally, the category effects that we see between food items and other items are highly interesting and encouraging. At the same time, task sensitivity will need to be improved. Finally, future tests of clinical samples could provide a clearer picture of the effects of eating disorder symptoms on foraging for food.

Traditional Food Environment and Factors Affecting Indigenous Food Consumption in Munda Tribal Community of Jharkhand, India

Indigenous food (IF) systems, derived from natural ecosystems are perceived to be sustainable and nutritionally adequate. Mundas, an indigenous tribal community in Jharkhand India, are surrounded by rich agroforestry resources, yet display high levels of malnutrition. Our study explored the food environment of Munda community, different IFs they accessed, levels of utilization of IFs in routine diets, their nutritional attributes and factors influencing IF consumption. A cross-sectional mixed-methods study was conducted in nine villages of Murhu and Torpa blocks in Khunti district, Jharkhand. Using focus group discussions and key informant interviews, we did free-listing of IFs known to the community. This was followed by enumerating preferred and little used/historically consumed IFs, along with reasons. Qualitative enquiries were recorded and transcribed verbatim; data were coded and analyzed using thematic framework approach. The listed IFs were identified through common names and photographs, and verified by ethnobotanist in the team. The nutritive values of identified IFs were searched in literature or nutritional analysis of specific plant based foods were undertaken in an accredited laboratory. The community demonstrated traditional ecological knowledge of several IFs (n = 194), which are accessed from wild, cultivated and built food environments. Taxonomic classification was available for 80% (n = 156) IFs, out of which 60 foods had nutritive values in secondary literature and 42 foods were analyzed in laboratory. Many IFs were rich in micronutrients like calcium, iron, folate, vitamin A and C. Among the listed IFs, only 45% were commonly consumed, while rest were little used/historically consumed. Factors like desirable taste, satiety, perceived nutrition benefits, adaptability to climate variability, traditional practice of food preservation and their cultural importance promoted IF consumption. However, local climatic impacts on agroforestry systems, easy access to foods bought from markets or distributed under government food security schemes, and promotion of hybrid seeds by local agricultural organizations, emerged as potential barriers. Thus, reinforcement of traditional ecological knowledge and informal food literacy, along with promotion of climate resilient attributes of IFs, can contribute to sustainable food systems in Munda community.

A meta-analytical and experimental examination of blood glucose effects on decision making under risk

Previous research has shown that short-term changes in blood glucose influence our preferences and may affect decisions about risk as well. However, consensus is lacking about whether and how blood glucose influences decision making under risk, and we conduct two experiments and a meta-analysis to examine this question in detail. In Study 1, using a pecuniary valuation method, we find no effect of blood glucose on willingness to pay for risky products that may act as allergens. In Study 2, using risky gambles, we find that low levels of blood glucose increase risk taking for food and to a lesser degree for non-food rewards. Combining our own and previous findings in a meta-analysis, we show that low levels of blood glucose on average increase risk taking about food. Low blood glucose does not increase risk taking about non-food rewards although this is subject to heterogeneity. Overall, our studies suggest that low blood glucose increases our willingness to gamble on how much food we can get, but not our willingness to eat food that can harm us. Our findings are best explained by the energy budget rule.

Foraging with Anne Treisman: Features versus conjunctions, patch leaving and memory for foraged locations

Foraging tasks are increasingly used to investigate human visual attention as they may provide a more dynamic and multifaceted picture of attentional orienting than more traditionally used visual search tasks. A common way of assessing foraging performance involves measuring when foragers decide to move to a new "patch" with a higher yield. We assessed this using Anne Treisman's famous feature versus conjunction manipulation in an iPad foraging task. We measured how well patch leaving accorded with the predictions of the marginal value theorem that describes how foragers may optimize their foraging by leaving a patch once the average yield within a patch drops below the average yield in the whole environment. Human foraging in our paradigm deviated from the predictions of such optimal foraging conceptions, and our participants kept on foraging within the same patch for longer than expected. Patch leaving and intertarget times differed surprisingly little between feature and conjunction foraging, especially in light of the dramatic differences typically seen between performance on feature and conjunction visual search tasks. Other aspects of foraging performance (run number and switch costs) differed strongly between feature and conjunction foraging, however. We conclude that human foraging is probably influenced by too many factors to be captured with a relatively simple mathematical model.

Which search are you on? Adapting to color while searching for shape

Human observers adjust their attentional control settings when searching for a target in the presence of predictable changes in the target-defining feature dimension. We investigated whether observers also adapt to changes in a nondefining target dimension. According to feature integration theory, stimuli that are unique in their environment in a single feature dimension can be detected with little effort. In two experiments, we studied how observers searching for such singletons adapt their attentional control settings to a dynamical change in a nondefining target dimension. Participants searched for a shape singleton and freely chose between two targets in each trial. The two targets differed in color, and the ratio of distractors colored like each target varied dynamically across trials. A model-based analysis with a Bayesian estimation approach showed that participants adapted their target choices to the color ratio: They tended to select the target from the smaller color subset, and switched their preference both when the color ratio changed between gray and heterogeneous colors (Exp. 1) and when it changed between red and blue (Exp. 2). Participants thus tuned their attentional control settings toward color, although the target was defined by shape. We concluded that observers spontaneously adapted their behavior to changing regularities in the environment. Because adaptation was more pronounced when color homogeneity allowed for element grouping, we suggest that observers adapt to regularities that can be registered without attentional resources. They do so even if the changes are not relevant for accomplishing the task-a process presumably based on statistical learning.

Visual Search: How Do We Find What We Are Looking For?

In visual search tasks, observers look for targets among distractors. In the lab, this often takes the form of multiple searches for a simple shape that may or may not be present among other items scattered at random on a computer screen (e.g., Find a red T among other letters that are either black or red.). In the real world, observers may search for multiple classes of target in complex scenes that occur only once (e.g., As I emerge from the subway, can I find lunch, my friend, and a street sign in the scene before me?). This article reviews work on how search is guided intelligently. I ask how serial and parallel processes collaborate in visual search, describe the distinction between search templates in working memory and target templates in long-term memory, and consider how searches are terminated.

Rethinking Space: A Review of Perception, Attention, and Memory in Scene Processing

Scene processing is fundamentally influenced and constrained by spatial layout and spatial associations with objects. However, semantic information has played a vital role in propelling our understanding of real-world scene perception forward. In this article, we review recent advances in assessing how spatial layout and spatial relations influence scene processing. We examine the organization of the larger environment and how we take full advantage of spatial configurations independently of semantic information. We demonstrate that a clear differentiation of spatial from semantic information is necessary to advance research in the field of scene processing.