Five Factors that Guide Attention in Visual Search

Attention capture by episodic long-term memory

Everyday behavior depends upon the operation of concurrent cognitive processes. In visual search, studies that examine memory-attention interactions have indicated that long-term memory facilitates search for a target (e.g., contextual cueing), but the potential for memories to capture attention and decrease search efficiency has not been investigated. To address this gap in the literature, five experiments were conducted to examine whether task-irrelevant encoded objects might capture attention. In each experiment, participants encoded scene-object pairs. Then, in a visual search task, 6-object search displays were presented and participants were told to make a single saccade to targets defined by shape (e.g., diamond among differently colored circles; Experiments 1, 4, and 5) or by color (e.g., blue shape among differently shaped gray objects; Experiments 2 and 3). Sometimes, one of the distractors was from the encoded set, and occasionally the scene that had been paired with that object was presented prior to the search display. Results indicated that eye movements were made, in error, more often to encoded distractors than to baseline distractors, and that this effect was greatest when the corresponding scene was presented prior to search. When capture did occur, participants looked longer at encoded distractors if scenes had been presented, an effect that we attribute to the representational match between a retrieved associate and the identity of the encoded distractor in the search display. In addition, the presence of a scene resulted in slower saccade deployment when participants made first saccades to targets, as instructed. Experiments 4 and 5 suggest that this slowdown may be due to the relatively rare and therefore, surprising, appearance of visual stimulus information prior to search. Collectively, results suggest that information encoded into episodic memory can capture attention, which is consistent with the recent proposal that selection history can guide attentional selection.

Prior target locations attract overt attention during search

A key question about visual search is how we guide attention to objects that are relevant to our goals. Traditionally, theories of visual attention have emphasized guidance by explicit knowledge of the target feature. But there is growing evidence that attention is also implicitly guided by prior experience. One such example is the phenomenon of location priming, whereby attention is automatically allocated to the location where the search target was previously found. Problematically, much of the previous evidence for location priming has been disputed because it relies exclusively on manual response time, making unclear the relative contribution of location priming on attentional allocation and later cognitive processes. The current study addressed this issue by measuring shifts of gaze, which provide a more direct measure of attentional orienting. In five experiments, first saccades were strongly attracted to the target location from the previous trial, even though this location was not predictive of the target location on the current trial. This oculomotor priming effect was so strong that it effectively disrupted attentional guidance to the search target. The results suggest that memories of recent experience can powerfully influence attentional allocation.

Crossmodal learning of target-context associations: When would tactile context predict visual search?

It is well established that statistical learning of visual target locations in relation to constantly positioned visual distractors facilitates visual search. In the present study, we investigated whether such a contextual-cueing effect would also work crossmodally, from touch onto vision. Participants responded to the orientation of a visual target singleton presented among seven homogenous visual distractors. Four tactile stimuli, two to different fingers of each hand, were presented either simultaneously with or prior to the visual stimuli. The identity of the stimulated fingers provided the crossmodal context cue: in half of the trials, a given visual target location was consistently paired with a given tactile configuration. The visual stimuli were presented above the unseen fingers, ensuring spatial correspondence between vision and touch. We found no evidence of crossmodal contextual cueing when the two sets of items (tactile, visual) were presented simultaneously (Experiment 1). However, a reliable crossmodal effect emerged when the tactile distractors preceded the onset of visual stimuli 700 ms (Experiment 2). But crossmodal cueing disappeared again when, after an initial learning phase, participants flipped their hands, making the tactile distractors appear at different positions in external space while their somatotopic positions remained unchanged (Experiment 3). In all experiments, participants were unable to explicitly discriminate learned from novel multisensory arrays. These findings indicate that search-facilitating context memory can be established across vision and touch. However, in order to guide visual search, the (predictive) tactile configurations must be remapped from their initial somatotopic into a common external representational format.

MILO Mobile: An iPad App to Measure Search Performance in Multi-Target Sequences

This article introduces a mobile app version of the Multi-Item Localization (MILO) task. The MILO task was designed to explore the temporal context of search through a sequence and has proven useful in both basic and applied research settings. Here, we describe the basic features of the app and how it can be obtained, installed, and modified. We also provide example data files and present two new sets of empirical data to verify that previous findings concerning prospective planning and retrospective memory (i.e., inhibitory tagging) are reproducible with the app. We conclude by discussing ongoing studies and future modifications that illustrate the flexibility and potential of the MILO Mobile app.

Principles of tactile search over the body

Although we routinely experience complex tactile patterns over our entire body, how we selectively experience multisite touch over our bodies remains poorly understood. Here, we characterized tactile search behavior over the full body using a tactile analog of the classic visual search task. On each trial, participants judged whether a target stimulus (e.g., 10-Hz vibration) was present or absent anywhere on the body. When present, the target stimulus could occur alone or simultaneously with distractor stimuli (e.g., 30-Hz vibrations) on other body locations. We systematically varied the number and spatial configurations of the distractors as well as the target and distractor frequencies and measured the impact of these factors on tactile search response times. First, we found that response times were faster on target-present trials compared with target-absent trials. Second, response times increased with the number of stimulated sites, suggesting a serial search process. Third, search performance differed depending on stimulus frequencies. This frequency-dependent behavior may be related to perceptual grouping effects based on timing cues. We constructed linear models to explore how the locations of the target and distractor cues influenced tactile search behavior. Our modeling results reveal that, in isolation, cues on the index fingers make relatively greater contributions to search performance compared with stimulation experienced on other body sites. Additionally, costimulation of sites within the same limb or simply on the same body side preferentially influence search behavior. Our collective findings identify some principles of attentional search that are common to vision and touch, but others that highlight key differences that may be unique to body-based spatial perception.NEW & NOTEWORTHY Little is known about how we selectively experience multisite touch patterns over the body. Using a tactile analog of the classic visual target search paradigm, we show that tactile search behavior for flutter cues is generally consistent with a serial search process. Modeling results reveal the preferential contributions of index finger stimulation and two-site stimulus interactions involving ipsilateral patterns and within-limb patterns. Our results offer initial evidence for spatial and temporal principles underlying tactile search behavior over the body.

Preparatory Template Activation during Search for Alternating Targets

Visual search is guided by representations of target-defining features (attentional templates). We tracked the time course of template activation processes during the preparation for search in a task where the identity of color-defined search targets switched across successive trials (ABAB). Task-irrelevant color probes that matched either the upcoming relevant target color or the previous now-irrelevant target color were presented every 200 msec during the interval between search displays. N2pc components (markers of attentional capture) were measured for both types of probes at each time point. A reliable probe N2pc indicates that the corresponding color template is active at the time when the probe appears. N2pcs of equal size emerged from 1000 msec before search display onset for both relevant-color and irrelevant-color probes, demonstrating that both color templates were activated concurrently. Evidence for color-selective attentional control was found only immediately before the arrival of the search display, where N2pcs were larger for relevant-color probes. These results reveal important limitations in the executive control of search preparation in tasks where two targets alternate across trials. Although the identity of the upcoming target is fully predictable, both task-relevant and task-irrelevant target templates are coactivated. Knowledge about target identity selectively biases these template activation processes in a temporally discrete fashion, guided by temporal expectations about when the target template will become relevant.

Space of preattentive shape features

Four decades of studies in visual attention and visual working memory used visual features such as colors, orientations, and shapes. The layout of their featural space is clearly established for most features (e.g., CIE-Lab for colors) but not shapes. Here, I attempted to reveal the basic dimensions of preattentive shape features by studying how shapes can be positioned relative to one another in a way that matches their perceived similarities. Specifically, 14 shapes were optimized as n-dimensional vectors to achieve the highest linear correlation (r) between the log-distances between C (14, 2) = 91 pairs of shapes and the discriminabilities (d') of these 91 pairs in a texture segregation task. These d' values were measured on a large sample (N = 200) and achieved high reliability (Cronbach's α = 0.982). A vast majority of variances in the results (r = 0.974) can be explained by a three-dimensional SCI shape space: segmentability, compactness, and spikiness.

Visual search inverts the classic Stroop asymmetry

The Stroop effect is typically much larger than the reverse Stroop effect. One explanation for this asymmetry asserts that interference between the attended feature and an incongruent unattended feature depends on which feature is more strongly associated with the processing typically needed to complete the task. Accordingly, because identification of the target's color or the target word (as in the traditional Stroop paradigm) is more strongly associated with verbal processing than visual processing, the target's meaning should interfere with identification of the target's color (Stroop) more than vice versa (reverse Stroop). In contrast, localization is more strongly associated with visual processing, so strength-of-association predicts that the target's color should interfere with localizing the target word (reverse Stroop) more than vice versa (Stroop). Experiments 1 and 2 supported the strength-of-association account: compared to Stroop, the reverse Stroop effect was smaller for an identification task, but larger for a localization task. Because overall responses were slower for the reverse Stroop condition than the Stroop condition in Experiment 2, we entertained two alternative explanations for the reverse Stroop effect being larger than the Stroop effect. Experiments 3 and 4 showed that the larger reverse Stroop effect could not have been due to scaling, and Experiment 5 showed that it could not have been due to covert translation. Taken together, these experiments demonstrate the role of strength of association in generating the classic Stroop asymmetry, and pave the way for future exploration of the reverse Stroop effect using localization tasks.

Automatic Attention Capture by Threatening, But Not by Semantically Incongruent Natural Scene Images

Visual objects are typically perceived as parts of an entire visual scene, and the scene’s context provides information crucial in the object recognition process. Fundamental insights into the mechanisms of context-object integration have come from research on semantically incongruent objects, which are defined as objects with a very low probability of occurring in a given context. However, the role of attention in processing of the context-object mismatch remains unclear, with some studies providing evidence in favor, but other against an automatic capture of attention by incongruent objects. Therefore, in the present study, 25 subjects completed a dot-probe task, in which pairs of scenes—congruent and incongruent or neutral and threatening—were presented as task-irrelevant distractors. Importantly, threatening scenes are known to robustly capture attention and thus were included in the present study to provide a context for interpretation of results regarding incongruent scenes. Using N2 posterior-contralateral ERP component as a primary measure, we revealed that threatening images indeed capture attention automatically and rapidly, but semantically incongruent scenes do not benefit from an automatic attentional selection. Thus, our results suggest that identification of the context-object mismatch is not preattentive.

Attentional repulsion effects produced by feature-guided shifts of attention

Attention shifts to particular objects in the visual field can distort perceptual location judgments. Visual stimuli are perceived to be shifted away from the current focus of attention (the attentional repulsion effect [ARE]). Although links between repulsion effects and stimulus-driven exogenous attentional capture have been demonstrated conclusively, it remains disputed whether AREs can also be elicited as a result of feature-guided attention shifts that are controlled by endogenous task sets. Here we demonstrate that this is indeed the case. Color singleton cues that appeared together with equiluminant gray items triggered repulsion effects only if they matched a current task-relevant color but not when their color was irrelevant. When target-color and nontarget-color singleton cues appeared in the same display, AREs emerged relative to the position of the target-color cue. By obtaining independent behavioral measures of perceptual repulsion and electrophysiological measures of attentional capture by target-color cues, we also showed that these two phenomena are correlated. Individuals who were more susceptible to attentional capture also produced larger AREs. These results confirm the existence of links between task-set contingent attentional capture and AREs. They also provide the first direct demonstration of the attentional nature of these effects with online brain activity measures: perceptual repulsion arises as the result of prior feature-guided attention shifts to specific locations in the visual field.

Expertise effects on attention and eye-movement control during visual search: Evidence from the domain of music reading

Experts in many domains use their domain-specific knowledge to rapidly locate relevant information. To explore this ability in music reading, we contrasted the eye movements of 30 expert musicians (with at least 10 years of music reading training) and 30 non-musicians (who could not read music) while they completed a visual search task that required them to match a section of a complex piano music score (i.e., the search template) to its identical counterpart within a larger music score (i.e., the search array). Critically, both the search template and array were presented simultaneously throughout each trial in the experiment, which allowed for visual comparisons between the search template and the array. Relative to the non-musicians, the experts had higher accuracy and also spent more time looking at the relevant regions and less time looking at irrelevant regions. Also, as evidence that the experts and non-musicians adopted qualitatively different search strategies, the experts spent more time than non-musicians looking at the search template at the beginning of the trial, and the experts returned to this region less often than non-musicians. Taken together, our results indicate that experts use domain-specific knowledge in the form of "chunks" (Chase & Simon, 1973a, 1973b) and "templates" (Gobet & Simon, 1996b, 2000) to acquire accurate representations of highly complex search templates.

Gist processing in digital breast tomosynthesis

Evans et al. (2016) showed that radiologists can classify the mammograms as normal or abnormal at above-chance levels after a 250-ms exposure. Our study documents a similar gist signal in digital breast tomosynthesis (DBT) images. DBT is a relatively new technology that creates a three-dimensional image set of slices through the volume of the breast. It improves performance over two-dimensional (2-D) mammography but at a cost in reading time. In the experiment presented, radiologists ( N = 16 ) viewed "movies" of DBT images from single breasts for an average of 1.5 s per case. Observers then marked the most likely lesion position on a blank outline and rated each case on a six-point scale from (1) certainly normal to (6) certainly recall. Results show that radiologists can discriminate normal from abnormal DBT cases at above-chance levels as in 2-D mammography. Ability was correlated with experience reading DBT. Observers performed at above-chance levels, even on those images where they could not localize the target, suggesting that this is a global signal that could prove valuable in the clinic.

What Can Computational Models Learn From Human Selective Attention? A Review From an Audiovisual Unimodal and Crossmodal Perspective

Selective attention plays an essential role in information acquisition and utilization from the environment. In the past 50 years, research on selective attention has been a central topic in cognitive science. Compared with unimodal studies, crossmodal studies are more complex but necessary to solve real-world challenges in both human experiments and computational modeling. Although an increasing number of findings on crossmodal selective attention have shed light on humans' behavioral patterns and neural underpinnings, a much better understanding is still necessary to yield the same benefit for intelligent computational agents. This article reviews studies of selective attention in unimodal visual and auditory and crossmodal audiovisual setups from the multidisciplinary perspectives of psychology and cognitive neuroscience, and evaluates different ways to simulate analogous mechanisms in computational models and robotics. We discuss the gaps between these fields in this interdisciplinary review and provide insights about how to use psychological findings and theories in artificial intelligence from different perspectives.

Novelty competes with saliency for attention

A highly debated question in attention research is to what extent attention is biased by bottom-up factors such as saliency versus top-down factors as governed by the task. Visual search experiments in which participants are briefly familiarized with the task and then see a novel stimulus unannounced and for the first time support yet another factor, showing that novel and surprising features attract attention. In the present study, we tested whether gaze behavior as an indicator for attentional prioritization can be predicted accurately within displays containing both salient and novel stimuli by means of a priority map that assumes novelty as an additional source of activation. To that aim, we conducted a visual search experiment where a color singleton was presented for the first time in the surprise trial and manipulated the color-novelty of the remaining non-singletons between participants. In one group, the singleton was the only novel stimulus ("one-new"), whereas in another group, the non-singleton stimuli were likewise novel ("all-new"). The surprise trial was always target absent and designed such that top-down prioritization of any color was unlikely. The results show that the singleton in the all-new group captured the gaze less strongly, with more early fixations being directed to the novel non-singletons. Overall, the fixation pattern can accurately be explained by noisy priority maps where saliency and novelty compete for gaze control.

Search and concealment strategies in the spatiotemporal domain

Although visual search studies have primarily focused on search behavior, concealment behavior is also important in the real world. However, previous studies in this regard are limited in that their findings about search and concealment strategies are restricted to the spatial (two-dimensional) domain. Thus, this study evaluated strategies during three-dimensional and temporal (i.e., spatiotemporal) search and concealment to determine whether participants would indicate where they would hide or find a target in a temporal sequence of items. The items were stacked in an upward (Experiments 1-3) or downward (Experiment 4) direction and three factors were manipulated: scenario (hide vs. seek), partner type (friend vs. foe), and oddball (unique item in the sequence; present vs. absent). Participants in both the hide and seek scenarios frequently selected the oddball for friends but not foes, which suggests that they applied common strategies because the oddball automatically attracts attention and can be readily discovered by friends. Additionally, a principle unique to the spatiotemporal domain was revealed, i.e., when the oddball was absent, participants in both scenarios frequently selected the topmost item of the stacked layer for friends, regardless of temporal order, whereas they selected the first item in the sequence for foes, regardless of the stacked direction. These principles were not affected by visual masking or number of items in the sequence. Taken together, these results suggest that finding and hiding positions in the spatiotemporal domain rely on the presence of salient items and physical accessibility or temporal remoteness, according to partner type.

Extra-foveal Processing of Object Semantics Guides Early Overt Attention During Visual Search

Eye-tracking studies using arrays of objects have demonstrated that some high-level processing of object semantics can occur in extra-foveal vision, but its role on the allocation of early overt attention is still unclear. This eye-tracking visual search study contributes novel findings by examining the role of object-to-object semantic relatedness and visual saliency on search responses and eye-movement behaviour across arrays of increasing size (3, 5, 7). Our data show that a critical object was looked at earlier and for longer when it was semantically unrelated than related to the other objects in the display, both when it was the search target (target-present trials) and when it was a target's semantically related competitor (target-absent trials). Semantic relatedness effects manifested already during the very first fixation after array onset, were consistently found for increasing set sizes, and were independent of low-level visual saliency, which did not play any role. We conclude that object semantics can be extracted early in extra-foveal vision and capture overt attention from the very first fixation. These findings pose a challenge to models of visual attention which assume that overt attention is guided by the visual appearance of stimuli, rather than by their semantics.

Scene memory and spatial inhibition in visual search : A neural dynamic process model and new experimental evidence

Any object-oriented action requires that the object be first brought into the attentional foreground, often through visual search. Outside the laboratory, this would always take place in the presence of a scene representation acquired from ongoing visual exploration. The interaction of scene memory with visual search is still not completely understood. Feature integration theory (FIT) has shaped both research on visual search, emphasizing the scaling of search times with set size when searches entail feature conjunctions, and research on visual working memory through the change detection paradigm. Despite its neural motivation, there is no consistently neural process account of FIT in both its dimensions. We propose such an account that integrates (1) visual exploration and the building of scene memory, (2) the attentional detection of visual transients and the extraction of search cues, and (3) visual search itself. The model uses dynamic field theory in which networks of neural dynamic populations supporting stable activation states are coupled to generate sequences of processing steps. The neural architecture accounts for basic findings in visual search and proposes a concrete mechanism for the integration of working memory into the search process. In a behavioral experiment, we address the long-standing question of whether both the overall speed and the efficiency of visual search can be improved by scene memory. We find both effects and provide model fits of the behavioral results. In a second experiment, we show that the increase in efficiency is fragile, and trace that fragility to the resetting of spatial working memory.

The Decline in Intrinsic Connectivity Between the Salience Network and Locus Coeruleus in Older Adults: Implications for Distractibility

We examined functional connectivity between the locus coeruleus (LC) and the salience network in healthy young and older adults to investigate why people become more prone to distraction with age. Recent findings suggest that the LC plays an important role in focusing processing on salient or goal-relevant information from multiple incoming sensory inputs (Mather et al., 2016). We hypothesized that the connection between LC and the salience network declines in older adults, and therefore the salience network fails to appropriately filter out irrelevant sensory signals. To examine this possibility, we used resting-state-like fMRI data, in which all task-related activities were regressed out (Fair et al., 2007; Elliott et al., 2019) and performed a functional connectivity analysis based on the time-course of LC activity. Older adults showed reduced functional connectivity between the LC and salience network compared with younger adults. Additionally, the salience network was relatively more coupled with the frontoparietal network than the default-mode network in older adults compared with younger adults, even though all task-related activities were regressed out. Together, these findings suggest that reduced interactions between LC and the salience network impairs the ability to prioritize the importance of incoming events, and in turn, the salience network fails to initiate network switching (e.g., Menon and Uddin, 2010; Uddin, 2015) that would promote further attentional processing. A chronic lack of functional connection between LC and salience network may limit older adults' attentional and executive control resources.

Assessing introspective awareness of attention capture

Visual attention can sometimes be involuntarily captured by salient stimuli, and this may lead to impaired performance in a variety of real-world tasks. If observers were aware that their attention was being captured, they might be able to exert control and avoid subsequent distraction. However, it is unknown whether observers can detect attention capture when it occurs. In the current study, participants searched for a target shape and attempted to ignore a salient color distractor. On a subset of trials, participants then immediately classified whether the salient distractor captured their attention ("capture" vs. "no capture"). Participants were slower and less accurate at detecting the target on trials on which they reported "capture" than "no capture." Follow-up experiments revealed that participants specifically detected covert shifts of attention to the salient item. Altogether, these results indicate that observers can have immediate awareness of visual distraction, at least under certain circumstances.

Attentional Orienting by Non-informative Cue Is Shaped via Reinforcement Learning

It has been demonstrated that a reward-associated stimulus feature captures attention involuntarily. The present study tested whether spatial attentional orienting is biased via reinforcement learning. Participants were to identify a target stimulus presented in one of two placeholders, preceded by a non-informative arrow cue at the center of the display. Importantly, reward was available when the target occurred at a location cued by a reward cue, defined as a specific color (experiments 1 and 3) or a color-direction combination (experiment 2). The attentional bias of the reward cue was significantly increased as trials progressed, resulting in a greater cue-validity effect for the reward cue than the no-reward cue. This attentional bias was still evident even when controlling for the possibility that the incentive salience of the reward cue color modulates the cue-validity effect (experiment 2) or when the reward was withdrawn after reinforcement learning (experiment 3). However, it disappeared when the reward was provided regardless of cue validity (experiment 4), implying that the reinforcement contingency between reward and attentional orienting is a critical determinant of reinforcement learning-based spatial attentional modulation. Our findings highlight that a spatial attentional bias is shaped by value via reinforcement learning.

Fighting Left Handers Promotes Different Visual Perceptual Strategies than Right Handers: The Study of Eye Movements of Foil Fencers in Attack and Defence

Left handers have long held the edge over right handers in one-on-one interactive combat sports. Particularly in fencing, top rankings show a relatively strong overrepresentation of left handers over right handers. Whether this can be attributed to perceptual strategies used by fencers in their bouts remains to be established. This study aims to verify whether right-handed fencers assess their opponents' behaviour based on different perceptual strategies when fencing a left vs. right hander. Twelve top-level (i.e., Olympic fencers, Junior World Team Fencing Champions, and top Polish senior foil fencers) right-handed female foil fencers (aged 16-30 years) took part in the study. They performed a total of 40 actions: 10 repetitions of offensive actions (attack) and 10 repetitions of defensive actions (defence), each type of action performed under 2 conditions (right- vs. left-handed opponent). While the participants were fencing, their eye movements were being recorded with a remote eye-tracker (SMI ETG 2.0). Both in their offensive and defensive actions, the fencers produced more fixations to the armed hand and spent more time observing the armed hand in duels with a left-handed (vs. right-handed) opponent. In defence, it was also the guard that attracted more fixations and gained a longer observation time in bouts with a left hander. In duels with a right-handed opponent, a higher number of fixations in attack and in defence, and longer observation times in defence were found for the upper torso. The results may point to different perceptual strategies employed in bouts with left- vs. right-handed individuals. The findings from this study may help to promote the implementation of specialized perceptual training programmes in foil fencing.

Distinguishing between parallel and serial processing in visual attention from neurobiological data

Serial and parallel processing in visual search have been long debated in psychology, but the processing mechanism remains an open issue. Serial processing allows only one object at a time to be processed, whereas parallel processing assumes that various objects are processed simultaneously. Here, we present novel neural models for the two types of processing mechanisms based on analysis of simultaneously recorded spike trains using electrophysiological data from prefrontal cortex of rhesus monkeys while processing task-relevant visual displays. We combine mathematical models describing neuronal attention and point process models for spike trains. The same model can explain both serial and parallel processing by adopting different parameter regimes. We present statistical methods to distinguish between serial and parallel processing based on both maximum likelihood estimates and decoding the momentary focus of attention when two stimuli are presented simultaneously. Results show that both processing mechanisms are in play for the simultaneously recorded neurons, but neurons tend to follow parallel processing in the beginning after the onset of the stimulus pair, whereas they tend to serial processing later on.

Deadeye Visualization Revisited: Investigation of Preattentiveness and Applicability in Virtual Environments

Visualizations rely on highlighting to attract and guide our attention. To make an object of interest stand out independently from a number of distractors, the underlying visual cue, e.g., color, has to be preattentive. In our prior work, we introduced Deadeye as an instantly recognizable highlighting technique that works by rendering the target object for one eye only. In contrast to prior approaches, Deadeye excels by not modifying any visual properties of the target. However, in the case of 2D visualizations, the method requires an additional setup to allow dichoptic presentation, which is a considerable drawback. As a follow-up to requests from the community, this paper explores Deadeye as a highlighting technique for 3D visualizations, because such stereoscopic scenarios support dichoptic presentation out of the box. Deadeye suppresses binocular disparities for the target object, so we cannot assume the applicability of our technique as a given fact. With this motivation, the paper presents quantitative evaluations of Deadeye in VR, including configurations with multiple heterogeneous distractors as an important robustness challenge. After confirming the preserved preattentiveness (all average accuracies above 90%) under such real-world conditions, we explore VR volume rendering as an example application scenario for Deadeye. We depict a possible workflow for integrating our technique, conduct an exploratory survey to demonstrate benefits and limitations, and finally provide related design implications.

Attention and binding in visual working memory: Two forms of attention and two kinds of buffer storage

We review our research on the episodic buffer in the multicomponent model of working memory (Baddeley, 2000), making explicit the influence of Anne Treisman's work on the way our research has developed. The crucial linking theme concerns binding, whereby the individual features of an episode are combined as integrated representations. We summarize a series of experiments on visual working memory that investigated the retention of feature bindings and individual features. The effects of cognitive load, perceptual distraction, prioritization, serial position, and their interactions form a coherent pattern. We interpret our findings as demonstrating contrasting roles of externally driven and internally driven attentional processes, as well as a distinction between visual buffer storage and the focus of attention. Our account has strong links with Treisman's concept of focused attention and aligns with a number of contemporary approaches to visual working memory.

Transport properties of random walks under stochastic noninstantaneous resetting

Random walks with stochastic resetting provides a treatable framework to study interesting features about central-place motion. In this work, we introduce noninstantaneous resetting as a two-state model being a combination of an exploring state where the walker moves randomly according to a propagator and a returning state where the walker performs a ballistic motion with constant velocity towards the origin. We study the emerging transport properties for two types of reset time probability density functions (PDFs): exponential and Pareto. In the first case, we find the stationary distribution and a general expression for the stationary mean-square displacement (MSD) in terms of the propagator. We find that the stationary MSD may increase, decrease or remain constant with the returning velocity. This depends on the moments of the propagator. Regarding the Pareto resetting PDF we also study the stationary distribution and the asymptotic scaling of the MSD for diffusive motion. In this case, we see that the resetting modifies the transport regime, making the overall transport subdiffusive and even reaching a stationary MSD, i.e., a stochastic localization. This phenomena is also observed in diffusion under instantaneous Pareto resetting. We check the main results with stochastic simulations of the process.

Alzheimer's Disease, Visual Search, and Instrumental Activities of Daily Living: A Review and a New Perspective on Attention and Eye Movements

Many instrumental activities of daily living (IADLs), like cooking and managing finances and medications, involve finding efficiently and in a timely manner one or several objects within complex environments. They may thus be disrupted by visual search deficits. These deficits, present in Alzheimer's disease (AD) from its early stages, arise from impairments in multiple attentional and memory mechanisms. A growing body of research on visual search in AD has examined several factors underlying search impairments in simple arrays. Little is known about how AD patients search in real-world scenes and in real settings, and about how such impairments affect patients' functional autonomy. Here, we review studies on visuospatial attention and visual search in AD. We then consider why analysis of patients' oculomotor behavior is promising to improve understanding of the specific search deficits in AD, and of their role in impairing IADL performance. We also highlight why paradigms developed in research on real-world scenes and real settings in healthy individuals are valuable to investigate visual search in AD. Finally, we indicate future research directions that may offer new insights to improve visual search abilities and autonomy in AD patients.

Spatiotemporal Characteristics of 360-Degree Basic Attention

The spatiotemporal characteristics of basic attention are important for understanding attending behaviours in real-life situations, and they are useful for evaluating the accessibility of visual information. However, although people are encircled by their 360-degree surroundings in real life, no study has addressed the general characteristics of attention to 360-degree surroundings. Here, we conducted an experiment using virtual reality technology to examine the spatiotemporal characteristics of attention in a highly controlled basic visual context consisting of a 360-degree surrounding. We measured response times and gaze patterns during the 360-degree search task and examined the spatial distribution of attention and its temporal variations in a 360-degree environment based on the participants' physical position. Data were collected from both younger adults and older adults to consider age-related differences. The results showed the fundamental spatiotemporal characteristics of 360-degree attention, which can be used as basic criteria to analyse the structure of exogenous effects on attention in complex 360-degree surroundings in real-life situations. For practical purposes, we created spherical criteria maps of 360-degree attention, which are useful for estimating attending behaviours to 360-degree environmental information or for evaluating visual information design in living environments, workspaces, or other real-life contexts.

The attentional guidance of individual colours in increasingly complex displays

The use of colours is a prevalent and effective tool for improving design. Understanding the effect of colours on attention is crucial for designers that wish to understand how their interfaces will be used. Previous research has consistently shown that attention is biased towards colour. However, despite previous evidence indicating that colours should be treated individually, it has thus far not been investigated whether this difference is reflected in individual effects on attention. To address this, a visual search experiment was conducted that tested the attentional guidance of six individual colours (red,blue, green, yellow, orange, purple) in increasingly complex displays. Results showed that the individual colours differed significantly in their level of guidance of attention, and that these differences increased as the visual complexity of the display increased. Implications for visual design and future research on applying colour in visual attention research and design are discussed.

Salience Models: A Computational Cognitive Neuroscience Review

The seminal model by Laurent Itti and Cristoph Koch demonstrated that we can compute the entire flow of visual processing from input to resulting fixations. Despite many replications and follow-ups, few have matched the impact of the original model-so what made this model so groundbreaking? We have selected five key contributions that distinguish the original salience model by Itti and Koch; namely, its contribution to our theoretical, neural, and computational understanding of visual processing, as well as the spatial and temporal predictions for fixation distributions. During the last 20 years, advances in the field have brought up various techniques and approaches to salience modelling, many of which tried to improve or add to the initial Itti and Koch model. One of the most recent trends has been to adopt the computational power of deep learning neural networks; however, this has also shifted their primary focus to spatial classification. We present a review of recent approaches to modelling salience, starting from direct variations of the Itti and Koch salience model to sophisticated deep-learning architectures, and discuss the models from the point of view of their contribution to computational cognitive neuroscience.

Template-to-distractor distinctiveness regulates visual search efficiency

All models of attention include the concept of an attentional template (or a target or search template). The template is conceptualized as target information held in memory that is used for prioritizing sensory processing and determining if an object matches the target. It is frequently assumed that the template contains a veridical copy of the target. However, we review recent evidence showing that the template encodes a version of the target that is adapted to the current context (e.g. distractors, task, etc.); information held within the template may include only a subset of target features, real world knowledge, pre-existing perceptual biases, or even be a distorted version of the veridical target. We argue that the template contents are customized in order to maximize the ability to prioritize information that distinguishes targets from distractors. We refer to this as template-to-distractor distinctiveness and hypothesize that it contributes to visual search efficiency by exaggerating target-to-distractor dissimilarity.

On Visually-Grounded Reference Production: Testing the Effects of Perceptual Grouping and 2D/3D Presentation Mode

When referring to a target object in a visual scene, speakers are assumed to consider certain distractor objects to be more relevant than others. The current research predicts that the way in which speakers come to a set of relevant distractors depends on how they perceive the distance between the objects in the scene. It reports on the results of two language production experiments, in which participants referred to target objects in photo-realistic visual scenes. Experiment 1 manipulated three factors that were expected to affect perceived distractor distance: two manipulations of perceptual grouping (region of space and type similarity), and one of presentation mode (2D vs. 3D). In line with most previous research on visually-grounded reference production, an offline measure of visual attention was taken here: the occurrence of overspecification with color. The results showed effects of region of space and type similarity on overspecification, suggesting that distractors that are perceived as being in the same group as the target are more often considered relevant distractors than distractors in a different group. Experiment 2 verified this suggestion with a direct measure of visual attention, eye tracking, and added a third manipulation of grouping: color similarity. For region of space in particular, the eye movements data indeed showed patterns in the expected direction: distractors within the same region as the target were fixated more often, and longer, than distractors in a different region. Color similarity was found to affect overspecification with color, but not gaze duration or the number of distractor fixations. Also the expected effects of presentation mode (2D vs. 3D) were not convincingly borne out by the data. Taken together, these results provide direct evidence for the close link between scene perception and language production, and indicate that perceptual grouping principles can guide speakers in determining the distractor set during reference production.

Scenes Modulate Object Processing Before Interacting With Memory Templates

When searching for relevant objects in our environment (say, an apple), we create a memory template (a red sphere), which causes our visual system to favor template-matching visual input (applelike objects) at the expense of template-mismatching visual input (e.g., leaves). Although this principle seems straightforward in a lab setting, it poses a problem in naturalistic viewing: Two objects that have the same size on the retina will differ in real-world size if one is nearby and the other is far away. Using the Ponzo illusion to manipulate perceived size while keeping retinal size constant, we demonstrated across 71 participants that visual objects attract attention when their perceived size matches a memory template, compared with mismatching objects that have the same size on the retina. This shows that memory templates affect visual selection after object representations are modulated by scene context, thus providing a working mechanism for template-based search in naturalistic vision.

What is a preattentive feature?

The concept of a preattentive feature has been central to vision and attention research for about half a century. A preattentive feature is a feature that guides attention in visual search and that cannot be decomposed into simpler features. While that definition seems straightforward, there is no simple diagnostic test that infallibly identifies a preattentive feature. This paper briefly reviews the criteria that have been proposed and illustrates some of the difficulties of definition.

Attention promotes accurate impression formation

OBJECTIVE

An ability to form accurate impressions of others is vital for adaptive social behavior in humans. Here, we examined if attending to persons more is associated with greater accuracy in personality impressions.

METHOD

We asked 42 observers (36 females; mean age = 21 years, age range = 18-28; expected power = 0.96) to form personality impressions of unacquainted individuals (i.e., targets) from video interviews while their attentional behavior was assessed using eye tracking. We examined whether (a) attending more to targets benefited accuracy, (b) attending to specific body parts (e.g., face vs. body) drove this association, and (c) targets' ease of personality readability modulated these effects.

RESULTS

Paying more attention to a target was associated with forming more accurate personality impressions. Attention to the whole person contributed to this effect, with this association occurring independently of targets' ease of readability.

CONCLUSIONS

These findings show that attending more to a person is associated with increased accuracy and thus suggest that attention promotes social adaption by supporting accurate social perception.

Attentional guidance varies with display density

The aim of the present study was to investigate how display density affects attentional guidance in heterogeneous search displays. In Experiment 1 we presented observers with heterogeneous sparse and dense search displays which were adaptively changed over the course of the experiment using genetic algorithms. We generated random displays, and based upon fastest search times, the displays that allowed most efficient search were selected to generate new displays for the next generations, thus revealing which properties facilitated or inhibited target search across display densities. The results showed that the prevalence of distractors sharing the target color was substantially reduced over generations in sparse displays. Dense displays also evolved to contain less distractors sharing the target color but only when the orientation of the distractors resembled the target orientation. More importantly, spatial analyses revealed that changes across generations occurred across all areas in sparse displays but were confined to occur around the target location only in dense displays. In Experiment 2, in which we used a factorial design, we showed that the presence of potentially interfering distractors in the target area affected search in dense displays but not in sparse displays. Together the results suggest that the role of salience-driven attentional guidance is larger in dense than sparse displays even in the absence of display homogeneity.

Visual search characteristics of precise map reading by orienteers

This article compares the differences in eye movements between orienteers of different skill levels on map information searches and explores the visual search patterns of orienteers during precise map reading so as to explore the cognitive characteristics of orienteers' visual search. We recruited 44 orienteers at different skill levels (experts, advanced beginners, and novices), and recorded their behavioral responses and eye movement data when reading maps of different complexities. We found that the complexity of map (complex vs. simple) affects the quality of orienteers' route planning during precise map reading. Specifically, when observing complex maps, orienteers of higher competency tend to have a better quality of route planning (i.e., a shorter route planning time, a longer gaze time, and a more concentrate distribution of gazes). Expert orienteers demonstrated obvious cognitive advantages in the ability to find key information. We also found that in the stage of route planning, expert orienteers and advanced beginners first pay attention to the checkpoint description table. The expert group extracted information faster, and their attention was more concentrated, whereas the novice group paid less attention to the checkpoint description table, and their gaze was scattered. We found that experts regarded the information in the checkpoint description table as the key to the problem and they give priority to this area in route decision making. These results advance our understanding of professional knowledge and problem solving in orienteering.

Task Difficulty Modulates the Disrupting Effects of Oral Respiration on Visual Search Performance

Previous research has suggested that oral respiration may disturb cognitive function and health. The present study investigated whether oral respiration negatively affects visual attentional processing during a visual search task. Participants performed a visual search task in the following three breathing conditions: wearing a nasal plug, wearing surgical tape over their mouths, or no modification (oral vs. nasal vs. control). The participants searched for a target stimulus within different set sizes of distractors in three search conditions (orientation vs colour vs conjunction). Experiment 1 did not show any effect due to respiration. Experiment 2 rigorously manipulated the search efficiency and found that participants required more time to find a poorly discriminable target during oral breathing compared with other breathing styles, which was due to the heightened intercept under this condition. Because the intercept is an index of pre-search sensory processing or motor response in visual search, such cognitive processing was likely disrupted by oral respiration. These results suggest that oral respiration and attentional processing during inefficient visual search share a common cognitive resource.

A serious game to explore human foraging in a 3D environment

Traditional search tasks have taught us much about vision and attention. Recently, several groups have begun to use multiple-target search to explore more complex and temporally extended "foraging" behaviour. Many of these new foraging tasks, however, maintain the simplified 2D displays and response demands associated with traditional, single-target visual search. In this respect, they may fail to capture important aspects of real-world search or foraging behaviour. In the current paper, we present a serious game for mobile platforms, developed in Unity3D, in which human participants play the role of an animal foraging for food in a simulated 3D environment. Game settings can be adjusted, so that, for example, custom target and distractor items can be uploaded, and task parameters, such as the number of target categories or target/distractor ratio are all easy to modify. We are also making the Unity3D project available, so that further modifications can also be made. We demonstrate how the app can be used to address specific research questions by conducting two human foraging experiments. Our results indicate that in this 3D environment, a standard feature/conjunction manipulation does not lead to a reduction in foraging runs, as it is known to do in simple, 2D foraging tasks.