Multielement visual tracking: attention and perceptual organization

What is the Bandwidth of Perceptual Experience?

Although our subjective impression is of a richly detailed visual world, numerous empirical results suggest that the amount of visual information observers can perceive and remember at any given moment is limited. How can our subjective impressions be reconciled with these objective observations? Here, we answer this question by arguing that, although we see more than the handful of objects, claimed by prominent models of visual attention and working memory, we still see far less than we think we do. Taken together, we argue that these considerations resolve the apparent conflict between our subjective impressions and empirical data on visual capacity, while also illuminating the nature of the representations underlying perceptual experience.

Selection of new objects by onset capture and visual marking

Visual search is easier after looking at some distractors in advance because previewed distractors are excluded from the search (preview benefit). A dominant explanation for preview benefit is that it occurs because of the inhibition of old objects (visual marking). However, another view claims that preview benefit simply reflects automatic attentional orienting to new objects (onset capture). To address the question of whether visual marking plays any role in addition to onset capture, we compared the search performance for a target that always appeared as a new item ("marking" condition) with the performance for a target that appeared equally as a new or old item ("capture" condition). When items were presented at random positions in an invisible matrix, the slope in the "marking" condition was shallower than that in the "capture" condition, favoring the involvement of visual marking (Experiments 1 and 2). In contrast, no difference in slope was found among the search conditions regardless of changes in old items when items were arranged around the circumference of a circle (Experiment 3). These findings suggest that the contribution of visual marking depends on the configuration of search items; with complex displays, prioritizing selection for new objects is more effective if coupled with de-prioritizing de-selection for old objects.

Position tracking and identity tracking are separate systems: Evidence from eye movements

How do we track multiple moving objects in our visual environment? Some investigators argue that tracking is based on a parallel mechanism (e.g., Cavanagh & Alvarez, 2005; Pylyshyn, 1989), others argue that tracking contains a serial component (e.g. Holcombe & Chen, 2013; Oksama & Hyönä, 2008). In the present study, we put previous theories into a direct test by registering observers' eye movements when they tracked identical moving targets (the MOT task) or when they tracked distinct object identities (the MIT task). The eye movement technique is a useful tool to study whether overt focal attention is exploited during tracking. We found a qualitative difference between these tasks in terms of eye movements. When the participants tracked only position information (MOT), the observers had a clear preference for keeping their eyes fixed for a rather long time on the same screen position. In contrast, active eye behavior was observed when the observers tracked the identities of moving objects (MIT). The participants updated over four target identities with overt attention shifts. These data suggest that there are two separate systems involved in multiple object tracking. The position tracking system keeps track of the positions of the moving targets in parallel without the need of overt attention shifts in the form of eye movements. On the other hand, the identity tracking system maintains identity-location bindings in a serial fashion by utilizing overt attention shifts.

Functional connectivity indicates differential roles for the intraparietal sulcus and the superior parietal lobule in multiple object tracking

Attentive tracking requires sustained object-based attention, rather than passive vigilance or rapid attentional shifts to brief events. Several theories of tracking suggest a mechanism of indexing objects that allows for attentional resources to be directed toward the moving targets. Imaging studies have shown that cortical areas belonging to the dorsal frontoparietal attention network increase BOLD-signal during multiple object tracking (MOT). Among these areas, some studies have assigned IPS a particular role in object indexing, but the neuroimaging evidence has been sparse. In the present study, we tested participants on a continuous version of the MOT task in order to investigate how cortical areas engage in functional networks during attentional tracking. Specifically, we analyzed the data using eigenvector centrality mapping (ECM) analysis, which provides estimates of individual voxels' connectedness with hub-like parts of the functional network. The results obtained using permutation based voxel-wise statistics support the proposed role for the IPS in object indexing as this region displayed increased centrality during tracking as well as increased functional connectivity with both prefrontal and visual perceptual cortices. In contrast, the opposite pattern was observed for the SPL, with decreasing centrality, as well as reduced functional connectivity with the visual and frontal cortices, in agreement with a hypothesized role for SPL in attentional shifts. These findings provide novel evidence that IPS and SPL serve different functional roles during MOT, while at the same time being highly engaged during tracking as measured by BOLD-signal changes.

Population responses in V1 encode different figures by response amplitude

The visual system simultaneously segregates between several objects presented in a visual scene. The neural code for encoding different objects or figures is not well understood. To study this question, we trained two monkeys to discriminate whether two elongated bars are either separate, thus generating two different figures, or connected, thus generating a single figure. Using voltage-sensitive dyes, we imaged at high spatial and temporal resolution V1 population responses evoked by the two bars, while keeping their local attributes similar among the two conditions. In the separate condition, unlike the connected condition, the population response to one bar is enhanced, whereas the response to the other is simultaneously suppressed. The response to the background remained unchanged between the two conditions. This divergent pattern developed ∼200 ms poststimulus onset and could discriminate well between the separate and connected single trials. The stimulus separation saliency and behavioral report were highly correlated with the differential response to the bars. In addition, the proximity and/or the specific location of the connectors seemed to have only a weak effect on this late activity pattern, further supporting the involvement of top-down influences. Additional neural codes were less informative about the separate and connected conditions, with much less consistency and discriminability compared with a response amplitude code. We suggest that V1 is involved in the encoding of each figure by different neuronal response amplitude, which can mediate their segregation and perception.

The Effect of Fearful Expressions on Multiple Face Tracking

How does the visual system realize dynamic tracking? This topic has become popular within cognitive science in recent years. The classical theory argues that multiple object tracking is accomplished via pre-attention visual indexes as part of a cognitively impenetrable low-level visual system. The present research aimed to investigate whether and how tracking processes are influenced by facial expressions that convey abundant social information about one’s mental state and situated environment. The results showed that participants tracked fearful faces more effectively than neutral faces. However, this advantage was only present under the low-attentional load condition, and distractor face emotion did not impact tracking performance. These findings imply that visual tracking is not driven entirely by low-level vision and encapsulated by high-level representations; rather, that facial expressions, a kind of social information, are able to influence dynamic tracking. Furthermore, the effect of fearful expressions on multiple face tracking is mediated by the availability of attentional resources.

Emotional Arousal and Memory Binding: An Object-Based Framework

Binding various features of an event together and maintaining these connections in memory is an essential component of episodic memories. Previous theories make contradictory predictions about the effects of emotional arousal on memory binding. In this article, I review evidence for both arousal-impaired and arousal-enhanced memory binding and explain these contradictory findings using an object-based framework. According to this framework, emotionally arousing objects attract attention that enhances binding of their constituent features. In contrast, the emotional arousal associated with one object either impairs or has no effect on the associations between that object and other distinct objects or background contextual information. After initial encoding, the attention-grabbing nature of emotionally arousing objects can lead to interference in working memory, making it more difficult to maintain other bound representations. These contrasting effects of arousal on memory binding should help predict which aspects of emotional memories are likely to be accurate and which aspects are likely to be misremembered.

Influence of Interpretation Aids on Attentional Capture, Visual Processing, and Understanding of Front-of-Package Nutrition Labels

OBJECTIVE

To study the influence of 2 interpretational aids of front-of-package (FOP) nutrition labels (color code and text descriptors) on attentional capture and consumers' understanding of nutritional information.

DESIGN

A full factorial design was used to assess the influence of color code and text descriptors using visual search and eye tracking.

PARTICIPANTS

Ten trained assessors participated in the visual search study and 54 consumers completed the eye-tracking study.

MAIN OUTCOME MEASURES

In the visual search study, assessors were asked to indicate whether there was a label high in fat within sets of mayonnaise labels with different FOP labels. In the eye-tracking study, assessors answered a set of questions about the nutritional content of labels.

ANALYSIS

The researchers used logistic regression to evaluate the influence of interpretational aids of FOP nutrition labels on the percentage of correct answers. Analyses of variance were used to evaluate the influence of the studied variables on attentional measures and participants' response times.

RESULTS

Response times were significantly higher for monochromatic FOP labels compared with color-coded ones (3,225 vs 964 ms; P < .001), which suggests that color codes increase attentional capture. The highest number and duration of fixations and visits were recorded on labels that did not include color codes or text descriptors (P < .05). The lowest percentage of incorrect answers was observed when the nutrient level was indicated using color code and text descriptors (P < .05).

CONCLUSIONS AND IMPLICATIONS

The combination of color codes and text descriptors seems to be the most effective alternative to increase attentional capture and understanding of nutritional information.

The Commingled Division of Visual Attention

Many critical activities require visual attention to be distributed simultaneously among distinct tasks where the attended foci are not spatially separated. In our two experiments, participants performed a large number of trials where both a primary task (enumeration of spots) and a secondary task (reporting the presence/absence or identity of a distinctive shape) required the division of visual attention. The spots and the shape were commingled spatially and the shape appeared unpredictably on a relatively small fraction of the trials. The secondary task stimulus (the shape) was reported in inverse proportion to the attentional load imposed by the primary task (enumeration of spots). When the shape did appear, performance on the primary task (enumeration) suffered relative to when the shape was absent; both speed and accuracy were compromised. When the secondary task required identification in addition to detection, reaction times increased by about 200 percent. These results are broadly compatible with biased competition models of perceptual processing. An important area of application, where the commingled division of visual attention is required, is the augmented reality head-up display (AR-HUD). This innovation has the potential to make operating vehicles safer but our data suggest that there are significant concerns regarding driver distraction.

Effects of spatial configurations on the resolution of spatial working memory

Recent research demonstrated that people represent spatial information configurally and preservation of configural cues at retrieval helps memory for spatial locations (Boduroğlu & Shah, Memory & Cognition, 37(8), 1120-1131 2009; Jiang, Olson, & Chun, Journal of Experimental Psychology: Learning, Memory, and Cognition, 26(3), 683-702 2000). The present study investigated the effects of spatial configurations on the resolution of individual location representations. In an open-ended task, participants first studied a set of object locations (three and five locations). Then, in a test display where available configural cues were manipulated, participants were asked to determine the original location of a target object whose color was auditorially cued. The difference between the reported location and the original location was taken as a measure of spatial resolution. In three experiments, we consistently observed that the resolution of spatial representations was facilitated by the preservation of spatial configurations at retrieval. We argue that participants may be using available configural cues in conjunction with the summary representation (e.g., centroid) of the original display in the computation of target locations.

Abnormalities in brain systems supporting individuation and enumeration in autism

Previous work indicates that adults with autism display a decreased capacity when rapidly enumerating small sets of elements (i.e., subitizing), compared to typically developing (TD) individuals. This ability is crucial for fundamental visual functions such as object individuation and parallel processing. Thus, the deficit in autism suggests limits in these skills. To examine the neural basis of this limitation, adults with and without high functioning autism rapidly enumerated 1 to 8 randomly located squares during a neuroimaging study. Typically, adults are thought to use parallel visual processes to quantify up to three or four elements, and serial processes to enumerate more (5+) elements. We hypothesized that parietal lobe regions associated with counting would be recruited with smaller sets of elements in adults with autism, compared to TD adults. Consistent with this hypothesis, activation in parietal regions increased with smaller set sizes in adults with autism compared to TD adults. Increased activation for three elements was evident in several regions, including those thought to underlie subitizing. In addition, regions specific to the counting range in TD adults were often equally active for set sizes in the subitizing range in the adults with autism. Finally, significant deactivation was evident in TD adults, presumably reflecting relative suppression of regions specialized for competing processes, but was not apparent in adults with autism. These differences in brain function in adults with autism on a simple enumeration task suggest atypical brain organization and function that is likely to impact most visual tasks, especially those with multiple elements.

Attentive tracking of moving objects in real 3D space

Results of earlier multiple object tracking (MOT) studies imply that humans can track several moving targets in a 2D environment simultaneously. Recently, a study suggested that stereoscopic depth has positive effect on tracking multiple objects when the objects are presented separately on multiple planes. However, it remains unclear whether or not humans can track moving targets in a real 3D environment. In this study, we investigated this issue displaying four targets and four distractors on near and/or far depth planes separated physically by 6, 10 or 50 cm using a half-mirror and two CRT-monitors. In addition we also tested whether participants could track the targets when either a target or a distractor changed depth during tracking. Our results suggested that performance dropped if the targets were presented on both depth planes especially when the distance between the planes was 50 cm. In addition, participants could track a depth-changed target if targets were presented on both planes before the start of a motion phase regardless of whether the initial state of targets distribution randomly varied or not, whereas they failed to track the target if all targets were presented on a single plane before MOT. In conclusion, humans have the ability to set attention on a wide range for MOT in a real 3D environment, with the provision that the efficiency of the tracking is critically dependent not only on the distance in depth but also on an initial state of distribution of the targets without the predictability of the initial state.

Enhancing multiple object tracking performance with noninvasive brain stimulation: a causal role for the anterior intraparietal sulcus

Multiple object tracking (MOT) is a complex task recruiting a distributed network of brain regions. There are also marked individual differences in MOT performance. A positive causal relationship between the anterior intraparietal sulcus (AIPS), an integral region in the MOT attention network and inter-individual variation in MOT performance has not been previously established. The present study used transcranial direct current stimulation (tDCS), a form of non-invasive brain stimulation, in order to examine such a causal link. Active anodal stimulation was applied to the right AIPS and the left dorsolateral prefrontal cortex (DLPFC) (and sham stimulation), an area associated with working memory (but not MOT) while participants completed a MOT task. Stimulation to the right AIPS significantly improved MOT accuracy more than the other two conditions. The results confirm a causal role of the AIPS in the MOT task and illustrate that tDCS has the ability to improve MOT performance.

Cognitive enhancement of healthy young adults with hyperbaric oxygen: A preliminary resting-state fMRI study

OBJECTIVE

To date, no study has examined the effect of hyperbaric oxygen (HBO) on the cognitive performance and spontaneous brain activity in healthy adults using resting-state functional magnetic resonance imaging (rsfMRI). Our aim was to reveal the neural mechanism underlying the change in cognitive performance caused by increased oxygen.

METHODS

In this study, we acquired fMRI data from 20 healthy young adults and used placebo-controlled (PBO) rsfMRI to identify the effect of HBO on the cognitive measures and the regional homogeneity (ReHo) in healthy adults.

RESULTS

Compared to the PBO group, the HBO group showed the following: (1) the scores of the spatial working memory and memory quotient were significantly increased after HBO administration; (2) the ReHo value was significantly increased in three clusters, the left hippocampus, right inferior frontal, and lingual gyri, and for these three clusters, their functional connectivity with the subcortical brain system was significantly increased after HBO administration; and (3) the changes of ReHo values in these clusters generated by HBO administration were correlated with several aspects of cognitive performance, clarifying the cognitive locus of the effect.

CONCLUSION

Our results suggested that the increased availability of oxygen can, to some extent, improve memory performance.

SIGNIFICANT

Our findings may improve our understanding of the role of HBO in clinical and practical applications.

Distractor Locations Influence Multiple Object Tracking Beyond Interobject Spacing: Evidence From Equidistant Distractor Displacements

Human observers are able to keep track of several independently moving objects among other objects. Within theories of multiple object tracking (MOT), distractors are assumed to influence tracking performance only by their distance toward the next target. In order to test this assumption, we designed a variant of the MOT paradigm that involved spatially arranged target-distractor pairs and sudden displacements of distractors during a brief flash. Critically, these displacements maintained target-distractor spacing. Our results show that displacing distractors hurts tracking performance (Experiment 1). Importantly, target-distractor confusions occur within target-distractor pairs with displaced distractors (Experiment 2). This displacement effect increases with an increasing displacement angle (Experiment 3) but is equal at different distances between target and distractor (Experiment 4). This finding illustrates that distractors influence tracking performance beyond pure interobject spacing. We discuss how inhibitory processes as well as relations between targets and distractors might interfere with target tracking.

The Identity-Location Binding Problem

The binding problem is fundamental to visual perception. It is the problem of associating an object's visual properties with itself and not with some other object. The problem is made particular difficult because different properties of an object, such as its color, shape, size, and motion, are often processed independently, sometimes in different cortical areas. The results of these separate analyses have to be combined before the object can be seen as a single coherent entity as opposed to a collection of unconnected features. Visual bindings are typically initiated and updated in a serial fashion, one object at a time. Here, we show that one type of binding, location-identity bindings, can be updated in parallel. We do this by using two complementary techniques, the simultaneous-sequential paradigm and systems factorial technology. These techniques make different assumptions and rely on different behavioral measures, yet both came to the same conclusion.

LoyalTracker: Visualizing Loyalty Dynamics in Search Engines

The huge amount of user log data collected by search engine providers creates new opportunities to understand user loyalty and defection behavior at an unprecedented scale. However, this also poses a great challenge to analyze the behavior and glean insights into the complex, large data. In this paper, we introduce LoyalTracker, a visual analytics system to track user loyalty and switching behavior towards multiple search engines from the vast amount of user log data. We propose a new interactive visualization technique (flow view) based on a flow metaphor, which conveys a proper visual summary of the dynamics of user loyalty of thousands of users over time. Two other visualization techniques, a density map and a word cloud, are integrated to enable analysts to gain further insights into the patterns identified by the flow view. Case studies and the interview with domain experts are conducted to demonstrate the usefulness of our technique in understanding user loyalty and switching behavior in search engines.

The Not-so-Staggering Effect of Staggered Animated Transitions on Visual Tracking

Interactive visual applications often rely on animation to transition from one display state to another. There are multiple animation techniques to choose from, and it is not always clear which should produce the best visual correspondences between display elements. One major factor is whether the animation relies on staggering-an incremental delay in start times across the moving elements. It has been suggested that staggering may reduce occlusion, while also reducing display complexity and producing less overwhelming animations, though no empirical evidence has demonstrated these advantages. Work in perceptual psychology does show that reducing occlusion, and reducing inter-object proximity (crowding) more generally, improves performance in multiple object tracking. We ran simulations confirming that staggering can in some cases reduce crowding in animated transitions involving dot clouds (as found in, e.g., animated 2D scatterplots). We empirically evaluated the effect of two staggering techniques on tracking tasks, focusing on cases that should most favour staggering. We found that introducing staggering has a negligible, or even negative, impact on multiple object tracking performance. The potential benefits of staggering may be outweighed by strong costs: a loss of common-motion grouping information about which objects travel in similar paths, and less predictability about when any specific object would begin to move. Staggering may be beneficial in some conditions, but they have yet to be demonstrated. The present results are a significant step toward a better understanding of animation pacing, and provide direction for further research.

The effect of spatial organization of targets and distractors on the capacity to selectively memorize objects in visual short-term memory

We conducted a series of experiments to explore how the spatial configuration of objects influences the selection and the processing of these objects in a visual short-term memory task. We designed a new experiment in which participants had to memorize 4 targets presented among 4 distractors. Targets were cued during the presentation of distractor objects. Their locations varied according to 4 spatial configurations. From the first to the last configuration, the distance between targets’ locations was progressively increased. The results revealed a high capacity to select and memorize targets embedded among distractors even when targets were extremely distant from each other. This capacity is discussed in relation to the unitary conception of attention, models of split attention, and the competitive interaction model. Finally, we propose that the spatial dispersion of objects has different effects on attentional allocation and processing stages. Thus, when targets are extremely distant from each other, attentional allocation becomes more difficult while processing becomes easier. This finding implicates that these 2 aspects of attention need to be more clearly distinguished in future research.

The effects of sequential attention shifts within visual working memory

Previous studies have shown conflicting data as to whether it is possible to sequentially shift spatial attention among visual working memory (VWM) representations. The present study investigated this issue by asynchronously presenting attentional cues during the retention interval of a change detection task. In particular, we focused on two types of sequential attention shifts: (1) orienting attention to one location, and then withdrawing attention from it, and (2) switching the focus of attention from one location to another. In Experiment 1, a withdrawal cue was presented after a spatial retro-cue to measure the effect of withdrawing attention. The withdrawal cue significantly reduced the cost of invalid spatial cues, but surprisingly, did not attenuate the benefit of valid spatial cues. This indicates that the withdrawal cue only triggered the activation of facilitative components but not inhibitory components of attention. In Experiment 2, two spatial retro-cues were presented successively to examine the effect of switching the focus of attention. We observed equivalent benefits of the first and second spatial cues, suggesting that participants were able to reorient attention from one location to another within VWM, and the reallocation of attention did not attenuate memory at the first-cued location. In Experiment 3, we found that reducing the validity of the preceding spatial cue did lead to a significant reduction in its benefit. However, performance was still better at first-cued locations than at uncued and neutral locations, indicating that the first cue benefit might have been preserved both partially under automatic control and partially under voluntary control. Our findings revealed new properties of dynamic attentional control in VWM maintenance.

Differential neuronal representation of spatial attention dependent on relative target locations during multiple object tracking

Humans can simultaneously track multiple moving objects with attention. The number of objects that can be tracked is known to be larger when visual stimuli are presented bilaterally rather than presented unilaterally. To elucidate the underlying neuronal mechanism, we trained monkeys to covertly track a single or multiple object(s). We found that neurons in the lateral prefrontal cortex exhibited greater activity for the target passing through the receptive field (RF) than for distractors. During multiple-object tracking, response enhancement for one target presented in the RF was stronger when the other target was located in the opposite than the same visual hemifield. Because the neuronal modulation did not differ depending on relative target locations with respect to upper and lower visual hemifields, the distance between the targets does not explain the results. We propose that inherent, anatomical separation of visual processing for contralateral and ipsilateral visual fields might constrain cognitive capacity.

Where's Waldo? How perceptual, cognitive, and emotional brain processes cooperate during learning to categorize and find desired objects in a cluttered scene

The Where's Waldo problem concerns how individuals can rapidly learn to search a scene to detect, attend, recognize, and look at a valued target object in it. This article develops the ARTSCAN Search neural model to clarify how brain mechanisms across the What and Where cortical streams are coordinated to solve the Where's Waldo problem. The What stream learns positionally-invariant object representations, whereas the Where stream controls positionally-selective spatial and action representations. The model overcomes deficiencies of these computationally complementary properties through What and Where stream interactions. Where stream processes of spatial attention and predictive eye movement control modulate What stream processes whereby multiple view- and positionally-specific object categories are learned and associatively linked to view- and positionally-invariant object categories through bottom-up and attentive top-down interactions. Gain fields control the coordinate transformations that enable spatial attention and predictive eye movements to carry out this role. What stream cognitive-emotional learning processes enable the focusing of motivated attention upon the invariant object categories of desired objects. What stream cognitive names or motivational drives can prime a view- and positionally-invariant object category of a desired target object. A volitional signal can convert these primes into top-down activations that can, in turn, prime What stream view- and positionally-specific categories. When it also receives bottom-up activation from a target, such a positionally-specific category can cause an attentional shift in the Where stream to the positional representation of the target, and an eye movement can then be elicited to foveate it. These processes describe interactions among brain regions that include visual cortex, parietal cortex, inferotemporal cortex, prefrontal cortex (PFC), amygdala, basal ganglia (BG), and superior colliculus (SC).

Motion integration for ocular pursuit does not hinder perceptual segregation of moving objects

When confronted with a complex moving stimulus, the brain can integrate local element velocities to obtain a single motion signal, or segregate the elements to maintain awareness of their identities. The integrated motion signal can drive smooth-pursuit eye movements (Heinen and Watamaniuk, 1998), whereas the segregated signal guides attentive tracking of individual elements in multiple-object tracking tasks (MOT; Pylyshyn and Storm, 1988). It is evident that these processes can occur simultaneously, because we can effortlessly pursue ambulating creatures while inspecting disjoint moving features, such as arms and legs, but the underlying mechanism is unknown. Here, we provide evidence that separate neural circuits perform the mathematically opposed operations of integration and segregation, by demonstrating with a dual-task paradigm that the two processes do not share attentional resources. Human observers attentively tracked a subset of target elements composing a small MOT stimulus, while pursuing it ocularly as it translated across a computer display. Integration of the multidot stimulus yielded optimal pursuit. Importantly, performing MOT while pursuing the stimulus did not degrade performance on either task compared with when each was performed alone, indicating that they did not share attention. A control experiment showed that pursuit was not driven by integration of only the nontargets, leaving the MOT targets free for segregation. Nor was a predictive strategy used to pursue the stimulus, because sudden changes in its global velocity were accurately followed. The results suggest that separate neural mechanisms can simultaneously segregate and integrate the same motion signals.

The role of spatial configuration in multiple identity tracking

Background

The simultaneous tracking and identification of multiple moving objects encountered in everyday life requires one to correctly bind identities to objects. In the present study, we investigated the role of spatial configuration made by multiple targets when observers are asked to track multiple moving objects with distinct identities.

Methodology/Principal Findings

The overall spatial configuration made by the targets was manipulated: In the constant condition, the configuration remained as a virtual convex polygon throughout the tracking, and in the collapsed condition, one of the moving targets (critical target) crossed over an edge of the virtual polygon during tracking, destroying it. Identification performance was higher when the configuration remained intact than when it collapsed (Experiments 1a, 1b, and 2). Moreover, destroying the configuration affected the allocation of dynamic attention: the critical target captured more attention than did the other targets. However, observers were worse at identifying the critical target and were more likely to confuse it with the targets that formed the virtual crossed edge (Experiments 3–5). Experiment 6 further showed that the visual system constructs an overall configuration only by using the targets (and not the distractors); identification performance was not affected by whether the distractor violated the spatial configuration.

Conclusions/Significance

In sum, these results suggest that the visual system may integrate targets (but not distractors) into a spatial configuration during multiple identity tracking, which affects the distribution of dynamic attention and the updating of identity-location binding.

Long-term memory guidance of visuospatial attention in a change-detection paradigm

Visual task performance is generally stronger in familiar environments. One reason for this familiarity benefit is that we learn where to direct our visual attention and effective attentional deployment enhances performance. Visual working memory plays a central role in supporting long-term memory guidance of visuospatial attention. We modified a change detection task to create a new paradigm for investigating long-term memory guidance of attention. During the training phase, subjects viewed images in a flicker paradigm and were asked to detect between one and three changes in the images. The test phase required subjects to detect a single change in a one-shot change detection task in which they held all possible locations of changes in visual working memory and deployed attention to those locations to determine if a change occurred. Subjects detected significantly more changes in images for which they had been trained to detect the changes, demonstrating that memory of the images guided subjects in deploying their attention. Moreover, capacity to detect changes was greater for images that had multiple changes during the training phase. In Experiment 2, we observed that capacity to detect changes for the 3-studied change condition increased significantly with more study exposures and capacity was significantly higher than 1, indicating that subjects were able to attend to more than one location. Together, these findings suggest memory and attentional systems interact via working memory such that long-term memory can be used to direct visual spatial attention to multiple locations based on previous experience.

Resource demands of object tracking and differential allocation of the resource

The attentional processes for tracking moving objects may be largely hemisphere-specific. Indeed, in our first two experiments the maximum object speed (speed limit) for tracking targets in one visual hemifield (left or right) was not significantly affected by a requirement to track additional targets in the other hemifield. When the additional targets instead occupied the same hemifield as the original targets, the speed limit was reduced. At slow target speeds, however, adding a second target to the same hemifield had little effect. At high target speeds, the cost of adding a same-hemifield second target was approximately as large as would occur if observers could only track one of the targets. This shows that performance with a fast-moving target is very sensitive to the amount of resource allocated. In a third experiment, we investigated whether the resources for tracking can be distributed unequally between two targets. The speed limit for a given target was higher if the second target was slow rather than fast, suggesting that more resource was allocated to the faster of the two targets. This finding was statistically significant only for targets presented in the same hemifield, consistent with the theory of independent resources in the two hemifields. Some limited evidence was also found for resource sharing across hemifields, suggesting that attentional tracking resources may not be entirely hemifield-specific. Together, these experiments indicate that the largely hemisphere-specific tracking resource can be differentially allocated to faster targets.

Speed has an effect on multiple-object tracking independently of the number of close encounters between targets and distractors

Multiple-object tracking (MOT) studies have shown that tracking ability declines as object speed increases. However, this might be attributed solely to the increased number of times that target and distractor objects usually pass close to each other ("close encounters") when speed is increased, resulting in more target-distractor confusions. The present study investigates whether speed itself affects MOT ability by using displays in which the number of close encounters is held constant across speeds. Observers viewed several pairs of disks, and each pair rotated about the pair's midpoint and, also, about the center of the display at varying speeds. Results showed that even with the number of close encounters held constant across speeds, increased speed impairs tracking performance, and the effect of speed is greater when the number of targets to be tracked is large. Moreover, neither the effect of number of distractors nor the effect of target-distractor distance was dependent on speed, when speed was isolated from the typical concomitant increase in close encounters. These results imply that increased speed does not impair tracking solely by increasing close encounters. Rather, they support the view that speed affects MOT capacity by requiring more attentional resources to track at higher speeds.

Spatio-temporal Patterns of Brain Activity Distinguish Strategies of Multiple-object Tracking

Human observers can readily track up to four independently moving items simultaneously, even in the presence of moving distractors. Here we combined EEG and magnetoencephalography recordings to investigate the neural processes underlying this remarkable capability. Participants were instructed to track four of eight independently moving items for 3 sec. When the movement ceased a probe stimulus consisting of four items with a higher luminance was presented. The location of the probe items could correspond fully, partly, or not at all with the tracked items. Participants reported whether the probe items fully matched the tracked items or not. About half of the participants showed slower RTs and higher error rates with increasing correspondence between tracked items and the probe. The other half, however, showed faster RTs and lower error rates when the probe fully matched the tracked items. This latter behavioral pattern was associated with enhanced probe-evoked neural activity that was localized to the lateral occipital cortex in the time range 170–210 msec. This enhanced response in the object-selective lateral occipital cortex suggested that these participants performed the tracking task by visualizing the overall shape configuration defined by the vertices of the tracked items, thereby producing a behavioral advantage on full-match trials. In a later time range (270–310 msec) probe-evoked neural activity increased monotonically as a function of decreasing target–probe correspondence in all participants. This later modulation, localized to superior parietal cortex, was proposed to reflect the degree of mismatch between the probe and the automatically formed visual STM representation of the tracked items.

Bottlenecks of motion processing during a visual glance: the leaky flask model

Where do the bottlenecks for information and attention lie when our visual system processes incoming stimuli? The human visual system encodes the incoming stimulus and transfers its contents into three major memory systems with increasing time scales, viz., sensory (or iconic) memory, visual short-term memory (VSTM), and long-term memory (LTM). It is commonly believed that the major bottleneck of information processing resides in VSTM. In contrast to this view, we show major bottlenecks for motion processing prior to VSTM. In the first experiment, we examined bottlenecks at the stimulus encoding stage through a partial-report technique by delivering the cue immediately at the end of the stimulus presentation. In the second experiment, we varied the cue delay to investigate sensory memory and VSTM. Performance decayed exponentially as a function of cue delay and we used the time-constant of the exponential-decay to demarcate sensory memory from VSTM. We then decomposed performance in terms of quality and quantity measures to analyze bottlenecks along these dimensions. In terms of the quality of information, two thirds to three quarters of the motion-processing bottleneck occurs in stimulus encoding rather than memory stages. In terms of the quantity of information, the motion-processing bottleneck is distributed, with the stimulus-encoding stage accounting for one third of the bottleneck. The bottleneck for the stimulus-encoding stage is dominated by the selection compared to the filtering function of attention. We also found that the filtering function of attention is operating mainly at the sensory memory stage in a specific manner, i.e., influencing only quantity and sparing quality. These results provide a novel and more complete understanding of information processing and storage bottlenecks for motion processing.

Automatic feature-based grouping during multiple object tracking

Contour interpolation automatically binds targets with distractors to impair multiple object tracking (Keane, Mettler, Tsoi, & Kellman, 2011). Is interpolation special in this regard or can other features produce the same effect? To address this question, we examined the influence of eight features on tracking: color, contrast polarity, orientation, size, shape, depth, interpolation, and a combination (shape, color, size). In each case, subjects tracked 4 of 8 objects that began as undifferentiated shapes, changed features as motion began (to enable grouping), and returned to their undifferentiated states before halting. We found that intertarget grouping improved performance for all feature types except orientation and interpolation (Experiment 1 and Experiment 2). Most importantly, target-distractor grouping impaired performance for color, size, shape, combination, and interpolation. The impairments were, at times, large (>15% decrement in accuracy) and occurred relative to a homogeneous condition in which all objects had the same features at each moment of a trial (Experiment 2), and relative to a "diversity" condition in which targets and distractors had different features at each moment (Experiment 3). We conclude that feature-based grouping occurs for a variety of features besides interpolation, even when irrelevant to task instructions and contrary to the task demands, suggesting that interpolation is not unique in promoting automatic grouping in tracking tasks. Our results also imply that various kinds of features are encoded automatically and in parallel during tracking.

Prediction processes during multiple object tracking (MOT): involvement of dorsal and ventral premotor cortices

BACKGROUND

The multiple object tracking (MOT) paradigm is a cognitive task that requires parallel tracking of several identical, moving objects following nongoal-directed, arbitrary motion trajectories.

AIMS

The current study aimed to investigate the employment of prediction processes during MOT. As an indicator for the involvement of prediction processes, we targeted the human premotor cortex (PM). The PM has been repeatedly implicated to serve the internal modeling of future actions and action effects, as well as purely perceptual events, by means of predictive feedforward functions.

MATERIALS AND METHODS

Using functional magnetic resonance imaging (fMRI), BOLD activations recorded during MOT were contrasted with those recorded during the execution of a cognitive control task that used an identical stimulus display and demanded similar attentional load. A particular effort was made to identify and exclude previously found activation in the PM-adjacent frontal eye fields (FEF).

RESULTS

We replicated prior results, revealing occipitotemporal, parietal, and frontal areas to be engaged in MOT.

DISCUSSION

The activation in frontal areas is interpreted to originate from dorsal and ventral premotor cortices. The results are discussed in light of our assumption that MOT engages prediction processes.

CONCLUSION

We propose that our results provide first clues that MOT does not only involve visuospatial perception and attention processes, but prediction processes as well.

Healthy older observers show equivalent perceptual-cognitive training benefits to young adults for multiple object tracking

The capacity to process complex dynamic scenes is of critical importance in real life. For instance, traveling through a crowd while avoiding collisions and maintaining orientation and good motor control requires fluent and continuous perceptual-cognitive processing. It is well documented that effects of healthy aging can influence perceptual-cognitive processes (Faubert, 2002) and that the efficiency of such processes can improve with training even for older adults (Richards et al., 2006). Here we assess the capacity of older participants to improve their tracking speed thresholds in a dynamic, virtual reality environment. Results show that this capacity is significantly affected by healthy aging but that perceptual-cognitive training can significantly reduce age-related effects in older individuals, who show an identical learning function to younger healthy adults. Data support the notion that learning in healthy older persons is maintained for processing complex dynamic scenes.

Sustained multifocal attentional enhancement of stimulus processing in early visual areas predicts tracking performance

Keeping track of multiple moving objects is an essential ability of visual perception. However, the mechanisms underlying this ability are not well understood. We instructed human observers to track five or seven independent randomly moving target objects amid identical nontargets and recorded steady-state visual evoked potentials (SSVEPs) elicited by these stimuli. Visual processing of moving targets, as assessed by SSVEP amplitudes, was continuously facilitated relative to the processing of identical but irrelevant nontargets. The cortical sources of this enhancement were located to areas including early visual cortex V1-V3 and motion-sensitive area MT, suggesting that the sustained multifocal attentional enhancement during multiple object tracking already operates at hierarchically early stages of visual processing. Consistent with this interpretation, the magnitude of attentional facilitation during tracking in a single trial predicted the speed of target identification at the end of the trial. Together, these findings demonstrate that attention can flexibly and dynamically facilitate the processing of multiple independent object locations in early visual areas and thereby allow for tracking of these objects.

Choosing colors for map display icons using models of visual search

OBJECTIVE

We show how to choose colors for icons on maps to minimize search time using predictions of a model of visual search.

BACKGROUND

The model analyzes digital images of a search target (an icon on a map) and a search display (the map containing the icon) and predicts search time as a function of target-distractor color distinctiveness and target eccentricity.

METHOD

We parameterized the model using data from a visual search task and performed a series of optimization tasks to test the model's ability to choose colors for icons to minimize search time across icons. Map display designs made by this procedure were tested experimentally. In a follow-up experiment, we examined the model's flexibility to assign colors in novel search situations.

RESULTS

The model fits human performance, performs well on the optimization tasks, and can choose colors for icons on maps with novel stimuli to minimize search time without requiring additional model parameter fitting.

CONCLUSION

Models of visual search can suggest color choices that produce search time reductions for display icons.

APPLICATION

Designers should consider constructing visual search models as a low-cost method of evaluating color assignments.

Assessing selective sustained attention in 3- to 5-year-old children: evidence from a new paradigm

Selective sustained attention (SSA) is crucial for higher order cognition. Factors promoting SSA are described as exogenous or endogenous. However, there is little research specifying how these factors interact during development, due largely to the paucity of developmentally appropriate paradigms. We report findings from a novel paradigm designed to investigate SSA in preschoolers. The findings indicate that this task (a) has good psychometric and parametric properties and (b) allows investigation of exogenous and endogenous factors within the same task, making it possible to attribute changes in performance to different mechanisms of attentional control rather than to differences in engagement in different tasks.

Swapping or dropping? Electrophysiological measures of difficulty during multiple object tracking

In the multiple object tracking task, participants are asked to keep targets separate from identical distractors as all items move randomly. It is well known that simple manipulations such as object speed and number of distractors dramatically alter the number of targets that are successfully tracked, but very little is known about what causes this variation in performance. One possibility is that participants tend to lose track of objects (dropping) more frequently under these conditions. Another is that the tendency to confuse a target with a distractor increases (swapping). These two mechanisms have very different implications for the attentional architecture underlying tracking. However, behavioral data alone cannot differentiate between these possibilities. In the current study, we used an electrophysiological marker of the number of items being actively tracked to assess which type of errors tended to occur during speed and distractor load manipulations. Our neural measures suggest that increased distractor load led to an increased likelihood of confusing targets with distractors while increased speed led to an increased chance of a target item being dropped. Behavioral experiments designed to test this novel prediction support this assertion.

The precision of visual memory for a complex contour shape measured by a freehand drawing task

Contour information is an important source for object perception and memory. Three experiments examined the precision of visual short-term memory for complex contour shapes. All used a new procedure that assessed recall memory for holistic information in complex contour shapes: Participants studied, then reproduced (without cues), a contoured shape by freehand drawing. In Experiment 1 memory precision was measured by comparing Fourier descriptors for studied and reproduced contours. Results indicated survival of lower (holistic) frequency information (i.e., ⩽5cycles/perimeter) and loss of higher (detail) frequency information. Secondary tasks placed demands on either verbal memory (Experiment 2) or visual spatial memory (Experiment 3). Neither secondary task interfered with recall of complex contour shapes, suggesting that the memory system maintaining holistic shape information was independent of both the verbal memory system and the visual spatial memory subsystem of visual short-term memory. The nature of memory for complex contour shape is discussed.