Object property encoding and change blindness in multiple object tracking

The role of motion in visual working memory for dynamic stimuli: More lagged but more precise representations of moving objects

While most visual working memory studies use static stimuli with unchanging features, objects in the real world are often dynamic, introducing significant differences in the surface feature information hitting the retina from the same object over time (e.g., changes in orientation, lighting, shadows). Previous research on dynamic stimuli has shown that change detection is improved if objects obey rules of physical motion, but it is unclear how memory for visual features interacts with object motion. In the current study, we investigated whether object motion facilitates greater temporal integration of continuously changing surface feature information. In a series of experiments, participants were asked to report the final color of continuously changing colored dots that were either moving or stationary on the screen. We found that the reported colors "lagged behind" the physical states of the dots when they were in motion. We also observed that the precision of memory responses was significantly higher for stimuli in the moving condition compared to the stationary condition. Together, these findings suggest that memory representation is improved - but lagged - for moving objects, consistent with the idea that object motion may facilitate integration of object information over longer intervals.

The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences

Mental representations remain the central posits of psychology after many decades of scrutiny. However, there is no consensus about the representational format(s) of biological cognition. This paper provides a survey of evidence from computational cognitive psychology, perceptual psychology, developmental psychology, comparative psychology, and social psychology, and concludes that one type of format that routinely crops up is the language-of-thought (LoT). We outline six core properties of LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate-argument structure; (iv) logical operators; (v) inferential promiscuity; and (vi) abstract content. These properties cluster together throughout cognitive science. Bayesian computational modeling, compositional features of object perception, complex infant and animal reasoning, and automatic, intuitive cognition in adults all implicate LoT-like structures. Instead of regarding LoT as a relic of the previous century, researchers in cognitive science and philosophy-of-mind must take seriously the explanatory breadth of LoT-based architectures. We grant that the mind may harbor many formats and architectures, including iconic and associative structures as well as deep-neural-network-like architectures. However, as computational/representational approaches to the mind continue to advance, classical compositional symbolic structures - that is, LoTs - only prove more flexible and well-supported over time.

The perception/cognition distincton: Challenging the representational account

A central goal for cognitive science and philosophy of mind is to distinguish between perception and cognition. The representational approach has emerged as a prominent candidate to draw such a distinction. The idea is that perception and cognition differ in the content and the format in which the information is represented -just as perceptual representations are nonconceptual in content and iconic in format, cognitive representations are conceptual in content and discursive in format. This paper argues against this view. I argue that both perception and cognition can use conceptual and nonconceptual contents and be vehiculated in iconic and discursive formats. If correct, the representational strategy to distinguish perception from cognition fails.

Capturing the objects of vision with neural networks

Human visual perception carves a scene at its physical joints, decomposing the world into objects, which are selectively attended, tracked and predicted as we engage our surroundings. Object representations emancipate perception from the sensory input, enabling us to keep in mind that which is out of sight and to use perceptual content as a basis for action and symbolic cognition. Human behavioural studies have documented how object representations emerge through grouping, amodal completion, proto-objects and object files. By contrast, deep neural network models of visual object recognition remain largely tethered to sensory input, despite achieving human-level performance at labelling objects. Here, we review related work in both fields and examine how these fields can help each other. The cognitive literature provides a starting point for the development of new experimental tasks that reveal mechanisms of human object perception and serve as benchmarks driving the development of deep neural network models that will put the object into object recognition.

Attentional capture in multiple object tracking

Attentional processes are generally assumed to be involved in multiple object tracking (MOT). The attentional capture paradigm is regularly used to study conditions of attentional control. It has up to now not been used to assess influences of sudden onset distractor stimuli in MOT. We investigated whether attentional capture does occur in MOT: Are onset distractors processed at all in dynamic attentional tasks? We found that sudden onset distractors were effective in lowering probe detection, thus demonstrating attentional capture. Tracking performance as dependent measure was not affected. The attentional capture effect persisted in conditions of higher tracking load (Experiment 2) and was dramatically increased in lower presentation frequency of the onset distractor (Experiment 3). Tracking performance was shown to suffer only when onset distractors were presented serially with very short time gaps in between, thus effectively disturbing re-engaging attention on the tracking set (Experiment 4). We discuss that rapid dis- and re-engagement of the attention process on target objects and an additional more basic process that continuously provides location information allow managing strong disruptions of attention during tracking.

Motion disrupts dynamic visual search for an orientation change

Visual search in dynamic environments, for example lifeguarding or CCTV monitoring, has several fundamentally different properties to standard visual search tasks. The visual environment is constantly moving, a range of items could become targets and the task is to search for a certain event. We developed a novel task in which participants were required to search static and moving displays for an orientation change thus capturing components of visual search, multiple object tracking and change detection paradigms. In Experiment 1, we found that the addition of moving distractors slowed participants' response time to detect an orientation changes in a moving target, showing that the motion of distractors disrupts the rapid detection of orientation changes in a moving target. In Experiment 2 we found that, in displays of both moving and static objects, response time was slower if a moving object underwent a change than if a static object did, thus demonstrating that motion of the target itself also disrupts the detection of an orientation change. Our results could have implications for training in real-world occupations where the task is to search a dynamic environment for a critical event. Moreover, we add to the literature highlighting the need to develop lab-based tasks with high experimental control from any real-world tasks researchers may wish to investigate rather than extrapolating from static visual search tasks to more dynamic environments.

Adaptive target enhancement determines levels of guidability in Multiple Object Tracking

Flexible resource models suggest that attentional deployment in Multiple Object Tracking either shows in target enhancement or distractor inhibition or both. In order to gauge the influence of these processes we manipulated distinctiveness of targets and distractors along a single dimension by finely grading gray values of objects. We established that a quantitative increase in distinctiveness results in a quantitative increase in tracking performance thus demonstrating a new finding. Further increases of distinctiveness beyond a certain degree produced no further improvements in tracking. This effect, however, was moderated by levels of task difficulty thus providing evidence for the relativity of this effect. With higher task difficulty higher degrees of distinctiveness still resulted in a significant performance gain (Experiment 1). A follow up experiment generalized this finding. By manipulating speed of objects, a situation with a yet higher task difficulty could be established showing that an increase of an already striking distinctiveness can produce an even further performance gain - provided higher task difficulty (Experiment 2). Finally we tested the hypothesis that target enhancement and distractor inhibition are influenced by feature distinctiveness. Although we found possible indications for distractor inhibition, we could not demonstrate an effect of feature distinctiveness on distractor inhibition. Target enhancement, however, was substantially influenced by variation of feature distinctiveness (Experiment 3).

Effects of Transient and Nontransient Changes of Surface Feature on Object Correspondence

Object correspondence is a fundamental problem in perception. Classic theories hold that the computation of correspondence is solely based on spatiotemporal information. Recent research showed that surface features also play an important role. However, the surface features of objects in many studies did not change throughout a trial. This study investigated the effect of feature change on object correspondence using the object-reviewing paradigm. Two moving objects underwent transient feature changes on color dimension (Experiment 1A) or a combination of three dimensions (Experiment 2A). Moreover, the objects moved behind four occluders to make the feature change nontransient (Experiments 1B and 2B). Object-specific preview benefits were reduced or eliminated when feature changes were transient, but the benefits were not affected when feature changes were nontransient. The effects of transient versus nontransient changes of surface feature in object correspondence are discussed.

Multiple-target tracking in human and machine vision

Humans are able to track multiple objects at any given time in their daily activities—for example, we can drive a car while monitoring obstacles, pedestrians, and other vehicles. Several past studies have examined how humans track targets simultaneously and what underlying behavioral and neural mechanisms they use. At the same time, computer-vision researchers have proposed different algorithms to track multiple targets automatically. These algorithms are useful for video surveillance, team-sport analysis, video analysis, video summarization, and human–computer interaction. Although there are several efficient biologically inspired algorithms in artificial intelligence, the human multiple-target tracking (MTT) ability is rarely imitated in computer-vision algorithms. In this paper, we review MTT studies in neuroscience and biologically inspired MTT methods in computer vision and discuss the ways in which they can be seen as complementary.

Multiple-target tracking (MTT) is a challenging task vital for both a human’s daily life and for many artificial intelligent systems, such as those used for urban traffic control. Neuroscientists are interested in discovering the underlying neural mechanisms that successfully exploit cognitive resources, e.g., spatial attention or memory, during MTT. Computer-vision specialists aim to develop powerful MTT algorithms based on advanced models or data-driven computational methods. In this paper, we review MTT studies from both communities and discuss how findings from cognitive studies can inspire developers to construct higher performing MTT algorithms. Moreover, some directions have been proposed through which MTT algorithms could raise new questions in the cognitive science domain, and answering them can shed light on neural processes underlying MTT.

How selective attention affects the detection of motion changes with peripheral vision in MOT

In sports, peripheral vision is expected to play an important role in tasks that demand distributed attention and motion-change detection. By using the Multiple-Object-Tracking (MOT) task, these demands were simulated in a well-controlled laboratory environment. Participants tracked four target out of ten moving objects (6 distractors) and pressed a button when one of the ten objects stopped. Detection rates for tracked targets were compared to detection rates of non-tracked distractors at eccentricities between 5° and 25°. The study's aim was to test how the location of attention affects peripheral motion detection. The results show a large attention effect because target stops were detected in 89 % and distractor stops only in 55 % of the trials. Distractor stops were more likely detected when they occurred closer to the fovea while target stops were detected at all eccentricities. That means, orienting attention at target objects facilitates the peripheral detection of their motion changes in monitoring tasks. Having distractors closer to the fovea increases the chance to also detect motion changes of unattended objects. On a theoretical level, results support a tracking mechanism with object-based attention, serial covert attention shifts and flexible but limited attentional resources. On a practical level, sports' experts should use their extensive knowledge to locate attention on most-relevant objects and reduce the eccentricity to other objects to detect motion changes of attended and unattended objects.

Chasing Animals With Split Attention: Are Animals Prioritized in Visual Tracking?

Some evolutionary psychologists have hypothesized that animals have priority in human attention. That is, they should be detected and selected more efficiently than other types of objects, especially man-made ones. Such a priority mechanism should automatically deploy more attentional resources and dynamic monitoring toward animal stimuli than nonanimals. Consequently, we postulated that variations of the multiple object or identity tracking and multiple event monitoring tasks should be particularly suitable paradigms for addressing the animate monitoring hypothesis, given their dynamic properties and dependency on divided attention. We used images of animals and artifacts and found neither a substantial sign of improvement in tracking the positions associated with animal stimuli nor a significant distracting effect of animals. We also failed to observe a significant prioritization in orders of response for positions associated with animals. While we observed an advantage for animals in event monitoring, this appeared to be dependent on properties of the task, as confirmed in further experiments. Moreover, we observed a small but inconclusive advantage for animals in identity accuracy. Thus, under certain conditions, some bias toward animals could be observed, but the evidence was weak and inconclusive. To conclude, effect sizes were generally small and not conclusively in favor of the expected attentional bias for animals. We found moderate to strong evidence that images of animals do not improve positional tracking, do not act as more effective distractors, are not selected prior to artifacts in the response phase, and are not easier to monitor for changes in size.

Short Article: Sequential Tapping Interferes Selectively with Multiple-Object Tracking: Do Finger-Tapping and Tracking Share a Common Resource?

Multiple-object tracking involves simultaneously monitoring positions of a number of target items as they move among distractors. Young adults are capable of tracking only 3–5 items at once. In this study we investigated the origin of this limitation by looking for secondary tasks that interfere with tracking. We compared tracking performance (baseline condition), with performance when participants tapped three fingers in a specific order while tracking (sequential tapping) or articulated three syllables in a specific order while tracking (sequential articulation). The articulation task was used to ensure that the interference produced by sequential tapping was more than would be expected by the executive demands of carrying out any two “attention-demanding” tasks at once. Even though sequential tapping does not require vision or memorizing the positions of external items, it produced significantly more interference than did sequential articulation, as might be expected if tracking and sequential tapping shared a common (limited) resource.

Hue distinctiveness overrides category in determining performance in multiple object tracking

The visual distinctiveness between targets and distractors can significantly facilitate performance in multiple object tracking (MOT), in which color is a feature that has been commonly used. However, the processing of color can be more than "visual." Color is continuous in chromaticity, while it is commonly grouped into discrete categories (e.g., red, green). Evidence from color perception suggested that color categories may have a unique role in visual tasks independent of its chromatic appearance. Previous MOT studies have not examined the effect of chromatic and categorical distinctiveness on tracking separately. The current study aimed to reveal how chromatic (hue) and categorical distinctiveness of color between the targets and distractors affects tracking performance. With four experiments, we showed that tracking performance was largely facilitated by the increasing hue distance between the target set and the distractor set, suggesting that perceptual grouping was formed based on hue distinctiveness to aid tracking. However, we found no color categorical effect, because tracking performance was not significantly different when the targets and distractors were from the same or different categories. It was concluded that the chromatic distinctiveness of color overrides category in determining tracking performance, suggesting a dominant role of perceptual feature in MOT.

Do cyclists make better drivers? Associations between cycling experience and change detection in road scenes

Efficient processing of visual information is crucial to safe driving. Previous research has demonstrated that driving experience strongly affects attentional allocation, with large differences between novice and experienced drivers. Expanding on this, we explored the influence of non-driving experiences on attentional allocation by comparing drivers with and without cycling experience. Based on situation awareness field studies, we predicted cyclist-drivers would demonstrate superior performance. Participants were 42 experienced drivers (17 female, 25 male) aged 30-50 years (M=39.8): 20 drivers and 22 cyclist-drivers. The experiment used a change detection flicker task, in which participants must determine whether two alternating images are identical (change-absent) or differ in a single detail (change-present). The changed object was either a road sign, car, pedestrian, or bicycle. Change target significantly affected both accuracy and response time: all participants were slower and less accurate at detecting changes to road signs, compared with when the change was a moving road user (i.e., car, pedestrian, bicycle). Accuracy did not differ significantly between groups, but cyclist-drivers were significantly faster than drivers at identifying changes, with the effect being largest for bicycle and sign changes. The results suggest that cycling experience is associated with more efficient attentional processing for road scenes.

Multiple event monitoring

Suppose you were monitoring a group of people in order to determine if anyone of them did something suspicious (e.g., putting down a bag) or if any two interacted in a suspicious manner (e.g., trading bags). How large a group could you monitor successfully? This paper reports on six experiments in which observers monitor a group of entities, watching for an event. Whether the event was performed by a single entity or was an interaction between a pair, the capacity for event monitoring was two to three items. This was lower than the multiple object tracking capacity for the same stimuli (approximately six items). Capacity was essentially the same whether entities were identical circles or unique cartoon animals; nor was capacity changed by an added requirement to identify the entities involved in an event. Event monitoring appears to be related to, but not identical to, multiple object tracking.

Decoding information about dynamically occluded objects in visual cortex

During dynamic occlusion, an object passes behind an occluding surface and then later reappears. Even when completely occluded from view, such objects are experienced as continuing to exist or persist behind the occluder even though they are no longer visible. The contents and neural basis of this persistent representation remain poorly understood. Questions remain as to whether there is information maintained about the object itself (i.e. its shape or identity) or non-object-specific information such as its position or velocity as it is tracked behind an occluder, as well as which areas of visual cortex represent such information. Recent studies have found that early visual cortex is activated by "invisible" objects during visual imagery and by unstimulated regions along the path of apparent motion, suggesting that some properties of dynamically occluded objects may also be neurally represented in early visual cortex. We applied functional magnetic resonance imaging in human subjects to examine representations within visual cortex during dynamic occlusion. For gradually occluded, but not for instantly disappearing objects, there was an increase in activity in early visual cortex (V1, V2, and V3). This activity was spatially-specific, corresponding to the occluded location in the visual field. However, the activity did not encode enough information about object identity to discriminate between different kinds of occluded objects (circles vs. stars) using MVPA. In contrast, object identity could be decoded in spatially-specific subregions of higher-order, topographically organized areas such as ventral, lateral, and temporal occipital areas (VO, LO, and TO) as well as the functionally defined LOC and hMT+. These results suggest that early visual cortex may only represent the dynamically occluded object's position or motion path, while later visual areas represent object-specific information.

Universal ontology

Previous research has demonstrated that adults are successful at visually tracking rigidly moving items, but experience great difficulties when tracking substance-like “pouring” items. Using a comparative approach, we investigated whether the presence/absence of the grammatical count–mass distinction influences adults and children’s ability to attentively track objects versus substances. More specifically, we aimed to explore whether the higher success at tracking rigid over substance-like items appears universally or whether speakers of classifier languages (like Japanese, not marking the object–substance distinction) are advantaged at tracking substances as compared to speakers of non-classifier languages (like Swiss German, marking the object–substance distinction). Our results supported the idea that language has no effect on low-level cognitive processes such as the attentive visual processing of objects and substances. We concluded arguing that the tendency to prioritize objects is universal and independent of specific characteristics of the language spoken.

Capacity limit of simultaneous temporal processing: how many concurrent 'clocks' in vision?

A fundamental ability for humans is to monitor and process multiple temporal events that occur at different spatial locations simultaneously. A great number of studies have demonstrated simultaneous temporal processing (STP) in human and animal participants, i.e., multiple 'clocks' rather than a single 'clock'. However, to date, we still have no knowledge about the exact limitation of the STP in vision. Here we provide the first experimental measurement to this critical parameter in human vision by using two novel and complementary paradigms. The first paradigm combines merits of a temporal oddball-detection task and a capacity measurement widely used in the studies of visual working memory to quantify the capacity of STP (CSTP). The second paradigm uses a two-interval temporal comparison task with various encoded spatial locations involved in the standard temporal intervals to rule out an alternative, 'object individuation'-based, account of CSTP, which is measured by the first paradigm. Our results of both paradigms indicate consistently that the capacity limit of simultaneous temporal processing in vision is around 3 to 4 spatial locations. Moreover, the binding of the 'local clock' and its specific location is undermined by bottom-up competition of spatial attention, indicating that the time-space binding is resource-consuming. Our finding that the capacity of STP is not constrained by the capacity of visual working memory (VWM) supports the idea that the representations of STP are likely stored and operated in units different from those of VWM. A second paradigm confirms further that the limited number of location-bound 'local clocks' are activated and maintained during a time window of several hundreds milliseconds.

Prediction processes during multiple object tracking (MOT): involvement of dorsal and ventral premotor cortices

BACKGROUND

The multiple object tracking (MOT) paradigm is a cognitive task that requires parallel tracking of several identical, moving objects following nongoal-directed, arbitrary motion trajectories.

AIMS

The current study aimed to investigate the employment of prediction processes during MOT. As an indicator for the involvement of prediction processes, we targeted the human premotor cortex (PM). The PM has been repeatedly implicated to serve the internal modeling of future actions and action effects, as well as purely perceptual events, by means of predictive feedforward functions.

MATERIALS AND METHODS

Using functional magnetic resonance imaging (fMRI), BOLD activations recorded during MOT were contrasted with those recorded during the execution of a cognitive control task that used an identical stimulus display and demanded similar attentional load. A particular effort was made to identify and exclude previously found activation in the PM-adjacent frontal eye fields (FEF).

RESULTS

We replicated prior results, revealing occipitotemporal, parietal, and frontal areas to be engaged in MOT.

DISCUSSION

The activation in frontal areas is interpreted to originate from dorsal and ventral premotor cortices. The results are discussed in light of our assumption that MOT engages prediction processes.

CONCLUSION

We propose that our results provide first clues that MOT does not only involve visuospatial perception and attention processes, but prediction processes as well.

Assessing selective sustained attention in 3- to 5-year-old children: evidence from a new paradigm

Selective sustained attention (SSA) is crucial for higher order cognition. Factors promoting SSA are described as exogenous or endogenous. However, there is little research specifying how these factors interact during development, due largely to the paucity of developmentally appropriate paradigms. We report findings from a novel paradigm designed to investigate SSA in preschoolers. The findings indicate that this task (a) has good psychometric and parametric properties and (b) allows investigation of exogenous and endogenous factors within the same task, making it possible to attribute changes in performance to different mechanisms of attentional control rather than to differences in engagement in different tasks.

Nonexplicit change detection in complex dynamic settings: what eye movements reveal

OBJECTIVE

We employed a computer-controlled command-and-control (C2) simulation and recorded eye movements to examine the extent and nature of the inability to detect critical changes in dynamic displays when change detection is implicit (i.e., requires no explicit report) to the operator's task.

BACKGROUND

Change blindness-the failure to notice significant changes to a visual scene-may have dire consequences on performance in C2 and surveillance operations.

METHOD

Participants performed a radar-based risk-assessment task involving multiple subtasks. Although participants were not required to explicitly report critical changes to the operational display, change detection was critical in informing decision making. Participants' eye movements were used as an index of visual attention across the display.

RESULTS

Nonfixated (i.e., unattended) changes were more likely to be missed than were fixated (i.e., attended) changes, supporting the idea that focused attention is necessary for conscious change detection. The finding of significant pupil dilation for changes undetected but fixated suggests that attended changes can nonetheless be missed because of a failure of attentional processes.

CONCLUSION

Change blindness in complex dynamic displays takes the form of failures in establishing task-appropriate patterns of attentional allocation.

APPLICATION

These findings have implications in the design of change-detection support tools for dynamic displays and work procedure in C2 and surveillance.

Benefits and costs of uniqueness in multiple object tracking: the role of object complexity

How do unique objects affect multiple-object tracking? Recent research has catalogued seemingly contradictory findings, varying from enhanced to impaired tracking performance. In this study, we explore the role of object complexity in this broad range of phenomena. In a series of three experiments, we demonstrate that unique objects of varying complexity can produce both costs and benefits on tracking performance. These experiments show that the key effects of uniqueness in object tracking are results of a tradeoff between tracking operation and processing of object identity information within the capacity limit of working memory.

The Effects of Distractors in Multiple Object Tracking are Modulated by the Similarity of Distractor and Target Features

Is the effect of distractors in multiple object tracking dependent on the distractors sharing the features of the targets? In experiment 1, observers tracked five targets among five distractors that were identical to the targets and a number of additional distractors that were either identical to or featurally distinct from the targets. Results showed that distractors that are distinct from the targets in shape or color, or are stationary, impair tracking less than distractors that are identical to the targets. However, tracking performance declined as the number of distractors increased, even for featurally distinct distractors. Experiment 2 showed that distractors that differ from the targets on two features impair tracking less than distractors that differ from the targets on only one feature, but only when target tracking load is low. These results indicate that shape, color, and motion information about distractors can be used to distinguish them from targets during tracking, although even distractors with a different feature from the targets produce some interference with tracking. These findings suggest that the effect of distractors on tracking is dependent on top–down settings for target features.

Stream/bounce event perception reveals a temporal limit of motion correspondence based on surface feature over space and time

We examined how stream/bounce event perception is affected by motion correspondence based on the surface features of moving objects passing behind an occlusion. In the stream/bounce display two identical objects moving across each other in a two-dimensional display can be perceived as either streaming through or bouncing off each other at coincidence. Here, surface features such as colour (Experiments 1 and 2) or luminance (Experiment 3) were switched between the two objects at coincidence. The moment of coincidence was invisible to observers due to an occluder. Additionally, the presentation of the moving objects was manipulated in duration after the feature switch at coincidence. The results revealed that a postcoincidence duration of approximately 200 ms was required for the visual system to stabilize judgments of stream/bounce events by determining motion correspondence between the objects across the occlusion on the basis of the surface feature. The critical duration was similar across motion speeds of objects and types of surface features. Moreover, controls (Experiments 4a–4c) showed that cognitive bias based on feature (colour/luminance) congruency across the occlusion could not fully account for the effects of surface features on the stream/bounce judgments. We discuss the roles of motion correspondence, visual feature processing, and attentive tracking in the stream/bounce judgments.

Visual cognition

Visual cognition, high-level vision, mid-level vision and top-down processing all refer to decision-based scene analyses that combine prior knowledge with retinal input to generate representations. The label "visual cognition" is little used at present, but research and experiments on mid- and high-level, inference-based vision have flourished, becoming in the 21st century a significant, if often understated part, of current vision research. How does visual cognition work? What are its moving parts? This paper reviews the origins and architecture of visual cognition and briefly describes some work in the areas of routines, attention, surfaces, objects, and events (motion, causality, and agency). Most vision scientists avoid being too explicit when presenting concepts about visual cognition, having learned that explicit models invite easy criticism. What we see in the literature is ample evidence for visual cognition, but few or only cautious attempts to detail how it might work. This is the great unfinished business of vision research: at some point we will be done with characterizing how the visual system measures the world and we will have to return to the question of how vision constructs models of objects, surfaces, scenes, and events.

Visual awareness of objects and their colour

At any given moment, our awareness of what we 'see' before us seems to be rather limited. If, for instance, a display containing multiple objects is shown (red or green disks), when one object is suddenly covered at random, observers are often little better than chance in reporting about its colour (Wolfe, Reinecke, & Brawn, Visual Cognition, 14, 749-780, 2006). We tested whether, when object attributes (such as colour) are unknown, observers still retain any knowledge of the presence of that object at a display location. Experiments 1-3 involved a task requiring two-alternative (yes/no) responses about the presence or absence of a colour-defined object at a probed location. On this task, if participants knew about the presence of an object at a location, responses indicated that they also knew about its colour. A fourth experiment presented the same displays but required a three-alternative response. This task did result in a data pattern consistent with participants' knowing more about the locations of objects within a display than about their individual colours. However, this location advantage, while highly significant, was rather small in magnitude. Results are compared with those of Huang (Journal of Vision, 10(10, Art. 24), 1-17, 2010), who also reported an advantage for object locations, but under quite different task conditions.

Timing divided attention

Visual attention can be divided over multiple objects or locations. However, there is no single theoretical framework within which the effects of dividing attention can be interpreted. In order to develop such a model, here we manipulated the stage of visual processing at which attention was divided, while simultaneously probing the costs of dividing attention on two dimensions. We show that dividing attention incurs dissociable time and precision costs, which depend on whether attention is divided during monitoring or during access. Dividing attention during monitoring resulted in progressively delayed access to attended locations as additional locations were monitored, as well as a one-off precision cost. When dividing attention during access, time costs were systematically lower at one of the accessed locations than at the other, indicating that divided attention during access, in fact, involves rapid sequential allocation of undivided attention. We propose a model in which divided attention is understood as the simultaneous parallel preparation and subsequent sequential execution of multiple shifts of undivided attention. This interpretation has the potential to bring together diverse findings from both the divided-attention and saccade preparation literature and provides a framework within which to integrate the broad spectrum of divided-attention methodologies.

Selecting and perceiving multiple visual objects

To explain how multiple visual objects are attended and perceived, we propose that our visual system first selects a fixed number of about four objects from a crowded scene based on their spatial information (object individuation) and then encode their details (object identification). We describe the involvement of the inferior intra-parietal sulcus (IPS) in object individuation and the superior IPS and higher visual areas in object identification. Our neural object-file theory synthesizes and extends existing ideas in visual cognition and is supported by behavioral and neuroimaging results. It provides a better understanding of the role of the different parietal areas in encoding visual objects and can explain various forms of capacity-limited processing in visual cognition such as working memory.

The Attentional Blink Reveals Serial Working Memory Encoding: Evidence from Virtual and Human Event-related Potentials

Observers often miss a second target (T2) if it follows an identified first target item (T1) within half a second in rapid serial visual presentation (RSVP), a finding termed the attentional blink. If two targets are presented in immediate succession, however, accuracy is excellent (Lag 1 sparing). The resource sharing hypothesis proposes a dynamic distribution of resources over a time span of up to 600 msec during the attentional blink. In contrast, the ST2 model argues that working memory encoding is serial during the attentional blink and that, due to joint consolidation, Lag 1 is the only case where resources are shared. Experiment 1 investigates the P3 ERP component evoked by targets in RSVP. The results suggest that, in this context, P3 amplitude is an indication of bottom–up strength rather than a measure of cognitive resource allocation. Experiment 2, employing a two-target paradigm, suggests that T1 consolidation is not affected by the presentation of T2 during the attentional blink. However, if targets are presented in immediate succession (Lag 1 sparing), they are jointly encoded into working memory. We use the ST2 model's neural network implementation, which replicates a range of behavioral results related to the attentional blink, to generate “virtual ERPs” by summing across activation traces. We compare virtual to human ERPs and show how the results suggest a serial nature of working memory encoding as implied by the ST2 model.

Object files can be purely episodic

Our ability to track an object as the same persisting entity over time and motion may primarily rely on spatiotemporal representations which encode some, but not all, of an object's features. Previous researchers using the 'object reviewing' paradigm have demonstrated that such representations can store featural information of well-learned stimuli such as letters and words at a highly abstract level. However, it is unknown whether these representations can also store purely episodic information (i.e. information obtained from a single, novel encounter) that does not correspond to pre-existing type-representations in long-term memory. Here, in an object-reviewing experiment with novel face images as stimuli, observers still produced reliable object-specific preview benefits in dynamic displays: a preview of a novel face on a specific object speeded the recognition of that particular face at a later point when it appeared again on the same object compared to when it reappeared on a different object (beyond display-wide priming), even when all objects moved to new positions in the intervening delay. This case study demonstrates that the mid-level visual representations which keep track of persisting identity over time--e.g. 'object files', in one popular framework can store not only abstract types from long-term memory, but also specific tokens from online visual experience.

The role of location and motion information in the tracking and recovery of moving objects

Observers in a multiple object tracking task can track about four to five independently moving targets among several moving distractors, even if all of the stimuli disappear for a 300-msec gap. How observers reacquire targets following such a gap reveals what kind of information they can maintain for targets. Previous research has suggested that participants maintain minimal information about a set of moving objects--namely, just their present spatial locations. We report five new experiments that demonstrate retention of location information for at least four objects, and extrapolated motion information for around two objects.

Dynamic binding of identity and location information: a serial model of multiple identity tracking

Tracking of multiple moving objects is commonly assumed to be carried out by a fixed-capacity parallel mechanism. The present study proposes a serial model (MOMIT) to explain performance accuracy in the maintenance of multiple moving objects with distinct identities. A serial refresh mechanism is postulated, which makes recourse to continuous attention switching, a capacity-limited episodic buffer for identity-location bindings, indexed location information stored in the visuospatial short-term memory, and an active role of long-term memory. As identity-location bindings are refreshed serially, a location error is inherent for all other targets except the focally attended one. The magnitude of this location error is a key factor in predicting tracking accuracy. MOMIT's predictions were supported by the data of five experiments: performance accuracy decreased as a function of target set-size, speed, and familiarity. A mathematical version of MOMIT fitted nicely to the observed data with plausible parameter estimates for the binding capacity and refresh time.

Tracking unique objects

Is content addressable in the representation that subserves performance in multiple-object-tracking (MOT) experiments? We devised an MOT variant that featured unique, nameable objects (cartoon animals) as stimuli. There were two possible response modes: standard, in which observers were asked to report the locations of all target items, and specific, in which observers had to report the location of a particular object (e.g., "Where is the zebra?"). A measure of capacity derived from accuracy allowed for comparisons of the results between conditions. We found that capacity in the specific condition (1.4 to 2.6 items across several experiments) was always reliably lower than capacity in the standard condition (2.3 to 3.4 items). Observers could locate specific objects, indicating a content-addressable representation. However, capacity differences between conditions, as well as differing responses to the experimental manipulations, suggest that there may be two separate systems involved in tracking, one carrying only positional information, and one carrying identity information as well.

How do we track invisible objects?

We previously demonstrated that observers in multiple object tracking experiments can successfully track targets when all the objects simultaneously vanish for periods lasting several hundred milliseconds (Alvarez, Horowitz, Arsenio, Dimase, and Wolfe, 2005). How do observers do this? Since observers can track objects that move behind occluders (e.g., Scholl and Pylyshyn, 1999), they may treat a temporal gap as a case of complete occlusion. If so, performance should improve if occlusion cues (deletion and accretion) are provided and items disappear and reappear one by one (asynchronously), rather than simultaneously. However, we found better performance with simultaneous than with asynchronous disappearance (Experiment 1), whereas occlusion cues were detrimental (Experiment 2). We propose that observers tolerate a gap in tracking by storing the current task state when objects vanish and resuming tracking on the basis of that memory when the objects reappear (a task-switching account).

Feature binding in visual working memory evaluated by type identification paradigm

Memory for feature binding comprises a key ingredient in coherent object representations. Previous studies have been equivocal about human capacity for objects in the visual working memory. To evaluate memory for feature binding, a type identification paradigm was devised and used with a multiple-object permanence tracking task. Using objects defined by shape and color, observers identified types of changes in feature combinations across an occlusion event, and the effects of object motion and number of switches were investigated. With only one switch, task performance was impaired even under stationary conditions, suggesting highly limited capacity of binding memory. Second switch improved performance only in the stationary condition, suggesting that object motion strongly disrupts feature binding. Further analyses and experiments suggest that improvement by the second switch reflects transition of binding memory by selective attention.

Motion-induced overestimation of the number of items in a display

Subjects were asked to report the number of items in a display as the items moved along a circular path around the fixation point. As the rotation speed increased, the apparent number of items also increased. This motion-induced overestimation (MIO) effect was investigated in three experiments. In the first experiment, the effect of rotation speed and set size was explored with an enumeration task. The overestimation error increased with an increase in speed or number of items in the display. In the second experiment, we used an adjustment paradigm to measure the speed threshold of MIO effect onset. Temporal rate of the display, which was defined as product of rotation speed and the number of rotating items, was the determining factor of MIO onset. In the third experiment, moving items were marked with different colours. Surprisingly, the number of perceived items was still overestimated even though the number of perceived colours was not.