Situating vision in the world

The effect of context on pointer allocation in visual working memory

Visual working memory (VWM) can hold a limited amount of visual information and manipulate it. It encodes this information and forms representations of each one of the relevant objects. When an object changes, VWM can either update or reset its representation to account for this change. To access a specific representation VWM relies on a pointer system associating each representation with the corresponding object in the environment. While previous studies described these processes as reacting to a change in the object status, this study investigated the adaptability of the pointer system to the task context. We measured the contralateral delay activity (CDA; an electrophysiological marker of VWM) as a marker of updating and resetting. In two experiments we used a shape change detection task (similar to Balaban & Luria, 2017) and manipulated the proportion of the resetting and updating trials to create different task contexts. Experiment 1 indicated that VWM can adapt to a resetting mode in which it performs resetting in conditions that triggered updating in previous studies. However, Experiment 2 revealed that the pointer system cannot adapt to an updating mode and perform updating in conditions that trigger resetting. These results suggest that VWM can strategically perform resetting, but once a pointer is lost, it's impossible to update the representation and a resetting process is mandatory triggered regardless of the context.

Multiple Object Tracking Without Pre-attentive Indexing

Multiple object tracking (MOT) involves simultaneous tracking of a certain number of target objects amongst a larger set of objects as they all move unpredictably over time. The prevalent explanation for successful target tracking by humans in MOT involving visually identical objects is based on the Visual Indexing Theory. This assumes that each target is indexed by a pointer using a non-conceptual mechanism to maintain an object's identity even as its properties change over time. Thus, successful tracking requires successful indexing and the absence of identification errors. Identity maintenance and successful tracking are measured in terms of identification (ID) and tracking accuracy respectively, with higher accuracy indicating better identity maintenance or better tracking. Existing evidence suggests that humans have high tracking accuracy despite poor identification accuracy, suggesting that it might be possible to perform MOT without indexing. Our work adds to existing evidence for this position through two experiments, and presents a computational model of multiple object tracking that does not require indexes. Our empirical results show that identification accuracy is aligned with tracking accuracy in humans for tracking up to three, but is lower when tracking more objects. Our computational model of MOT without indexing accounts for several empirical tracking accuracy patterns shown in earlier studies, reproduces the dissociation between tracking and identification accuracy produced earlier in the literature as well as in our experiments, and makes several novel predictions.

Dissociable online integration processes in visual working memory

Visual working memory has severe capacity limits, creating a bottleneck for active processing. A key way of mitigating this limitation is by chunking, i.e. compressing several pieces of information into one visual working memory representation. However, despite decades of research, chunking efficiency remains debated because of mixed evidence. We propose that there are actually 2 integration mechanisms: Grouping combines several objects to one representation, and object-unification merges the parts of a single object. Critically, we argue that the fundamental distinction between the 2 processes is their differential use of the pointer system, the indexing process connecting visual working memory representations with perception. In grouping, the objects that are represented together still maintain independent pointers, making integration costly but highly flexible. Conversely, object-unification fuses the pointers as well as the representations, with the single pointer producing highly efficient integration but blocking direct access to individual parts. We manipulated integration cues via task-irrelevant movement, and monitored visual working memory's online electrophysiological marker. Uniquely colored objects were flexibly grouped and ungrouped via independent pointers (experiment 1). If objects turned uniformly black, object-integration could not be undone (experiment 2), requiring visual working memory to reset before re-individuation. This demonstrates 2 integration levels (representational-merging versus pointer-compression) and establishes the dissociation between visual working memory representations and their underlying pointers.

Disentangling working memory from multiple-object tracking: Evidence from dual-task interferences

Multiple object tracking (MOT) is generally regarded as a pure attention-consuming task that draws heavily on attention resources. In the present study, we adopted a cross-channel visual-audio dual-task paradigm, i.e., the MOT task combined with the concurrent auditory N-back working memory task, to test whether working memory indeed plays a necessary role in the process of multiple tracking, as well as to further identify the specific types of working memory components involved in this process. Experiments 1a and 1b examined the relationship between the MOT task and nonspatial object working memory (OWM) processing by manipulating the tracking load and working memory load, respectively. Results in both experiments indicated that the concurrent nonspatial OWM task did not have a significant effect on the tracking capacity of the MOT task. In contrast, Experiments 2a and 2b examined the relationship between the MOT task and spatial working memory (SWM) processing by a similar approach. Results in both experiments indicated that the concurrent SWM task significantly impaired the tracking capacity of the MOT task, showing a gradual decrease with increasing SWM load. Overall, our study provides empirical evidence that multiple object tracking does involve working memory, primarily related to spatial working memory rather than nonspatial object working memory, which sheds more light on the mechanisms of multiple object tracking.

Towards a systematization of brain oscillatory activity in actions

Information processing in the brain is governed by oscillatory activity. Activity oscillations in specific frequency bands (theta, alpha, beta and gamma) have been associated with various cognitive functions. A drawback of this is that the plethora of findings led to considerable uncertainty as to the functional relevance of activity in different frequency bands and their interrelation. Here, we use a novel cognitive-science theoretical framework to better understand and conceptually harmonize neurophysiological research on human action control. We outline how this validated starting point can systematize and probably reframe the functional relevance of oscillatory activity relevant for action control and beyond.

Real-world objects are not stored in holistic representations in visual working memory

When storing multiple objects in visual working memory, observers sometimes misattribute perceived features to incorrect locations or objects. These misattributions are called binding errors (or swaps) and have been previously demonstrated mostly in simple objects whose features are easy to encode independently and arbitrarily chosen, like colors and orientations. Here, we tested whether similar swaps can occur with real-world objects, where the connection between features is meaningful rather than arbitrary. In Experiments 1 and 2, observers were simultaneously shown four items from two object categories. Within a category, the two exemplars could be presented in either the same or different states (e.g., open/closed; full/empty). After a delay, both exemplars from one of the categories were probed, and participants had to recognize which exemplar went with which state. We found good memory for state information and exemplar information on their own, but a significant memory decrement for exemplar–state combinations, suggesting that binding was difficult for observers and swap errors occurred even for meaningful real-world objects. In Experiment 3, we used the same task, but in one-half of the trials, the locations of the exemplars were swapped at test. We found that there are more errors in general when the locations of exemplars were swapped. We concluded that the internal features of real-world objects are not perfectly bound in working memory, and location updates impair object and feature representations. Overall, we provide evidence that even real-world objects are not stored in an entirely unitized format in working memory.

Subitizing object parts reveals a second stage of individuation

Humans can efficiently individuate a small number of objects. This subitizing ability is thought to be a consequence of limited attentional resources. However, how and what is selected during the individuation process remain outstanding questions. We investigated these in four experiments by examining if parts of objects are enumerated as efficiently as distinct objects in the presence and absence of distractor objects. We found that distractor presence reduced subitizing efficiency. Crucially, parts connected to multiple objects were enumerated less efficiently than independent objects or parts connected to a single object. These results argue against direct individuation of parts and show that objecthood plays a fundamental role in individuation. Objects are selected first and their components are selected in subsequent steps. This reveals that individuation operates sequentially over multiple levels.

Limitations of concurrently representing objects within view and in visual working memory

Representing visibly present stimuli is as limited in capacity as representing invisible stimuli in visual working memory (WM). In this study, we explored whether concurrently representing stimuli within view affects representing objects in visual WM, and if so, whether this effect is modulated by the storage states (active and silent state) of memory contents? In experiment 1, participants were asked to perform the change-detect task in a simultaneous-representing condition in which WM content and the continuously-visible stimuli in view were simultaneously represented, as well as a baseline condition in which only the representations of visual WM content were maintained. The results showed that the representations in visual WM would be impaired when the continuously-visible stimuli in view were concurrently represented, revealed by the reduced CDA amplitude and the lower behavior performance. In experiment 2, a dual-serial retro-cue paradigm was adopted to guide participants to maintain memory items in two different storage states, and the results revealed that simultaneously representing the continuously-visible stimuli and the WM content would only impair the WM representations in the active state. These evidences demonstrated that only the visual WM representations that were maintained in the active state would definitely share the limited resources with the representations of continuously-visible information, and further supported the dissociation between the active state and silent state of visual WM storage.

Neural evidence for an object-based pointer system underlying working memory

To accomplish even rudimentary tasks, our cognitive system must update its representation of the changing environment. This process relies on visual working memory (VWM), which can actively modify its representations. We argue that this ability depends on a pointer system, such that each representation is stably and uniquely mapped to a specific stimulus. Without these pointers, VWM representations are inaccessible and therefore unusable. In three Electroencephalogram (EEG) experiments, we examined whether the pointers are allocated in an object-based, featural, or spatial manner: three factors that were confounded in previous studies. We used a feature change-detection task, in which objects moved and could separate into independently-moving parts. Despite the movement and separation being completely task-irrelevant, we found that the separation invalidated the pointers. This happened in a shape task, where the separation changed both the objects and the task-relevant features, but importantly, also in a color task, where the separation destroyed the objects while leaving the task-relevant features intact. Furthermore, even in a color task where all items had identical shapes, object-separation invalidated the pointers. This suggests that objects and not task-relevant features underlie the pointer system. Finally, when each object-part could be individuated already before the separation, the pointers were maintained, suggesting that the pointers are specifically tied to objects rather than locations. These results shed new light on the pointers which underlie VWM performance, demonstrating that the pointer system is object-based regardless of the task requirements.

Delineating resetting and updating in visual working memory based on the object-to-representation correspondence

When an object we represent in visual working memory (VWM) changes, its representation is modified accordingly. VWM can either access and change the existing representation by an updating process, or it can reset, by encoding the object in its novel status as a new representation. Our goal was to show that the determining factor of updating versus resetting is the availability of a stable correspondence between the object and its VWM representation. Here, we demonstrate that updating relies on the object-to-representation mapping to access and modify the appropriate representation, while losing this mapping triggers a resetting process. We compared very similar situations of object separation that either allowed the mapping to hold, or caused it to be lost. When an object that was mapped to one representation separated, VWM reset, manifested by a sharp drop in the contralateral delay activity (CDA) amplitude (an electrophysiological marker of VWM contents; Experiment 1), and a behavioral cost to detect salient changes that co-occurred with the resetting-triggering event (Experiment 2). When each part was mapped to a different representation, the separation resulted in updating, with a gradual rise in CDA amplitude (Experiment 1), and a reduced behavioral cost (Experiment 2). Thus, while updating and resetting resulted in similar final representations (corresponding to the post-change objects), their dynamics were different, depending on the availability of the mapping. Our results reveal the triggering conditions of resetting and updating, establish methods to study these online processes, and highlight the importance of the object-to-representation correspondence in VWM.

The effect of negative emotion on multiple object tracking task: An ERP study

Previous studies have revealed that negative emotion may influence participants' cognitive processing. However, the neural mechanism of the impact of negative emotion on dynamic task like Multiple Object Tracking (MOT) is still unknown. This present study used electrophysiological (Event-Related Potentials, ERP) measures to investigate the effect of negative emotion on MOT tasks. Participants were required to complete MOT tasks while detecting the probe dots that would appear on targets, distractors or the space between them during tracking. Results of N2 amplitude showed that the distractor inhibition effect existed only in the neutral emotional picture condition. The P3 amplitude in the parietal area was also modulated by the emotion condition. P3 amplitude in the occipital area showed a target enhancement effect for both the neutral and negative emotion condition. The present study indicates that negative emotion could affect attention resource allocation during MOT.

Artificial consciousness and the consciousness-attention dissociation

Artificial Intelligence is at a turning point, with a substantial increase in projects aiming to implement sophisticated forms of human intelligence in machines. This research attempts to model specific forms of intelligence through brute-force search heuristics and also reproduce features of human perception and cognition, including emotions. Such goals have implications for artificial consciousness, with some arguing that it will be achievable once we overcome short-term engineering challenges. We believe, however, that phenomenal consciousness cannot be implemented in machines. This becomes clear when considering emotions and examining the dissociation between consciousness and attention in humans. While we may be able to program ethical behavior based on rules and machine learning, we will never be able to reproduce emotions or empathy by programming such control systems-these will be merely simulations. Arguments in favor of this claim include considerations about evolution, the neuropsychological aspects of emotions, and the dissociation between attention and consciousness found in humans. Ultimately, we are far from achieving artificial consciousness.

Does Previewing One Stimulus Feature Help Conjunction Search?

We examined the effects of previewing one aspect of a search display, in order to determine what subset of display information is most useful as a prelude to a search task. Observers were asked to indicate the presence or absence of a known target, in a conjunction search where the target was defined by the combination of colour and orientation (a yellow horizontal line presented among yellow vertical and pink horizontal distractors). In the colour preview condition of experiment 1, observers were first shown a 1 s preview of the locations and colours of the search items before the actual search set was presented. That is, search items first appeared as yellow and pink squares for 1 s, which each then turned into yellow and pink oriented lines (in the same locations) which comprised the display to be searched. In the orientation preview condition, observers were first shown a 1 s preview of the locations and orientations of the search items before the actual search display was presented. These two conditions were compared to a control condition consisting of standard conjunction search without any preview display. There was no effect of colour preview; there was a marginal effect of orientation preview, but in the opposite direction from what was expected—reaction time increased for orientation preview searches. In experiment 2 these previews were compared to two spatial cueing conditions; in this experiment the colour preview did provide a small amount of help. Finally, in experiment 3 both previews were presented in succession, and increased facilitation was found, in particular when the colour preview preceded the orientation preview. These findings are discussed in relation to the literature, in particular the Guided Search model (Wolfe et al 1989 Journal of Experimental Psychology: Human Perception and Performance15 419–433; Wolfe 1994 Psychonomic Bulletin & Review1 202–238).

Illumination frame of reference in the object-reviewing paradigm: A case of luminance and lightness

The present study combines the object-reviewing paradigm (Kahneman, Treisman, & Gibbs, 1992) with the checkershadow illusion (Adelson, 1995) to contrast the effects of objects' luminance versus lightness on the object-specific preview benefit. To this end, we manipulated objects' luminance and the amount of illumination given by an informative background scene in experiments. In line with previous studies (Moore, Stephens, & Hein, 2010), there was no object-specific preview benefit when objects were presented on a uniformly colored background and luminance switched between objects. In contrast, when objects were presented on the checkershadow illusion background which provided an explanation for the luminance switch, a reliable object-specific preview benefit was observed. This suggests that object correspondence as measured by the object-reviewing paradigm can be influenced by scene-induced, perceived lightness of objects' surfaces. We replicated this finding and moreover showed that the scene context only influences the object-specific preview benefit if the objects are perceived as part of the background scene.

Cognitive control: componential and yet emergent

In this commentary, I will argue that the componential and emergent views of cognitive control as defined by Cooper (2010) do not necessarily oppose each other, and I will try to make a case for their interdependence. First, I will use the construct of cognitive inhibition-one of the main componential control functions mentioned in the target articles-to illustrate my line of reasoning. Then, I will comment on how some of the target articles, each from a different perspective, bring arguments in favor of this integrative view.

Abnormalities in brain systems supporting individuation and enumeration in autism

Previous work indicates that adults with autism display a decreased capacity when rapidly enumerating small sets of elements (i.e., subitizing), compared to typically developing (TD) individuals. This ability is crucial for fundamental visual functions such as object individuation and parallel processing. Thus, the deficit in autism suggests limits in these skills. To examine the neural basis of this limitation, adults with and without high functioning autism rapidly enumerated 1 to 8 randomly located squares during a neuroimaging study. Typically, adults are thought to use parallel visual processes to quantify up to three or four elements, and serial processes to enumerate more (5+) elements. We hypothesized that parietal lobe regions associated with counting would be recruited with smaller sets of elements in adults with autism, compared to TD adults. Consistent with this hypothesis, activation in parietal regions increased with smaller set sizes in adults with autism compared to TD adults. Increased activation for three elements was evident in several regions, including those thought to underlie subitizing. In addition, regions specific to the counting range in TD adults were often equally active for set sizes in the subitizing range in the adults with autism. Finally, significant deactivation was evident in TD adults, presumably reflecting relative suppression of regions specialized for competing processes, but was not apparent in adults with autism. These differences in brain function in adults with autism on a simple enumeration task suggest atypical brain organization and function that is likely to impact most visual tasks, especially those with multiple elements.

The influence of early aging on eye movements during motor simulation

Movement based interventions such as imagery and action observation are used increasingly to support physical rehabilitation of adults during early aging. The efficacy of these more covert approaches is based on an intuitively appealing assumption that movement execution, imagery and observation share neural substrate; alteration of one influences directly the function of the other two. Using eye movement metrics this paper reports findings that question the congruency of the three conditions. The data reveal that simulating movement through imagery and action observation may offer older adults movement practice conditions that are not constrained by the age-related decline observed in physical conditions. In addition, the findings provide support for action observation as a more effective technique for movement reproduction in comparison to imagery. This concern for imagery was also seen in the less congruent temporal relationship in movement time between imagery and movement execution suggesting imagery inaccuracy in early aging.

An object-mediated updating account of insensitivity to transsaccadic change

Recent evidence has suggested that relatively precise information about the location and visual form of a saccade target object is retained across a saccade. However, this information appears to be available for report only when the target is removed briefly, so that the display is blank when the eyes land. We hypothesized that the availability of precise target information is dependent on whether a post-saccade object is mapped to the same object representation established for the presaccade target. If so, then the post-saccade features of the target overwrite the presaccade features, a process of object mediated updating in which visual masking is governed by object continuity. In two experiments, participants' sensitivity to the spatial displacement of a saccade target was improved when that object changed surface feature properties across the saccade, consistent with the prediction of the object-mediating updating account. Transsaccadic perception appears to depend on a mechanism of object-based masking that is observed across multiple domains of vision. In addition, the results demonstrate that surface-feature continuity contributes to visual stability across saccades.

The development of individuation in autism

Evidence suggests that people with autism rely less on holistic visual information than typical adults. The current studies examine this by investigating core visual processes that contribute to holistic processing--namely, individuation and element grouping--and how they develop in participants with autism and typically developing (TD) participants matched for age, IQ, and gender. Individuation refers to the ability to "see" approximately four elements simultaneously; grouping elements can modify how many elements can be individuated. We examined these processes using two well-established paradigms, rapid enumeration and multiple object tracking (MOT). In both tasks, a performance limit of four elements in typical adults is thought to reflect individuation capacity. Participants with autism displayed a smaller individuation capacity than TD controls, regardless of whether they were enumerating static elements or tracking moving ones. To manipulate the holistic information available via element grouping, elements were arranged into a design in rapid enumeration, or moved together in MOT. Performance in participants with autism was affected to a similar degree as TD participants by element grouping, whether the manipulation helped or hurt performance, consistent with evidence that some types of gestalt/grouping information are processed typically in autism. There was substantial development from childhood to adolescence in the speed of individuation in those with autism, but not from adolescence to adulthood, a pattern distinct from TD participants. These results reveal how core visual processes function in autism, and provide insight into the architecture of vision (i.e., individuation appears distinct from visual strengths in autism, such as visual search).

A simple proximity heuristic allows tracking of multiple objects through occlusion

Moving objects in the world present a challenge to the visual system, in that they often move in and out of view as they are occluded by other surfaces. Nevertheless, the ability to track multiple objects through periods of occlusion is surprisingly robust. Here, we identify a simple heuristic that underlies this ability: Pre- and postocclusion views of objects are linked together solely by their spatial proximity. Tracking through occlusion was always improved when the postocclusion instances reappeared closer to the preocclusion views. Strikingly, this was true even when objects' previous trajectories predicted different reappearance locations and when objects reappeared "too close," from invisible "slits" in empty space, rather than from more distant occluder contours. Tracking through occlusion appears to rely only on spatial proximity, and not on encoding heading information, likely reappearance locations, or the visible structure of occluders.

Spatio-temporal priority revisited: the role of feature identity and similarity for object correspondence in apparent motion

We live in a dynamic environment in which objects change location over time. To maintain stable object representations the visual system must determine how newly sampled information relates to existing object representations, the correspondence problem. Spatiotemporal information is clearly an important factor that the visual system takes into account when solving the correspondence problem, but is feature information irrelevant as some theories suggest? The Ternus display provides a context in which to investigate solutions to the correspondence problem. Two sets of three horizontally aligned disks, shifted by one position, were presented in alternation. Depending on how correspondence is resolved, these displays are perceived either as one disk "jumping" from one end of the row to the other (element motion) or as a set of three disks shifting back and forth together (group motion). We manipulated a feature (e.g., color) of the disks such that, if features were taken into account by the correspondence process, it would bias the resolution of correspondence toward one version or the other. Features determined correspondence, whether they were luminance-defined or not. Moreover, correspondence could be established on the basis of similarity, when features were not identical between alternations. Finally, the stronger the feature information supported a certain correspondence solution the more it dominated spatiotemporal information.

BAYESIAN PROPAGATION FOR PERCEIVING MOVING OBJECTS

In this paper we address the issue of how form and motion can be integrated in order to provide suitable information to attentively track multiple moving objects. Such integration is designed in a Bayesian framework, and a Belief Propagation technique is exploited to perform coherent form/motion labeling of regions of the observed scene. Experiments on both synthetic and real data are presented and discussed.

Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how "attentional shrouds" are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of crowding shows how the cortical magnification factor, among other variables, can cause multiple object surfaces to share a single surface-shroud resonance, thereby preventing recognition of the individual objects.

Building a mechanistic model of the development and function of the primary visual cortex

Researchers have used a very wide range of different experimental and theoretical approaches to help understand mammalian visual systems. These approaches tend to have quite different assumptions, strengths, and weaknesses. Computational models of the visual cortex, in particular, have typically implemented either a proposed circuit for part of the visual cortex of the adult, assuming a very specific wiring pattern based on findings from adults, or else attempted to explain the long-term development of a visual cortex region from an initially undifferentiated starting point. Previous models of adult V1 have been able to account for many of the measured properties of V1 neurons, while not explaining how these properties arise or why neurons have those properties in particular. Previous developmental models have been able to reproduce the overall organization of specific feature maps in V1, such as orientation maps, but are generally formulated at an abstract level that does not allow testing with real images or analysis of detailed neural properties relevant for visual function. In this review of results from a large set of new, integrative models developed from shared principles and a set of shared software components, I show how these models now represent a single, consistent explanation for a wide body of experimental evidence, and form a compact hypothesis for much of the development and behavior of neurons in the visual cortex. The models are the first developmental models with wiring consistent with V1, the first to have realistic behavior with respect to visual contrast, and the first to include all of the demonstrated visual feature dimensions. The goal is to have a comprehensive explanation for why V1 is wired as it is in the adult, and how that circuitry leads to the observed behavior of the neurons during visual tasks.

The Role of Surface Feature Continuity in Object-based Inhibition of Return

The contribution of surface feature continuity to object-based inhibition of return (IOR) was tested in three experiments. Participants executed a saccade to a previously fixated or unfixated colored disk after the object had moved to a new location. Object-based IOR was observed as lengthened saccade latency to a previously fixated object. The consistency of surface feature (color) and spatiotemporal information was manipulated to examine the feature used to define the persisting objects to which inhibition is assigned. If the two objects traded colors during motion, object-based IOR was reliably reduced (Experiment 2), suggesting a role for surface feature properties in defining the objects of object-based IOR. However, if the two objects changed to new colors during motion, object-based IOR was preserved (Experiment 1), and color consistency was not sufficient to support object continuity across a salient spatiotemporal discontinuity (Experiment 3). These results suggest that surface feature consistency plays a significant role in defining object persistence for the purpose of IOR, although surface features may be weighted less strongly than spatiotemporal features in this domain.

Cognitive control in majority search: a computational modeling approach

Despite the importance of cognitive control in many cognitive tasks involving uncertainty, the computational mechanisms of cognitive control in response to uncertainty remain unclear. In this study, we develop biologically realistic neural network models to investigate the instantiation of cognitive control in a majority function task, where one determines the category to which the majority of items in a group belong. Two models are constructed, both of which include the same set of modules representing task-relevant brain functions and share the same model structure. However, with a critical change of a model parameter setting, the two models implement two different underlying algorithms: one for grouping search (where a subgroup of items are sampled and re-sampled until a congruent sample is found) and the other for self-terminating search (where the items are scanned and counted one-by-one until the majority is decided). The two algorithms hold distinct implications for the involvement of cognitive control. The modeling results show that while both models are able to perform the task, the grouping search model fit the human data better than the self-terminating search model. An examination of the dynamics underlying model performance reveals how cognitive control might be instantiated in the brain for computing the majority function.

Developmental profiles for multiple object tracking and spatial memory: typically developing preschoolers and people with Williams syndrome

The ability to track moving objects, a crucial skill for mature performance on everyday spatial tasks, has been hypothesized to require a specialized mechanism that may be available in infancy (i.e. indexes). Consistent with the idea of specialization, our previous work showed that object tracking was more impaired than a matched spatial memory task in individuals with Williams syndrome (WS), a genetic disorder characterized by severe visuo-spatial impairment. We now ask whether this unusual pattern of performance is a reflection of general immaturity or of true abnormality, possibly reflecting the atypical brain development in WS. To examine these two possibilities, we tested typically developing 3- and 4-year-olds and people with WS on multiple object tracking (MOT) and memory for static spatial location. The maximum number of objects that could be correctly tracked or remembered (estimated from the k-statistic) showed similar developmental profiles in typically developing 3- and 4-year-old children, but the WS profile differed from either age group. People with WS could track more objects than 3-year-olds, and the same number as 4-year-olds, but they could remember the locations of more static objects than both 3- and 4-year-olds. Combining these data with those from our previous studies, we found that typically developing children show increases in the number of objects they can track or remember between the ages of 3 and 6, and these increases grow in parallel across the two tasks. In contrast, object tracking in older children and adults with WS remains at the level of 4-year-olds, whereas the ability to remember multiple locations of static objects develops further. As a whole, the evidence suggests that MOT and memory for static location develop in tandem typically, but not in WS. Atypical development of the parietal lobe in people with WS could play a causal role in the abnormal, uneven pattern of performance in WS. This interpretation is consistent with the idea that multiple object tracking engages different mechanisms from those involved in memory for static object location, and that the former can be particularly disrupted by atypical development.

Tracking multiple objects is limited only by object spacing, not by speed, time, or capacity

In dealing with a dynamic world, people have the ability to maintain selective attention on a subset of moving objects in the environment. Performance in such multiple-object tracking is limited by three primary factors-the number of objects that one can track, the speed at which one can track them, and how close together they can be. We argue that this last limit, of object spacing, is the root cause of all performance constraints in multiple-object tracking. In two experiments, we found that as long as the distribution of object spacing is held constant, tracking performance is unaffected by large changes in object speed and tracking time. These results suggest that barring object-spacing constraints, people could reliably track an unlimited number of objects as fast as they could track a single object.

Object correspondence across brief occlusion is established on the basis of both spatiotemporal and surface feature cues

The correspondence problem is a classic issue in vision and cognition. Frequent perceptual disruptions, such as saccades and brief occlusion, create gaps in perceptual input. How does the visual system establish correspondence between objects visible before and after the disruption? Current theories hold that object correspondence is established solely on the basis of an object's spatiotemporal properties and that an object's surface feature properties (such as color or shape) are not consulted in correspondence operations. In five experiments, we tested the relative contributions of spatiotemporal and surface feature properties to establishing object correspondence across brief occlusion. Correspondence operations were strongly influenced both by the consistency of an object's spatiotemporal properties across occlusion and by the consistency of an object's surface feature properties across occlusion. These data argue against the claim that spatiotemporal cues dominate the computation of object correspondence. Instead, the visual system consults multiple sources of relevant information to establish continuity across perceptual disruption.

Mathematical skills in Williams syndrome: insight into the importance of underlying representations

Williams syndrome (WS) is a developmental disorder characterized by relatively spared verbal skills and severe visuospatial deficits. Serious impairments in mathematics have also been reported. This article reviews the evidence on mathematical ability in WS, focusing on the integrity and developmental path of two fundamental representations, namely those that support judgments of "how much" (i.e., magnitude) and "how many" (i.e., number of objects). Studies on magnitude or "number line" representation in WS suggest that this core aspect of mathematical ability, is atypical in WS throughout development, causing differences on some but not all aspects of math. Studies on the representation of small numbers of objects in WS are also reviewed, given the proposed links between this type of representation and early number skills such as counting. In WS, representation appears to be relatively typical in infancy but limitations become evident by maturity, suggesting a truncated developmental trajectory. The math deficits in WS are consistent with neurological data indicating decreased gray matter and hypoactivation in parietal areas in WS, as these areas are implicated in mathematical processing as well as visuospatial abilities and visual attention. In spite of their deficits in core mathematical representations, people with WS can learn many mathematical skills and show some strengths, such as reading numbers. Thus individuals with WS may be able to take advantage of their relatively strong verbal skills when learning some mathematical tasks. The uneven mathematical abilities found in persons with WS provide insight into not only appropriate remediation for this developmental disorder but also into the precursors of mathematical ability, their neural substrates, and their developmental importance.

A repetition-suppression account of between-trial effects in a modified Stroop paradigm

Theories that postulate cognitive inhibition are very common in psychology and cognitive neuroscience [e.g., Hasher, L., Lustig, C., & Zacks, R. T. (2007). Inhibitory mechanisms and the control of attention. In A. Conway, C. Jarrold, M. Kane, A. Miyake, A. Towse, & J. Towse (Eds.), Variation in working memory (pp. 227-249). New York, NY: Oxford, University Press], although they have recently been severely criticized [e.g., MacLeod, C. M., Dodd, M. D., Sheard, E. D., Wilson, D. E., & Bibi, U. (2003). In opposition to inhibition. In H. Ross (Ed.), The psychology of learning and motivation (Vol. 43, pp. 163-214). Elsevier Science]. This paper poses and attempts to answer the question whether a research program with cognitive inhibition as its main theoretical assumption is still worth pursuing. We present a set of empirical data from a modified Stroop paradigm that replicates previously reported findings. These findings refer to between-trial effects previously described in the literature on Stroop, negative priming, and inhibition-of-return. Existing theoretical accounts fail to explain all these effects in an integrated way. A repetition-suppression mechanism is proposed in order to account for these data. This mechanism is instantiated as a computational cognitive model. The theoretical implications of this model are discussed.

Taking a new look at looking at nothing

A crucial question in cognitive science is how linguistic and visual information are integrated. Previous research has shown that eye movements to objects in the visual environment are locked to linguistic input. More surprisingly, listeners fixate on now-empty regions that had previously been occupied by relevant objects. This 'looking at nothing' phenomenon has been linked to the claim that the visual system constructs sparse representations of the external world and relies on saccades and fixations to extract information in a just-in-time manner. Our model provides a different explanation: based on recent work in visual cognition and memory, it assumes that the visual system creates and stores detailed internal memory representations, and that looking at nothing facilitates retrieval of those representations.

Feature head-start: Conjunction search following progressive feature disclosure

When a colour/orientation conjunction search display is immediately preceded by a display that shows either the colour or the orientation of each upcoming search item, search is faster after colour-preview than after orientation-preview. One explanation for this feature asymmetry is that colour has priority access to attentional selection relative to features such as orientation and size. In support of this hypothesis, we show that this asymmetry persists even after colour and orientation feature search performance is equated. However, this notion was ruled out by our subsequent experiments in which the target was defined by conjunction of colour and size; colour-preview was less helpful than size-preview (even though colour-feature search was faster than size-feature search, for these feature values). A final set of experiments tested size-preview vs. orientation-preview for size/orientation conjunction search, using stimuli for which orientation-feature search was easier than size-feature search. Size-preview produced much faster search than orientation-preview, demonstrating again that ease of feature search does not predict effects of a feature-preview. Overall, size produced the most facilitation when presented as a feature-preview (for both colour/size and size/orientation conjunctions), followed by colour (for colour/orientation conjunction but not for colour/size conjunction) and then orientation (which never facilitated search). Whilst each feature-preview may potentially facilitate search, the transition from feature-preview display to search display could disrupt search processes, because of luminance and/or colour changes. We see evidence for some sort of disruption when the feature-preview slows search. An explanation of this set of results must focus on both facilitation and disruption: these effects are not mutually exclusive, and neither suffices alone, since performance after feature-preview can be significantly better or significantly worse than conjunction baseline.

Establishing object correspondence across eye movements: Flexible use of spatiotemporal and surface feature information

Visual input is frequently disrupted by eye movements, blinks, and occlusion. The visual system must be able to establish correspondence between objects visible before and after a disruption. Current theories hold that correspondence is established solely on the basis of spatiotemporal information, with no contribution from surface features. In five experiments, we tested the relative contributions of spatiotemporal and surface feature information in establishing object correspondence across saccades. Participants generated a saccade to one of two objects, and the objects were shifted during the saccade so that the eyes landed between them, requiring a corrective saccade to fixate the target. To correct gaze to the appropriate object, correspondence must be established between the remembered saccade target and the target visible after the saccade. Target position and surface feature consistency were manipulated. Contrary to existing theories, surface features and spatiotemporal information both contributed to object correspondence, and the relative weighting of the two sources of information was governed by the demands of the task. These data argue against a special role for spatiotemporal information in object correspondence, indicating instead that the visual system can flexibly use multiple sources of relevant information.