Visual indexes, preconceptual objects, and situated vision

The calculating brain

The human brain possesses neural networks and mechanisms enabling the representation of numbers, basic arithmetic operations, and mathematical reasoning. Without the ability to represent numerical quantity and perform calculations, our scientifically and technically advanced culture would not exist. However, the origins of numerical abilities are grounded in an intuitive understanding of quantity deeply rooted in biology. Nevertheless, more advanced symbolic arithmetic skills require a cultural background with formal mathematical education. In the past two decades, cognitive neuroscience has seen significant progress in understanding the workings of the calculating brain through various methods and model systems. This review begins by exploring the mental and neuronal representations of nonsymbolic numerical quantity and then progresses to symbolic representations acquired in childhood. During arithmetic operations (addition, subtraction, multiplication, and division), these representations are processed and transformed according to arithmetic rules and principles, leveraging different mental strategies and types of arithmetic knowledge that can be dissociated in the brain. Although it was once believed that number processing and calculation originated from the language faculty, it is now evident that mathematical and linguistic abilities are primarily processed independently in the brain. Understanding how the healthy brain processes numerical information is crucial for gaining insights into debilitating numerical disorders, including acquired conditions like acalculia and learning-related calculation disorders such as developmental dyscalculia.

Activation thresholds, not quitting thresholds, account for the low prevalence effect in dynamic search

The low-prevalence effect (LPE) is the finding that target detection rates decline as targets become less frequent in a visual search task. A major source of this effect is thought to be that fewer targets result in lower quitting thresholds, i.e., observers respond target-absent after looking at fewer items compared to searches with a higher prevalence of targets. However, a lower quitting threshold does not directly account for an LPE in searches where observers continuously monitor a dynamic display for targets. In these tasks there are no discrete "trials" to which a quitting threshold could be applied. This study examines whether the LPE persists in this type of dynamic search context. Experiment 1 was a 2 (dynamic/static) x 2 (10%/40% prevalence targets) design. Although overall performance was worse in the dynamic task, both tasks showed a similar magnitude LPE. In Experiment 2, we replicated this effect using a task where subjects searched for either of two targets (Ts and Ls). One target appeared infrequently (10%) and the other moderately (40%). Given this method of manipulating prevalence rate, the quitting threshold explanation does not account for the LPE even for static displays. However, replicating Experiment 1, we found an LPE of similar magnitude for both search scenarios, and lower target detection rates with the dynamic displays, demonstrating the LPE is a potential concern for both static and dynamic searches. These findings suggest an activation threshold explanation of the LPE may better account for our observations than the traditional quitting threshold model.

Multiple Object Tracking Without Pre-attentive Indexing

Multiple object tracking (MOT) involves simultaneous tracking of a certain number of target objects amongst a larger set of objects as they all move unpredictably over time. The prevalent explanation for successful target tracking by humans in MOT involving visually identical objects is based on the Visual Indexing Theory. This assumes that each target is indexed by a pointer using a non-conceptual mechanism to maintain an object's identity even as its properties change over time. Thus, successful tracking requires successful indexing and the absence of identification errors. Identity maintenance and successful tracking are measured in terms of identification (ID) and tracking accuracy respectively, with higher accuracy indicating better identity maintenance or better tracking. Existing evidence suggests that humans have high tracking accuracy despite poor identification accuracy, suggesting that it might be possible to perform MOT without indexing. Our work adds to existing evidence for this position through two experiments, and presents a computational model of multiple object tracking that does not require indexes. Our empirical results show that identification accuracy is aligned with tracking accuracy in humans for tracking up to three, but is lower when tracking more objects. Our computational model of MOT without indexing accounts for several empirical tracking accuracy patterns shown in earlier studies, reproduces the dissociation between tracking and identification accuracy produced earlier in the literature as well as in our experiments, and makes several novel predictions.

Electrophysiological hallmarks for event relations and event roles in working memory

The ability to maintain events (i.e., interactions between/among objects) in working memory is crucial for our everyday cognition, yet the format of this representation is poorly understood. The current ERP study was designed to answer two questions: How is maintaining events (e.g., the tiger hit the lion) neurally different from maintaining item coordinations (e.g., the tiger and the lion)? That is, how is the event relation (present in events but not coordinations) represented? And how is the agent, or initiator of the event encoded differently from the patient, or receiver of the event during maintenance? We used a novel picture-sentence match-across-delay approach in which the working memory representation was "pinged" during the delay, replicated across two ERP experiments with Chinese and English materials. We found that maintenance of events elicited a long-lasting late sustained difference in posterior-occipital electrodes relative to non-events. This effect resembled the negative slow wave reported in previous studies of working memory, suggesting that the maintenance of events in working memory may impose a higher cost compared to coordinations. Although we did not observe significant ERP differences associated with pinging the agent vs. the patient during the delay, we did find that the ping appeared to dampen the ongoing sustained difference, suggesting a shift from sustained activity to activity silent mechanisms. These results suggest a new method by which ERPs can be used to elucidate the format of neural representation for events in working memory.

Effects of spatial frequency cross-adaptation on the visual number sense

When observing a simple visual scene such as an array of dots, observers can easily and automatically extract their number. How does our visual system accomplish this? We investigate the role of specific spatial frequencies to the encoding of number through cross-adaptation. In two experiments, observers were peripherally adapted to six randomly generated sinusoidal gratings varying from relatively low-spatial frequency (M = 0.44 c/deg) to relatively high-spatial frequency (M = 5.88 c/deg). Subsequently, observers judged which side of the screen had a higher number of dots. We found a strong number-adaptation effect to low-spatial frequency gratings (i.e., participants significantly underestimated the number of dots on the adapted side) but a significantly reduced adaptation effect for high-spatial frequency gratings. Various control conditions demonstrate that these effects are not due to a generic response bias for the adapted side, nor moderated by dot size or spacing effects. In a third experiment, we observed no cross-adaptation for centrally presented gratings. Our results show that observers' peripheral number perception can be adapted even with stimuli lacking any numeric or segmented object information and that low spatial frequencies adapt peripheral number perception more than high ones. Together, our results are consistent with recent number perception models that suggest a key role for spatial frequency in the extraction of number from the visual signal (e.g., Paul, Ackooij, Ten Cate, & Harvey, 2022), but additionally suggest that some spatial frequencies - especially in the low range and in the periphery - may be weighted more by the visual system when estimating number. We argue that the cross-adaptation paradigm is also a useful methodology for discovering the primitives of visual number encoding.

Dissociable online integration processes in visual working memory

Visual working memory has severe capacity limits, creating a bottleneck for active processing. A key way of mitigating this limitation is by chunking, i.e. compressing several pieces of information into one visual working memory representation. However, despite decades of research, chunking efficiency remains debated because of mixed evidence. We propose that there are actually 2 integration mechanisms: Grouping combines several objects to one representation, and object-unification merges the parts of a single object. Critically, we argue that the fundamental distinction between the 2 processes is their differential use of the pointer system, the indexing process connecting visual working memory representations with perception. In grouping, the objects that are represented together still maintain independent pointers, making integration costly but highly flexible. Conversely, object-unification fuses the pointers as well as the representations, with the single pointer producing highly efficient integration but blocking direct access to individual parts. We manipulated integration cues via task-irrelevant movement, and monitored visual working memory's online electrophysiological marker. Uniquely colored objects were flexibly grouped and ungrouped via independent pointers (experiment 1). If objects turned uniformly black, object-integration could not be undone (experiment 2), requiring visual working memory to reset before re-individuation. This demonstrates 2 integration levels (representational-merging versus pointer-compression) and establishes the dissociation between visual working memory representations and their underlying pointers.

Keeping quantifier meaning in mind: Connecting semantics, cognition, and pragmatics

A complete theory of the meaning of linguistic expressions needs to explain their semantic properties, their links to non-linguistic cognition, and their use in communication. Even though in principle interconnected, these areas are generally not pursued in tandem. We present a novel take on the semantics-cognition-pragmatics interface. We propose that formal semantic differences in expressions' meanings lead those meanings to activate distinct cognitive systems, which in turn have downstream effects on when speakers prefer to use those expressions. As a case study, we focus on the quantifiers "each" and "every", which can be used to talk about the same state of the world, but have been argued to differ in meaning. In particular, we adopt a mentalistic proposal about these quantifiers on which "each" has a purely individualistic meaning that interfaces with the psychological system for representing object-files, whereas "every" has a meaning that implicates a group and interfaces with the psychological system for representing ensembles. In seven experiments, we demonstrate that this account correctly predicts both known and newly-observed constraints on how "each" and "every" are pragmatically used. More generally, this integrated approach to semantics, cognition, and pragmatics suggests that canonical patterns of language use can be affected in predictable ways by fine-grained differences in semantic meanings and the cognitive systems to which those meanings connect.

Events and objects are similar cognitive entities

Logico-semantic theories have long noted parallels between the linguistic representation of temporal entities (events) and spatial entities (objects): bounded (or telic) predicates such as fix a car resemble count nouns such as sandcastle because they are "atoms" that have well-defined boundaries, contain discrete minimal parts and cannot be divided arbitrarily. By contrast, unbounded (or atelic) phrases such as drive a car resemble mass nouns such as sand in that they are unspecified for atomic features. Here, we demonstrate for the first time the parallels in the perceptual-cognitive representation of events and objects even in entirely non-linguistic tasks. Specifically, after viewers form categories of bounded or unbounded events, they can extend the category to objects or substances respectively (Experiments 1 and 2). Furthermore, in a training study, people successfully learn event-to-object mappings that respect atomicity (i.e., grouping bounded events with objects and unbounded events with substances) but fail to acquire the opposite, atomicity-violating mappings (Experiment 3). Finally, viewers can spontaneously draw connections between events and objects without any prior training (Experiment 4). These striking similarities between the mental representation of events and objects have implications for current theories of event cognition, as well as the relationship between language and thought.

Disentangling working memory from multiple-object tracking: Evidence from dual-task interferences

Multiple object tracking (MOT) is generally regarded as a pure attention-consuming task that draws heavily on attention resources. In the present study, we adopted a cross-channel visual-audio dual-task paradigm, i.e., the MOT task combined with the concurrent auditory N-back working memory task, to test whether working memory indeed plays a necessary role in the process of multiple tracking, as well as to further identify the specific types of working memory components involved in this process. Experiments 1a and 1b examined the relationship between the MOT task and nonspatial object working memory (OWM) processing by manipulating the tracking load and working memory load, respectively. Results in both experiments indicated that the concurrent nonspatial OWM task did not have a significant effect on the tracking capacity of the MOT task. In contrast, Experiments 2a and 2b examined the relationship between the MOT task and spatial working memory (SWM) processing by a similar approach. Results in both experiments indicated that the concurrent SWM task significantly impaired the tracking capacity of the MOT task, showing a gradual decrease with increasing SWM load. Overall, our study provides empirical evidence that multiple object tracking does involve working memory, primarily related to spatial working memory rather than nonspatial object working memory, which sheds more light on the mechanisms of multiple object tracking.

The Binding Problem 2.0: Beyond Perceptual Features

The "binding problem" has been a central question in vision science for some 30 years: When encoding multiple objects or maintaining them in working memory, how are we able to represent the correspondence between a specific feature and its corresponding object correctly? In this letter we argue that the boundaries of this research program in fact extend far beyond vision, and we call for coordinated pursuit across the broader cognitive science community of this central question for cognition, which we dub "Binding Problem 2.0".

Are all real-world objects created equal? Estimating the "set-size" of the search target in visual working memory

Are all real-world objects created equal? Visual search difficulty increases with the number of targets and as target-related visual working memory (VWM) load increases. Our goal was to investigate the load imposed by individual real-world objects held in VWM in the context of search. Measures of visual clutter attempt to quantify real-world set-size in the context of scenes. We applied one of these measures, the number of proto-objects, to individual real-world objects and used contralateral delay activity (CDA) to measure the resulting VWM load. The current study presented a real-world object as a target cue, followed by a delay where CDA was measured. This was followed by a four-object search array. We compared CDA and later search performance from target cues containing a high or low number of proto-objects. High proto-object target cues resulted in greater CDA, longer search RTs, target dwell times, and reduced search guidance, relative to low proto-object targets. These findings demonstrate that targets with more proto-objects result in a higher VWM load and reduced search performance. This shows that the number of proto-objects contained within individual objects produce set-size like effects in VWM and suggests proto-objects may be a viable unit of measure of real-world VWM load. Importantly, this demonstrates that not all real-world objects are created equal.

Unravelling the Physiological Correlates of Mental Workload Variations in Tracking and Collision Prediction Tasks

Modern work environments have extensive interactions with technology and greater cognitive complexity of the tasks, which results in human operators experiencing increased mental workload. Air traffic control operators routinely work in such complex environments, and we designed tracking and collision prediction tasks to emulate their elementary tasks. The physiological response to the workload variations in these tasks was elucidated to untangle the impact of workload variations experienced by operators. Electroencephalogram (EEG), eye activity, and heart rate variability (HRV) data were recorded from 24 participants performing tracking and collision prediction tasks with three levels of difficulty. Our findings indicate that variations in task load in both these tasks are sensitively reflected in EEG, eye activity and HRV data. Multiple regression results also show that operators' performance in both tasks can be predicted using the corresponding EEG, eye activity and HRV data. The results also demonstrate that the brain dynamics during each of these tasks can be estimated from the corresponding eye activity, HRV and performance data. Furthermore, the markedly distinct neurometrics of workload variations in the tracking and collision prediction tasks indicate that neurometrics can provide insights on the type of mental workload. These findings have applicability to the design of future mental workload adaptive systems that integrate neurometrics in deciding not just "when" but also "what" to adapt. Our study provides compelling evidence in the viability of developing intelligent closed-loop mental workload adaptive systems that ensure efficiency and safety in complex work environments.

Attentional capture in multiple object tracking

Attentional processes are generally assumed to be involved in multiple object tracking (MOT). The attentional capture paradigm is regularly used to study conditions of attentional control. It has up to now not been used to assess influences of sudden onset distractor stimuli in MOT. We investigated whether attentional capture does occur in MOT: Are onset distractors processed at all in dynamic attentional tasks? We found that sudden onset distractors were effective in lowering probe detection, thus demonstrating attentional capture. Tracking performance as dependent measure was not affected. The attentional capture effect persisted in conditions of higher tracking load (Experiment 2) and was dramatically increased in lower presentation frequency of the onset distractor (Experiment 3). Tracking performance was shown to suffer only when onset distractors were presented serially with very short time gaps in between, thus effectively disturbing re-engaging attention on the tracking set (Experiment 4). We discuss that rapid dis- and re-engagement of the attention process on target objects and an additional more basic process that continuously provides location information allow managing strong disruptions of attention during tracking.

First-person dimensions of mental agency in visual counting of moving objects

Counting objects, especially moving ones, is an important capacity that has been intensively explored in experimental psychology and related disciplines. The common approach is to trace the three counting principles (estimating, subitizing, serial counting) back to functional constructs like the Approximate Number System and the Object Tracking System. While usually attempts are made to explain these competing models by computational processes at the neural level, their first-person dimensions have been hardly investigated so far. However, explanatory gaps in both psychological and philosophical terms may suggest a methodologically complementary approach that systematically incorporates introspective data. For example, the mental-action debate raises the question of whether mental activity plays only a marginal role in otherwise automatic cognitive processes or if it can be developed in such a way that it can count as genuine mental action. To address this question not only theoretically, we conducted an exploratory study with a moving-dots task and analyze the self-report data qualitatively and quantitatively on different levels. Building on this, a multi-layered, consciousness-immanent model of counting is presented, which integrates the various counting principles and concretizes mental agency as developing from pre-reflective to increasingly conscious mental activity.

How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests

We investigated whether standardized neuropsychological tests and experimental cognitive paradigms measure the same cognitive faculties. Specifically, do neuropsychological tests commonly used to assess attention measure the same construct as attention paradigms used in cognitive psychology and neuroscience? We built on the “general attention factor”, comprising several widely used experimental paradigms (Huang et al., 2012). Participants (n = 636) completed an on-line battery (TestMyBrain.org) of six experimental tests [Multiple Object Tracking, Flanker Interference, Visual Working Memory, Approximate Number Sense, Spatial Configuration Visual Search, and Gradual Onset Continuous Performance Task (Grad CPT)] and eight neuropsychological tests [Trail Making Test versions A & B (TMT-A, TMT-B), Digit Symbol Coding, Forward and Backward Digit Span, Letter Cancellation, Spatial Span, and Arithmetic]. Exploratory factor analysis in a subset of 357 participants identified a five-factor structure: (1) attentional capacity (Multiple Object Tracking, Visual Working Memory, Digit Symbol Coding, Spatial Span), (2) search (Visual Search, TMT-A, TMT-B, Letter Cancellation); (3) Digit Span; (4) Arithmetic; and (5) Sustained Attention (GradCPT). Confirmatory analysis in 279 held-out participants showed that this model fit better than competing models. A hierarchical model where a general cognitive factor was imposed above the five specific factors fit as well as the model without the general factor. We conclude that Digit Span and Arithmetic tests should not be classified as attention tests. Digit Symbol Coding and Spatial Span tap attentional capacity, while TMT-A, TMT-B, and Letter Cancellation tap search (or attention-shifting) ability. These five tests can be classified as attention tests.

Quantitative abilities of invertebrates: a methodological review

Quantitative abilities are widely recognized to play important roles in several ecological contexts, such as foraging, mate choice, and social interaction. Indeed, such abilities are widespread among vertebrates, in particular mammals, birds, and fish. Recently, there has been an increasing number of studies on the quantitative abilities of invertebrates. In this review, we present the current knowledge in this field, especially focusing on the ecological relevance of the capacity to process quantitative information, the similarities with vertebrates, and the different methods adopted to investigate this cognitive skill. The literature argues, beyond methodological differences, a substantial similarity between the quantitative abilities of invertebrates and those of vertebrates, supporting the idea that similar ecological pressures may determine the emergence of similar cognitive systems even in distantly related species.

Decoding location-specific and location-invariant stages of numerosity processing in subitizing

Extracting the number of objects in perceived scenes is a fundamental cognitive ability. Number processing is proposed to rely on two consecutive stages: an early object location map that captures individuated objects in a location‐specific way and a subsequent location‐invariant representation that captures numerosity at an abstract level. However, it is unclear whether this framework applies to small numerosities that can be individuated at once (“subitized”). Here, we reanalyzed data from two electroencephalography (EEG) experiments using multivariate pattern decoding to identify location‐specific and location‐invariant stages of numerosity processing in the subitizing range. In these experiments, one to three targets were presented in the left or right hemifield, which allowed for decoding target numerosity within each hemifield separately (location specific) or across hemifields (location invariant). Experiment 1 indicated the presence of a location‐specific stage (180–200 ms after stimulus), followed by a location‐invariant stage (300 ms after stimulus). A time‐by‐channel searchlight analysis revealed that the early location‐specific stage is most evident at occipital channels, whereas the late location‐invariant stage is most evident at parietal channels. Experiment 2 showed that both location‐specific and location‐invariant components are engaged only during tasks that explicitly require numerosity processing, ruling out automatic, and passive recording of numerosity. These results suggest that numerosity coding in subitizing is strongly grounded on an attention‐based, location‐specific stage. This stage overlaps with the subsequent activation of a location‐invariant stage, where a full representation of numerosity is finalized. Taken together, our findings provide clear evidence for a temporal and spatial segregation of location‐specific and location‐invariant numerosity coding of small object numerosities.

The role of kinematic properties in multiple object tracking

People commonly track objects moving in complex natural displays and their performance in the multiple object tracking paradigm has been used to study such visual attention for more than three decades. Given the theoretical and practical importance of object tracking, it is critical to understand how people solve the correspondence problem to track objects; however, it remains unclear what information people use to achieve this feat. In particular, although people can track multiple moving objects based on their positions, there is ambiguity about whether people can track objects via higher order kinematic information, such as velocity. We designed a paradigm in which position was rendered uninformative to directly examine whether people could use higher order kinematic information to track multiple objects. We find that people can track via velocity, but not acceleration, even though observers can reliably detect the acceleration cue that they cannot use for tracking. Furthermore, we show a capacity constraint on using higher order kinematic information—people perform worse when required to use velocity to resolve correspondence for multiple object pairs simultaneously. Together, our results suggest that, although people can use higher order kinematic information for object tracking, precise higher order kinematic information is not freely available from the early visual system.

Multiple-object tracking and visually guided touch

Multiple-object tracking (MOT) involves keeping track of the positions of multiple independent target items as they move among distractors. According to Pylyshyn (Cognition, 80, 127-158, 2001), the item individuation mechanism used in MOT is also used in visually guided touch. To test this, we compared single-task MOT (MOT alone) with dual-task MOT (MOT while touching items that changed colour), looking for interference: cases where single-task performance was worse than dual-task. Touching items that changed colour interfered with MOT, but effects varied depending on whether the item touched was a target or distractor in MOT. Touching distractors always reduced MOT performance more than touching targets. Touching targets during MOT did not interfere when there was only a single target to track but interfered more once there were two or more targets. We also measured interference based on latencies to touch items that changed colour, comparing single and dual-task conditions (touch alone, touch + track). MOT interfered with touch, increasing RT to touch items that changed colour, with latencies significantly higher when those items were distractors rather than targets. Overall, there was general interference (differences between single and dual-task performance), as might be expected if coordinating the two tasks required a common limited resource such as general attention or working memory. However, there was also differential interference that varied based on whether the touched item was a target or distractor in MOT. This differential interference suggests the specific mechanisms used in MOT may also play a role in visually guided touch.

Information stored in memory affects abductive reasoning

Abductive reasoning describes the process of deriving an explanation from given observations. The theory of abductive reasoning (TAR; Johnson and Krems, Cognitive Science 25:903-939, 2001) assumes that when information is presented sequentially, new information is integrated into a mental representation, a situation model, the central data structure on which all reasoning processes are based. Because working memory capacity is limited, the question arises how reasoning might change with the amount of information that has to be processed in memory. Thus, we conducted an experiment (N = 34) in which we manipulated whether previous observation information and previously found explanations had to be retrieved from memory or were still visually present. Our results provide evidence that people experience differences in task difficulty when more information has to be retrieved from memory. This is also evident in changes in the mental representation as reflected by eye tracking measures. However, no differences are found between groups in the reasoning outcome. These findings suggest that individuals construct their situation model from both information in memory as well as external memory stores. The complexity of the model depends on the task: when memory demands are high, only relevant information is included. With this compensation strategy, people are able to achieve similar reasoning outcomes even when faced with tasks that are more difficult. This implies that people are able to adapt their strategy to the task in order to keep their reasoning successful.

Why Not Just Features? Reconsidering Infants' Behavior in Individuation Tasks

It counts as empirically proven that infants can individuate objects. Object individuation is assumed to be fundamental in the development of infants' ontology within the object-first account. It crucially relies on an object-file (OF) system, representing both spatiotemporal ("where") and categorical ("what") information about objects as solid, cohesive bodies moving continuously in space and time. However, infants' performance in tasks requiring them to use featural information to detect individuation violations appears to be at odds with the object-first account. In such cases, infants do not appear to be able to develop correct expectations about the numerosity of objects. Recently, proponents of the object-first account proposed that these individuation failures result from integration errors between the OF system and an additional physical reasoning system. We are going to argue that the predictions of a feature-based physical-reasoning (PR) system are sufficient for explaining infants' behavior. The striking predictive power of the PR system calls into question the relevance of the OF system and, thereby, challenges the assumption that infants can individuate objects early on.

Bumblebees Use Sequential Scanning of Countable Items in Visual Patterns to Solve Numerosity Tasks

Most research in comparative cognition focuses on measuring if animals manage certain tasks; fewer studies explore how animals might solve them. We investigated bumblebees’ scanning strategies in a numerosity task, distinguishing patterns with two items from four and one from three, and subsequently transferring numerical information to novel numbers, shapes, and colors. Video analyses of flight paths indicate that bees do not determine the number of items by using a rapid assessment of number (as mammals do in “subitizing”); instead, they rely on sequential enumeration even when items are presented simultaneously and in small quantities. This process, equivalent to the motor tagging (“pointing”) found for large number tasks in some primates, results in longer scanning times for patterns containing larger numbers of items. Bees used a highly accurate working memory, remembering which items have already been scanned, resulting in fewer than 1% of re-inspections of items before making a decision. Our results indicate that the small brain of bees, with less parallel processing capacity than mammals, might constrain them to use sequential pattern evaluation even for low quantities.

Individuation of object parts in aging

Research on enumeration with isolated objects has indicated that young and older adults can report up to three elements with similar efficiency (subitizing effect). Recent studies on subitizing in young adults have shown that individuation occurs over parts of an object as efficiently as over physically disconnected objects, suggesting that spatial separation is a sufficient requirement for efficient individuation. Do young and older adults share this sufficient requirement? In two experiments, we tested for the presence of subitizing in an enumeration task with a varying number of distinct objects and object parts. In Experiment 1, results indicated the presence of a bilinear function (with an inflection point between 3 and 4 elements, a proxy for subitizing) in the response speed of young and older adults, and in both stimulus conditions. In addition, the enumeration slope in older participants was steeper for object parts than for objects in the subitizing range, possibly due to perceptual degradation (e.g., in contour detection). The pattern found generalizes to other stimuli (Experiment 2), thus highlighting the robustness of the present findings. Overall, the results indicate that while some perceptual factors (such as contour detection or curvature polarity) may hamper subitizing speed of older individuals relative to young adults, the subitizing span remains at approximately three to four elements for multiple objects and object parts in both young and older adults. Thus, individuation of multiple objects and object parts is a mechanism relatively resistant to aging.

Audiovisual integration capacity modulates as a function of illusory visual contours, visual display circumference, and sound type

Research into the capacity of audiovisual integration has previously assessed whether capacity is strictly limited to a single item, or whether it can exceed one item under certain environmental conditions. More recently, investigations have turned to examining the effects of various stimulus factors on capacity. Across two experiments, we looked at a number of factors that were expected to play a modulatory role on capacity. Experiment 1 deployed a manipulation of illusory polygons, revealing an increase in audiovisual capacity, even in an absence of visual connections. This demonstrates that exceeding the capacity of 1 does not only represent a functional increase in the binding of a singular, complex visual object, but that it can also represent binding of multiple simpler objects. Findings also support the hypothesis that capacity modulates quantitatively, but not qualitatively, with respect to speed of presentation. Experiment 2 examined the effects of different sound types (sine tones or white noise) and of different spatial visual field sizes on the capacity of audiovisual integration. The results indicate that capacity is maximized when stimuli are presented in a smaller circle (7.5°) if alongside a sine tone, and when presented in a larger circle (18.5°) alongside white noise. These results suggest that audiovisual integration capacity is dependent on the combination of sound type and visual spatial field size. The combination of these results reveal additional phenomenological features of the capacity of audiovisual integration, and provides impetus for further research into applications of the findings.

Periphere Wahrnehmung im Sport

Zusammenfassung. Die periphere Wahrnehmung im Sport ist eine theoretische wie methodische Herausforderung. Während die bisher in der Literatur diskutierten Funktionalitäten des gleichzeitigen peripheren Monitorings mehrerer Objekte, der Detektion von peripheren Bewegungsveränderungen und der peripheren Preview-Funktion zur Planung von Blicksprüngen gut begründet scheinen, fehlte bislang deren eindeutiger empirischer Nachweis. Mit Hilfe des Multiple-Objekt-Tracking-Paradigmas konnten die beiden erstgenannten Funktionalitäten empirisch untermauert und in diesem Zuge zu berücksichtigende visuelle und aufmerksamkeitsbedingte Randbedingungen bestimmt werden. In einem weiteren Schritt wurden die neu eingeführten Begriffe Anker, Pivot und Spot mit den gefundenen Funktionalitäten in Beziehung gesetzt. Abschließend wurden konkrete Vorhersagen für sportspezifische Untersuchungen formuliert, um die so umschriebenen Funktionalitäten empirisch zu überprüfen. Die Ergebnisse solcher Untersuchungen werden zeigen, inwieweit sich die grundlagenwissenschaftlichen Befunde auf Belange des Sports transferieren lassen. Für die Sportpraxis könnte es dabei ein wichtiges Ziel sein, ein funktional begründetes Blick- und Aufmerksamkeitstraining zu integrieren, um das volle Potenzial der peripheren Wahrnehmung auszuschöpfen.

How selective attention affects the detection of motion changes with peripheral vision in MOT

In sports, peripheral vision is expected to play an important role in tasks that demand distributed attention and motion-change detection. By using the Multiple-Object-Tracking (MOT) task, these demands were simulated in a well-controlled laboratory environment. Participants tracked four target out of ten moving objects (6 distractors) and pressed a button when one of the ten objects stopped. Detection rates for tracked targets were compared to detection rates of non-tracked distractors at eccentricities between 5° and 25°. The study's aim was to test how the location of attention affects peripheral motion detection. The results show a large attention effect because target stops were detected in 89 % and distractor stops only in 55 % of the trials. Distractor stops were more likely detected when they occurred closer to the fovea while target stops were detected at all eccentricities. That means, orienting attention at target objects facilitates the peripheral detection of their motion changes in monitoring tasks. Having distractors closer to the fovea increases the chance to also detect motion changes of unattended objects. On a theoretical level, results support a tracking mechanism with object-based attention, serial covert attention shifts and flexible but limited attentional resources. On a practical level, sports' experts should use their extensive knowledge to locate attention on most-relevant objects and reduce the eccentricity to other objects to detect motion changes of attended and unattended objects.

Two-year-olds succeed at MIT: Multiple identity tracking in 20- and 25-month-old infants

Infants' ability to remember objects and their locations emerges during the first year of life. However, not much is known about infants' ability to track objects' identities in a dynamic environment. Here, we tailored the delayed match retrieval eye-tracking paradigm to study infants' ability to track two object identities during occlusion-an infant version of multiple identity tracking (MIT). Delayed match retrieval uses virtual "cards" as stimuli that are first shown face up, exposing to-be-remembered information, and then turned face down, occluding it. Here, cards were subject to movement during the face-down occlusion period. We used complex non-nameable objects as card faces to discourage verbal rehearsal. In three experiments (N = 110), we compared infants' ability to track object identities when two previously exposed cards were static (Experiment 1), were moved into new positions along the same trajectory (Experiment 2), or were moved along different trajectories (Experiment 3) while face down. We found that 20-month-olds could remember two object identities when static; however, it was not until 25 months of age that infants could track when movement was introduced. Our results show that the ability to track multiple identities in visual working memory is present by 25 months.

Is it dangerous? The role of an emotional visual search strategy and threat-relevant training in the detection of guns and knives

Counter-terrorism strategies rely on the assumption that it is possible to increase threat detection by providing explicit verbal instructions to orient people's attention to dangerous objects and hostile behaviours in their environment. Nevertheless, whether verbal cues can be used to enhance threat detection performance under laboratory conditions is currently unclear. In Experiment 1, student participants were required to detect a picture of a dangerous or neutral object embedded within a visual search display on the basis of an emotional strategy 'is it dangerous?' or a semantic strategy 'is it an object?'. The results showed a threat superiority effect that was enhanced by the emotional visual search strategy. In Experiment 2, whilst trainee police officers displayed a greater threat superiority effect than student controls, both groups benefitted from performing the task under the emotional than semantic visual search strategy. Manipulating situational threat levels (high vs. low) in the experimental instructions had no effect on visual search performance. The current findings provide new support for the language-as-context hypothesis. They are also consistent with a dual-processing account of threat detection involving a verbally mediated route in working memory and the deployment of a visual template developed as a function of training.

Differences in Counting Skills Between Chinese and German Children Are Accompanied by Differences in Processing of Approximate Numerical Magnitude Information

Human beings are supposed to possess an approximate number system (ANS) dedicated to extracting and representing approximate numerical magnitude information as well as an object tracking system (OTS) for the rapid and accurate enumeration of small sets. It is assumed that the OTS and the ANS independently contribute to the acquisition of more elaborate numerical concepts. Chinese children have been shown to exhibit more elaborate numerical concepts than their non-Chinese peers, but it is still an open question whether similar cross-national differences exist with regard to the underlying systems, namely the ANS and the OTS. In the present study, we investigated this question by comparing Chinese and German preschool children with regard to their performance in a non-symbolic numerical magnitude comparison task (assessing the ANS) and in an enumeration task (assessing the OTS). In addition, we compared children’s counting skills. To ensure that possible between-group differences could not be explained by differences in more general performance factors, we also assessed children’s reasoning ability and processing speed. Chinese children showed a better counting performance and a more accurate performance in the non-symbolic numerical magnitude comparison task. These differences in performance could not be ascribed to differences in reasoning abilities and processing speed. In contrast, Chinese and German children did not differ significantly in the enumeration of small sets. The superior counting performance of Chinese children was thus found to be reflected in the ANS but not in the OTS.

The effects of colour complexity and similarity on multiple object tracking performance

Surface features can be used during multiple object tracking (MOT). Previous studies suggested that surface features might be stored in visual working memory to assist object tracking, and attentive tracking and visual working memory share common attentional resources. However, it is still unknown whether features of both the target and distractor sets will be stored, or features of the target and distractor sets are processed differently. Moreover, how feature distinctiveness and similarity between the target and distractor sets affect tracking and allocation of attentional resources are still not clear. First, we manipulated the colour complexity of the target set (CT) and the colour complexity of the distractor set (CD), respectively, in two experiments, where colours of the target and distractor sets were always distinct, to test their effects on tracking performance. If features of the target and distractor sets are stored, manipulating feature complexity of the target and distractor sets would significantly affect tracking performance. Second, this study tested whether tracking performance was affected by different levels of distinctiveness between the target and distractor sets (DTD) and explored how distinctiveness affected tracking and allocation of attentional resources. Results showed that DTD and CT significantly affect tracking performance and allocation of attentional resources, but not CD. These results indicated that when targets and distractors have distinct features, only the surface features of the targets are maintained in visual working memory. And when targets have the same colour with the distractors, they are more difficult and consume more attentional resources to track.

Task-irrelevant spatial dividers facilitate counting and numerosity estimation

Counting is characterized as a slow and error-prone action relying heavily on serial allocation of focused attention. However, quick and accurate counting is required for many real-world tasks (e.g., counting heads to ensure everyone is evacuated to a safe place in an emergency). Previous research suggests that task-irrelevant spatial dividers, which segment visual displays into small areas, facilitate focused attention and improve serial search. The present study investigated whether counting, which is also closely related to focused attention, can be facilitated by spatial dividers. Furthermore, the effect of spatial dividers on numerosity estimation, putatively dependent upon distributed attention, was also examined to provide insights into different types of number systems and different modes of visual attention. The results showed profound performance improvement by task-irrelevant spatial dividers in both counting and numerosity estimation tasks, indicating that spatial dividers may activate interaction between number and visual attention systems. Our findings provide the first evidence that task-irrelevant spatial dividers can be used to facilitate various types of numerical cognition.

A common source of attention for auditory and visual tracking

Tasks that require tracking visual information reveal the severe limitations of our capacity to attend to multiple objects that vary in time and space. Although these limitations have been extensively characterized in the visual domain, very little is known about tracking information in other sensory domains. Does tracking auditory information exhibit characteristics similar to those of tracking visual information, and to what extent do these two tracking tasks draw on the same attention resources? We addressed these questions by asking participants to perform either single or dual tracking tasks from the same (visual-visual) or different (visual-auditory) perceptual modalities, with the difficulty of the tracking tasks being manipulated across trials. The results revealed that performing two concurrent tracking tasks, whether they were in the same or different modalities, affected tracking performance as compared to performing each task alone (concurrence costs). Moreover, increasing task difficulty also led to increased costs in both the single-task and dual-task conditions (load-dependent costs). The comparison of concurrence costs between visual-visual and visual-auditory dual-task performance revealed slightly greater interference when two visual tracking tasks were paired. Interestingly, however, increasing task difficulty led to equivalent costs for visual-visual and visual-auditory pairings. We concluded that visual and auditory tracking draw largely, though not exclusively, on common central attentional resources.

Neural Mechanisms of High-Level Vision

The last three decades have seen major strides in our understanding of neural mechanisms of high-level vision, or visual cognition of the world around us. Vision has also served as a model system for the study of brain function. Several broad insights, as yet incomplete, have recently emerged. First, visual perception is best understood not as an end unto itself, but as a sensory process that subserves the animal's behavioral goal at hand. Visual perception is likely to be simply a side effect that reflects the readout of visual information processing that leads to behavior. Second, the brain is essentially a probabilistic computational system that produces behaviors by collectively evaluating, not necessarily consciously or always optimally, the available information about the outside world received from the senses, the behavioral goals, prior knowledge about the world, and possible risks and benefits of a given behavior. Vision plays a prominent role in the overall functioning of the brain providing the lion's share of information about the outside world. Third, the visual system does not function in isolation, but rather interacts actively and reciprocally with other brain systems, including other sensory faculties. Finally, various regions of the visual system process information not in a strict hierarchical manner, but as parts of various dynamic brain-wide networks, collectively referred to as the "connectome." Thus, a full understanding of vision will ultimately entail understanding, in granular, quantitative detail, various aspects of dynamic brain networks that use visual sensory information to produce behavior under real-world conditions. © 2017 American Physiological Society. Compr Physiol 8:903-953, 2018.

Bridgemanian space constancy as a precursor to extended cognition

A few decades ago, cognitive psychologists generally took for granted that the reason we perceive our visual environment as one contiguous stable whole (i.e., space constancy) is because we have an internal mental representation of the visual environment as one contiguous stable whole. They supposed that the non-contiguous visual images that are gathered during the brief fixations that intervene between pairs of saccadic eye movements (a few times every second) are somehow stitched together to construct this contiguous internal mental representation. Determining how exactly the brain does this proved to be a vexing puzzle for vision researchers. Bruce Bridgeman's research career is the story of how meticulous psychophysical experimentation, and a genius theoretical insight, eventually solved this puzzle. The reason that it was so difficult for researchers to figure out how the brain stitches together these visual snapshots into one accurately-rendered mental representation of the visual environment is that it doesn't do that. Bruce discovered that the brain couldn't do that if it tried. The neural information that codes for saccade amplitude and direction is simply too inaccurate to determine exact relative locations of each fixation. Rather than the perception of space constancy being the result of an internal representation, Bruce determined that it is the result of a brain that simply assumes that external space remains constant, and it rarely checks to verify this assumption. In our extension of Bridgeman's formulation, we suggest that objects in the world often serve as their own representations, and cognitive operations can be performed on those objects themselves, rather than on mental representations of them.

A Basic Architecture of an Autonomous Adaptive System With Conscious-Like Function for a Humanoid Robot

In developing a humanoid robot, there are two major objectives. One is developing a physical robot having body, hands, and feet resembling those of human beings and being able to similarly control them. The other is to develop a control system that works similarly to our brain, to feel, think, act, and learn like ours. In this article, an architecture of a control system with a brain-oriented logical structure for the second objective is proposed. The proposed system autonomously adapts to the environment and implements a clearly defined "consciousness" function, through which both habitual behavior and goal-directed behavior are realized. Consciousness is regarded as a function for effective adaptation at the system-level, based on matching and organizing the individual results of the underlying parallel-processing units. This consciousness is assumed to correspond to how our mind is "aware" when making our moment to moment decisions in our daily life. The binding problem and the basic causes of delay in Libet's experiment are also explained by capturing awareness in this manner. The goal is set as an image in the system, and efficient actions toward achieving this goal are selected in the goal-directed behavior process. The system is designed as an artificial neural network and aims at achieving consistent and efficient system behavior, through the interaction of highly independent neural nodes. The proposed architecture is based on a two-level design. The first level, which we call the "basic-system," is an artificial neural network system that realizes consciousness, habitual behavior and explains the binding problem. The second level, which we call the "extended-system," is an artificial neural network system that realizes goal-directed behavior.

Short Article: Sequential Tapping Interferes Selectively with Multiple-Object Tracking: Do Finger-Tapping and Tracking Share a Common Resource?

Multiple-object tracking involves simultaneously monitoring positions of a number of target items as they move among distractors. Young adults are capable of tracking only 3–5 items at once. In this study we investigated the origin of this limitation by looking for secondary tasks that interfere with tracking. We compared tracking performance (baseline condition), with performance when participants tapped three fingers in a specific order while tracking (sequential tapping) or articulated three syllables in a specific order while tracking (sequential articulation). The articulation task was used to ensure that the interference produced by sequential tapping was more than would be expected by the executive demands of carrying out any two “attention-demanding” tasks at once. Even though sequential tapping does not require vision or memorizing the positions of external items, it produced significantly more interference than did sequential articulation, as might be expected if tracking and sequential tapping shared a common (limited) resource.

Multiple-Target Tracking: A Role for Working Memory?

In order to identify the cognitive processes associated with target tracking, a dual-task experiment was carried out in which participants undertook a dynamic multiple-object tracking task first alone and then again, concurrently with one of several secondary tasks, in order to investigate the cognitive processes involved. The research suggests that after designated targets within the visual field have attracted preattentive indexes that point to their locations in space, conscious processes, vulnerable to secondary visual and spatial task interference, form deliberate strategies beneficial to the tracking task, before tracking commences. Target tracking itself is realized by central executive processes, which are sensitive to any other cognitive demands. The findings are discussed in the context of integrating dynamic spatial cognition within a working memory framework.

Effects of Age on Searching for and Enumerating Targets that Cannot be Detected Efficiently

We investigated the effects of old age on search, subitizing, and counting of difficult-to-find targets. In Experiment 1, young and older adults enumerated targets (Os) with and without distractors (Qs). Without distractors, the usual subitization-counting function occurred in both groups, with the same subitization span of 3.3 items. Subitization disappeared with distractors; older adults were slowed more overall by their presence but enumeration rates were not slowed by ageing either with or without distractors. In contrast, search rates for a single target (O among Qs) were twice as slow for older as for young adults. Experiment 2 tested and ruled out one account of age-equivalent serial enumeration based on the need to subvocalize numbers as items are enumerated. Alternative explanations based on the specific task differences between detecting and enumerating stimuli are discussed.

Decoding early and late cortical contributions to individuation of attended and unattended objects

To isolate a visual stimulus as a unique object with a specific spatial location and time of occurrence, it is necessary to first register (individuate) the stimulus as a distinct perceptual entity. Recent investigations into the neural substrates of object individuation have suggested it is subserved by a distributed neural network, but previous manipulations of individuation load have introduced extraneous visual confounds, which might have yielded ambiguous findings, particularly in early cortical areas. Furthermore, while it has been assumed that selective attention is required for object individuation, there is no definitive evidence on the brain regions recruited for attended and ignored objects. Here we addressed these issues by combining functional magnetic resonance imaging (fMRI) with a novel object-enumeration paradigm in which to-be-individuated objects were defined by illusory contours, such that the physical elements of the display remained constant across individuation conditions. Multi-voxel pattern analyses revealed that attended objects modulated patterns of activity in early visual cortex, as well as frontal and parietal brain areas, as a function of object-individuation load. These findings suggest that object individuation recruits both early and later cortical areas, consistent with theoretical accounts proposing that this operation acts at the junction of feed-forward and feedback processing stages in visual analysis. We also found dissociations between brain regions involved in individuation of attended and unattended objects, suggesting that voluntary spatial attention influences the brain regions recruited for this process.

Attending to multiple objects relies on both feature- and dimension-based control mechanisms: Evidence from human electrophysiology

Numerous everyday search tasks require humans to attentionally select and temporally store more than one object present in the visual environment. Recently, several enumeration studies sought to isolate the mechanisms underlying multiple object processing by means of electrophysiological measures, which led to a more fine-grained picture as to which processing stages are modulated by object numerosity. One critical limitation that most of these studies share is that they used stimulus designs in which multiple targets were exclusively defined by the same feature value. Accordingly, it remains an open issue whether these findings generalize to search scenarios in which multiple targets are physically not identical. To systematically address this issue, we introduced three target context conditions in which multiple targets were defined randomly by (1) the same feature (sF), (2) different features within the same dimension (dFsD), or (3) different features across dimensions (dD). Our findings revealed that participants' ability to enumerate multiple targets was remarkably influenced by inter-target relationships, with fastest responses for sF trials, slowest responses for dD trials, and responses of intermediate speed for dFsD trials. Our electrophysiological analyses disclosed that one source of this response slowing was feature-based and originated from the stage of attentional selection (as indexed by PCN waves), whereas another source was dimension-based and associated with working memory processes (as indexed by P3b waves). Overall, our results point to a significant role of physical inter-target relationships in multiple object processing-a factor that has been largely neglected in most studies on enumeration.