Implicit short-term memory and event frequency effects in visual search

Non-verbal intelligence outperforms selective attention in a visual short-term memory test

Short-term memory is a dynamic psychological process that operates within a network in which non-verbal intelligence and attentional domains are connected. However, no consensus has been reached about which process has the greatest effect on this memory ability, which was the main objective of the present study. A sample of 1448 Brazilian participants (mean age = 26.62 years, standard deviation = 9.97 years; 53.9% females) were collectively tested on pen-and-paper standardized and validated measures of selective (ROTAS-C), alternating (ROTAS-A), and divided (ROTAS-D) attention. They also performed the R1 Non-verbal Intelligence Test and a visual short-term memory test (Memória Visual de Curto Prazo [MEMORE] test). The statistical analyses consisted of a data mining procedure, in which exhaustive automatic selection screening was performed. The results were compared with Corrected Akaike Information Criteria. The linear model met the classic assumptions of ordinary least squares and only included main effects of selective attention (standardized β = 0.39) and non-verbal intelligence (standardized β = 0.37) as main predictors (F2,39 = 7.01, p < 0.01, adjusted R2 = 24%). The results are discussed within a cognitive psychology framework.

Does feature intertrial priming guide attention? The jury is still out

Our search performance is strongly influenced by our past experience. In the lab, this influence has been demonstrated by investigating a variety of phenomena, including intertrial priming, statistical learning, and reward history, and collectively referred to as selection history. The resulting findings have led researchers to claim that selection history guides attention, thereby challenging the prevailing dichotomy, according to which top-down and bottom-up factors alone determine attentional priority. Here, we re-examine this claim with regard to one selection-history phenomenon, feature intertrial priming (aka priming of pop-out). We evaluate the evidence that specifically pertains to the role of feature intertrial priming in attentional guidance, rather than in later selective processes occurring after the target is found. We distinguish between the main experimental rationales, while considering the extent to which feature intertrial priming, as studied through different protocols, shares characteristics of top-down attention. We show that there is strong evidence that feature intertrial priming guides attention when the experimental protocol departs from the canonical paradigm and encourages observers to maintain the critical feature in visual working memory or to form expectations about the upcoming target. By contrast, the current evidence regarding the standard feature intertrial priming phenomenon is inconclusive. We propose directions for future research and suggest that applying the methodology used here in order to re-evaluate of the role of other selection history phenomena in attentional guidance should clarify the mechanisms underlying the strong impact of past experience on visual search performance.

Inter-trial effects in priming of pop-out: Comparison of computational updating models

In visual search tasks, repeating features or the position of the target results in faster response times. Such inter-trial ‘priming’ effects occur not just for repetitions from the immediately preceding trial but also from trials further back. A paradigm known to produce particularly long-lasting inter-trial effects–of the target-defining feature, target position, and response (feature)–is the ‘priming of pop-out’ (PoP) paradigm, which typically uses sparse search displays and random swapping across trials of target- and distractor-defining features. However, the mechanisms underlying these inter-trial effects are still not well understood. To address this, we applied a modeling framework combining an evidence accumulation (EA) model with different computational updating rules of the model parameters (i.e., the drift rate and starting point of EA) for different aspects of stimulus history, to data from a (previously published) PoP study that had revealed significant inter-trial effects from several trials back for repetitions of the target color, the target position, and (response-critical) target feature. By performing a systematic model comparison, we aimed to determine which EA model parameter and which updating rule for that parameter best accounts for each inter-trial effect and the associated n-back temporal profile. We found that, in general, our modeling framework could accurately predict the n-back temporal profiles. Further, target color- and position-based inter-trial effects were best understood as arising from redistribution of a limited-capacity weight resource which determines the EA rate. In contrast, response-based inter-trial effects were best explained by a bias of the starting point towards the response associated with a previous target; this bias appeared largely tied to the position of the target. These findings elucidate how our cognitive system continually tracks, and updates an internal predictive model of, a number of separable stimulus and response parameters in order to optimize task performance.

In many perceptual tasks, performance is faster and more accurate when critical stimulus attributes are repeated from trial to trial compared to when they change. Priming of pop-out (PoP), visual search with sparse search displays and random swapping of the target feature between trials, is a paradigm in which such inter-trial effects can be traced back over several recent trial episodes. While many studies have explored PoP paradigms, the mechanisms underlying priming of the search-critical target feature, the target position, and the response-critical information are not yet fully understood. Here, we addressed this question by applying evidence accumulation (EA) decision models to the data from a previously published PoP study. The modeling framework combines evidence accumulation with Bayesian updating of the model parameters. Comparison of (> 1000) different combinations of decision models and updating rules revealed that the featural and positional priming effects were best explained by assuming that attentional “weight” resources are dynamically redistributed based on the recent history of target color and position, whereas response decisions are biased based on the recent history of the response-critical property of targets occuring at a particular (and nearby) position(s). These findings confirm that our cognitive system continually tracks, and updates an internal predictive model of, a number of separable stimulus and response parameters in order to optimize task performance.

Temporal Characteristics of Priming of Attention Shifts Are Mirrored by BOLD Response Patterns in the Frontoparietal Attention Network

Priming of attention shifts involves the reduction in search RTs that occurs when target location or target features repeat. We used functional magnetic resonance imaging to investigate the neural basis of such attentional priming, specifically focusing on its temporal characteristics over trial sequences. We first replicated earlier findings by showing that repetition of target color and of target location from the immediately preceding trial both result in reduced blood oxygen level-dependent (BOLD) signals in a cortical network that encompasses occipital, parietal, and frontal cortices: lag-1 repetition suppression. While such lag-1 suppression can have a number of explanations, behaviorally, the influence of attentional priming extends further, with the influence of past search trials gradually decaying across multiple subsequent trials. Our results reveal that the same regions within the frontoparietal network that show lag-1 suppression, also show longer term BOLD reductions that diminish over the course of several trial presentations, keeping pace with the decaying behavioral influence of past target properties across trials. This distinct parallel between the across-trial patterns of cortical BOLD and search RT reductions, provides strong evidence that these cortical areas play a key role in attentional priming.

Top-down imagery overrides the influence of selection history effects

The present study investigated whether color imagery could override the representations of the prevalent selection history effect termed Priming of Pop-out (PoP), which is constituted by faster responding when the target color is repeated rather than switched across trials of color singleton search. Participants imagined a color in the interval between trials of a color singleton search task that could be the same as or different to the previous target color, and they were to rate the vividness of these representations following each imagery event. It was revealed that when highly vivid imagery was reported, the PoP effect was attenuated relative to less vivid forms of it (and absent in two out of three experiments), and that color imagery eliminated the build-up of priming following consecutive target color repeats. Overall, the present findings suggest the representations of the selection history system can be overridden by top-down imagery.

Statistical learning of unbalanced exclusive-or temporal sequences in humans

A pervasive issue in statistical learning has been to determine the parameters of regularity extraction. Our hypothesis was that the extraction of transitional probabilities can prevail over frequency if the task involves prediction. Participants were exposed to four repeated sequences of three stimuli (XYZ) with each stimulus corresponding to the position of a red dot on a touch screen that participants were required to touch sequentially. The temporal and spatial structure of the positions corresponded to a serial version of the exclusive-or (XOR) that allowed testing of the respective effect of frequency and first- and second-order transitional probabilities. The XOR allowed the first-order transitional probability to vary while being not completely related to frequency and to vary while the second-order transitional probability was fixed (p(Z|X, Y) = 1). The findings show that first-order transitional probability prevails over frequency to predict the second stimulus from the first and that it also influences the prediction of the third item despite the presence of second-order transitional probability that could have offered a certain prediction of the third item. These results are particularly informative in light of statistical learning models.

Coupled recursive estimation for online interactive perception of articulated objects

We present online multi-modal perception systems for extracting kinematic and dynamic models of articulated objects from physical interactions with the environment. The systems rely on a RGB-D stream, contact wrenches, and proprioception. The proposed systems share an algorithmic foundation: they are based on an architecture of coupled recursive estimation processes. We present and advocate this architecture as a general, versatile, and robust solution for online interactive perception problems. We validate the architecture in extensive experiments to extract kinematic models interactively, varying the appearance, size, structure, and dynamic properties of objects for different tasks and under different environmental conditions. In addition, we experimentally show that the information acquired by the online perception systems enables robot manipulation of articulated objects. Furthermore, we discuss the relationship between the proposed architecture for robot perception and insights about biological perception systems.

A meta-analysis of contingent-capture effects

The present meta-analyses investigated the widely used contingent-capture protocol. Contingent-capture theory postulates that only top-down matching stimuli capture attention. Evidence comes from the contingent-capture protocol, in which participants search for a predefined target stimulus preceded by a spatial cue. The cue is typically uninformative of the target's position but either presented at target position (valid condition) or away from the target (invalid condition). The common finding is that seemingly only top-down matching cues capture attention as shown by a selective cueing effect (faster responses in valid than invalid conditions) for cues with a feature similar to the searched-for target only, but not for cues without target-similar feature. The origin of this "contingent-capture effect" is, however, debated. One alternative explanation is that intertrial priming-the priming of attention capture by the cue in a given trial by attending to a feature-similar target in the preceding trial-mediates the contingent-capture effect. Alternatively, the rapid-disengagement account argues that all salient stimuli capture attention initially, but that the disengagement from non-matching cues is rapid. The present meta-analyses shed light on this debate by (a) identifying moderators of the size of reported contingent-capture effects (64 experiments) and (b) analyzing pure (blocked) versus mixed presentation of different targets as well as summarizing results of published intertrial priming studies (12 experiments) in the contingent-capture protocol. We found target-singleton versus non-singleton status and pure versus mixed presentation of different targets to be reliable moderators. Furthermore, results indicated the presence of publication bias. Otherwise, the contingent-capture theory was supported, but we discuss additional factors that must be taken into account for a full account of the results.

You prime what you code: The fAIM model of priming of pop-out

Our visual brain makes use of recent experience to interact with the visual world, and efficiently select relevant information. This is exemplified by speeded search when target- and distractor features repeat across trials versus when they switch, a phenomenon referred to as intertrial priming. Here, we present fAIM, a computational model that demonstrates how priming can be explained by a simple feature-weighting mechanism integrated into an established model of bottom-up vision. In fAIM, such modulations in feature gains are widespread and not just restricted to one or a few features. Consequentially, priming effects result from the overall tuning of visual features to the task at hand. Such tuning allows the model to reproduce priming for different types of stimuli, including for typical stimulus dimensions such as 'color' and for less obvious dimensions such as 'spikiness' of shapes. Moreover, the model explains some puzzling findings from the literature: it shows how priming can be found for target-distractor stimulus relations rather than for their absolute stimulus values per se, without an explicit representation of relations. Similarly, it simulates effects that have been taken to reflect a modulation of priming by an observers' goals-without any representation of goals in the model. We conclude that priming is best considered as a consequence of a general adaptation of the brain to visual input, and not as a peculiarity of visual search.

Effects of average uncertainty and trial-type frequency on choice response time: A hierarchical extension of Hick/Hyman Law

Hick/Hyman Law is the linear relationship between average uncertainty and mean response time across entire blocks of trials. While unequal trial-type frequencies within blocks can be used to manipulate average uncertainty, the current version of the law does not apply to or account for the differences in mean response time across the different trial types contained in a block. Other simple predictors of the effects of trial-type frequency also fail to produce satisfactory fits. In an attempt to resolve this limitation, the present work takes a hierarchical approach, first fitting the block-level data using average uncertainty (i.e., Hick/Hyman Law is given priority), then fitting the remaining trial-level differences using various versions of trial-type frequency. The model that employed the relative probability of occurrence as the second-layer predictor produced very strong fits, thereby extending Hick/Hyman Law to the level of trial types within blocks. The advantages and implications of this hierarchical model are briefly discussed.

Implicit short- and long-term memory direct our gaze in visual search

Visual attention is strongly affected by the past: both by recent experience and by long-term regularities in the environment that are encoded in and retrieved from memory. In visual search, intertrial repetition of targets causes speeded response times (short-term priming). Similarly, targets that are presented more often than others may facilitate search, even long after it is no longer present (long-term priming). In this study, we investigate whether such short-term priming and long-term priming depend on dissociable mechanisms. By recording eye movements while participants searched for one of two conjunction targets, we explored at what stages of visual search different forms of priming manifest. We found both long- and short- term priming effects. Long-term priming persisted long after the bias was present, and was again found even in participants who were unaware of a color bias. Short- and long-term priming affected the same stage of the task; both biased eye movements towards targets with the primed color, already starting with the first eye movement. Neither form of priming affected the response phase of a trial, but response repetition did. The results strongly suggest that both long- and short-term memory can implicitly modulate feedforward visual processing.

The long and the short of priming in visual search

Memory affects visual search, as is particularly evident from findings that when target features are repeated from one trial to the next, selection is faster. Two views have emerged on the nature of the memory representations and mechanisms that cause these intertrial priming effects: independent feature weighting versus episodic retrieval of previous trials. Previous research has attempted to disentangle these views focusing on short term effects. Here, we illustrate that the episodic retrieval models make the unique prediction of long-term priming: biasing one target type will result in priming of this target type for a much longer time, well after the bias has disappeared. We demonstrate that such long-term priming is indeed found for the visual feature of color, but only in conjunction search and not in singleton search. Two follow-up experiments showed that it was the kind of search (conjunction versus singleton) and not the difficulty, that determined whether long-term priming occurred. Long term priming persisted unaltered for at least 200 trials, and could not be explained as the result of explicit strategy. We propose that episodic memory may affect search more consistently than previously thought, and that the mechanisms for intertrial priming may be qualitatively different for singleton and conjunction search.

Positional priming of visual pop-out search is supported by multiple spatial reference frames

The present study investigates the representations(s) underlying positional priming of visual ‘pop-out’ search (Maljkovic and Nakayama, 1996). Three search items (one target and two distractors) were presented at different locations, in invariant (Experiment 1) or random (Experiment 2) cross-trial sequences. By these manipulations it was possible to disentangle retinotopic, spatiotopic, and object-centered priming representations. Two forms of priming were tested: target location facilitation (i.e., faster reaction times – RTs– when the trial n target is presented at a trial n-1 target relative to n-1 blank location) and distractor location inhibition (i.e., slower RTs for n targets presented at n-1 distractor compared to n-1 blank locations). It was found that target locations were coded in positional short-term memory with reference to both spatiotopic and object-centered representations (Experiment 1 vs. 2). In contrast, distractor locations were maintained in an object-centered reference frame (Experiments 1 and 2). We put forward the idea that the uncertainty induced by the experiment manipulation (predictable versus random cross-trial item displacements) modulates the transition from object- to space-based representations in cross-trial memory for target positions.

How is working memory content consciously experienced? The 'conscious copy' model of WM introspection

We address the issue of how visual information stored in working memory (WM) is introspected. In other words, how do we become aware of WM content in order to consciously examine or manipulate it? Influential models of WM have suggested that WM representations are either conscious by definition, or directly accessible for conscious inspection. We propose that WM introspection does not operate on the actual memory trace but rather requires a new representation to be created for the conscious domain. This conscious representation exists in addition and in parallel to the actual memory representation. The existence of such a separate representation is revealed by and reflected in the qualitatively different functional characteristics between the actual memory trace and its conscious experience, and their distinct interactions within external visual input. Our model differs from state-based models in that WM introspection does not involve a change in the state of WM content, but rather involves the creation of a new, second representation existing in parallel to the original memory trace.

Can a single short-term mechanism account for priming of pop-out?

Trial-to-trial feature repetition speeds response times in pop-out visual search tasks. These priming effects are often ascribed to a short-term memory system. Recently, however, it has been reported that a 'build-up' sequence of repetitions could facilitate responses over 16 trials later - well beyond twice the typically reported time course (Vision Research, 2011, 51, 1972-1978). Here, we first report two replication attempts that yielded little to no support for such long-term priming of pop-out. The results instead fell in line with the predictions of a previously proposed computational model that describes priming as short-lived facilitation that decays over approximately eight trials (Vision Research, 2010, 50, 2110-2115). In the second part of this study, we show that these data are consistent with a simple formulation of decay with a single timescale, and that there is no significant priming beyond eight trials.

The roles of scene priming and location priming in object-scene consistency effects

Presenting consistent objects in scenes facilitates object recognition as compared to inconsistent objects. Yet the mechanisms by which scenes influence object recognition are still not understood. According to one theory, consistent scenes facilitate visual search for objects at expected places. Here, we investigated two predictions following from this theory: If visual search is responsible for consistency effects, consistency effects could be weaker (1) with better-primed than less-primed object locations, and (2) with less-primed than better-primed scenes. In Experiments 1 and 2, locations of objects were varied within a scene to a different degree (one, two, or four possible locations). In addition, object-scene consistency was studied as a function of progressive numbers of repetitions of the backgrounds. Because repeating locations and backgrounds could facilitate visual search for objects, these repetitions might alter the object-scene consistency effect by lowering of location uncertainty. Although we find evidence for a significant consistency effect, we find no clear support for impacts of scene priming or location priming on the size of the consistency effect. Additionally, we find evidence that the consistency effect is dependent on the eccentricity of the target objects. These results point to only small influences of priming to object-scene consistency effects but all-in-all the findings can be reconciled with a visual-search explanation of the consistency effect.

The human somatosensory system: from perception to decision making

Pioneering human and animal research has yielded a better understanding of the brain networks involved in somatosensory perception and decision making. New methodical achievements in combination with computational formalization allow research questions to be addressed which increasingly reflect not only the complex sensory demands of real environments, but also the cognitive ones. Here, we review the latest research on somatosensory perception and decision making with a special focus on the recruitment of supplementary brain networks which are dependent on the situation-associated sensory and cognitive demands. We also refer to literature on sensory-motor integration processes during visual decision making to delineate the complexity and dynamics of how sensory information is relayed to the motor output system. Finally, we review the latest literature which provides novel evidence that other everyday life situations, such as semantic decision making or social interactions, appear to depend on tactile experiences; suggesting that the sense of touch, being the first sense to develop ontogenetically, may essentially support later development of other conceptual knowledge.

When do I quit? The search termination problem in visual search

In visual search tasks, observers look for targets in displays or scenes containing distracting, non-target items. Most of the research on this topic has concerned the finding of those targets. Search termination is a less thoroughly studied topic. When is it time to abandon the current search? The answer is fairly straight forward when the one and only target has been found (There are my keys.). The problem is more vexed if nothing has been found (When is it time to stop looking for a weapon at the airport checkpoint?) or when the number of targets is unknown (Have we found all the tumors?). This chapter reviews the development of ideas about quitting time in visual search and offers an outline of our current theory.

Stochastic characterization of small-scale algorithms for human sensory processing

Human sensory processing can be viewed as a functional H mapping a stimulus vector s into a decisional variable r. We currently have no direct access to r; rather, the human makes a decision based on r in order to drive subsequent behavior. It is this (typically binary) decision that we can measure. For example, there may be two external stimuli s([0]) and s([1]), mapped onto r([0]) and r([1]) by the sensory apparatus H; the human chooses the stimulus associated with largest r. This kind of decisional transduction poses a major challenge for an accurate characterization of H. In this article, we explore a specific approach based on a behavioral variant of reverse correlation techniques, where the input s contains a target signal corrupted by a controlled noisy perturbation. The presence of the target signal poses an additional challenge because it distorts the otherwise unbiased nature of the noise source. We consider issues arising from both the decisional transducer and the target signal, their impact on system identification, and ways to handle them effectively for system characterizations that extend to second-order functional approximations with associated small-scale cascade models.

Temporal consistency is currency in shifts of transient visual attention

Background

Observers respond more accurately to targets in visual search tasks that share properties with previously presented items, and transient attention can learn featural consistencies on a precue, irrespective of its absolute location.

Methodology/Principal Findings

We investigated whether such attentional benefits also apply to temporal consistencies. Would performance on a precued Vernier acuity discrimination task, followed by a mask, improve if the cue-lead times (CLTs; 50, 100, 150 or 200 ms) remained constant between trials compared to when they changed? The results showed that if CLTs remained constant for a few trials in a row, Vernier acuity performance gradually improved while changes in CLT from one trial to the next led to worse than average discrimination performance. The results show that transient attention can quickly adjust to temporal regularities, similarly to spatial and featural regularities. Further experiments show that this form of learning is not under voluntary control.

Conclusions/Significance

The results add to a growing literature showing how consistency in visual presentation improves visual performance, in this case temporal consistency.

The Evolution of Color Polymorphism: Crypticity, Searching Images, and Apostatic Selection

The development and maintenance of color polymorphism in cryptic prey species is a source of enduring fascination, in part because it appears to result from selective processes operating across multiple levels of analysis, ranging from cognitive psychology to population ecology. Since the 1960s, prey species with diverse phenotypes have been viewed as the evolved reflection of the perceptual and cognitive characteristics of their predators. Because it is harder to search simultaneously for two or more cryptic prey types than to search for only one, visual predators should tend to focus on the most abundant forms and effectively overlook the others. The result should be frequency-dependent, apostatic selection, which will tend to stabilize the prey polymorphism. Validating this elegant hypothesis has been difficult, and many details have been established only relatively recently. This review clarifies the argument for a perceptual selective mechanism and examines the relevant experimental evidence.

Target selection for visually guided reaching in macaque

We examined target selection for visually guided reaching in monkeys using a visual search task in which an odd-colored target was presented with distractors. The colors of the target and distractors were randomly switched in each trial between red and green, and the number of distractors was varied. Previous studies of saccades and attention have shown that target selection in this task is easier when a greater number of homogenous distractors is present. We found that monkeys made fewer reaches to distractors and that reaches to the target were completed more quickly when a greater number of homogenous distractors was present. When the target was presented in a sparse array of distractors, reaches had longer movement durations and greater trajectory curvature. Reaching errors were directed more often to a distractor adjacent to the target, suggesting a spatially coarse-to-fine progression during target selection. Reaches were also influenced by the properties of trials in the recent past. When the colors of the target and distractors remained the same from trial to trial rather than switching, reaches were completed more quickly and accurately, indicating that color priming across trials facilitates target selection. Moreover, when difficult search trials were randomly intermixed with easier trials without distractors, reach latencies were influenced by the difficulty of previous trials, indicating that motor initiation strategies are gradually adjusted based on accumulated experience. Overall, these results are consistent with reaching results in humans, indicating that the monkey provides a sound model for understanding the neural underpinnings of reach target selection.