Where perception meets memory: A review of repetition priming in visual search tasks

Simultaneous attentional guidance by working-memory and selection history reveals two distinct sources of attention

Recent theories of attention have proposed that selection history is a separate, dissociable source of information that influences attention. The current study sought to investigate the simultaneous involvement of selection history and working-memory on attention during visual search. Experiments 1 and 2 used target feature probability to manipulate selection history and found significant effects of both working-memory and selection history, although working-memory dominated selection history when they cued different locations. Experiment 3 eliminated the contribution of voluntary refreshing of working-memory and replicated the main effects, although selection history became dominant. Using the same methodology, but with reduced probability cue validity, both effects were present in Experiment 4 and did not significantly differ in their contribution to attention. Effects of selection history and working-memory never interacted. These results suggest that selection history and working-memory are separate influences on attention and have little impact on each other. Theoretical implications for models of attention are discussed.

Statistical learning as a tool for rehabilitation in spatial neglect

We propose that neglect includes a disorder of representational updating. Representational updating refers to our ability to build mental models and adapt those models to changing experience. This updating ability depends on the processes of priming, working memory, and statistical learning. These processes in turn interact with our capabilities for sustained attention and precise temporal processing. We review evidence showing that all these non-spatial abilities are impaired in neglect, and we discuss how recognition of such deficits can lead to novel approaches for rehabilitating neglect.

What is Bottom-Up and What is Top-Down in Predictive Coding?

Everyone knows what bottom-up is, and how it is different from top-down. At least one is tempted to think so, given that both terms are ubiquitously used, but only rarely defined in the psychology and neuroscience literature. In this review, we highlight the problems and limitations of our current understanding of bottom-up and top-down processes, and we propose a reformulation of this distinction in terms of predictive coding.

A value-driven mechanism of attentional selection

Attention selects stimuli for cognitive processing, and the mechanisms that underlie the process of attentional selection have been a major topic of psychological research for over 30 years. From this research, it has been well documented that attentional selection can proceed both voluntarily, driven by visual search goals, and involuntarily, driven by the physical salience of stimuli. In this review, I provide a conceptual framework for attentional control that emphasizes the need for stimulus selection to promote the survival and wellbeing of an organism. I argue that although goal-driven and salience-driven mechanisms of attentional selection fit within this framework, a central component that is missing is a mechanism of attentional selection that is uniquely driven by learned associations between stimuli and rewards. I go on to review recent evidence for such a value-driven mechanism of attentional selection, and describe how this mechanism functions independently of the well-documented salience-driven and goal-driven mechanisms. I conclude by arguing that reward learning modifies the attentional priority of stimuli, allowing them to compete more effectively for selection even when nonsalient and task-irrelevant.

Local and global level-priming occurs for hierarchical stimuli composed of outlined, but not filled-in, elements

When attention is directed to the local or global level of a hierarchical stimulus, attending to that same scale of information is subsequently facilitated. This effect is called level-priming, and in its pure form, it has been dissociated from stimulus- or response-repetition priming. In previous studies, pure level-priming has been demonstrated using hierarchical stimuli composed of alphanumeric forms consisting of lines. Here, we test whether pure level-priming extends to hierarchical configurations of generic geometric forms composed of elements that can be depicted either outlined or filled-in. Interestingly, whereas hierarchical stimuli composed of outlined elements benefited from pure level-priming, for both local and global targets, those composed of filled-in elements did not. The results are not readily attributable to differences in spatial frequency content, suggesting that forms composed of outlined and filled-in elements are treated differently by attention and/or priming mechanisms. Because our results present a surprising limit on attentional persistence to scale, we propose that other findings in the attention and priming literature be evaluated for their generalizability across a broad range of stimulus classes, including outlined and filled-in depictions.

Salience-based selection: attentional capture by distractors less salient than the target

Current accounts of attentional capture predict the most salient stimulus to be invariably selected first. However, existing salience and visual search models assume noise in the map computation or selection process. Consequently, they predict the first selection to be stochastically dependent on salience, implying that attention could even be captured first by the second most salient (instead of the most salient) stimulus in the field. Yet, capture by less salient distractors has not been reported and salience-based selection accounts claim that the distractor has to be more salient in order to capture attention. We tested this prediction using an empirical and modeling approach of the visual search distractor paradigm. For the empirical part, we manipulated salience of target and distractor parametrically and measured reaction time interference when a distractor was present compared to absent. Reaction time interference was strongly correlated with distractor salience relative to the target. Moreover, even distractors less salient than the target captured attention, as measured by reaction time interference and oculomotor capture. In the modeling part, we simulated first selection in the distractor paradigm using behavioral measures of salience and considering the time course of selection including noise. We were able to replicate the result pattern we obtained in the empirical part. We conclude that each salience value follows a specific selection time distribution and attentional capture occurs when the selection time distributions of target and distractor overlap. Hence, selection is stochastic in nature and attentional capture occurs with a certain probability depending on relative salience.

Rewards teach visual selective attention

Visual selective attention is the brain function that modulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior. Enhanced analysis of currently relevant or otherwise salient information is often accompanied by suppressed processing of the less relevant or salient input. Recent findings indicate that rewards exert a powerful influence on the deployment of visual selective attention. Such influence takes different forms depending on the specific protocol adopted in the given study. In some cases, the prospect of earning a larger reward in relation to a specific stimulus or location biases attention accordingly in order to maximize overall gain. This is mediated by an effect of reward acting as a type of incentive motivation for the strategic control of attention. In contrast, reward delivery can directly alter the processing of specific stimuli by increasing their attentional priority, and this can be measured even when rewards are no longer involved, reflecting a form of reward-mediated attentional learning. As a further development, recent work demonstrates that rewards can affect attentional learning in dissociable ways depending on whether rewards are perceived as feedback on performance or instead are registered as random-like events occurring during task performance. Specifically, it appears that visual selective attention is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them. Overall this emerging literature demonstrates unequivocally that rewards "teach" visual selective attention so that processing resources will be allocated to objects, features and locations which are likely to optimize the organism's interaction with the surrounding environment and maximize positive outcome.

Memory-guided attention: control from multiple memory systems

Attention is strongly influenced by both external stimuli and internal goals. However, this useful dichotomy does not readily capture the ubiquitous and often automatic contribution of past experience stored in memory. We review recent evidence about how multiple memory systems control attention, consider how such interactions are manifested in the brain, and highlight how this framework for 'memory-guided attention' might help systematize previous findings and guide future research.

Revisiting the time course of inter-trial feature priming in singleton search

Current theories of the locus of inter-trial priming effects in efficient visual search posit an early perceptual component that reflects the short-term influence of a memory trace for low-level stimulus attributes. Despite the fact that this memory trace is hypothesized to be short term, and should therefore have a diminishing influence on performance over time, there has been relatively little study of the effect of time alone on singleton priming effects. The present series of experiments addresses this issue by systematically examining the effect of time on the priming of pop-out (PoP) effect. In Experiment 1, we show that the PoP effect does indeed diminish with increases in the RSI between trials, and does so in accord with a power-law function. In Experiment 2, we show that temporal discriminability of trial n - 1 from the trial that precedes it does not contribute to PoP effects. The results of Experiment 3 revealed two key results: (1) the PoP effect survives an equivalent number of intervening trials across very different RSI conditions; and (2) the cumulative target repetition benefit does depend on the RSI between trials. Together, the results favor neither a simple passive decay nor a strong episodic retrieval account of the PoP effect.

Top-down versus bottom-up attentional control: a failed theoretical dichotomy

Prominent models of attentional control assert a dichotomy between top-down and bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. This theoretical dichotomy, however, fails to explain a growing number of cases in which neither current goals nor physical salience can account for strong selection biases. For example, equally salient stimuli associated with reward can capture attention, even when this contradicts current selection goals. Thus, although 'top-down' sources of bias are sometimes defined as those that are not due to physical salience, this conception conflates distinct--and sometimes contradictory--sources of selection bias. We describe an alternative framework, in which past selection history is integrated with current goals and physical salience to shape an integrated priority map.

Dynamic coding of temporal luminance variation

The range of variation in environmental stimuli is much larger than the visual system can represent. It is therefore sensible for the system to adjust its responses to the momentary input statistics of the environment, such as when our pupils contract to limit the light entering the eye. Previous evidence indicates that the visual system increasingly centers responses on the mean of the visual input and scales responses to its variation during adaptation. To what degree does adaptation to a stimulus varying in luminance over time result in such adjustment of responses? The first two experiments were designed to test whether sensitivity to changes in the amplitude and the mean of a 9.6° central patch varying sinusoidally in luminance at 0.6 Hz would increase or decrease with adaptation. This was also tested for a dynamic peripheral stimulus (random patches rotating on the screen) to test to what extent the effects uncovered in the first two experiments reflect retinotopic mechanisms. Sensitivity to changes in mean and amplitude of the temporal luminance variation increased sharply the longer the adaptation to the variation, both for the large patch and the peripheral patches. Adaptation to luminance variation leads to increased sensitivity to temporal luminance variation for both central and peripheral presentation, the latter result ruling retinotopic mechanisms out as sole explanations for the adaptation effects.

Simulated loss of foveal vision eliminates visual search advantage in repeated displays

In the contextual cueing paradigm, incidental visual learning of repeated distractor configurations leads to faster search times in repeated compared to new displays. This contextual cueing is closely linked to the visual exploration of the search arrays as indicated by fewer fixations and more efficient scan paths in repeated search arrays. Here, we examined contextual cueing under impaired visual exploration induced by a simulated central scotoma that causes the participant to rely on extrafoveal vision. We let normal-sighted participants search for the target either under unimpaired viewing conditions or with a gaze-contingent central scotoma masking the currently fixated area. Under unimpaired viewing conditions, participants revealed shorter search times and more efficient exploration of the display for repeated compared to novel search arrays and thus exhibited contextual cueing. When visual search was impaired by the central scotoma, search facilitation for repeated displays was eliminated. These results indicate that a loss of foveal sight, as it is commonly observed in maculopathies, e.g., may lead to deficits in high-level visual functions well beyond the immediate consequences of a scotoma.

Distinct causal mechanisms of attentional guidance by working memory and repetition priming in early visual cortex

Human attention may be guided by representations held in working memory (WM) and also by priming from implicit memory. Neurophysiological data suggest that WM and priming may be associated with distinct neural mechanisms, but this prior evidence is only correlative. Furthermore, the role of the visual cortex in attention biases from memory remains unclear, because most previous studies conflated memory and selection processes. Here, we manipulated memory and attention in an orthogonal fashion and used an interventional approach to demonstrate the functional significance of WM and priming states in visual cortex for attentional biasing. Observers searched for a Landolt target that was preceded by a nonpredictive color cue that either had to be held in WM for a later recognition test or merely attended (priming counterpart). The application of transcranial magnetic stimulation (TMS) over the occipital cortex modulated the impact of memory on search. Critically, the direction of this modulation depended on the memory state. In the WM condition, the application of TMS on validly cued trials (when the cue surrounded the sought target) enhanced search accuracy relative to the invalid trials (when the cue surrounded a distracter); the opposite pattern was observed in the priming condition. That the effects of occipital TMS on selection were contingent on memory context demonstrates that WM and priming represent distinct states in the early visual cortex that play a causal role in memory-based guidance of attention.

On the limits of top-down control of visual selection

In the present study, observers viewed displays in which two equally salient color singletons were simultaneously present. Before each trial, observers received a word cue (e.g., the word red, or green) or a symbolic cue (a circle colored red or green) telling them which color singleton to select on the upcoming trial. Even though many theories of visual search predict that observers should be able to selectively attend the target color singleton, the results of the present study show that observers could not select the target singleton without interference from the irrelevant color singleton. The results indicate that the irrelevant color singleton captured attention. Only when the color of the target singleton remained the same from one trial to the next was selection perfect—an effect that is thought to be the result of passive automatic intertrial priming. The results of the present study demonstrate the limits of top-down attentional control.

Opposite influence of perceptual memory on initial and prolonged perception of sensory ambiguity

Observers continually make unconscious inferences about the state of the world based on ambiguous sensory information. This process of perceptual decision-making may be optimized by learning from experience. We investigated the influence of previous perceptual experience on the interpretation of ambiguous visual information. Observers were pre-exposed to a perceptually stabilized sequence of an ambiguous structure-from-motion stimulus by means of intermittent presentation. At the subsequent re-appearance of the same ambiguous stimulus perception was initially biased toward the previously stabilized perceptual interpretation. However, prolonged viewing revealed a bias toward the alternative perceptual interpretation. The prevalence of the alternative percept during ongoing viewing was largely due to increased durations of this percept, as there was no reliable decrease in the durations of the pre-exposed percept. Moreover, the duration of the alternative percept was modulated by the specific characteristics of the pre-exposure, whereas the durations of the pre-exposed percept were not. The increase in duration of the alternative percept was larger when the pre-exposure had lasted longer and was larger after ambiguous pre-exposure than after unambiguous pre-exposure. Using a binocular rivalry stimulus we found analogous perceptual biases, while pre-exposure did not affect eye-bias. We conclude that previously perceived interpretations dominate at the onset of ambiguous sensory information, whereas alternative interpretations dominate prolonged viewing. Thus, at first instance ambiguous information seems to be judged using familiar percepts, while re-evaluation later on allows for alternative interpretations.

The effects of context and musical training on auditory temporal-interval discrimination

Non sensory factors such as stimulus context and musical experience are known to influence auditory frequency discrimination, but whether the context effect extends to auditory temporal processing remains unknown. Whether individual experiences such as musical training alter the context effect is also unknown. The goal of the present study was therefore to investigate the effects of stimulus context and musical experience on auditory temporal-interval discrimination. In experiment 1, temporal-interval discrimination was compared between fixed context conditions in which a single base temporal interval was presented repeatedly across all trials and variable context conditions in which one of two base intervals was randomly presented on each trial. Discrimination was significantly better in the fixed than in the variable context conditions. In experiment 2 temporal discrimination thresholds of musicians and non-musicians were compared across 3 conditions: a fixed context condition in which the target interval was presented repeatedly across trials, and two variable context conditions differing in the frequencies used for the tones marking the temporal intervals. Musicians outperformed non-musicians on all 3 conditions, but the effects of context were similar for the two groups. Overall, it appears that, like frequency discrimination, temporal-interval discrimination benefits from having a fixed reference. Musical experience, while improving performance, did not alter the context effect, suggesting that improved discrimination skills among musicians are probably not an outcome of more sensitive contextual facilitation or predictive coding mechanisms.

Neural correlates of inter-trial priming and role-reversal in visual search

Studies of priming of visual perception demonstrate that observers respond more quickly to targets in a field of distractors when relevant features are repeated versus novel or role-reversed. In a recent brain imaging study by Kristjánsson et al. (2007), participants were presented with two items of one color and a single item in a different color with the task of reporting the orientation of the uniquely colored item. Consistent with previous behavioral reports, they found that observers were faster to respond when the target and distractor colors were identical to the previous trial than when they were reversed. They found reduced BOLD activity in brain areas linked with attentional control on trials where the target and distractor colors were repeated relative to reversed, which they interpreted as reflecting response suppression (decreased BOLD signal for repeated stimuli). However, since their design only compared repeated versus reversed task demands, it is logically possible that this pattern reflects increased BOLD signal for role-reversed stimuli: activity required to inhibit previously facilitated information and select previously inhibited information. We explored this possibility with a task where we contrasted the signal generated by repeated, reversed, and novel features. Our data suggest that the majority of the change in neural signal elicited by priming of pop-out reflects increased activation when selection criteria are reversed.

Deciding where to attend: priming of pop-out drives target selection

With attention and eye-movements humans orient to targets of interest. This orienting occurs faster when the same target repeats: priming of pop-out (PoP). While reaction times (RTs) can be important, PoP's real function could be to steer where to orient, a possibility underexposed in many current paradigms, as these predesignate a target to which to orient. In a novel procedure we intermixed pop-out trials (one oddball target, two identical distractors) with choice trials (one item of each kind) where observers freely chose an item to attend to. Pop-out trials strongly drove subsequent choice: observers typically chose the preceding target. Conversely, choice trials affected subsequent pop-out RTs. Conventional PoP measures correlated positively with our choice measures among observers, suggesting common mechanisms. Our results support PoP accounts centered on altered target priority, and underscore PoP's importance for visual exploration.

Reinforcement of inhibitory positional priming by spatial working memory contents

This study examined whether positional priming of pop-out is modulated by spatial working memory (WM). In Experiments 1A and 1B, observers were presented with a to-be-memorized item (Experiment 1A: triangle; Experiment 1B: circle) prior to performing a block of search trials, with triangular stimulus configurations (one target, two distractors) on an underlying elliptical frame. Each search block was followed by a memory test (i.e., memory conditions). In Experiment 1C, the presentation of the memory item (triangle) was immediately followed by the memory test, and the search block was performed after this test (i.e., no-memory condition). It was found that targets presented at a previous target were detected faster and targets presented at a previous distractor location slower, relative to a previous empty ('neutral') stimulus location, respectively. While facilitatory position priming was uninfluenced by the memory manipulation, inhibitory positional priming was larger in the memory than no-memory condition, but only when the memory stimulus (triangle) matched the (triangle) configuration formed by the three search items. This finding of larger inhibitory priming under memory conditions provides further evidence that positional priming, rather than being purely bottom-up determined, is open to top-down influences.

Subliminal semantic priming in speech

Numerous studies have reported subliminal repetition and semantic priming in the visual modality. We transferred this paradigm to the auditory modality. Prime awareness was manipulated by a reduction of sound intensity level. Uncategorized prime words (according to a post-test) were followed by semantically related, unrelated, or repeated target words (presented without intensity reduction) and participants performed a lexical decision task (LDT). Participants with slower reaction times in the LDT showed semantic priming (faster reaction times for semantically related compared to unrelated targets) and negative repetition priming (slower reaction times for repeated compared to semantically related targets). This is the first report of semantic priming in the auditory modality without conscious categorization of the prime.

Dissociable effects of reward on attentional learning: from passive associations to active monitoring

Visual selective attention (VSA) is the cognitive function that regulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior, facilitating analysis of currently relevant information while suppressing the less relevant input. Recent findings indicate that the deployment of VSA is shaped according to past outcomes. Targets whose selection has led to rewarding outcomes become relatively easier to select in the future, and distracters that have been ignored with higher gains are more easily discarded. Although outcomes (monetary rewards) were completely predetermined in our prior studies, participants were told that higher rewards would follow more efficient responses. In a new experiment we have eliminated the illusory link between performance and outcomes by informing subjects that rewards were randomly assigned. This trivial yet crucial manipulation led to strikingly different results. Items that were associated more frequently with higher gains became more difficult to ignore, regardless of the role (target or distracter) they played when differential rewards were delivered. Therefore, VSA is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them.

The involvement of posterior parietal cortex and frontal eye fields in spatially primed visual search

BACKGROUND

Right posterior parietal cortex (rPPC) and frontal eye fields (FEF) are known to be involved in processing visuospatial attention. However, the functional involvement of these areas in spatial priming in complex conjunction visual search has yet to be determined.

OBJECTIVE

This study aimed to examine the roles of rPPC and bilateral FEF in conjunction search when spatial ambiguity was reduced by priming the target location.

METHODS

Participants completed a conjunction search task whereby the target location was random or else repeated from the previous trial. Transcranial magnetic stimulation was delivered to each one of the three sites of interest at a time, and task performance was compared with a sham condition.

RESULTS

Spatial priming occurred for all conditions: search times were faster for primed relative to nonprimed trials. When the target appeared at a nonprimed location, stimulation over any of the three sites increased reaction times relative to the sham condition. However, when the target location was repeated, reaction time was only significantly increased by stimulation over the right FEF.

CONCLUSIONS

rPPC and left FEF are only involved when the target location is random, suggesting that these areas are essential for resolving spatial ambiguity to localize targets. Conversely, right FEF contributes equally to visual search regardless of spatial priming. We propose that right FEF has a role in the integration of bottom up saliency and top down expectancy signals and is the node at which rPPC and/or left FEF is either recruited or not.

Biasing visual selection: functional neuroimaging of the interplay between spatial cueing and feature memory guidance

The authors investigate the interplay between spatial attention and memory-based feature guidance of visual selection. Three types of guidance were tested: working memory, spatial cueing and passive memory. In all cases the memory-cue was not relevant to a subsequent search task, whilst the spatial cue always provided valid information. Behaviourally, search performance was influenced by spatial cueing and by feature-based cueing from the contents of working memory; both forms of guidance interacted, with feature guidance being more effective when the target's location was not pre-cued. Spatial cueing recruited the dorsal fronto-parietal network which was silent during the WM-only condition. Memory guidance of selection was reflected in activity in a frontal-temporal-occipital network. Interestingly, when spatial and memory guidance were pitted against each other, neural activity in this latter network was greatly attenuated. Connectivity analysis showed that the posterior parietal cortices inhibit the responses of occipital and temporal regions to the onset of memory-items in the search display. In the presence of a reliable spatial cue the posterior parietal cortex resumes control of attentional deployment. These results illustrate how different forms of attention guidance interact to optimise visual selection.

Adaptation and visual salience

We examined how the salience of color is affected by adaptation to different color distributions. Observers searched for a color target on a dense background of distractors varying along different directions in color space. Prior adaptation to the backgrounds enhanced search on the same background while adaptation to orthogonal background directions slowed detection. Advantages of adaptation were seen for both contrast adaptation (to different color axes) and chromatic adaptation (to different mean chromaticities). Control experiments, including analyses of eye movements during the search, suggest that these aftereffects are unlikely to reflect simple learning or changes in search strategies on familiar backgrounds, and instead result from how adaptation alters the relative salience of the target and background colors. Comparable effects were observed along different axes in the chromatic plane or for axes defined by different combinations of luminance and chromatic contrast, consistent with visual search and adaptation mediated by multiple color mechanisms. Similar effects also occurred for color distributions characteristic of natural environments with strongly selective color gamuts. Our results are consistent with the hypothesis that adaptation may play an important functional role in highlighting the salience of novel stimuli by discounting ambient properties of the visual environment.

Temporal consistency is currency in shifts of transient visual attention

Background

Observers respond more accurately to targets in visual search tasks that share properties with previously presented items, and transient attention can learn featural consistencies on a precue, irrespective of its absolute location.

Methodology/Principal Findings

We investigated whether such attentional benefits also apply to temporal consistencies. Would performance on a precued Vernier acuity discrimination task, followed by a mask, improve if the cue-lead times (CLTs; 50, 100, 150 or 200 ms) remained constant between trials compared to when they changed? The results showed that if CLTs remained constant for a few trials in a row, Vernier acuity performance gradually improved while changes in CLT from one trial to the next led to worse than average discrimination performance. The results show that transient attention can quickly adjust to temporal regularities, similarly to spatial and featural regularities. Further experiments show that this form of learning is not under voluntary control.

Conclusions/Significance

The results add to a growing literature showing how consistency in visual presentation improves visual performance, in this case temporal consistency.

Spatial probability AIDS visual stimulus discrimination

We investigated whether the statistical predictability of a target's location would influence how quickly and accurately it was classified. Recent results have suggested that spatial probability can be a cue for the allocation of attention in visual search. One explanation for probability cuing is spatial repetition priming. In our two experiments we used probability distributions that were continuous across the display rather than relying on a few arbitrary screen locations. This produced fewer spatial repeats and allowed us to dissociate the effect of a high-probability location from that of short-term spatial repetition. The task required participants to quickly judge the color of a single dot presented on a computer screen. In Experiment 1, targets were more probable in an off-center hotspot of high-probability that gradually declined to a background rate. Targets garnered faster responses if they were near earlier target locations (priming) and if they were near the high-probability hotspot (probability cuing). In Experiment 2, target locations were chosen on three concentric circles around fixation. One circle contained 80% of targets. The value of this ring distribution is that it allowed for a spatially restricted high-probability zone in which sequentially repeated trials were not likely to be physically close. Participant performance was sensitive to the high-probability circle in addition to the expected effects of eccentricity and the distance to recent targets. These two experiments suggest that inhomogeneities in spatial probability can be learned and used by participants on-line and without prompting as an aid for visual stimulus discrimination and that spatial repetition priming is not a sufficient explanation for this effect. Future models of attention should consider explicitly incorporating the probabilities of targets locations and features.