Where perception meets memory: A review of repetition priming in visual search tasks

Location- and feature-based selection histories make independent, qualitatively distinct contributions to urgent visuomotor performance

Attention mechanisms that guide visuomotor behaviors are classified into three broad types according to their reliance on stimulus salience, current goals, and selection histories (i.e., recent experience with events of many sorts). These forms of attentional control are clearly distinct and multifaceted, but what is largely unresolved is how they interact dynamically to determine impending visuomotor choices. To investigate this, we trained two macaque monkeys to perform an urgent version of an oddball search task in which a red target appears among three green distracters, or vice versa. By imposing urgency, performance can be tracked continuously as it transitions from uninformed guesses to informed choices, and this, in turn, permits assessment of attentional control as a function of time. We found that the probability of making a correct choice was strongly modulated by the histories of preceding target colors and target locations. Crucially, although both effects were gated by success (or reward), the two variables played dynamically distinct roles: whereas location history promoted an early motor bias, color history modulated the later perceptual evaluation. Furthermore, target color and location influenced performance independently of each other. The results show that, when combined, selection histories can give rise to enormous swings in visuomotor performance even in simple tasks with highly discriminable stimuli.

Priming effect of individual similarity and ensemble perception in visual search and working memory

Perceptual priming is a well-known phenomenon showing that the repetition of an object's feature can facilitate subsequent detection of that item. Although the priming effect has been rigorously studied in visual search, less is known about its effect on working memory and it is unclear whether the repetition of similar features, and furthermore, ensemble perception created by a large set of similar features, can induce priming. In this study, we investigated the priming effects of individual similarity and ensemble perception in visual search and visual working memory (VWM). We replicated the classic perceptual priming effect (Experiment 1a) and found that visual search was enhanced when the current target had a similar color to the previous target (Experiment 1b), but not when the similar color had been shown as a distractor before (Experiment 1c). However, if the target and distractors of similar colors formed ensemble perception, the search efficiency was again promoted even when the current target shared the same color with the previous distractor (Experiment 1d). For VWM, repeating the ensembles of the target- and nontarget-color subsets did not significantly affect the memory capacity, while switching the two harmed the memory fidelity but not capacity (Experiment 2). We suggest different underlying mechanisms for priming in visual search and VWM: in the former, the perception history of individual similarity and stimuli ensemble exert their effects on through the priority map, by forming a gradient distribution of attentional weights that peak at the previous target feature and diminish as stimulus diverges from the previously selected one; while in the latter, perception history of memory ensemble may influence the deployment of existing memory resources across trials, thereby affecting the memory fidelity but not its capacity.

Trichotomy revisited: A monolithic theory of attentional control

The control of attention was long held to reflect the influence of two competing mechanisms of assigning priority, one goal-directed and the other stimulus-driven. Learning-dependent influences on the control of attention that could not be attributed to either of those two established mechanisms of control gave rise to the concept of selection history and a corresponding third mechanism of attentional control. The trichotomy framework that ensued has come to dominate theories of attentional control over the past decade, replacing the historical dichotomy. In this theoretical review, I readily affirm that distinctions between the influence of goals, salience, and selection history are substantive and meaningful, and that abandoning the dichotomy between goal-directed and stimulus-driven mechanisms of control was appropriate. I do, however, question whether a theoretical trichotomy is the right answer to the problem posed by selection history. If we reframe the influence of goals and selection history as different flavors of memory-dependent modulations of attentional priority and if we characterize the influence of salience as a consequence of insufficient competition from such memory-dependent sources of priority, it is possible to account for a wide range of attention-related phenomena with only one mechanism of control. The monolithic framework for the control of attention that I propose offers several concrete advantages over a trichotomy framework, which I explore here.

Effector-independent Representations Guide Sequential Target Selection Biases in Action

Previous work shows that automatic attention biases toward recently selected target features transfer across action and perception and even across different effectors such as the eyes and hands on a trial-by-trial basis. Although these findings suggest a common neural representation of selection history across effectors, the extent to which information about recently selected target features is encoded in overlapping versus distinct brain regions is unknown. Using fMRI and a priming of pop-out task where participants selected unpredictable, uniquely colored targets among homogeneous distractors via reach or saccade, we show that color priming is driven by shared, effector-independent underlying representations of recent selection history. Consistent with previous work, we found that the intraparietal sulcus (IPS) was commonly activated on trials where target colors were switched relative to those where the colors were repeated; however, the dorsal anterior insula exhibited effector-specific activation related to color priming. Via multivoxel cross-classification analyses, we further demonstrate that fine-grained patterns of activity in both IPS and the medial temporal lobe encode information about selection history in an effector-independent manner, such that ROI-specific models trained on activity patterns during reach selection could predict whether a color was repeated or switched on the current trial during saccade selection and vice versa. Remarkably, model generalization performance in IPS and medial temporal lobe also tracked individual differences in behavioral priming sensitivity across both types of action. These results represent a first step to clarify the neural substrates of experience-driven selection biases in contexts that require the coordination of multiple actions.

Determinants of Face Recognition: The Role of Target Prevalence and Similarity

Studies of facial identity processing typically assess perception (via matching) and/or memory (via recognition), with experimental designs differing with respect to one important aspect: Target Prevalence. Some designs include "target absent" (TA) among "target present" (TP) trials. In visual search tasks, TA trials shift an observer's decisional criterion towards a stricter one, increasing misses. However, decisional biases will differ between individuals and across an individual's decisions as well. In this way, excluding TA trials ensures comparable levels of expectation and thus a more controlled decisional bias both within and between observers by not considering correct rejections and false alarms. However, TA trials may occur, e.g., in police line-ups, where it is important to consider observers' face recognition ability net of the potential biases introduced by TA and TP trials. And, while these have been investigated in numerous other stimulus domains, their effects have not yet been extended to face recognition. We therefore sought to fill this void by testing different versions of the previously established Models Memory Test, which measures old/new recognition of experimentally learned facial identities. Our study found significant expectation effects, driven by target prevalence that persist even given prevalence changes. This implies that face recognition - even measured with naturalistic changes - is influenced by prior perceptual decisions.

Cognitive control adjustments are dependent on the level of conflict

The congruency sequence effect (CSE) is one of the most investigated effects in the cognitive control literature. The conflict monitoring theory suggests that the CSE is the result of adjustments in cognitive control based on perceived conflict. A recent paper by Zhang and colleagues, has investigated whether the manipulation of conflict level by changing distractor incompatibility in a flanker task affects the amount of adjustments in cognitive control. Their study produced mixed findings, somewhat supporting the original conflict monitoring theory, but also suggesting other explanations, such as the repetition expectancy account. We replicated the experimental design in a multisite online study (N = 347), with Hungarian, Italian, and Singaporean participants. Our results supported the prediction that changes in the level of conflict trigger conflict adaptation, revealing that increasing conflict levels induced stronger adaptive control. Bayesian hypothesis testing indicated a monotonic reduction in congruency effects as a function of previous conflict strength. This finding is in line with the extension of the traditional conflict monitoring theory, as well as other theories like affective signaling and expected value of control, implying that the relationship between conflict and interference effects is gradual, rather than a binary function.

The dynamics of statistical learning in visual search and its interaction with salience processing: An EEG study

Visual attention can be guided by statistical regularities in the environment, that people implicitly learn from past experiences (statistical learning, SL). Moreover, a perceptually salient element can automatically capture attention, gaining processing priority through a bottom-up attentional control mechanism. The aim of our study was to investigate the dynamics of SL and if it shapes attentional target selection additively with salience processing, or whether these mechanisms interact, e.g. one gates the other. In a visual search task, we therefore manipulated target frequency (high vs. low) across locations while, in some trials, the target was salient in terms of colour. Additionally, halfway through the experiment, the high-frequency location changed to the opposite hemifield. EEG activity was simultaneously recorded, with a specific interest in two markers related to target selection and post-selection processing, respectively: N2pc and SPCN. Our results revealed that both SL and saliency significantly enhanced behavioural performance, but also interacted with each other, with an attenuated saliency effect at the high-frequency target location, and a smaller SL effect for salient targets. Concerning processing dynamics, the benefit of salience processing was more evident during the early stage of target selection and processing, as indexed by a larger N2pc and early-SPCN, whereas SL modulated the underlying neural activity particularly later on, as revealed by larger late-SPCN. Furthermore, we showed that SL was rapidly acquired and adjusted when the spatial imbalance changed. Overall, our findings suggest that SL is flexible to changes and, combined with salience processing, jointly contributes to establishing attentional priority.

The illusory truth effect requires semantic coherence across repetitions

Repeated exposure to information increases its' perceived truth, and this illusory truth effect is often explained by two theoretical frameworks: the fluency account and the referential theory of truth. Whereas the fluency account suggests that prior activation of a single referent within a statement should increase its perceived truth, the referential theory makes no such predictions. The referential theory instead proposes that when a statement is processed, it activates the corresponding memory referents within that statement and strengthens the connection between these referents in the semantic memory network. Because repeated statements will have more coherent corresponding referents than new statements, they are perceived as relatively truer. Experiments 1 and 2 focused on testing the fluency account, with participants exposed to one or two of a statement's referents before evaluating that statement's truth. Experiments 3 and 4 focused on the referential theory by exposing participants to non-critical facts that linked together two of a critical statements' referents before evaluating the truth of the critical statements. We consistently observed a standard illusory truth effect, such that facts that repeated verbatim were rated as truer than new facts. However, perceived truth was not affected by prior exposure to the critical statement's topic (Experiment 1) or by prior exposure to non-critical facts related to the same topic(s) as the critical statement (Experiment 2). There was also no boost in perceived truth following prior exposure to non-critical facts that linked together two of the primary referents of the critical statement but did so in a semantically distinct manner from how those same referents were linked in the critical statement itself (Experiments 3 and 4). However, Experiment 4 demonstrated that perceived truth significantly increased if there was prior exposure to non-critical facts that linked two of the critical statement primary referents in a way that was semantically coherent with how those same referents were linked within the critical statement. Together, these results are consistent with the referential theory, and suggest that semantic consistency across repetitions plays a crucial role in leading to repetition-based illusory truth effects.

Boundary updating as a source of history effect on decision uncertainty

When sorting a sequence of stimuli into binary classes, current choices are often negatively correlated with recent stimulus history. This phenomenon-dubbed the repulsive bias-can be explained by boundary updating, a process of shifting the class boundary to previous stimuli. This explanation implies that recent stimulus history can also influence "decision uncertainty," the probability of making incorrect decisions, because it depends on the location of the boundary. However, there have been no previous efforts to elucidate the impact of previous stimulus history on decision uncertainty. Here, from the boundary-updating process that accounts for the repulsive bias, we derived a prediction that decision uncertainty increases as current choices become more congruent with previous stimuli. We confirmed this prediction in behavioral, physiological, and neural correlates of decision uncertainty. Our work demonstrates that boundary updating offers a principled account of how previous stimulus history concurrently relates to choice bias and decision uncertainty.

Bilingual toddlers show increased attention capture by static faces compared to monolinguals

Bilingual infants rely differently than monolinguals on facial information, such as lip patterns, to differentiate their native languages. This may explain, at least in part, why young monolinguals and bilinguals show differences in social attention. For example, in the first year, bilinguals attend faster and more often to static faces over non-faces than do monolinguals (Mercure et al., 2018). However, the developmental trajectories of these differences are unknown. In this pre-registered study, data were collected from 15- to 18-month-old monolinguals (English) and bilinguals (English and another language) to test whether group differences in face-looking behaviour persist into the second year. We predicted that bilinguals would orient more rapidly and more often to static faces than monolinguals. Results supported the first but not the second hypothesis. This suggests that, even into the second year of life, toddlers' rapid visual orientation to static social stimuli is sensitive to early language experience.

The association of targets modulates the search efficiency in multitarget searches

Previous studies have found that distractors can affect visual search efficiency when associated with the target in a single-target search. However, multitarget searches are frequently necessary in daily life. In the present study, we examined how the association of targets in a multitarget search affected performance when searching for two targets simultaneously (Experiment 1). In addition, we explored whether the association affected switch cost (Experiment 2) and preparation cost (Experiment 3). Participants were required to learn associations between different colors or shapes and then performed feature search and conjunction search tasks. For all experiments, the results of search efficiency showed that for conjunction search, the search efficiency under the associated condition was significantly higher than that under the neutral condition. Similarly, the response times in the associated condition were significantly faster than those in the neutral condition under the conjunction search condition in Experiments 1 and 2. However, in Experiment 3, the response times in the associated condition were longer than those in the neutral condition. These results indicate that the association between targets can improve the efficiency of multitarget searches. Furthermore, associations can reduce the time spent searching for individual targets and the switch cost; however, the preparation cost increases.

Reconstructing a disambiguation sequence that forms perceptual memory of multistable displays via reverse correlation method: Bias onset perception but gently

When multistable displays are presented intermittently with long blank intervals, their onset perception is determined by perceptual memory of multistable displays. We investigated when and how it is formed using a reverse correlation method and bistable kinetic depth effect displays. Each experimental block consisted of interleaved fully ambiguous probe and exogenously disambiguated prime displays. The purpose of the former was to "read out" the perceptual memory, whereas the latter contained purely random disambiguation sequences that were presented at the beginning of the prime display, throughout the entire presentation, or at the beginning and the end of the presentation. For each experiment and condition, we selected a subset of trials with disambiguation sequences that led to a change in perception of either the prime itself (sequences that modified perception) or the following fully ambiguous probe (sequences that modified perceptual memory). We estimated average disambiguation sequences for each participant using additive linear models. We found that an optimal sequence started at the onset with a moderate disambiguation against the previously dominant state (dominant perception for the previous probe) that gradually reduced until the display is fully ambiguous. We also show that the same sequence leads to an altered perception of the prime, indicating that perception and perceptual memory form at the same time. We suggest that perceptual memory is a consequence of an earlier evidence accumulation process and is informative about how the visual system treated ambiguity in the past rather than how it anticipates an uncertain future.

Priming of probabilistic attentional templates

Attentional priming has a dominating influence on vision, speeding visual search, releasing items from crowding, reducing masking effects, and during free-choice, primed targets are chosen over unprimed ones. Many accounts postulate that templates stored in working memory control what we attend to and mediate the priming. But what is the nature of these templates (or representations)? Analyses of real-world visual scenes suggest that tuning templates to exact color or luminance values would be impractical since those can vary greatly because of changes in environmental circumstances and perceptual interpretation. Tuning templates to a range of the most probable values would be more efficient. Recent evidence does indeed suggest that the visual system represents such probability, gradually encoding statistical variation in the environment through repeated exposure to input statistics. This is consistent with evidence from neurophysiology and theoretical neuroscience as well as computational evidence of probabilistic representations in visual perception. I argue that such probabilistic representations are the unit of attentional priming and that priming of, say, a repeated single-color value simply involves priming of a distribution with no variance. This "priming of probability" view can be modelled within a Bayesian framework where priming provides contextual priors. Priming can therefore be thought of as learning of the underlying probability density function of the target or distractor sets in a given continuous task.

Top-down then automatic: Instructions can continue to influence visual search when no longer actively implemented

The present study investigated the automaticity of top-down instructions in visual search when the instruction was no longer actively implemented. To do so, we exploited the Priming of Pop-out (PoP) effect, a selection history phenomenon that reflects faster responses when the target and distractor colors are repeated than switched across trials of singleton search. We then had participants perform a color singleton search task where they implemented the instruction of imagining the opposite color of the previous target, which put the target colors underlying PoP and the imagery instruction in opposition. To assess automaticity, on some trials participants were instructed to stop implementing the imagery instruction. When the imagery instruction was implemented, responses were faster when the target and distractor colors switched (i.e., imagery congruent) than repeated (i.e., imagery incongruent) across search displays - a pattern of results opposite to the PoP effect. When participants were to not implement this instruction, the PoP effect was absent, indicating the imagery instruction had a lingering influence on visual search. This remained true even when participants reported successfully not implementing the instruction, and only when the imagery abandonment instruction was supplanted by a different top-down task was the lingering influence removed such that the PoP effect returned. Overall, the present study demonstrates that top-down instructions can continue to influence visual search despite the will of the observer.

The persistence of value-driven attention capture is task-dependent

Visual features previously associated with reward can capture attention even when task-irrelevant, a phenomenon known as value-driven attention capture (VDAC). VDAC persists without reinforcement, unlike other forms of learning, where removing reinforcement typically leads to extinction. In five experiments, factors common to many studies were manipulated to examine their impact on VDAC and its extinction. All experiments included learning and test phases. During learning, participants completed a visual search task during which one of two target colors was associated with a reward, and the other with no reward. During test, 1 week later, participants completed another visual search task in which the reward association was not reinforced. When a rewarded feature remained task-relevant (Experiment 1), VDAC was observed. When the rewarded feature was made task-irrelevant (Experiments 2-5) there was no evidence of a VDAC effect, except when the target feature was physically salient and there was a reduction in the frequency of exposure to the reward-associated feature (Experiment 5). We failed to find evidence of VDAC in Experiments 2-4, suggesting that VDAC may depend on the demands of the task resulting in vulnerability to VDAC. When VDAC was observed, extinction was also observed. This indicates that VDAC is subject to extinction as would be expected from an effect driven by reinforcement learning.

Selection history influences an attentional decision bias toward singleton targets

Selection history effects are ubiquitous findings that show how implicitly encoding a target's feature or location on a trial can facilitate target activation on the following trial. Although the target-defining feature (e.g., color) is usually unpredictable, it is often relevant to determining the target on a given trial. The present study used a feature priming task, like the three-item oddball search task, but varied the target-defining feature (shape) orthogonal to the priming feature (color) that could influence target activation. On any trial the target could be a color singleton or not, and the target's feature could repeat or switch between trials. Larger priming effects were seen when the current target was a color singleton than a nonsingleton. Importantly, diffusion analyses showed that pretrial selection bias contributed to these larger priming effects. The results suggest selection history facilitates target activation through an attentional decision bias to select the object with the most recently attended color, and this attentional decision is easier when the current target is also distinct.

Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Phase separation of competing memories along the human hippocampal theta rhythm

Competition between overlapping memories is considered one of the major causes of forgetting, and it is still unknown how the human brain resolves such mnemonic conflict. In the present magnetoencephalography (MEG) study, we empirically tested a computational model that leverages an oscillating inhibition algorithm to minimise overlap between memories. We used a proactive interference task, where a reminder word could be associated with either a single image (non-competitive condition) or two competing images, and participants were asked to always recall the most recently learned word–image association. Time-resolved pattern classifiers were trained to detect the reactivated content of target and competitor memories from MEG sensor patterns, and the timing of these neural reactivations was analysed relative to the phase of the dominant hippocampal 3 Hz theta oscillation. In line with our pre-registered hypotheses, target and competitor reactivations locked to different phases of the hippocampal theta rhythm after several repeated recalls. Participants who behaviourally experienced lower levels of interference also showed larger phase separation between the two overlapping memories. The findings provide evidence that the temporal segregation of memories, orchestrated by slow oscillations, plays a functional role in resolving mnemonic competition by separating and prioritising relevant memories under conditions of high interference.

Difficulty with the preceding visual search affects brain activity in the following resting period

It has been well-documented that brain regions related to a task are activated during the task performance. We investigated whether brain activity and functional connectivity during the rest period are affected by the preceding task. Participants performed visual search tasks with three search conditions, which were followed by a rest period. During the rest period, participants were asked to look at the display that did not show any visual stimuli. In the result, brain activity in occipital and superior parietal regions would be deactivated by the preceding task during the rest period after visual search tasks. However, the activity of the inferior frontal gyrus during the rest period, which is also part of the attention network, was not affected by the brain activity during the preceding visual search task. We proposed a new model for explaining how the cognitive demands of the preceding visual search task regulate the attention network during the rest period after the task. In this model, the cognitive demand changes with task difficulty, which affects the brain activity even after removing the visual search task in the rest phase.

Visual priming and serial dependence are mediated by separate mechanisms

Perceptual history influences current perception, readily revealed by visual priming (the facilitation of responses on repeated presentations of similar stimuli) and by serial dependence (systematic biases toward the previous stimuli). We asked whether the two phenomena shared perceptual mechanisms. We modified the standard “priming of pop-out” paradigm to measure both priming and serial dependence concurrently. The stimulus comprised three grating patches, one or two red, and the other green. Participants identified the color singleton (either red or green), and reproduced its orientation. Trial sequences were designed to maximize serial dependence, and long runs of priming color and position. The results showed strong effects of priming, both on reaction times and accuracy, which accumulated steadily over time, as generally reported in the literature. The serial dependence effects were also strong, but did not depend on previous color, nor on the run length. Reaction times measured under various conditions of repetition or change of priming color or position were reliably correlated with imprecision in orientation reproduction, but reliably uncorrelated with magnitude of serial dependence. The results suggest that visual priming and serial dependence are mediated by different neural mechanisms. We propose that priming affects sensitivity, possibly via attention-like mechanisms, whereas serial dependence affects criteria, two orthogonal dimensions in the signal detection theory.

Training modulates memory-driven capture

Attention is captured by information matching the contents of working memory. Though many factors modulate the amount of capture, there is surprising resistance to cognitive control. Capture occurs even when participants are instructed either that an item would never be a target or to drop that item from memory. Does the persistence of capture under these conditions reflect a rigidity in capture, or can properly motivated participants learn to completely suppress distractors and/or completely drop items from memory? Surprisingly, no studies have looked at the influence of extensive training of involuntary capture from working memory items. Here, we addressed whether training leads to a reduction or even elimination of memory-driven capture. After memorizing a single object, participants were cued to remember or to forget this object. Subsequently, they were asked to execute a search task. To measure capture, we compared search performances in displays that did and did not contain a distractor matching the earlier memorized object. Participants completed multiple experimental sessions over four days. The results showed that attentional capture by to-be-remembered distractors was reduced, but not eliminated in subsequent sessions compared with the first session. Training did not impact capture by to-be-forgotten objects. The results suggest observable, but limited, cognitive control over memory-driven capture.

Eye-specific attentional bias driven by selection history

Attention helps in selection among competing stimuli, but attentional selection also biases subsequent information processing as a prior experience. Previous studies have demonstrated that intertrial repetition of target features or locations facilitates perceptual processing as selection history guides attention. In the current study, we found that eye selection history in binocular rivalry induces eye-specific attentional bias. In four experiments, participants responded to the target presented at one of the locations on either eye. The results showed that the target was detected faster when presented to the same eye as in the previous trial under binocular rivalry. However, the effect of eye repetition was not observed when the interocular conflict was reduced by presenting stimuli to only one eye on each trial. Our result indicates that eye selection history can affect eye dominance during binocular rivalry as attention amplifies selected information among competing inputs. These findings suggest that prior experience of attentional deployment modulates subsequent information processing owing to the residual effect of attentional amplification.

Covert attention is attracted to prior target locations: Evidence from the probe paradigm

There is growing evidence that visual attention can be guided by selection history. One example of this is intertrial location priming, whereby attention is attracted to the target location from the previous trial. Most previous demonstrations of location priming have relied on manual response time effects whereby search is speeded when the target location repeats from the previous trial. However, these latency-based effects have recently been challenged as being due to response facilitation that occurs after the target has been found, rather than an attentional bias toward the previous target location. To resolve this, the current study used a probe paradigm to assess whether covert attention is biased to the previous-trial target location. On search trials, participants searched for a specific target shape amongst distractor shapes and made a speeded response to the location of a dot inside the target. On probe trials, letters briefly appeared at each search location and after a delay, participants were asked to report as many letters as possible. Probe report accuracy was used to assess the likelihood that a given location was attended. Three experiments indicated that probe report accuracy was greatly improved for letters at the previous-trial target location compared with baseline levels. Importantly, this occurred even when strong attentional guidance to the target was encouraged and even when a nontarget stimulus appeared at the primed location. Altogether, the results suggest that covert attention is strongly attracted to the previous target location during visual search.

Top-down, bottom-up, and history-driven processing of multisensory attentional cues in intellectual disability: An experimental study in virtual reality

Models of attention demonstrated the existence of top-down, bottom-up, and history-driven attentional mechanisms, controlled by partially segregated networks of brain areas. However, few studies have examined the specific deficits in those attentional mechanisms in intellectual disability within the same experimental setting. The aim of the current study was to specify the attentional deficits in intellectual disability in top-down, bottom-up, and history-driven processing of multisensory stimuli, and gain insight into effective attentional cues that could be utilized in cognitive training programs for intellectual disability. The performance of adults with mild to moderate intellectual disability (n = 20) was compared with that of typically developing controls (n = 20) in a virtual reality visual search task. The type of a spatial cue that could aid search performance was manipulated to be either endogenous or exogenous in different sensory modalities (visual, auditory, tactile). The results identified that attentional deficits in intellectual disability are overall more pronounced in top-down rather than in bottom-up processing, but with different magnitudes across cue types: The auditory or tactile endogenous cues were much less effective than the visual endogenous cue in the intellectual disability group. Moreover, the history-driven processing in intellectual disability was altered, such that a reversed priming effect was observed for immediate repetitions of the same cue type. These results suggest that the impact of intellectual disability on attentional processing is specific to attentional mechanisms and cue types, which has theoretical as well as practical implications for developing effective cognitive training programs for the target population.

Disrupting Short-Term Memory Maintenance in Premotor Cortex Affects Serial Dependence in Visuomotor Integration

Human behavior is biased by past experience. For example, when intercepting a moving target, the speed of previous targets will bias responses in future trials. Neural mechanisms underlying this so-called serial dependence are still under debate. Here, we tested the hypothesis that the previous trial leaves a neural trace in brain regions associated with encoding task-relevant information in visual and/or motor regions. We reasoned that injecting noise by means of transcranial magnetic stimulation (TMS) over premotor and visual areas would degrade such memory traces and hence reduce serial dependence. To test this hypothesis, we applied bursts of TMS pulses to right visual motion processing region hV5/MT+ and to left dorsal premotor cortex (PMd) during intertrial intervals of a coincident timing task performed by twenty healthy human participants (15 female). Without TMS, participants presented a bias toward the speed of the previous trial when intercepting moving targets. TMS over PMd decreased serial dependence in comparison to the control Vertex stimulation, whereas TMS applied over hV5/MT+ did not. In addition, TMS seems to have specifically affected the memory trace that leads to serial dependence, as we found no evidence that participants' behavior worsened after applying TMS. These results provide causal evidence that an implicit short-term memory mechanism in premotor cortex keeps information from one trial to the next, and that this information is blended with current trial information so that it biases behavior in a visuomotor integration task with moving objects.SIGNIFICANCE STATEMENT Human perception and action are biased by the recent past. The origin of such serial bias is still not fully understood, but a few components seem to be fundamental for its emergence: the brain needs to keep previous trial information in short-term memory and blend it with incoming information. Here, we present evidence that a premotor area has a potential role in storing previous trial information in short-term memory in a visuomotor task and that this information is responsible for biasing ongoing behavior. These results corroborate the perspective that areas associated with processing information of a stimulus or task also participate in maintaining that information in short-term memory even when this information is no longer relevant for current behavior.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Contrasting attentional biases in a saccadic choice task

To gain insight into how human observers select items in the visual field we pitted two attentional biases against one another in a single free choice design. The first bias is the nasal-temporal asymmetry during free choice tasks, where observers tend to choose targets that appear in their temporal hemifield over targets appearing in their nasal hemifield. The second is the choice bias found in studies of attentional priming. When observers have to select between a stimulus that shares features with a preceding target and a stimulus sharing features with previous distractors, they have a strong tendency to choose the preceding search target and this bias increases the more often the same search is repeated. Our results show that both biases affect saccadic choice, but they also show that the nasal-temporal bias can modulate the strength of the priming effects, but not vice versa. The priming effect was stronger for stimuli appearing in the temporal than in the nasal hemifield, but the nasal-temporal bias was similar for primed and unprimed targets. Additionally, our findings are the first to show how search repetition leads to faster saccades. The observed difference between the effects of the NTA and priming biases may reflect the difference in neural mechanisms thought to be behind these biases and that biases at lower levels may outrank higher-level biases, at least in their effect on visual attention.

Development and Initial Validation of the Perceptual Assessment of Memory (PASSOM): A Simulator Study

OBJECTIVE

Performance validity tests (PVTs) are an integral component of neuropsychological assessment. There is a need for the development of more PVTs, especially those employing covert determinations. The aim of the present study was to provide initial validation of a new computerized PVT, the Perceptual Assessment of Memory (PASSOM).

METHOD

Participants were 58 undergraduate students randomly assigned to a simulator (SIM) or control (CON) group. All participants were provided written instructions for their role prior to testing and were administered the PASSOM as part of a brief battery of neurocognitive tests. Indices of interest included response accuracy for Trials 1 and 2, and total errors across Trials, as well as response time (RT) for Trials 1 and 2, and total RT for both Trials.

RESULTS

The SIM group produced significantly more errors than the CON group for Trials 1 and 2, and committed more total errors across trials. Significantly longer response latencies were found for the SIM group compared to the CON group for all RT indices examined. Linear regression modeling indicated excellent group classification for all indices studied, with areas under the curve ranging from 0.92 to 0.95. Sensitivity and specificity rates were good for several cut scores across all of the accuracy and RT indices, and sensitivity improved greatly by combining RT cut scores with the more traditional accuracy cut scores.

CONCLUSION

Findings demonstrate the ability of the PASSOM to distinguish individuals instructed to feign cognitive impairment from those told to perform to the best of their ability.

Does feature intertrial priming guide attention? The jury is still out

Our search performance is strongly influenced by our past experience. In the lab, this influence has been demonstrated by investigating a variety of phenomena, including intertrial priming, statistical learning, and reward history, and collectively referred to as selection history. The resulting findings have led researchers to claim that selection history guides attention, thereby challenging the prevailing dichotomy, according to which top-down and bottom-up factors alone determine attentional priority. Here, we re-examine this claim with regard to one selection-history phenomenon, feature intertrial priming (aka priming of pop-out). We evaluate the evidence that specifically pertains to the role of feature intertrial priming in attentional guidance, rather than in later selective processes occurring after the target is found. We distinguish between the main experimental rationales, while considering the extent to which feature intertrial priming, as studied through different protocols, shares characteristics of top-down attention. We show that there is strong evidence that feature intertrial priming guides attention when the experimental protocol departs from the canonical paradigm and encourages observers to maintain the critical feature in visual working memory or to form expectations about the upcoming target. By contrast, the current evidence regarding the standard feature intertrial priming phenomenon is inconclusive. We propose directions for future research and suggest that applying the methodology used here in order to re-evaluate of the role of other selection history phenomena in attentional guidance should clarify the mechanisms underlying the strong impact of past experience on visual search performance.

Sources of variation in search and foraging: A theoretical perspective

Search-the problem of exploring a space of alternatives to identify target goals-is a fundamental behaviour for many species. Although its foundation lies in foraging, most studies of human search behaviour have been directed towards understanding the attentional mechanisms that underlie the efficient visual exploration of two-dimensional (2D) scenes. With this review, we aim to characterise how search behaviour can be explained across a wide range of contexts, environments, spatial scales, and populations, both typical and atypical. We first consider the generality of search processes across psychological domains. We then review studies of interspecies differences in search. Finally, we explore in detail the individual and contextual variables that affect visual search and related behaviours in established experimental psychology paradigms. Despite the heterogeneity of the findings discussed, we identify that variations in control processes, along with the ability to regulate behaviour as a function of the structure of search space and the sampling processes adopted, to be central to explanations of variations in search behaviour. We propose a tentative theoretical model aimed at integrating these notions and close by exploring questions that remain unaddressed.

Infants' Selective Visual Attention Is Dependent on Maternal Affect and Emotional Context

Development of selective attention during the first year of life is critical to cognitive and socio-emotional skills. It is also a period that the average child’s interactions with their mother dominate their social environment. This study examined how maternal negative affect and an emotion face prime (mother/stranger) jointly effect selective visual attention. Results from linear mixed-effects modeling showed that 9-month olds (N=70) were faster to find a visual search target after viewing a fearful face (regardless of familiarity) or their mother’s angry face. For mothers with high negative affect, infants’ attention was further impacted by fearful faces, resulting in faster search times. Face emotion interacted with mother’s negative affect, demonstrating a capacity to influence what infants attend in their environment.

What kind of empirical evidence is needed for probabilistic mental representations? An example from visual perception

Recent accounts of perception and cognition propose that the brain represents information probabilistically. While this assumption is common, empirical support for such probabilistic representations in perception has recently been criticized. Here, we evaluate these criticisms and present an account based on a recently developed psychophysical methodology, Feature Distribution Learning (FDL), which provides promising evidence for probabilistic representations by avoiding these criticisms. The method uses priming and role-reversal effects in visual search. Observers' search times reveal the structure of perceptual representations, in which the probability distribution of distractor features is encoded. We explain how FDL results provide evidence for a stronger notion of representation that relies on structural correspondence between stimulus uncertainty and perceptual representations, rather than a mere co-variation between the two. Moreover, such an account allows us to demonstrate what kind of empirical evidence is needed to support probabilistic representations as posited in current probabilistic Bayesian theories of perception.

The effect of categorical superiority in subsequent search misses

Subsequent search misses (SSM) refer to the decrease in accuracy of second target detection in dual-target visual search. One of the theoretical explanations of SSM errors is similarity bias - the tendency to search for similar targets and to miss the dissimilar ones. The current study focuses on both perceptual and categorical similarity and their individual roles in SSM. Five experiments investigated the role of perceptual and categorical similarity in subsequent search misses, wherein perceptual and categorical similarities were manipulated separately, and task relevance was controlled. The role of both perceptual and categorical similarity was revealed, however, the categorical similarity had greater impact on second target detection. The findings of this research suggest the revision of the traditional perceptual set hypothesis that mainly focuses on perceptual target similarity in multiple target visual search.

Alpha-Band Phase Modulates Bottom-up Feature Processing

Recent studies reveal that attention operates in a rhythmic manner, that is, sampling each location or feature alternatively over time. However, most evidence derives from top-down tasks, and it remains elusive whether bottom-up processing also entails dynamic coordination. Here, we developed a novel feature processing paradigm and combined time-resolved behavioral measurements and electroencephalogram (EEG) recordings to address the question. Specifically, a salient color in a multicolor display serves as a noninformative cue to capture attention and presumably reset the oscillations of feature processing. We then measured the behavioral performance of a probe stimulus associated with either high- or low-salient color at varied temporal lags after the cue. First, the behavioral results (i.e., reaction time) display an alpha-band (~8 Hz) profile with a consistent phase lag between high- and low-salient conditions. Second, simultaneous EEG recordings show that behavioral performance is modulated by the phase of alpha-band neural oscillation at the onset of the probes. Finally, high- and low-salient probes are associated with distinct preferred phases of alpha-band neural oscillations. Taken together, our behavioral and neural results convergingly support a central function of alpha-band rhythms in feature processing, that is, features with varied saliency levels are processed at different phases of alpha neural oscillations.

Temporal Characteristics of Priming of Attention Shifts Are Mirrored by BOLD Response Patterns in the Frontoparietal Attention Network

Priming of attention shifts involves the reduction in search RTs that occurs when target location or target features repeat. We used functional magnetic resonance imaging to investigate the neural basis of such attentional priming, specifically focusing on its temporal characteristics over trial sequences. We first replicated earlier findings by showing that repetition of target color and of target location from the immediately preceding trial both result in reduced blood oxygen level-dependent (BOLD) signals in a cortical network that encompasses occipital, parietal, and frontal cortices: lag-1 repetition suppression. While such lag-1 suppression can have a number of explanations, behaviorally, the influence of attentional priming extends further, with the influence of past search trials gradually decaying across multiple subsequent trials. Our results reveal that the same regions within the frontoparietal network that show lag-1 suppression, also show longer term BOLD reductions that diminish over the course of several trial presentations, keeping pace with the decaying behavioral influence of past target properties across trials. This distinct parallel between the across-trial patterns of cortical BOLD and search RT reductions, provides strong evidence that these cortical areas play a key role in attentional priming.

Testing temporal integration of feature probability distributions using role-reversal effects in visual search

The visual system is sensitive to statistical properties of complex scenes and can encode feature probability distributions in detail. But does the brain use these statistics to build probabilistic models of the ever-changing visual input? To investigate this, we examined how observers temporally integrate two different orientation distributions from sequentially presented visual search trials. If the encoded probabilistic information is used in a Bayesian optimal way, observers should weigh more reliable information more strongly, such as feature distributions with low variance. We therefore manipulated the variance of the two feature distributions. Participants performed sequential odd-one-out visual search for an oddly oriented line among distractors. During successive learning trials, the distractor orientations were sampled from two different Gaussian distributions on alternating trials. Then, observers performed a 'test trial' where the orientations of the target and distractors were switched, allowing us to assess observer's internal representation of distractor distributions based on changes in response times. In three experiments we observed that observer's search times on test trials depended mainly on the very last learning trial, indicating a strong recency effect. Since temporal integration has been previously observed with this method, we conclude that when the input is unreliable, the visual system relies more on the most recent stimulus. This indicates that the visual system prefers to utilize sensory history when the statistical properties of the environment are relatively stable.

Oculomotor inhibition and location priming in schizophrenia

Schizophrenia is widely thought to involve elevated distractibility, which may reflect a general impairment in top-down inhibitory processes. Schizophrenia also appears to involve increased priming of previously performed actions. Here, we used a highly refined eye-tracking paradigm that makes it possible to concurrently assess distractibility, inhibition, and priming. In both healthy control subjects (HCS, N = 41) and people with schizophrenia (PSZ, N = 46), we found that initial saccades were actually less likely to be directed toward a salient "singleton" distractor than toward less salient distractors, reflecting top-down suppression of the singleton. Remarkably, this oculomotor suppression effect was as strong or stronger in PSZ than in HCS, indicating intact inhibitory control. In addition, saccades were frequently directed to the location of the previous-trial target in both groups, but this priming effect was much stronger in PSZ than in HCS. Indeed, PSZ directed gaze toward the location of the previous-trial target as often as they directed gaze to the location of the current-trial target. These results demonstrate that-at least in the context of visual search-PSZ are no more distractable than HCS and are fully capable of inhibiting salient-but-irrelevant stimuli. However, PSZ do exhibit exaggerated priming, focusing on recently attended locations even when this is not beneficial for goal attainment. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Procedural Control Versus Resources as Potential Origins of Human Hyper Selectivity

In the current review, we argue that experimental results usually interpreted as evidence for cognitive resource limitations could also reflect functional necessities of human information processing. First, we point out that selective processing of only specific features, objects, or locations at each moment in time allows humans to monitor the success and failure of their own overt actions and covert cognitive procedures. We then proceed to show how certain instances of selectivity are at odds with commonly assumed resource limitations. Next, we discuss examples of seemingly automatic, resource-free processing that challenge the resource view but can be easily understood from the functional perspective of monitoring cognitive procedures. Finally, we suggest that neurophysiological data supporting resource limitations might actually reflect mechanisms of how procedural control is implemented in the brain.

Statistical learning of target selection and distractor suppression shape attentional priority according to different timeframes

Recent findings suggest that attentional and oculomotor control is heavily affected by past experience, giving rise to selection and suppression history effects, so that target selection is facilitated if they appear at frequently attended locations, and distractor filtering is facilitated at frequently ignored locations. While selection history effects once instantiated seem to be long-lasting, whether suppression history is similarly durable is still debated. We assessed the permanence of these effects in a unique experimental setting investigating eye-movements, where the locations associated with statistical unbalances were exclusively linked with either target selection or distractor suppression. Experiment 1 and 2 explored the survival of suppression history in the long and in the short term, respectively, revealing that its lingering traces are relatively short lived. Experiment 3 showed that in the very same experimental context, selection history effects were long lasting. These results seem to suggest that different mechanisms support the learning-induced plasticity triggered by selection and suppression history. Specifically, while selection history may depend on lasting changes within stored representations of the visual space, suppression history effects hinge instead on a functional plasticity which is transient in nature, and involves spatial representations which are constantly updated and adaptively sustain ongoing oculomotor control.

The road to long-term memory: Top-down attention is more effective than bottom-up attention for forming long-term memories

Does the strength of representations in long-term memory (LTM) depend on which type of attention is engaged? We tested participants' memory for objects seen during visual search. We compared implicit memory for two types of objects-related-context nontargets that grabbed attention because they matched the target defining feature (i.e., color; top-down attention) and salient distractors that captured attention only because they were perceptually distracting (bottom-up attention). In Experiment 1, the salient distractor flickered, while in Experiment 2, the luminance of the salient distractor was alternated. Critically, salient and related-context nontargets produced equivalent attentional capture, yet related-context nontargets were remembered far better than salient distractors (and salient distractors were not remembered better than unrelated distractors). These results suggest that LTM depends not only on the amount of attention but also on the type of attention. Specifically, top-down attention is more effective in promoting the formation of memory traces than bottom-up attention.

Top-down imagery overrides the influence of selection history effects

The present study investigated whether color imagery could override the representations of the prevalent selection history effect termed Priming of Pop-out (PoP), which is constituted by faster responding when the target color is repeated rather than switched across trials of color singleton search. Participants imagined a color in the interval between trials of a color singleton search task that could be the same as or different to the previous target color, and they were to rate the vividness of these representations following each imagery event. It was revealed that when highly vivid imagery was reported, the PoP effect was attenuated relative to less vivid forms of it (and absent in two out of three experiments), and that color imagery eliminated the build-up of priming following consecutive target color repeats. Overall, the present findings suggest the representations of the selection history system can be overridden by top-down imagery.

Target value and prevalence influence visual foraging in younger and older age

The prevalence and reward-value of targets have an influence on visual search. The strength of the effect of an item's reward-value on attentional selection varies substantially between individuals and is potentially sensitive to aging. We investigated individual and age differences in a hybrid foraging task, in which the prevalence and value of multiple target types was varied. Using optimal foraging theory measures, foraging was more efficient overall in younger than older observers. However, the influence of prevalence and value on target selections was similar across age groups, suggesting that the underlying cognitive mechanisms are preserved in older age. When prevalence was varied but target value was balanced, younger and older observers preferably selected the most frequent target type and were biased to select another instance of the previously selected target type. When value was varied, younger and older observers showed a tendency to select high-value targets, but preferences were more diverse between individuals. When value and prevalence were inversely related, some observers showed particularly strong preferences for high-valued target types, while others showed a preference for high-prevalent, albeit low-value, target types. In younger adults, individual differences in the selection choices correlated with a personality index, suggesting that avoiding selections of low-value targets may be related to reward-seeking behaviour.

Selection history modulates the limit of visual awareness in color perception

Among studies on the limit of conscious representation of color at a given instant, some have shown evidence of momentary awareness of only a single color, while others have not, leading to uncertainty about the factors that influence the limit. In two experiments, we explored the role of selection history, or recent experience with a trial, which is known to influence the representations of task stimuli and responses. Two color patches were briefly displayed either simultaneously or sequentially. In Experiment 1, we presented the two types of trials either in separate blocks or in interleaved couplets. In the former case, participants could deploy optimal attentional control setting in response to different types of trials with little cost by using recent experience with a preceding trial and prior knowledge. In the latter case, reconfiguring attentional control setting after each trial would be costly. In Experiment 2, we mixed the two types of trials randomly within a block during testing, but re-grouped them in data analyses such that the same type of trials was either repeated or not repeated. The results show that accuracy was comparable between the simultaneous and sequential trials in the block condition in Experiment 1 and in the repeat condition in Experiment 2, suggesting that two colors were perceived at a time. These results indicate that selection history plays an important role in the limit of visual awareness in color perception and that the finding of single-color perception reported in previous research might not be a general phenomenon.

Using fast visual rhythmic stimulation to control inter-hemispheric phase offsets in visual areas

Spike timing dependent plasticity (STDP) is believed to be important for neural communication and plasticity in human episodic memory, but causal evidence is lacking due to technical challenges. Rhythmic sensory stimulation that has been used to investigate causal relations between oscillations and cognition may be able to address this question. The challenge, however, is that the frequency corresponding to the critical time window for STDP is gamma (~40 Hz), yet the application of rhythmic sensory stimulation has been limited primarily to lower frequencies (<30 Hz). It remains unknown whether this method can be applied to precisely control the activation time delay between distant groups of neurons at a millisecond scale. To answer this question and examine the role of STDP in human episodic memory, we simulated the STDP function by controlling the activation time delay between the left and right visual cortices during memory encoding. This was achieved by presenting flickering (37.5 Hz) movie pairs in the left and right visual fields with a phase lag of either 0, 90, 180 or 270°. Participants were asked to memorize the two movies within each pair and the association was later tested. Behavioral results revealed no significant difference in memory performance across conditions with different degrees of gamma phase synchrony. Yet importantly, our study showed for the first time, that oscillatory activity can be driven with a precision of 6.67 ms delay between neuronal groups. Our method hereby provides an approach to investigate relations between precise neuronal timing and cognitive functions.

Disruption of the Prefrontal Cortex Improves Implicit Contextual Memory-Guided Attention: Combined Behavioral and Electrophysiological Evidence

Many studies have shown that the dorsolateral prefrontal cortex (DLPFC) plays an important role in top-down cognitive control over intentional and deliberate behavior. However, recent studies have reported that DLPFC-mediated top-down control interferes with implicit forms of learning. Here we used continuous theta-burst stimulation (cTBS) combined with electroencephalography to investigate the causal role of DLPFC in implicit contextual memory-guided attention. We aimed to test whether transient disruption of the DLPFC would interfere with implicit learning performance and related electrical brain activity. We applied neuronavigation-guided cTBS to the DLPFC or to the vertex as a control region prior to the performance of an implicit contextual learning task. We found that cTBS applied over the DLPFC significantly improved performance during implicit contextual learning. We also noted that beta-band (13-19 Hz) oscillatory power was reduced at fronto-central channels about 140 to 370 ms after visual stimulus onset in cTBS DLPFC compared with cTBS vertex. Taken together, our results provide evidence that DLPFC-mediated top-down control interferes with contextual memory-guided attention and beta-band oscillatory activity.

Simple action planning can affect attentional allocation in subsequent visual search

Previous research has shown that mental representations of actions can influence performance on relevant tasks or dimensions even when there is no overt execution of the action. In this study, we examined whether cognitive processes prior to the physical execution of an action can elicit attentional bias towards irrelevant tasks or dimensions of that action. Participants performed two independent tasks-an action task and a search task-where they were instructed to plan an action and execute the action following the visual search task. We found that the same features of the object were prioritized in the subsequent search task when participants had planned an action response on the object in comparison to when they had not. This effect occurred even when the feature was irrelevant to the tasks or required action. Furthermore, the effect of action planning without physical response was found to be comparable to the effect of physical response. These results suggest that planning of a simple action can induce attentional bias to irrelevant features of objects even without physical action.