Reward has a residual impact on target selection in visual search, but not on the suppression of distractors

Reward history modulates visual attention in an avian model

Attention can be biased towards previously reward-associated stimuli even when they are task-irrelevant and physically non-salient, although studies of reward-modulated attention have been largely limited to primate (including human and nonhuman) models. Birds have been shown to have the capacity to discriminate reward and spatial cues in a manner similar to primates, but whether reward history involuntarily affects their attention in the same way remains unclear. We adapted a spatial cueing paradigm with differential rewards to investigate how reward modulates the allocation of attention in peafowl (Pavo cristatus). The birds were required to locate and peck a target on a computer screen that was preceded by a high-value or low-value color cue that was uninformative with respect to the location of the upcoming target. All birds exhibited a validity effect (performance enhanced on valid compared to invalid cue), and an interaction effect between value and validity was evident at the group level, being particularly pronounced in the birds with the greatest amount of reward training. The time course of reward learning was conspicuously incremental, phenomenologically slower compared to primates. Our findings suggest a similar influence of reward history on attention across phylogeny despite a significant difference in neuroanatomy.

Graded prioritisation of targets in search: reward diminishes the low prevalence effect

In many real-life contexts, observers are required to search for targets that are rarely present (e.g. tumours in X-rays; dangerous items in airport security screenings). Despite the rarity of these items, they are of enormous importance for the health and safety of the public, yet they are easily missed during visual search. This is referred to as the prevalence effect. In the current series of experiments, we investigate whether unequal reward can modulate the prevalence effect, in a multiple target search task. Having first established the impact of prevalence (Experiment 1) and reward (Experiment 2) on how efficiently participants can find one of several targets in the current paradigm, we then combined the two forms of priority to investigate their interaction. An unequal reward distribution (where lower prevalence items are more rewarded; Experiment 3) was found to diminish the effect of prevalence, compared to an equal reward distribution (Experiment 4) as indicated by faster response times and fewer misses. These findings suggest that when combined with an unequal reward distribution, the low prevalence effect can be diminished.

The persistence of value-driven attention capture is task-dependent

Visual features previously associated with reward can capture attention even when task-irrelevant, a phenomenon known as value-driven attention capture (VDAC). VDAC persists without reinforcement, unlike other forms of learning, where removing reinforcement typically leads to extinction. In five experiments, factors common to many studies were manipulated to examine their impact on VDAC and its extinction. All experiments included learning and test phases. During learning, participants completed a visual search task during which one of two target colors was associated with a reward, and the other with no reward. During test, 1 week later, participants completed another visual search task in which the reward association was not reinforced. When a rewarded feature remained task-relevant (Experiment 1), VDAC was observed. When the rewarded feature was made task-irrelevant (Experiments 2-5) there was no evidence of a VDAC effect, except when the target feature was physically salient and there was a reduction in the frequency of exposure to the reward-associated feature (Experiment 5). We failed to find evidence of VDAC in Experiments 2-4, suggesting that VDAC may depend on the demands of the task resulting in vulnerability to VDAC. When VDAC was observed, extinction was also observed. This indicates that VDAC is subject to extinction as would be expected from an effect driven by reinforcement learning.

Reward Weakened Inhibition of Return (IOR) in the Near Depth Plane

In attentional orienting, researchers have proposed that reward history is a component of attentional control, as the reward value might enhance the spatial attention process to achieve more efficient goal-directed behavior and to improve target-detection performance. Although the effect of reward-induced motivation on attentional orienting has been studied in two-dimensional (2-D) space, the specific mechanisms underlying the influence of reward on inhibition of return (IOR) of attentional orienting in three-dimensional space (3-D) remain unclear. In the present study, by incorporating the Posner spatial-cueing paradigm into a virtual 3-D environment, we aimed to investigate the influence of reward on IOR in 3-D space. The results showed the following: (1) IOR size in the rewarded conditions was smaller than IOR size in the unrewarded condition in the near depth plane, resulting in an IOR difference with or without reward. (2) Reward weakened IOR in the near depth plane because the response to the uncued location was delayed, not because the response to the cued location was accelerated. The present study indicated that the different depth planes of the target location in 3-D space could influence the interaction between reward and IOR, and reward weakened IOR in the near depth plane.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Effects of reward associations on components of attentional network

Previous research has revealed the influence of reward associations on attentional selection and control. The attentional network can be divided into three components according to its function: Alerting, orienting, and executive control. In the current research, we used training-test procedure and attention network test variant to investigate the effects of color-based reward associations on alerting (Experiment 1), orienting (Experiment 2), executive control (Experiment 3), as well as the interactions among these three networks (Experiment 4). The findings were as follows: Compared with colors previously associated with low reward, colors previously associated with high reward trigger stronger alerting and orienting effects (Experiments 1 and 2), and they had stronger interference effects when functioning as features of flanker distractor (Experiment 3). More importantly, reward associations had only a positive impact on the interaction of orienting by executive control but not on the interaction of alerting by executive control (Experiment 4). In summary, reward associations have different effects on the three attentional networks and can enhance the interaction of orienting by executive control.

Differential Deployment of Visual Attention During Interactive Approach and Avoidance Behavior

The ability to coordinate approach and avoidance actions in dynamic environments represents the boundary between extinction and the continued survival of many animal species. It is therefore crucial that sensory systems allocate limited attentional resources to the most relevant information to facilitate planning and execution of appropriate actions. Prominent theories of how attention regulates visual processing focus on the distinction between behaviorally relevant and irrelevant visual inputs. To date, however, no study has directly compared the deployment of attention to visual inputs relevant for approach and avoidance behaviors, which naturally occur in dynamic, interactive environments. In two experiments, we combined electroencephalography, frequency tagging, and eye gaze measures to investigate whether the deployment of visual selective attention differs for items relevant for approach and avoidance actions. Participants maneuvered a cursor to approach and avoid contact with moving items in a continuous interactive task. The results indicated that while the approach and avoidance tasks recruited equivalent attentional resources overall, attentional biases were directed toward task-relevant items during approach, and away from task-relevant items during avoidance. We conclude that the deployment of visual attention is guided not only by relevance to a behavioral goal, but also by the nature of that goal.

Attention Capture of Non-target Emotional Faces: An Evidence From Reward Learning

The aim of this study was to explore whether reward learning would affect the processing of targets when an emotional stimulus was task irrelevant. In the current study, using a visual search paradigm to establish an association between emotional faces and reward, an emotional face appeared as a task-irrelevant distractor during the test after reward learning, and participants were asked to judge the orientation of a line on the face. In experiment 1, no significant difference was found between the high reward-fear distractor condition and the no reward-neutral condition, but the response times of the high reward-fear condition were significantly longer than those of the low reward-happy condition. In experiment 2, there was no significant difference in participants' performance between high reward-happy and no reward-neutral responses. In addition, response times of the low reward-fear condition wear significantly longer than those of the high reward-happy and no reward-neutral conditions. The results show that reward learning affects attention bias of task-irrelevant emotional faces even when reward is absent. Moreover, the high reward selection history is more effective in weakening the emotional advantage of the processing advantage than the low reward.

Electrophysiological correlates of the flexible allocation of visual working memory resources

Visual working memory is a brief, capacity-limited store of visual information that is involved in a large number of cognitive functions. To guide one’s behavior effectively, one must efficiently allocate these limited memory resources across memory items. Previous research has suggested that items are either stored in memory or completely blocked from memory access. However, recent behavioral work proposes that memory resources can be flexibly split across items based on their level of task importance. Here, we investigated the electrophysiological correlates of flexible resource allocation by manipulating the distribution of resources amongst systematically lateralized memory items. We examined the contralateral delay activity (CDA), a waveform typically associated with the number of items held in memory. Across three experiments, we found that, in addition to memory load, the CDA flexibly tracks memory resource allocation. This allocation occurred as early as attentional selection, as indicated by the N2pc. Additionally, CDA amplitude was better-described when fit with a continuous model predicted by load and resources together than when fit with either alone. Our findings show that electrophysiological markers of attentional selection and memory maintenance not only track memory load, but also the proportion of memory resources those items receive.

Pavlovian reward learning elicits attentional capture by reward-associated stimuli

Feature-reward association elicits value-driven attentional capture (VDAC) regardless of the task relevance of associated features. What are the necessary conditions for feature-reward associations in VDAC? Recent studies claim that VDAC is based on Pavlovian conditioning. In this study, we manipulated the temporal relationships among feature, response, and reward in reward learning to elucidate the necessary components of VDAC. We presented reward-associated features in a variety of locations in a flanker task to form a color-reward association (training phase) and then tested VDAC in a subsequent visual search task (test phase). In Experiment 1, we showed reward-associated features in a task display requiring response selection and observed VDAC, consistent with most previous studies. In Experiment 2, features presented at a fixation display before a task display also induced VDAC. Moreover, in Experiment 3, we reduced the time interval between features and rewards so that features appeared after a task display and we obtained marginally significant VDAC. However, no VDAC was observed when features and rewards were simultaneously presented in a feedback display in Experiments 4 and 5, suggesting that a direct association between feature and reward is not sufficient for VDAC. These results are in favor of the idea that response selection does not mediate feature-reward association in VDAC. Moreover, the evidence suggests that the time interval of feature and reward is flexible with some restriction in the learning of feature-reward association. The present study supports the hypothesis that theories of Pavlovian conditioning can account for feature-reward association in VDAC.

Reward expectation facilitates context learning and attentional guidance in visual search

Modulations of visual attention due to expectation of reward were frequently reported in recent years. Recent studies revealed that reward can modulate the implicit learning of repeated context configurations (e.g., Tseng & Lleras, 2013). We investigated the influence of reward expectations on context learning by associating colors to different reward magnitudes. Participants searched through contexts consisting of spatially distributed L-shaped distractors and a T-shaped target, with half of these objects appearing in a color associated with low, medium, or high reward. Half of these context configurations were repeatedly presented in every experimental block, whereas the other half was generated newly for every trial. Results showed an earlier and more pronounced contextual cueing effect in contexts associated with high reward compared with low reward contexts. This was visible as faster decline of response times to targets in repeated contexts associated with high reward compared with repeated low reward and novel contexts, and was reflected in the eye movement pattern as shorter distance of the first fixation to the target location. These results suggest that expectation of high reward magnitude facilitates subsequent learning of repeated context configurations. High reward also increases the efficiency of attention guidance toward the target location.

Selection history: How reward modulates selectivity of visual attention

Visual attention enables us to selectively prioritize or suppress information in the environment. Prominent models concerned with the control of visual attention differentiate between goal-directed, top-down and stimulus-driven, bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. In the current review, we discuss recent studies that demonstrate that attentional selection does not need to be the result of top-down or bottom-up processing but, instead, is often driven by lingering biases due to the "history" of former attention deployments. This review mainly focuses on reward-based history effects; yet other types of history effects such as (intertrial) priming, statistical learning and affective conditioning are also discussed. We argue that evidence from behavioral, eye-movement and neuroimaging studies supports the idea that selection history modulates the topographical landscape of spatial "priority" maps, such that attention is biased toward locations having the highest activation on this map.

You prime what you code: The fAIM model of priming of pop-out

Our visual brain makes use of recent experience to interact with the visual world, and efficiently select relevant information. This is exemplified by speeded search when target- and distractor features repeat across trials versus when they switch, a phenomenon referred to as intertrial priming. Here, we present fAIM, a computational model that demonstrates how priming can be explained by a simple feature-weighting mechanism integrated into an established model of bottom-up vision. In fAIM, such modulations in feature gains are widespread and not just restricted to one or a few features. Consequentially, priming effects result from the overall tuning of visual features to the task at hand. Such tuning allows the model to reproduce priming for different types of stimuli, including for typical stimulus dimensions such as 'color' and for less obvious dimensions such as 'spikiness' of shapes. Moreover, the model explains some puzzling findings from the literature: it shows how priming can be found for target-distractor stimulus relations rather than for their absolute stimulus values per se, without an explicit representation of relations. Similarly, it simulates effects that have been taken to reflect a modulation of priming by an observers' goals-without any representation of goals in the model. We conclude that priming is best considered as a consequence of a general adaptation of the brain to visual input, and not as a peculiarity of visual search.

Learning Where to Look for High Value Improves Decision Making Asymmetrically

Decision making in any brain is imperfect and costly in terms of time and energy. Operating under such constraints, an organism could be in a position to improve performance if an opportunity arose to exploit informative patterns in the environment being searched. Such an improvement of performance could entail both faster and more accurate (i.e., reward-maximizing) decisions. The present study investigated the extent to which human participants could learn to take advantage of immediate patterns in the spatial arrangement of serially presented foods such that a region of space would consistently be associated with greater subjective value. Eye movements leading up to choices demonstrated rapidly induced biases in the selective allocation of visual fixation and attention that were accompanied by both faster and more accurate choices of desired goods as implicit learning occurred. However, for the control condition with its spatially balanced reward environment, these subjects exhibited preexisting lateralized biases for eye and hand movements (i.e., leftward and rightward, respectively) that could act in opposition not only to each other but also to the orienting biases elicited by the experimental manipulation, producing an asymmetry between the left and right hemifields with respect to performance. Potentially owing at least in part to learned cultural conventions (e.g., reading from left to right), the findings herein particularly revealed an intrinsic leftward bias underlying initial saccades in the midst of more immediate feedback-directed processes for which spatial biases can be learned flexibly to optimize oculomotor and manual control in value-based decision making. The present study thus replicates general findings of learned attentional biases in a novel context with inherently rewarding stimuli and goes on to further elucidate the interactions between endogenous and exogenous biases.

Changes of Attention during Value-Based Reversal Learning Are Tracked by N2pc and Feedback-Related Negativity

Previously learned reward values can have a pronounced impact, behaviorally and neurophysiologically, on the allocation of selective attention. All else constant, stimuli previously associated with a high value gain stronger attentional prioritization than stimuli previously associated with a low value. The N2pc, an ERP component indicative of attentional target selection, has been shown to reflect aspects of this prioritization, by changes of mean amplitudes closely corresponding to selective enhancement of high value target processing and suppression of high value distractor processing. What has remained unclear so far is whether the N2pc also reflects the flexible and repeated behavioral adjustments needed in a volatile task environment, in which the values of stimuli are reversed often and unannounced. Using a value-based reversal learning task, we found evidence that the N2pc amplitude flexibly and reversibly tracks value-based choices during the learning of reward associated stimulus colors. Specifically, successful learning of current value-contingencies was associated with reduced N2pc amplitudes, and this effect was more apparent for distractor processing, compared with target processing. In addition, following a value reversal the feedback related negativity(FRN), an ERP component that reflects feedback processing, was amplified and co-occurred with increased N2pc amplitudes in trials following low-value feedback. Importantly, participants that showed the greatest adjustment in N2pc amplitudes based on feedback were also the most efficient learners. These results allow further insight into how changes in attentional prioritization in an uncertain and volatile environment support flexible adjustments of behavior.

Funny money: the attentional role of monetary feedback detached from expected value

Stimuli associated with monetary reward can become powerful cues that effectively capture visual attention. We examined whether such value-driven attentional capture can be induced with monetary feedback in the absence of an expected cash payout. To this end, we implemented images of U.S. dollar bills as reward feedback. Participants knew in advance that they would not receive any money based on their performance. Our reward stimuli-$5 and $20 bill images-were thus dissociated from any practical utility. Strikingly, we observed a reliable attentional capture effect for the mere images of bills. Moreover, this finding generalized to Monopoly money. In two control experiments, we found no evidence in favor of nominal or symbolic monetary value. Hence, we claim that bill images are special monetary representations, such that there are strong associations between the defining visual features of bills and reward, probably due to a lifelong learning history. Together, we show that the motivation to earn cash plays a minor role when it comes to monetary rewards, while bill-defining visual features seem to be sufficient. These findings have the potential to influence human factor applications, such as gamification, and can be extended to novel value systems, such as the electronic cash Bitcoin being developed for use in mobile banking. Finally, our procedure represents a proof of concept on how images of money can be used to conserve expenditures in the experimental context.

Learned value and object perception: Accelerated perception or biased decisions?

Learned value is known to bias visual search toward valued stimuli. However, some uncertainty exists regarding the stage of visual processing that is modulated by learned value. Here, we directly tested the effect of learned value on preattentive processing using temporal order judgments. Across four experiments, we imbued some stimuli with high value and some with low value, using a nonmonetary reward task. In Experiment 1, we replicated the value-driven distraction effect, validating our nonmonetary reward task. Experiment 2 showed that high-value stimuli, but not low-value stimuli, exhibit a prior-entry effect. Experiment 3, which reversed the temporal order judgment task (i.e., reporting which stimulus came second), showed no prior-entry effect, indicating that although a response bias may be present for high-value stimuli, they are still reported as appearing earlier. However, Experiment 4, using a simultaneity judgment task, showed no shift in temporal perception. Overall, our results support the conclusion that learned value biases perceptual decisions about valued stimuli without speeding preattentive stimulus processing.

Personality correlates of individual differences in the recruitment of cognitive mechanisms when rewards are at stake

Individuals differ greatly in their sensitivity to rewards and punishments. In the extreme, these differences are implicated in a range of psychiatric disorders from addiction to depression. However, it is unclear how these differences influence the recruitment of attention, working memory, and long-term memory when responding to potential rewards. Here, we used a rewarded memory-guided visual search task and ERPs to examine the influence of individual differences in self-reported reward/punishment sensitivity, as measured by the Behavioral Inhibition System (BIS)/Behavioral Activation System (BAS) scales, on the recruitment of cognitive mechanisms in conditions of potential reward. Select subscales of the BAS, including the fun seeking and reward responsiveness scales, showed unique relationships with context updating to reward cues and working memory maintenance of potentially rewarded stimuli. In contrast, BIS scores showed unique relationships with deployment of attention at different points in the task. These results suggest that sensitivity to rewards (i.e., BAS) and to punishment (i.e., BIS) may play an important role in the recruitment of specific and distinct cognitive mechanisms in conditions of potential rewards.

Counter-regulation in affective attentional biases: Evidence in the additional singleton paradigm

We investigated motivational influences on affective processing biases; specifically, we were interested in whether anticipating positive versus negative future outcomes during goal pursuit affects attentional biases toward positive or negative stimuli. Attentional valence biases were assessed with the additional singleton task, with the task-irrelevant singleton colors being positive, negative or neutral. The motivational relevance of colors was established in a preceding task: In a balanced design, one color acquired positive valence by indicating the chance to win money, and a different color acquired negative valence by indicating the danger to lose money. Blocks of the additional singleton task were associated with either the chance of winning money (positive outcome focus) or the danger of losing money (negative outcome focus). We found an interaction of outcome focus and singleton valence in the accuracy rates, indicating an incongruency effect: Attentional capture was stronger for positive (negative) singletons in the negative (positive) outcome focus conditions. This result further corroborates the counter-regulation hypothesis, extending previous findings on the motivational top-down regulation of affective processing to the domain of early attentional processes.

A protocol for a cluster randomised feasibility study of an adolescent incentive intervention to increase uptake of HPV vaccination among girls

BACKGROUND

Uptake of the human papillomavirus (HPV) vaccine in the UK is good, but there are pockets of the community who remain unprotected. Immunisation teams usually require written parental consent for a girl to receive the vaccine. Evidence suggests that uptake of the vaccine might be improved by promoting consent form return (if returned, forms are likely to grant consent). Incentivising girls to return consent forms is a promising approach to promoting consent form return. Before testing the efficacy of an incentive intervention in a randomised controlled trial (RCT), we must first establish whether the RCT is feasible. In this randomised feasibility study, we aim to establish the feasibility of conducting a cluster RCT of an adolescent incentive intervention to increase uptake of HPV vaccination.

METHODS

At least six schools will be randomised to either an incentive intervention arm or a standard invitation arm. Girls in standard invitation arm schools will receive the usual HPV vaccine programme invitation materials. Girls attending schools in the incentive intervention arm will receive the standard invitation and will also be told that they will receive an incentive if they return their consent form (regardless of whether consent is granted or denied). The incentive is being entered into a prize draw to win a retail voucher. Feasibility objectives include estimating the schools' and parents' willingness to participate in the study and be randomised; response rates to questionnaires; the extent of missing data; the girls' and parents' attitudes towards the incentive offered; school staff experiences of participating, fidelity to the trial procedures, data on any unintended consequences and the possible mechanisms of action, and proof-of-concept evidence of the effect of the intervention on consent form return rates and uptake of the vaccine. Analysis of feasibility outcomes will primarily be descriptive. Consent form return rates and uptake of the vaccine will be presented by trial arm without comparison.

DISCUSSION

Incentivising HPV vaccine consent form return may promote HPV vaccine uptake. This study will provide the evidence needed to establish whether testing this incentive intervention using a RCT design in the future is feasible.

TRIAL REGISTRATION

ISRCTN72136061.

The neurophysiological basis of reward effects on backward inhibition processes

The ability to flexibly switch between tasks is an important faculty in daily life. One process that has been suggested to be an important aspect of flexible task switching is the inhibition of a recently performed task. This is called backward inhibition. Several studies suggest that task switching performance can be enhanced by rewards. However, it is less clear in how far backward inhibition mechanisms are also affected by rewards, especially when it comes to the neuronal mechanisms underlying reward-related modulations of backward inhibition. We therefore investigated this using a system neurophysiological approach combining EEG recordings with source localization techniques. We demonstrate that rewards reduce the strength of backward inhibition processes. The neurophysiological data shows that these reward-related effects emerge from response and/or conflict monitoring processes within medial frontal cortical structures. Upstream processes of perceptual gating and attentional selection, as well as downstream processes of context updating and stimulus-response mapping are not modulated by reward, even though they also play a role in backward inhibition effects.

Human ventromedial prefrontal lesions alter incentivisation by reward

Although medial frontal brain regions are implicated in valuation of rewards, evidence from focal lesions to these areas is scant, with many conflicting results regarding motivation and affect, and no human studies specifically examining incentivisation by reward. Here, 19 patients with isolated, focal damage in ventral and medial prefrontal cortex were selected from a database of 453 individuals with subarachnoid haemorrhage. Using a speeded saccadic task based on the oculomotor capture paradigm, we manipulated the maximum reward available on each trial using an auditory incentive cue. Modulation of behaviour by motivation permitted quantification of reward sensitivity. At the group level, medial frontal damage was overall associated with significantly reduced effects of reward on invigorating saccadic velocity and autonomic (pupil) responses compared to age-matched, healthy controls. Crucially, however, some individuals instead showed abnormally strong incentivisation effects for vigour. Increased sensitivity to rewards within the lesion group correlated with damage in subgenual ventromedial prefrontal cortex (vmPFC) areas, which have recently become the target for deep brain stimulation (DBS) in depression. Lesion correlations with clinical apathy suggested that the apathy associated with prefrontal damage is in fact reduced by damage at those coordinates. Reduced reward sensitivity showed a trend to correlate with damage near nucleus accumbens. Lesions did not, on the other hand, influence reward sensitivity of cognitive control, as measured by distractibility. Thus, although medial frontal lesions may generally reduce reward sensitivity, damage to key subregions paradoxically protect from this effect.

The attention habit: how reward learning shapes attentional selection

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications.

Attentional capture during attentional awakening

We investigated whether attentional set is available at the beginning of a trial or whether it develops gradually within a trial. Thus, we manipulated the time from the onset of a trial to a target and observers' search strategy. We also observed the effect of the presence or absence of distractors as an index of the temporal development of attentional set. Participants identified a target letter embedded in a stream of rapidly presented nontargets while ignoring peripheral distractors. Baseline accuracy when no peripheral distractor was presented increased as the target appeared later in the stream, suggesting attentional awakening. Identification accuracy was impaired by the presence of peripheral distractors (i.e., attentional capture) early in the stream only when observers adopted the feature search mode. The magnitude of attentional capture increased over the course of the first 1,000 ms of a trial under the singleton detection and feature search modes. These results suggest that singleton detection mode requires time for a bottom-up signal to be effective in capturing attention, whereas the feature search mode does not require such a warm-up period to be effective and is available from the beginning of viewing the stream.

Relevance drives attention: Attentional bias for gain- and loss-related stimuli is driven by delayed disengagement

Attentional bias to gain- and loss-related stimuli was investigated in a dot-probe task. We used coloured stimuli that had acquired their valence during the experiment by signalling the chance to either win or lose points in a game task. Replicating previous findings with the additional singleton paradigm, we found attentional bias effects for both gain- and loss-related colours. The effects were due to delayed disengagement from valent stimuli, especially if they were positive, and could not be explained by nonattentional processes like behavioural freezing. Our findings suggest that stimuli signalling opportunities and dangers hold attention, supporting a general motivational relevance principle of the orienting of attention.

Attentional capture by evaluative stimuli: gain- and loss-connoting colors boost the additional-singleton effect

In a valence induction task, one color acquired positive valence by indicating the chance to win money (in the case of fast and correct responses), and a different color acquired negative valence by indicating the danger to lose money (in the case of slow or incorrect responses). In the additional-singleton trials of a visual search task, the task-irrelevant singleton color was either the positive one, the negative one, or one of two neutral colors. We found an additional-singleton effect (i.e., longer RTs with a singleton color than in the no-singleton control condition). This effect was significantly increased for the two valent colors (with no differences between them) relative to the two neutral colors (with no differences between them, either). This result favors the hypothesis that the general relevance of stimuli elicits attentional capture, rather than the negativity bias hypothesis.

Automatic versus Choice-Dependent Value Representations in the Human Brain

The subjective values of choice options can impact on behavior in two fundamentally different types of situations: first, when people explicitly base their actions on such values, and second, when values attract attention despite being irrelevant for current behavior. Here we show with functional magnetic resonance imaging (fMRI) that these two behavioral functions of values are encoded in distinct regions of the human brain. In the medial prefrontal cortex, value-related activity is enhanced when subjective value becomes choice-relevant, and the magnitude of this increase relates directly to the outcome and reliability of the value-based choice. In contrast, activity in the posterior cingulate cortex represents values similarly when they are relevant or irrelevant for the present choice, and the strength of this representation predicts attentional capture by choice-irrelevant values. Our results suggest that distinct components of the brain's valuation network encode value in context-dependent manners that serve fundamentally different behavioral aims.

Reward-priming of location in visual search

Existing visual search research has demonstrated that the receipt of reward will be beneficial for subsequent perceptual and attentional processing of features that have characterized targets, but detrimental for processing of features that have characterized irrelevant distractors. Here we report a similar effect of reward on location. Observers completed a visual search task in which they selected a target, ignored a salient distractor, and received random-magnitude reward for correct performance. Results show that when target selection garnered rewarding outcome attention is subsequently a.) primed to return to the target location, and b.) biased away from the location that was occupied by the salient, task-irrelevant distractor. These results suggest that in addition to priming features, reward acts to guide visual search by priming contextual locations of visual stimuli.

Rewarding distractor context versus rewarding target location: a commentary on Tseng and Lleras (2013)

The influence of reward on cognitive processes including visual perception, spatial attention, and perceptual learning has become an increasingly important field of study in recent years. For example, Tseng and Lleras (Attention, Perception, & Psychophysics, 75(2), 287–298, 2013) investigated whether reward has an effect on implicit learning of target–distractor arrangements in visual search—that is, contextual cueing (Chun & Jiang Cognitive Psychology, 36(1), 28–71, 1998). They found that reward expedited the development of the cueing effect—that is, the reaction time difference between repeated and nonrepeated displays. However, their analysis did not account for potential effects of reward on the learning of individual target locations—that is, probability cueing (Jiang, Swallow, & Rosenbaum Journal of Experimental Psychology. Human Perception and Performance, 39, 285–297, 2013). The present study was a replication of Tseng and Lleras (Attention, Perception, & Psychophysics, 75(2), 287–298, 2013) that took into account reward effects on configural and locational learning, as well. We found that reward led to performance gains even in baseline (“new”) displays, which contained only repeated target, but not distractor, locations. Furthermore, contextual cueing was smaller, and not larger, in high- than in low-reward trials. We concluded that reward modulates probability, and not contextual, cueing, and that this mechanism can account for the findings of Tseng and Lleras.

Random reward priming is task-contingent: the robustness of the 1-trial reward priming effect

Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings are thought to reflect that rewarded features become more salient than unrewarded ones on the subsequent trial. Here we attempt to conceptually replicate this effect, testing its generalizability. In three versions of an analogous paradigm to the additional singleton paradigm involving singleton search for a Gabor patch of odd spatial frequency we found no evidence of reward priming, while we only partially replicate the reward priming in the exact original paradigm tested by Hickey and colleagues. The results cast doubt on the proposal that random reward enhances salience, suggested in the original papers, and highlight the need for a more nuanced account. In many other paradigms reward effects have been found to progress gradually, becoming stronger as they build up, and we argue that for robust reward priming, reward schedules need to be more consistent than in the original 1-trial reward priming paradigm.

Rewarding context accelerates implicit guidance in visual search

It is well known that observers can implicitly learn the spatial context of complex visual searches, such that future searches through repeated contexts are completed faster than those through novel contexts, even though observers remain at chance at discriminating repeated from new contexts. This contextual-cueing effect arises quickly (within less than five exposures) and asymptotes within 30 exposures to repeated contexts. In spite of being a robust effect (its magnitude is over 100 ms at the asymptotic level), the effect is implicit: Participants are usually at chance at discriminating old from new contexts at the end of an experiment, in spite of having seen each repeated context more than 30 times throughout a 50-min experiment. Here, we demonstrate that the speed at which the contextual-cueing effect arises can be modulated by external rewards associated with the search contexts (not with the performance itself). Following each visual search trial (and irrespective of a participant's search speed on the trial), we provided a reward, a penalty, or no feedback to the participant. Crucially, the type of feedback obtained was associated with the specific contexts, such that some repeated contexts were always associated with reward, and others were always associated with penalties. Implicit learning occurred fastest for contexts associated with positive feedback, though penalizing contexts also showed a learning benefit. Consistent feedback also produced faster learning than did variable feedback, though unexpected penalties produced the largest immediate effects on search performance.

Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing

Covert shifts of attention precede and direct overt eye movements to stimuli that are task relevant or physically salient. A growing body of evidence suggests that the learned value of perceptual stimuli strongly influences their attentional priority. For example, previously rewarded but otherwise irrelevant and inconspicuous stimuli capture covert attention involuntarily. It is unknown, however, whether stimuli also draw eye movements involuntarily as a consequence of their reward history. Here, we show that previously rewarded but currently task-irrelevant stimuli capture both attention and the eyes. Value-driven oculomotor capture was observed during unconstrained viewing, when neither eye movements nor fixations were required, and was strongly related to individual differences in visual working memory capacity. The appearance of a reward-associated stimulus came to evoke pupil dilation over the course of training, which provides physiological evidence that the stimuli that elicit value-driven capture come to serve as reward-predictive cues. These findings reveal a close coupling of value-driven attentional capture and eye movements that has broad implications for theories of attention and reward learning.

Punishment sensitivity predicts the impact of punishment on cognitive control

Cognitive control theories predict enhanced conflict adaptation after punishment. However, no such effect was found in previous work. In the present study, we demonstrate in a flanker task how behavioural adjustments following punishment signals are highly dependent on punishment sensitivity (as measured by the Behavioural Inhibition System (BIS) scale): Whereas low punishment-sensitive participants do show increased conflict adaptation after punishment, high punishment-sensitive participants show no such modulation. Interestingly, participants with a high punishment-sensitivity showed an overall reaction time increase after punishments. Our results stress the role of individual differences in explaining motivational modulations of cognitive control.

Rewards teach visual selective attention

Visual selective attention is the brain function that modulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior. Enhanced analysis of currently relevant or otherwise salient information is often accompanied by suppressed processing of the less relevant or salient input. Recent findings indicate that rewards exert a powerful influence on the deployment of visual selective attention. Such influence takes different forms depending on the specific protocol adopted in the given study. In some cases, the prospect of earning a larger reward in relation to a specific stimulus or location biases attention accordingly in order to maximize overall gain. This is mediated by an effect of reward acting as a type of incentive motivation for the strategic control of attention. In contrast, reward delivery can directly alter the processing of specific stimuli by increasing their attentional priority, and this can be measured even when rewards are no longer involved, reflecting a form of reward-mediated attentional learning. As a further development, recent work demonstrates that rewards can affect attentional learning in dissociable ways depending on whether rewards are perceived as feedback on performance or instead are registered as random-like events occurring during task performance. Specifically, it appears that visual selective attention is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them. Overall this emerging literature demonstrates unequivocally that rewards "teach" visual selective attention so that processing resources will be allocated to objects, features and locations which are likely to optimize the organism's interaction with the surrounding environment and maximize positive outcome.

Reward modulates adaptations to conflict

Both cognitive conflict (e.g. Verguts & Notebaert, 2009) and reward signals (e.g. Waszak & Pholulamdeth, 2009) have been proposed to enhance task-relevant associations. Bringing these two notions together, we predicted that reward modulates conflict-based sequential adaptations in cognitive control. This was tested combining either a single flanker task (Experiment 1) or a task-switch paradigm (Experiment 2) with performance-related rewards. Both experiments confirmed that adaptations after conflict were modulated by reward. In the flanker task, this resulted in increased conflict adaptation after rewarded trials. In the task-switching experiment, reward increased the conflict-modulated switch cost. Interestingly, both adaptations to conflict disappeared after no-reward trials. Moreover, individual differences in participants' sensitivity to reward predicted these reward modulations of trial-to-trial adaptations. These findings shed new light on the exact role of cognitive conflict in shaping subsequent behavior.