Shaping attention with reward: effects of reward on space- and object-based selection

Impact of relative and absolute values on orienting attention in time

Reward has been known to render the reward-associated stimulus more salient to block effective attentional orienting in space. However, whether and how reward influences goal-directed attention in time remains unclear. Here, we used a modified attentional cueing paradigm to explore the effect of reward on temporal attention, in which the valid targets were given a low monetary reward and invalid targets were given a high monetary reward. The results showed that the temporal cue validity effect was significantly smaller when the competitive reward structure was employed (Experiment 1), and we ruled out the possibility that the results were due to the practice effect (Experiment 2a) or a reward-promoting effect (Experiment 2b). When further strengthening the intensity of the reward from 1:10 to 1:100 (Experiment 3), we found a similar pattern of results to those in Experiment 1. These results suggest that reward information which was based on relative instead of absolute values can weaken, but not reverse, the orienting attention in time.

The Architecture of Object-Based Attention

The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are involved? Here, we review recent progress in the field to determine the mechanisms underlying object-based attention. First, findings from unconscious priming and cueing suggest that the preattentive targets of object-based attention can be fully developed object representations that have reached the level of identity. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. How feedback from object areas can accurately target the object's specific locations and features is unknown but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could all rely on object-based attention. Specifically, studies show that attention can be allocated to the separated members of a group-without affecting the space between them-matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. We outline the architecture of object-based attention, the novel predictions it brings, and discuss how it works in parallel with other attention pathways.

Value-driven modulation of visual perception by visual and auditory reward cues: The role of performance-contingent delivery of reward

Perception is modulated by reward value, an effect elicited not only by stimuli that are predictive of performance-contingent delivery of reward (PC) but also by stimuli that were previously rewarded (PR). PC and PR cues may engage different mechanisms relying on goal-driven versus stimulus-driven prioritization of high value stimuli, respectively. However, these two modes of reward modulation have not been systematically compared against each other. This study employed a behavioral paradigm where participants' visual orientation discrimination was tested in the presence of task-irrelevant visual or auditory reward cues. In the first phase (PC), correct performance led to a high or low monetary reward dependent on the identity of visual or auditory cues. In the subsequent phase (PR), visual or auditory cues were not followed by reward delivery anymore. We hypothesized that PC cues have a stronger modulatory effect on visual discrimination and pupil responses compared to PR cues. We found an overall larger task-evoked pupil dilation in PC compared to PR phase. Whereas PC and PR cues both increased the accuracy of visual discrimination, value-driven acceleration of reaction times (RTs) and pupillary responses only occurred for PC cues. The modulation of pupil size by high reward PC cues was strongly correlated with the modulation of a combined measure of speed and accuracy. These results indicate that although value-driven modulation of perception can occur even when reward delivery is halted, stronger goal-driven control elicited by PC reward cues additionally results in a more efficient balance between accuracy and speed of perceptual choices.

Excess success in articles on object-based attention

Twenty-five years of research has explored the object-based attention effect using the two-rectangles paradigm and closely related paradigms. While reading this literature, we noticed statistical attributes that are sometimes related to questionable research practices, which can undermine the reported conclusions. To quantify these attributes, we applied the Test for Excess Success (TES) individually to 37 articles that investigate various properties of object-based attention and comprise four or more experiments. A TES analysis estimates the probability that a direct replication of the experiments in a given article with the same sample sizes would have the same success (or better) as the original article. If the probability is low, then readers should be skeptical about the conclusions that are based on those experimental results. We find that 19 of the 37 analyzed articles (51%) seem too good to be true in that they have a replication probability below 0.1. In a new large sample study, we do find evidence for the basic object-based attention effect in the two-rectangles paradigm, which this literature builds on. A power analysis using this data shows that commonly used sample sizes in studies that investigate properties of object-based attention with the two-rectangles paradigm are, in fact, much too small to reliably detect even the basic effect.

Using aversive conditioning with near-real-time feedback to shape eye movements during naturalistic viewing

Strategically shaping patterns of eye movements through training has manifold promising applications, with the potential to improve the speed and efficiency of visual search, improve the ability of humans to extract information from complex displays, and help correct disordered eye movement patterns. However, training how a person moves their eyes when viewing an image or scene is notoriously difficult, with typical approaches relying on explicit instruction and strategy, which have notable limitations. The present study introduces a novel approach to eye movement training using aversive conditioning with near-real-time feedback. Participants viewed indoor scenes (eight scenes presented over 48 trials) with the goal of remembering those scenes for a later memory test. During viewing, saccades meeting specific amplitude and direction criteria probabilistically triggered an aversive electric shock, which was felt within 50 ms after the eliciting eye movement, allowing for a close temporal coupling between an oculomotor behavior and the feedback intended to shape it. Results demonstrate a bias against performing an initial saccade in the direction paired with shock (Experiment 1) or generally of the amplitude paired with shock (Experiment 2), an effect that operates without apparent awareness of the relationship between shocks and saccades, persists into extinction, and generalizes to the viewing of novel images. The present study serves as a proof of concept concerning the implementation of near-real-time feedback in eye movement training.

Real-Time Sound and Motion Feedback for Violin Bow Technique Learning: A Controlled, Randomized Trial

The production of good sound generation in the violin is a complex task that requires coordination and spatiotemporal control of bowing gestures. The use of motion-capture technologies to improve performance or reduce injury risks in the area of kinesiology is becoming widespread. The combination of motion accuracy and sound quality feedback has the potential of becoming an important aid in violin learning. In this study, we evaluate motion-capture and sound-quality analysis technologies developed inside the context of the TELMI, a technology-enhanced music learning project. We analyzed the sound and bow motion of 50 participants with no prior violin experience while learning to produce a stable sound in the violin. Participants were divided into two groups: the experimental group (N = 24) received real-time visual feedback both on kinematics and sound quality, while participants in the control group (N = 26) practiced without any type of external help. An additional third group of violin experts performed the same task for comparative purposes (N = 15). After the practice session, all groups were evaluated in a transfer phase without feedback. At the practice phase, the experimental group improved their bowing kinematics in comparison to the control group, but this was at the expense of impairing the sound quality of their performance. At the retention phase, the experimental group showed better results in sound quality, especially concerning control of sound dynamics. Besides, we found that the expert group improved the stability of their sound while using the technology. All in all, these results emphasize the importance of feedback technologies in learning complex tasks, such as musical instrument learning.

Reward makes the rhythmic sampling of spatial attention emerge earlier

A growing body of evidence demonstrates a rhythmic characteristic of spatial attention, with the corresponding behavioral performance fluctuating periodically. Here, we investigate whether and how the rhythmic characteristic of spatial attention is affected by reward-an important factor in attentional selection. We adopted the classic spatial cueing paradigm with a time-resolved stimulus-onset-asynchrony (SOA) between the spatial cue and the target such that responses to the target in different phases could be examined. The color of the spatial cue was associated with either a high or low level of reward. Results showed that in the low-frequency band (<2 Hz) where classic exogenous spatial attention effects (i.e., facilitation and inhibition of return; IOR) appeared, reward enhanced the late IOR effect through facilitating behavioral responses to the target at the uncued location. Recurring lower alpha power (alpha inhibition) which fluctuated in a low-theta frequency (2-3 Hz) was observed at the cued location relative to the uncued location, irrespective of the reward level of the cue. Importantly, the recurring alpha inhibition emerged earlier (~120 ms) in the high-reward condition relative to the low-reward condition. We propose that the recurring alpha inhibition at the cued location implies a recurring attention sampling at the cued location and the expectation of a high reward makes the periodic attention sampling emerge earlier.

Reward Influences Masked Free-Choice Priming

While it is known that reward induces attentional prioritization, it is not clear what effect reward-learning has when associated with stimuli that are not fully perceived. The masked priming paradigm has been extensively used to investigate the indirect impact of brief stimuli on response behavior. Interestingly, the effect of masked primes is observed even when participants choose their responses freely. While classical theories assume this process to be automatic, recent studies have provided evidence for attentional modulations of masked priming effects. Most such studies have manipulated bottom-up or top-down modes of attentional selection, but the role of “newer” forms of attentional control such as reward-learning and selection history remains unclear. In two experiments, with number and arrow primes, we examined whether reward-mediated attentional selection modulates masked priming when responses are chosen freely. In both experiments, we observed that primes associated with high-reward lead to enhanced free-choice priming compared to primes associated with no-reward. The effect was seen on both proportion of choices and response times, and was more evident in the faster responses. In the slower responses, the effect was diminished. Our study adds to the growing literature showing the susceptibility of masked priming to factors related to attention and executive control.

Target frequency modulates object-based attention

Decades of research have provided evidence that object representations contribute to attentional selection. However, most evidence for object-based attentional allocation is drawn from studies employing the two-rectangle paradigm where the target distribution is biased towards the cued object. It is thus unclear whether object-based attentional selection is from object representations or a consequence of spatial attention based on statistical imbalances. Here, we investigate the extent to which target frequency modulates object-based attention by systematically manipulating the frequency of target appearance in a particular spatial location within objects to equate spatial allocation, bias specific spatial locations, or bias objects. In four experiments, participants were presented with a variant of the two-rectangle paradigm in which one end of a rectangle was cued and performed a target discrimination task. Critically, the target location probabilities were parametrically manipulated. The target could appear equally in all ends within the objects (valid, invalid within-object, invalid between-object, diagonal) (Experiment 1) or with overall equality between objects but biased towards the invalid locations (Experiment 2). The target could also appear in three locations (valid, invalid within-object, invalid between-object) distributed equally between objects but biased towards the invalid between-object location (Experiment 3) or with an overall bias towards the invalid between-object location (Experiment 4). We observed that while objects bias attention, spatial biases are prioritized over object representations. Combined results suggest that object-based contribution to attentional guidance is the result of both spatial probabilities and object representations.

Attentional Orienting by Non-informative Cue Is Shaped via Reinforcement Learning

It has been demonstrated that a reward-associated stimulus feature captures attention involuntarily. The present study tested whether spatial attentional orienting is biased via reinforcement learning. Participants were to identify a target stimulus presented in one of two placeholders, preceded by a non-informative arrow cue at the center of the display. Importantly, reward was available when the target occurred at a location cued by a reward cue, defined as a specific color (experiments 1 and 3) or a color-direction combination (experiment 2). The attentional bias of the reward cue was significantly increased as trials progressed, resulting in a greater cue-validity effect for the reward cue than the no-reward cue. This attentional bias was still evident even when controlling for the possibility that the incentive salience of the reward cue color modulates the cue-validity effect (experiment 2) or when the reward was withdrawn after reinforcement learning (experiment 3). However, it disappeared when the reward was provided regardless of cue validity (experiment 4), implying that the reinforcement contingency between reward and attentional orienting is a critical determinant of reinforcement learning-based spatial attentional modulation. Our findings highlight that a spatial attentional bias is shaped by value via reinforcement learning.

Goal-directed unequal attention allocation during multiple object tracking

In standard multiple object tracking (MOT) tasks the relative importance of the targets being tracked is equal. This is atypical of everyday situations in which an individual may need to prioritize one target relative to another and so allocate attention unequally. We report three experiments that examined whether participants could unequally split attention using a modified MOT task in which target priority was manipulated. Specifically, we examined the effect of priority on participants’ magnitude of error and used a distribution mixture analysis to investigate how priority affected both participants’ probability of losing an item and tracking precision. Experiment 1 (trajectory tracking) revealed a higher magnitude of error and higher proportion of guessing for low- compared with high-priority targets. Experiments 2 (trajectory tracking) and 3 (position tracking) examined how fine-grained this ability is by manipulating target priority at finer increments. In line with Experiment 1, results from both these experiments indicated that participants could split attention unequally. There was some evidence that participants could allocate attention unequally at fine increments, but this was less conclusive. Taken together, these experiments demonstrate participants’ ability to distribute attention unequally across multiple moving objects but suggest some limitation with the flexibility of attention allocation.

Neural and Attentional Correlates of Intrinsic Motivation Resulting from Social Performance Expectancy

Some models of motivation distinguish between intrinsic and extrinsic motivation. While past work has examined the neural and cognitive correlates of extrinsic motivation, research on intrinsic motivation has relied primarily on behavioral measures of performance and learning. In particular, no past work has examined the neural and cognitive correlates of social performance expectancy, which is linked to intrinsic motivation. The current study manipulated expectancy of difficult (vs. easy) trials on a cued flanker task and assessed attentional scope and performance. EEG was used to examine motor-action preparation as measured by suppression of beta band activity over the motor cortex and feedback processing as measured by the Reward Positivity (RewP). Results revealed expectancy of difficult (vs. easy) trials narrowed attentional scope, reduced beta activity over the motor cortex, and enhanced RewP amplitudes to win feedback. These findings suggest that enhancing intrinsic motivation through expectancies of positive social comparison engages similar neural and cognitive correlates as extrinsic motivators high in motivational intensity.

The impact of monetary stimuli on object-based attention

Previous research has implied that monetary reward to target location (a reward for spatial properties) can affect object-based attention, but no study has directly investigated the influence of monetary objects (a reward for object properties) on object-based attention. Thus, it is unclear whether and how monetary objects can affect object-based attention. To experimentally investigate this problem, this study adapted the well-established two-rectangle paradigm. In Experiment 1, either two 100-yuan notes or two 1-yuan notes were presented to participants. We found an object-based effect with faster responses to targets at an uncued position on the cued object compared to those at an equidistant position on the uncued object; the effect was similar in 100-yuan and 1-yuan note trials. In Experiment 2, two notes (one 100-yuan and one 1-yuan) were simultaneously presented to participants, and cue location (100-yuan, 1-yuan) was manipulated. We found a greater object-based effect when the cue appeared on the 100-yuan note than on the 1-yuan note. These results suggest that the rewarding property of objects can affect object-based attention by means of altering object salience.

White matter lesion loads associated with dynamic functional connectivity within attention network in patients with relapsing-remitting multiple sclerosis

Using time-variant of blood oxygenation level dependent (BOLD) signal to investigate the temporal changes in functional connectivity (FC) between key nodes may shed light on the dynamic characteristics of network. Twenty-two relapsing-remitting multiple sclerosis (RRMS) and 22 well-matched healthy control subjects (HCs) participated in this study. Previously validated key nodes of attention network seeds were defined as spherical regions of interests (ROIs); then, we captured the pattern of dFC using sliding window correlation of ROIs in the RRMS and HCs during rest. Furthermore, correlation analysis between altered dFC of paired-ROIs with clinical measures in RRMS were performed. Compared with the HCs, the RRMS showed: a certain specificity transient pattern of FC of attention network at time window levels, including decreased dFC within dorsal attention network [connections of left intraparietal sulcus (LIPS)-right intraparietal sulcus (RIPS), LIPS-right frontal eye field (RFEF) and left frontal eye field (LFEF)-RIPS] and ventral attention network [connection of right ventral frontal cortex (RVFC)-right temporal parietal junction (RTPJ)], increased dFC between dorsal and ventral attention network (connections of LIPS-RTPJ and LIPS-RVFC). Secondary analysis indicated that the dFC coefficients of the connections of LIPS-RIPS (r = -0.467, P = 0.023) and RVFC-RTPJ (r = -0.452, P = 0.043) were significant negative correlated with the total white matter lesion load. In conclusion, we found that the instantaneous configuration pattern of FC in attention network of RRMS are relate to lesions loads.

Selection history: How reward modulates selectivity of visual attention

Visual attention enables us to selectively prioritize or suppress information in the environment. Prominent models concerned with the control of visual attention differentiate between goal-directed, top-down and stimulus-driven, bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. In the current review, we discuss recent studies that demonstrate that attentional selection does not need to be the result of top-down or bottom-up processing but, instead, is often driven by lingering biases due to the "history" of former attention deployments. This review mainly focuses on reward-based history effects; yet other types of history effects such as (intertrial) priming, statistical learning and affective conditioning are also discussed. We argue that evidence from behavioral, eye-movement and neuroimaging studies supports the idea that selection history modulates the topographical landscape of spatial "priority" maps, such that attention is biased toward locations having the highest activation on this map.

Funny money: the attentional role of monetary feedback detached from expected value

Stimuli associated with monetary reward can become powerful cues that effectively capture visual attention. We examined whether such value-driven attentional capture can be induced with monetary feedback in the absence of an expected cash payout. To this end, we implemented images of U.S. dollar bills as reward feedback. Participants knew in advance that they would not receive any money based on their performance. Our reward stimuli-$5 and $20 bill images-were thus dissociated from any practical utility. Strikingly, we observed a reliable attentional capture effect for the mere images of bills. Moreover, this finding generalized to Monopoly money. In two control experiments, we found no evidence in favor of nominal or symbolic monetary value. Hence, we claim that bill images are special monetary representations, such that there are strong associations between the defining visual features of bills and reward, probably due to a lifelong learning history. Together, we show that the motivation to earn cash plays a minor role when it comes to monetary rewards, while bill-defining visual features seem to be sufficient. These findings have the potential to influence human factor applications, such as gamification, and can be extended to novel value systems, such as the electronic cash Bitcoin being developed for use in mobile banking. Finally, our procedure represents a proof of concept on how images of money can be used to conserve expenditures in the experimental context.

Pavlovian reward learning underlies value driven attentional capture

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.

Learned value and object perception: Accelerated perception or biased decisions?

Learned value is known to bias visual search toward valued stimuli. However, some uncertainty exists regarding the stage of visual processing that is modulated by learned value. Here, we directly tested the effect of learned value on preattentive processing using temporal order judgments. Across four experiments, we imbued some stimuli with high value and some with low value, using a nonmonetary reward task. In Experiment 1, we replicated the value-driven distraction effect, validating our nonmonetary reward task. Experiment 2 showed that high-value stimuli, but not low-value stimuli, exhibit a prior-entry effect. Experiment 3, which reversed the temporal order judgment task (i.e., reporting which stimulus came second), showed no prior-entry effect, indicating that although a response bias may be present for high-value stimuli, they are still reported as appearing earlier. However, Experiment 4, using a simultaneity judgment task, showed no shift in temporal perception. Overall, our results support the conclusion that learned value biases perceptual decisions about valued stimuli without speeding preattentive stimulus processing.

Unresponsive Choline Transporter as a Trait Neuromarker and a Causal Mediator of Bottom-Up Attentional Biases

Some rats [sign-trackers (STs)] are prone to attribute incentive salience to reward cues, which can manifest as a propensity to approach and contact pavlovian cues, and for addiction-like behavior. STs also exhibit poor attentional performance, relative to goal-trackers (GTs), which is associated with attenuated acetylcholine (ACh) levels in prefrontal cortex (Paolone et al., 2013). Here, we demonstrate a cellular mechanism, linked to ACh synthesis, that accounts for attenuated cholinergic capacity in STs. First, we found that electrical stimulation of the basal forebrain increased cortical choline transporter (CHT)-mediated choline transport in GTs, paralleled by a redistribution of CHTs to the synaptic plasma membrane. Neither increases in choline uptake nor translocation of CHTs occurred in STs. Second, and consistent with uptake/translocation alterations, STs demonstrated a reduced ability to support cortical ACh release in vivo compared with GTs after reverse-dialysis to elevate extracellular potassium levels. Third, rats were significantly more likely to develop sign-tracking behavior if treated systemically before pavlovian conditioned approach training with the CHT inhibitor VU6001221. Consistent with its proposed mechanisms, administration of VU6001221 attenuated potassium-evoked ACh levels in prefrontal cortex measured with in vivo microdialysis. We propose that loss of CHT-dependent activation of cortical cholinergic activity in STs degrades top-down executive control over behavior, producing a bias for bottom-up or stimulus-driven attention. Such an attentional bias contributes to nonadaptive reward processing and thus identifies a novel mechanism that can support psychopathology, including addiction.SIGNIFICANCE STATEMENT The vulnerability for addiction-like behavior has been associated with psychological traits, such as the propensity to attribute incentive salience to reward cues that is modeled in rats by sign-tracking behavior. Sign-trackers tend to approach and contact cues associated with reward, whereas their counterparts, the goal-trackers, have a preference for approaching the location of the reward. Here, we show that the capacity of presynaptic cholinergic synapses to respond to stimulation by elevating presynaptic choline uptake and releasing acetylcholine is attenuated in sign-trackers. Furthermore, pharmacological inhibition of choline transport induced sign-tracking behavior. Our findings suggest that reduced levels of cholinergic neuromodulation can mediate an attentional bias toward reward-related cues, thereby allowing such cues to exert relatively greater control over behavior.

Detection of object onsets and offsets: Does the primacy of onset persist even with bias for detecting offset?

Onset primacy is a robust visual phenomenon in which appearance of new objects (onsets) in a scene more effectively captures observers' attention compared with disappearance of previously viewed objects (offsets). We hypothesized that the human attentional system is programmed by default to prioritize the processing of onsets, because quick detection of them is advantageous in most situations. However, the attentional priority may be able to flexibly adapt to the detection of object offsets depending on observers' behavioral goals. To test these hypotheses, two experiments were conducted in which participants were biased toward finding offset of an existing object through top-down and bottom-up manipulations. Results showed that although onset primacy was reduced to some degree under strong offset bias, in general participants continued to detect onsets efficiently. These findings did not eliminate the possibility of attentional flexibility, but they do demonstrate the robustness of onset primacy, suggesting that environmental demands or motivational factors would need to be sufficiently strong for people to switch to an adaptive attentional mode.

The Neuroscience of Human Decision-Making Through the Lens of Learning and Memory

We are called upon to make decisions, large and small, many times a day. Whether in the voting booth, the stock exchange, or the cafeteria line, we identify potential options, estimate and compare their subjective values, and make a choice. Decision-making has only recently become a focus for cognitive neuroscience. The last two decades have seen rapid progress in our understanding of the brain basis of at least some aspects of this rather complex aspect of cognition. This work has provided fresh perspectives on poorly understood brain regions, such as orbitofrontal cortex and ventral striatum. It has led to interesting interdisciplinary exchanges with diverse fields, notably economics, but also ecology and political science, among others. The novel perspectives arising from these exchanges have begun to be related to better understood aspects of cognition. In particular, it is increasingly clear that decision-making is tightly interlinked with learning and memory. Key early insights in decision neuroscience came from what were essentially reinforcement learning tasks. Recent work has made similar links to aspects of declarative memory. Indeed, decision-making can be seen as the link between memory of the past and future actions. This chapter reviews selected topics in decision neuroscience, with a particular focus on the links to learning and memory, and a particular emphasis on regions within prefrontal cortex.

The effect of reward on orienting and reorienting in exogenous cuing

It is thought that reward-induced motivation influences perceptual, attentional, and cognitive control processes to facilitate behavioral performance. In this study, we investigated the effect of reward-induced motivation on exogenous attention orienting and inhibition of return (IOR). Attention was captured by peripheral onset cues that were nonpredictive for the target location. Participants performed a target discrimination task at short (170 ms) and long (960 ms) cue–target stimulus onset asynchronies. Reward-induced motivation was manipulated by exposing participants to low- and high-reward blocks. Typical cue facilitation effects on initial orienting were observed for both the low- and high-reward conditions. However, IOR was found only for the high-reward condition. This indicates that reward-induced motivation has a clear effect on reorienting and inhibitory processes following the initial capture of attention, but not on initial exogenous orienting that is considered to be exclusively automatic and stimulus-driven. We suggest that initial orienting is completely data-driven, not affected by top-down motivational processes, while reorienting and the accompanying IOR effect involve motivational top-down processes. To support this, we showed that reward-induced motivational processes and top-down control processes co-act in order to improve behavioral performance: High-reward-induced motivation caused an increase in top-down cognitive control, as signified by posterror slowing. Moreover, we show that personality trait propensity to reward-driven behavior (BAS-Drive scale) was related to reward-triggered behavioral changes in top-down reorienting, but not to changes in automatic orienting.

Altering spatial priority maps via reward-based learning

Spatial priority maps are real-time representations of the behavioral salience of locations in the visual field, resulting from the combined influence of stimulus driven activity and top-down signals related to the current goals of the individual. They arbitrate which of a number of (potential) targets in the visual scene will win the competition for attentional resources. As a result, deployment of visual attention to a specific spatial location is determined by the current peak of activation (corresponding to the highest behavioral salience) across the map. Here we report a behavioral study performed on healthy human volunteers, where we demonstrate that spatial priority maps can be shaped via reward-based learning, reflecting long-lasting alterations (biases) in the behavioral salience of specific spatial locations. These biases exert an especially strong influence on performance under conditions where multiple potential targets compete for selection, conferring competitive advantage to targets presented in spatial locations associated with greater reward during learning relative to targets presented in locations associated with lesser reward. Such acquired biases of spatial attention are persistent, are nonstrategic in nature, and generalize across stimuli and task contexts. These results suggest that reward-based attentional learning can induce plastic changes in spatial priority maps, endowing these representations with the "intelligent" capacity to learn from experience.

Reward-priming of location in visual search

Existing visual search research has demonstrated that the receipt of reward will be beneficial for subsequent perceptual and attentional processing of features that have characterized targets, but detrimental for processing of features that have characterized irrelevant distractors. Here we report a similar effect of reward on location. Observers completed a visual search task in which they selected a target, ignored a salient distractor, and received random-magnitude reward for correct performance. Results show that when target selection garnered rewarding outcome attention is subsequently a.) primed to return to the target location, and b.) biased away from the location that was occupied by the salient, task-irrelevant distractor. These results suggest that in addition to priming features, reward acts to guide visual search by priming contextual locations of visual stimuli.

The timecourse of space- and object-based attentional prioritization with varying degrees of certainty

The relative contributions of objects (i.e., object-based) and underlying spatial (i.e., space-based representations) to attentional prioritization and selection remain unclear. In most experimental circumstances, the two representations overlap thus their respective contributions cannot be evaluated. Here, a dynamic version of the two-rectangle paradigm allowed for a successful de-coupling of spatial and object representations. Space-based (cued spatial location), cued end of the object, and object-based (locations within the cued object) effects were sampled at several timepoints following the cue with high or low certainty as to target location. In the high uncertainty condition spatial benefits prevailed throughout most of the timecourse, as evidenced by facilitatory and inhibitory effects. Additionally, the cued end of the object, rather than a whole object, received the attentional benefit. When target location was predictable (low uncertainty manipulation), only probabilities guided selection (i.e., evidence by a benefit for the statistically biased location). These results suggest that with high spatial uncertainty, all available information present within the stimulus display is used for the purposes of attentional selection (e.g., spatial locations, cued end of the object) albeit to varying degrees and at different time points. However, as certainty increases, only spatial certainty guides selection (i.e., object ends and whole objects are filtered out). Taken together, these results further elucidate the contributing role of space- and object-representations to attentional guidance.

Reward-based transfer from bottom-up to top-down search tasks

Recent evidence has suggested that reward modulates bottom-up and top-down attentional selection and that this effect persists within the same task even when reward is no longer offered. It remains unclear whether reward effects transfer across tasks, especially those engaging different modes of attention. We directly investigated whether reward-based contingency learned in a bottom-up search task was transferred to a subsequent top-down search task, and probed the nature of the transfer mechanism. Results showed that a reward-related benefit established in a pop-out-search task was transferred to a conjunction-search task, increasing participants' efficiency at searching for targets previously associated with a higher level of reward. Reward history influenced search efficiency by enhancing both target salience and distractor filtering, depending on whether the target and distractors shared a critical feature. These results provide evidence for reward-based transfer between different modes of attention and strongly suggest that an integrated priority map based on reward information guides both top-down and bottom-up attention.

The differential effects of reward on space- and object-based attentional allocation

Estimating reward contingencies and allocating attentional resources to a subset of relevant information are the most important contributors to increasing adaptability of an organism. Although recent evidence suggests that reward- and attention-based guidance recruits overlapping cortical regions and has similar effects on sensory responses, the exact nature of the relationship between the two remains elusive. Here, using event-related fMRI on human participants, we contrasted the effects of reward on space- and object-based selection in the same experimental setting. Reward was either distributed randomly or biased a particular object. Behavioral and neuroimaging results show that space- and object-based attention is influenced by reward differentially. Space-based attentional allocation is mandatory, integrating reward information over time, whereas object-based attentional allocation is a default setting that is completely replaced by the reward signal. Nonadditivity of the effects of reward and object-based attention was observed consistently at multiple levels of analysis in early visual areas as well as in control regions. These results provide strong evidence that space- and object-based allocation are two independent attentional mechanisms, and suggest that reward serves to constrain attentional selection.