Neural evidence reveals the rapid effects of reward history on selective attention

Motivational context and neurocomputation of stop expectation moderate early attention responses supporting proactive inhibitory control

Alterations in attention to cues signaling the need for inhibitory control play a significant role in a wide range of psychopathology. However, the degree to which motivational and attentional factors shape the neurocomputations of proactive inhibitory control remains poorly understood. The present study investigated how variation in monetary incentive valence and stake modulate the neurocomputational signatures of proactive inhibitory control. Adults (N = 46) completed a Stop-Signal Task (SST) with concurrent EEG recording under four conditions associated with stop performance feedback: low and high punishment (following unsuccessful stops) and low and high reward (following successful stops). A Bayesian learning model was used to infer individual's probabilistic expectations of the need to stop on each trial: P(stop). Linear mixed effects models were used to examine whether interactions between motivational valence, stake, and P(stop) parameters predicted P1 and N1 attention-related event-related potentials (ERPs) time-locked to the go-onset stimulus. We found that P1 amplitudes increased at higher levels of P(stop) in punished but not rewarded conditions, although P1 amplitude differences between punished and rewarded blocks were maximal on trials when the need to inhibit was least expected. N1 amplitudes were positively related to P(stop) in the high punishment condition (low N1 amplitude), but negatively related to P(stop) in the high reward condition (high N1 amplitude). Critically, high P(stop)-related N1 amplitude to the go-stimulus predicted behavioral stop success during the high reward block, providing evidence for the role of motivationally relevant context and inhibitory control expectations in modulating the proactive allocation of attentional resources that affect inhibitory control. These findings provide novel insights into the neurocomputational mechanisms underlying proactive inhibitory control under valence-dependent motivational contexts, setting the stage for developing motivation-based interventions that boost inhibitory control.

Trichotomy revisited: A monolithic theory of attentional control

The control of attention was long held to reflect the influence of two competing mechanisms of assigning priority, one goal-directed and the other stimulus-driven. Learning-dependent influences on the control of attention that could not be attributed to either of those two established mechanisms of control gave rise to the concept of selection history and a corresponding third mechanism of attentional control. The trichotomy framework that ensued has come to dominate theories of attentional control over the past decade, replacing the historical dichotomy. In this theoretical review, I readily affirm that distinctions between the influence of goals, salience, and selection history are substantive and meaningful, and that abandoning the dichotomy between goal-directed and stimulus-driven mechanisms of control was appropriate. I do, however, question whether a theoretical trichotomy is the right answer to the problem posed by selection history. If we reframe the influence of goals and selection history as different flavors of memory-dependent modulations of attentional priority and if we characterize the influence of salience as a consequence of insufficient competition from such memory-dependent sources of priority, it is possible to account for a wide range of attention-related phenomena with only one mechanism of control. The monolithic framework for the control of attention that I propose offers several concrete advantages over a trichotomy framework, which I explore here.

Cortical and subcortical substrates of minutes and days-long object value memory in humans

Obtaining valuable objects motivates many of our daily decisions. However, the neural underpinnings of object processing based on human value memory are not yet fully understood. Here, we used whole-brain functional magnetic resonance imaging (fMRI) to examine activations due to value memory as participants passively viewed objects before, minutes after, and 1-70 days following value training. Significant value memory for objects was evident in the behavioral performance, which nevertheless faded over the days following training. Minutes after training, the occipital, ventral temporal, interparietal, and frontal areas showed strong value discrimination. Days after training, activation in the frontal, temporal, and occipital regions decreased, whereas the parietal areas showed sustained activation. In addition, days-long value responses emerged in certain subcortical regions, including the caudate, ventral striatum, and thalamus. Resting-state analysis revealed that these subcortical areas were functionally connected. Furthermore, the activation in the striatal cluster was positively correlated with participants' performance in days-long value memory. These findings shed light on the neural basis of value memory in humans with implications for object habit formation and cross-species comparisons.

The Electrophysiological Markers of Statistically Learned Attentional Enhancement: Evidence for a Saliency-based Mechanism

It is well established that attention can be sharpened through the process of statistical learning (e.g., visual search becomes faster when targets appear at high-relative-to-low probability locations). Although this process of statistically learned attentional enhancement differs behaviorally from the well-studied top-down and bottom-up forms of attention, relatively little work has been done to characterize the electrophysiological correlates of statistically learned attentional enhancement. It thus remains unclear whether statistically learned enhancement recruits any of the same cognitive mechanisms as top-down or bottom-up attention. In the current study, EEG data were collected while participants searched for an ambiguous unique shape in a visual array (the additional singleton task). Unbeknownst to the participants, targets appeared more frequently in one location in space (probability cuing). Encephalographic data were then analyzed in two phases: an anticipatory phase and a reactive phase. In the anticipatory phase preceding search stimuli onset, alpha lateralization as well as the Anterior Directing Attention Negativity and Late Directing Attention Positivity components-signs of preparatory attention known to characterize top-down enhancement-were tested. In the reactive phase, the N2pc component-a well-studied marker of target processing-was examined following stimuli onset. Our results showed that statistically learned attentional enhancement is not characterized by any of the well-known anticipatory markers of top-down attention; yet targets at high probability locations did reliably evoke larger N2pc amplitudes, a finding that is associated with bottom-up attention and saliency. Overall, our findings are consistent with the notion that statistically learned attentional enhancement increases the perceptual salience of items appearing at high-probability locations relative to low-probability locations.

Neural correlates of value-driven spatial orienting

Reward learning has been shown to habitually guide overt spatial attention to specific regions of a scene. However, the neural mechanisms that support this bias are unknown. In the present study, participants learned to orient themselves to a particular quadrant of a scene (a high-value quadrant) to maximize monetary gains. This learning was scene-specific, with the high-value quadrant varying across different scenes. During a subsequent test phase, participants were faster at identifying a target if it appeared in the high-value quadrant (valid), and initial saccades were more likely to be made to the high-value quadrant. fMRI analyses during the test phase revealed learning-dependent priority signals in the caudate tail, superior colliculus, frontal eye field, anterior cingulate cortex, and insula, paralleling findings concerning feature-based, value-driven attention. In addition, ventral regions typically associated with scene selection and spatial information processing, including the hippocampus, parahippocampal gyrus, and temporo-occipital cortex, were also implicated. Taken together, our findings offer new insights into the neural architecture subserving value-driven attention, both extending our understanding of nodes in the attention network previously implicated in feature-based, value-driven attention and identifying a ventral network of brain regions implicated in reward's influence on scene-dependent spatial orienting.

Differential effects of intra-modal and cross-modal reward value on perception: ERP evidence

In natural environments objects comprise multiple features from the same or different sensory modalities but it is not known how perception of an object is affected by the value associations of its constituent parts. The present study compares intra- and cross-modal value-driven effects on behavioral and electrophysiological correlates of perception. Human participants first learned the reward associations of visual and auditory cues. Subsequently, they performed a visual discrimination task in the presence of previously rewarded, task-irrelevant visual or auditory cues (intra- and cross-modal cues, respectively). During the conditioning phase, when reward associations were learned and reward cues were the target of the task, high value stimuli of both modalities enhanced the electrophysiological correlates of sensory processing in posterior electrodes. During the post-conditioning phase, when reward delivery was halted and previously rewarded stimuli were task-irrelevant, cross-modal value significantly enhanced the behavioral measures of visual sensitivity, whereas intra-modal value produced only an insignificant decrement. Analysis of the simultaneously recorded event-related potentials (ERPs) of posterior electrodes revealed similar findings. We found an early (90-120 ms) suppression of ERPs evoked by high-value, intra-modal stimuli. Cross-modal stimuli led to a later value-driven modulation, with an enhancement of response positivity for high- compared to low-value stimuli starting at the N1 window (180-250 ms) and extending to the P3 (300-600 ms) responses. These results indicate that sensory processing of a compound stimulus comprising a visual target and task-irrelevant visual or auditory cues is modulated by the reward value of both sensory modalities, but such modulations rely on distinct underlying mechanisms.

The persistence of value-driven attention capture is task-dependent

Visual features previously associated with reward can capture attention even when task-irrelevant, a phenomenon known as value-driven attention capture (VDAC). VDAC persists without reinforcement, unlike other forms of learning, where removing reinforcement typically leads to extinction. In five experiments, factors common to many studies were manipulated to examine their impact on VDAC and its extinction. All experiments included learning and test phases. During learning, participants completed a visual search task during which one of two target colors was associated with a reward, and the other with no reward. During test, 1 week later, participants completed another visual search task in which the reward association was not reinforced. When a rewarded feature remained task-relevant (Experiment 1), VDAC was observed. When the rewarded feature was made task-irrelevant (Experiments 2-5) there was no evidence of a VDAC effect, except when the target feature was physically salient and there was a reduction in the frequency of exposure to the reward-associated feature (Experiment 5). We failed to find evidence of VDAC in Experiments 2-4, suggesting that VDAC may depend on the demands of the task resulting in vulnerability to VDAC. When VDAC was observed, extinction was also observed. This indicates that VDAC is subject to extinction as would be expected from an effect driven by reinforcement learning.

Cross-modal generalization of value-based attentional priority

This study aimed to determine whether value-based attentional biases learned in the auditory domain can correspondingly shape visual attention. A learning phase established associations between auditory words and monetary rewards via a modified version of the dichotic listening task. In a subsequent test phase, participants performed a Stroop task including written representations of auditory words previously paired with reward and semantic associates of formerly rewarded words. Results support a semantic generalization of value-driven attention from the auditory to the visual domain. The findings provide valuable insight into a critical aspect of adaptation and the understanding of maladaptive behaviors (e.g., addiction).

Stress diminishes outcome but enhances response representations during instrumental learning

Stress may shift behavioural control from a goal-directed system that encodes action-outcome relationships to a habitual system that learns stimulus-response associations. Although this shift to habits is highly relevant for stress-related psychopathologies, limitations of existing behavioural paradigms hinder research from answering the fundamental question of whether the stress-induced bias to habits is due to reduced outcome processing or enhanced response processing at the time of stimulus presentation, or both. Here, we used EEG-based multivariate pattern analysis to decode neural outcome representations crucial for goal-directed control, as well as response representations during instrumental learning. We show that stress reduced outcome representations but enhanced response representations. Both were directly associated with a behavioural index of habitual responding. Furthermore, changes in outcome and response representations were uncorrelated, suggesting that these may reflect distinct processes. Our findings indicate that habitual behaviour under stress may be the result of both enhanced stimulus-response processing and diminished outcome processing.

Spatial task relevance modulates value-driven attentional capture

Attention tends to be attracted to visual features previously associated with reward. To date, nearly all existing studies examined value-associated stimuli at or near potential target locations, making such locations meaningful to inspect. The present experiments examined whether the attentional priority of a value-associated stimulus depends on its location-wise task relevance. In three experiments we used an RSVP task to compare the attentional demands of a value-associated peripheral distractor to that of a distractor associated with the top-down search goal. At a peripheral location that could never contain the target, a value-associated color did not capture attention. In contrast, at the same location, a distractor in a goal-matching color did capture attention. The results show that value-associated stimuli lose their attentional priority at task-irrelevant locations, in contrast to other types of stimuli that capture attention.

Dynamic modulation of neural feedback processing and attention during spatial probabilistic learning

Learned stimulus-reward associations can modulate behavior and the underlying neural processing of information. We investigated the cascade of these neurocognitive mechanisms involved in the learning of spatial stimulus-reward associations. Using electroencephalogram recordings while participants performed a probabilistic spatial reward learning task, we observed that the feedback-related negativity component was more negative in response to loss feedback compared to gain feedback but showed no modulation by learning. The late positive component became larger in response to losses as the learning set progressed but smaller in response to gains. In addition, feedback-locked alpha frequency oscillations measured over occipital sites were predictive of N2pc amplitudes—a marker of spatial attention orienting—observed on the next trial. This relationship was found to become stronger with learning set progression. Taken together, we elucidated neurocognitive dynamics underlying feedback processing during spatial reward learning, and the subsequent effects of these learned spatial stimulus-reward associations on spatial attention.

•

We can learn which spatial location relates to the highest probability of reward

•

Neural processing of feedback valence was not influenced by learning

•

LPC amplitude was dynamically modulated by learning, reflecting context updating

•

Feedback-locked alpha power was predictive of ensuing orientation of attention

Reward reduces the fission illusion in the sound-induced flash illusion

Pairing a single visual stimulus with multiple auditory stimuli will lead to the illusory perception of multiple visual stimuli, which is known as sound-induced flash illusion (SIFI). The present study adopted the classic SIFI paradigm to investigate whether value-associated tasks could affect the SIFI. By adjusting the sequence of reward and nonreward conditions, we also examined the effect of reward history on SIFI. The results showed that the fission illusion was reduced when associated with momentary reward, demonstrating significantly higher accuracy and discriminability than the nonreward condition. However, the fusion illusion was not affected by the momentary reward, and the explanation was that the fusion illusion was not as stable as the fission illusion and disappeared across different trials and conditions. Moreover, the robustness of reward history in the present study was not as strong as previous studies have suggested, indicating that the effect of sound on the perceptual representation of visual stimuli is strong and robust to reward history. These findings demonstrated that the reward could reduce the SIFI and broaden the existing dichotomy of SIFI. New evidence for the operation of value-driven attention mechanisms is also provided, suggesting that the underlying value-driven attention operates across multiple sensory systems.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

The Impact of Error-Consequence Severity on Cue Processing in Importance-Biased Prospective Memory

Prospective memory (PM) enables people to remember to complete important tasks in the future. Failing to do so can result in consequences of varying severity. Here, we investigated how PM error-consequence severity impacts the neural processing of relevant cues for triggering PM and the ramification of that processing on the associated prospective task performance. Participants role-played a cafeteria worker serving lunches to fictitious students and had to remember to deliver an alternative lunch to students (as PM cues) who would otherwise experience a moderate or severe aversive reaction. Scalp-recorded, event-related potential (ERP) measures showed that the early-latency frontal positivity, reflecting the perception-based neural responses to previously learned stimuli, did not differ between the severe versus moderate PM cues. In contrast, the longer-latency parietal positivity, thought to reflect full PM cue recognition and post-retrieval processes, was elicited earlier by the severe than the moderate PM cues. This faster instantiation of the parietal positivity to the severe-consequence PM cues was then followed by faster and more accurate behavioral responses. These findings indicate how the relative importance of a PM can be neurally instantiated in the form of enhanced and faster PM-cue recognition and processing and culminate into better PM.

Search strategies improve with practice, but not with time pressure or financial incentives

When searching for an object, do we minimize the number of eye movements we need to make? Under most circumstances, the cost of saccadic parsimony likely outweighs the benefit, given the cost is extensive computation and the benefit is a few hundred milliseconds of time saved. Previous research has measured the proportion of eye movements directed to locations where the target would have been visible in the periphery as a way of quantifying the proportion of superfluous fixations. A surprisingly large range of individual differences has emerged from these studies, suggesting some people are highly efficient and others much less so. Our question in the current study is whether these individual differences can be explained by differences in motivation. In two experiments, we demonstrate that neither time pressure nor financial incentive led to improvements of visual search strategies; the majority of participants continued to make many superfluous fixations in both experiments. The wide range of individual differences in efficiency observed previously was replicated here. We observed small but consistent improvements in strategy over the course of the experiment (regardless of reward or time pressure) suggesting practice, not motivation, makes participants more efficient. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Dynamic Interplay between Reward and Voluntary Attention Determines Stimulus Processing in Visual Cortex

Reward enhances stimulus processing in the visual cortex, but the mechanisms through which this effect occurs remain unclear. Reward prospect can both increase the deployment of voluntary attention and increase the salience of previously neutral stimuli. In this study, we orthogonally manipulated reward and voluntary attention while human participants performed a global motion detection task. We recorded steady-state visual evoked potentials to simultaneously measure the processing of attended and unattended stimuli linked to different reward probabilities, as they compete for attentional resources. The processing of the high rewarded feature was enhanced independently of voluntary attention, but this gain diminished once rewards were no longer available. Neither the voluntary attention nor the salience account alone can fully explain these results. Instead, we propose how these two accounts can be integrated to allow for the flexible balance between reward-driven increase in salience and voluntary attention.

Differing Time Courses of Reward-Related Attentional Processing: An EEG Source-Space Analysis

Since our environment typically contains more information than can be processed at any one time due to the limited capacity of our visual system, we are bound to differentiate between relevant and irrelevant information. This process, termed attentional selection, is usually categorized into bottom-up and top-down processes. However, recent research suggests reward might also be an important factor in guiding attention. Monetary reward can bias attentional selection in favor of task-relevant targets and reduce the efficiency of visual search when a reward-associated, but task-irrelevant distractor is present. This study is the first to investigate reward-related target and distractor processing in an additional singleton task using neurophysiological measures and source space analysis. Based on previous studies, we hypothesized that source space analysis would find enhanced neural activity in regions of the value-based attention network, such as the visual cortex and the anterior cingulate. Additionally, we went further and explored the time courses of the underlying attentional mechanisms. Our neurophysiological results showed that rewarding distractors led to a stronger attentional capture. In line with this, we found that reward-associated distractors (compared with reward-associated targets) enhanced activation in frontal regions, indicating the involvement of top-down control processes. As hypothesized, source space analysis demonstrated that reward-related targets and reward-related distractors elicited activation in regions of the value-based attention network. However, these activations showed time-dependent differences, indicating that the neural mechanisms underlying reward biasing might be different for task-relevant and task-irrelevant stimuli.

Decreased modulation of segregated SEEKING and selective attention systems in chronic insomnia

Sleep-related attentional bias and instinctual craving-sleep status may be associated with value-driven selective attention network and SEEKING system. We hypothesized that the two networks might be important components and underlie etiology of inability to initiate or/and maintain sleep in patients with chronic insomnia (PIs). Our aim is to investigate whether frequency-frequency couplings(temporal and spatial coupling, and differences of a set of imaging parameters) could elevate the sensibility to characterize the two insomnia-related networks in studying their relationships with sleep parameters and post-insomnia emotions. Forty-eight PIs and 48 status-matched good sleepers were requested to complete sleep and emotion-related questionnaires. Receiver operating characteristic curve was used to calculate the discriminatory power of a set of parameters. Granger causality and mediating causality analysis were used to address the causal relationships between the two networks and sleep/emotion-related parameters. Frequency-frequency couplings could characterize the two networks with high discriminatory power (AUC, 0.951; sensitivity, 87.5%; specificity, 95.8%), which suggested that the frequency-frequency couplings could be served as a useful biomarker to address the insomnia-related brain networks. Functional deficits of the SEEKING system played decreased mediator acting in post-insomnia negative emotions (decreased frequency-frequency coupling). Functional hyperarousal of the value-driven attention network played decreased mediator acting in sleep regulation (increased frequency-frequency coupling). Granger causality analysis showed decreased causal effect connectivity between and within the two networks. The between-network causal effect connectivity segregation played decreased mediator acting in sleep regulation (decreased connectivity). These findings suggest that the functional deficits and segregation of the two systems may underlie etiology of PIs.

Stimulus-response learning and expected reward value enhance stimulus cognitive processing: An ERP study

Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.

Progress Toward Resolving the Attentional Capture Debate

For over 25 years, researchers have debated whether physically salient stimuli capture attention in an automatic manner, independent of the observer's goals, or whether the capture of attention depends on the match between a stimulus and the observer's task set. Recent evidence suggests an intermediate position in which salient stimuli automatically produce a priority signal, but the capture of attention can be prevented via an inhibitory mechanism that suppresses the salient stimulus. Here, proponents from multiple sides of the debate describe how their original views have changed in light of recent research, as well as remaining areas of disagreement. These perspectives highlight some emerging areas of consensus and provide new directions for future research on attentional capture.

Value associations bias ensemble perception

Ensemble perception refers to awareness of average properties, e.g. size, of “noisy” elements that often comprise visual arrays in natural scenes. Here, we asked how ensemble perception might be influenced when some but not all array elements are associated with monetary reward. Previous studies show that reward associations can speed object processing, facilitate selection, and enhance working-memory maintenance, suggesting they may bias ensemble judgments. To investigate, participants reported the average element size of brief arrays of different-sized circles. In the learning phase, all circles had the same color, but different colors produced high or low performance-contingent rewards. Then, in an unrewarded test phase, arrays comprised three spatially inter-mixed subsets, each with a different color, including the high-reward color. In different trials, the mean size of the subset with the high-reward color was smaller, larger, or the same as the ensemble mean. Ensemble size estimates were significantly biased by the high-reward-associated subset, showing that value associations modulate ensemble perception. In the test phase of a second experiment, a pattern mask appeared immediately after array presentation to limit top-down processing. Not only was value-biasing eliminated, ensemble accuracy improved, suggesting that value associations distort consciously available ensemble representation via late high-level processing.

Previously Reward-Associated Stimuli Capture Spatial Attention in the Absence of Changes in the Corresponding Sensory Representations as Measured with MEG

Studies of selective attention typically consider the role of task goals or physical salience, but attention can also be captured by previously reward-associated stimuli, even if they are currently task irrelevant. One theory underlying this value-driven attentional capture (VDAC) is that reward-associated stimulus representations undergo plasticity in sensory cortex, thereby automatically capturing attention during early processing. To test this, we used magnetoencephalography to probe whether stimulus location and identity representations in sensory cortex are modulated by reward learning. We furthermore investigated the time course of these neural effects, and their relationship to behavioral VDAC. Male and female human participants first learned stimulus-reward associations. Next, we measured VDAC in a separate task by presenting these stimuli in the absence of reward contingency and probing their effects on the processing of separate target stimuli presented at different time lags. Using time-resolved multivariate pattern analysis, we found that learned value modulated the spatial selection of previously rewarded stimuli in posterior visual and parietal cortex from ∼260 ms after stimulus onset. This value modulation was related to the strength of participants' behavioral VDAC effect and persisted into subsequent target processing. Importantly, learned value did not influence cortical signatures of early processing (i.e., earlier than ∼200 ms); nor did it influence the decodability of stimulus identity. Our results suggest that VDAC is underpinned by learned value signals that modulate spatial selection throughout posterior visual and parietal cortex. We further suggest that VDAC can occur in the absence of changes in early visual processing in cortex.SIGNIFICANCE STATEMENT Attention is our ability to focus on relevant information at the expense of irrelevant information. It can be affected by previously learned but currently irrelevant stimulus-reward associations, a phenomenon termed "value-driven attentional capture" (VDAC). The neural mechanisms underlying VDAC remain unclear. It has been speculated that reward learning induces visual cortical plasticity, which modulates early visual processing to capture attention. Although we find that learned value modulates spatial signals in visual cortical areas, an effect that correlates with VDAC, we find no relevant signatures of changes in early visual processing in cortex.

An event-related potential study of consumers' responses to food bundles

We conducted two event-related potentials (ERP) experiments to investigate consumers' responses to different types of food bundles. In Experiment 1, the participants were instructed to indicate their wanting of a three-yogurt bundle when their neural activity was recorded. The results of self-report wanting scores revealed that the participants wanted bundles consisting of their favorite yogurt products more than those of disliked products. Such a difference in self-report scores was also indexed by the N2 in frontal brain and the P1 in the left hemisphere. By contrast, bundles consisting of three different yogurt products elicited a smaller amplitude of the N2 than bundles consisting of two favorite products and one disliked product, but these two types of bundles received comparable wanting scores. Moreover, we asked the participants in Experiment 2 to perform a visual discrimination task on these bundles, and did not found these effects on the N2 or the P1. Collectively, these results revealed neural activities underlying consumers' responses to food rewards, and demonstrated the role of individuals' variety-seeking tendency in wanting process.

Learned prioritization yields attentional biases through selection history

While numerous studies have provided evidence for selection history as a robust influence on attentional allocation, it is unclear precisely which behavioral factors can result in this form of attentional bias. In the current study, we focus on “learned prioritization” as an underlying mechanism of selection history and its effects on selective attention. We conducted two experiments, each starting with a training phase to ensure that participants learned different stimulus priorities. This was accomplished via a visual search task in which a specific color was consistently more relevant when presented together with another given color. In Experiment 1, one color was always prioritized over another color and inferior to a third color, such that each color had an equal overall priority by the end of the training session. In Experiment 2, the three different colors had unequal priorities at the end of the training session. A subsequent testing phase in which participants had to search for a shape-defined target showed that only stimuli with unequal overall priorities (Experiment 2) affected attentional selection, with increased reaction times when a distractor was presented in a previously high-priority compared with a low-priority color. These results demonstrate that adopting an attentional set where certain stimuli are prioritized over others can result in a lingering attentional bias and further suggest that selection history does not equally operate on all previously selected stimuli. Finally, we propose that findings in value-driven attention studies where high-value and low-value signaling stimuli differentially capture attention may be a result of learned prioritization rather than reward.

Premembering Experience: A Hierarchy of Time-Scales for Proactive Attention

Memories are about the past, but they serve the future. Memory research often emphasizes the former aspect: focusing on the functions that re-constitute (re-member) experience and elucidating the various types of memories and their interrelations, timescales, and neural bases. Here we highlight the prospective nature of memory in guiding selective attention, focusing on functions that use previous experience to anticipate the relevant events about to unfold-to "premember" experience. Memories of various types and timescales play a fundamental role in guiding perception and performance adaptively, proactively, and dynamically. Consonant with this perspective, memories are often recorded according to expected future demands. Using working memory as an example, we consider how mnemonic content is selected and represented for future use. This perspective moves away from the traditional representational account of memory toward a functional account in which forward-looking memory traces are informationally and computationally tuned for interacting with incoming sensory signals to guide adaptive behavior.

Value-driven attentional capture enhances distractor representations in early visual cortex

When a behaviorally relevant stimulus has been previously associated with reward, behavioral responses are faster and more accurate compared to equally relevant but less valuable stimuli. Conversely, task-irrelevant stimuli that were previously associated with a high reward can capture attention and distract processing away from relevant stimuli (e.g., seeing a chocolate bar in the pantry when you are looking for a nice, healthy apple). Although increasing the value of task-relevant stimuli systematically up-regulates neural responses in early visual cortex to facilitate information processing, it is not clear whether the value of task-irrelevant distractors influences behavior via competition in early visual cortex or via competition at later stages of decision-making and response selection. Here, we measured functional magnetic resonance imaging (fMRI) in human visual cortex while subjects performed a value-based learning task, and we applied a multivariate inverted encoding model (IEM) to assess the fidelity of distractor representations in early visual cortex. We found that the fidelity of neural representations related to task-irrelevant distractors increased when the distractors were previously associated with a high reward. This finding suggests that value-driven attentional capture begins with sensory modulations of distractor representations in early areas of visual cortex.

Electrophysiological indexes of option characteristic processing

Decision making is vital to human behavior and can be divided into multiple stages including option assessment, behavioral output, and feedback evaluation. Studying how people evaluate option characteristics in the option assessment stage would provide important knowledge on human decision making. Using the event-related potential (ERP) method, the present study investigated the neural mechanism of evaluating two types of option characteristics (i.e., reward magnitude and degree of uncertainty) in the temporal dimension. Thirty-five volunteers participated in a monetary gambling task, where they either accepted or rejected gambles. The ERP results showed a double dissociation pattern, with the early P1 component being sensitive to magnitude but insensitive to degree of uncertainty, while both the N2 and P3 components showed the opposite pattern. The results suggest that these two fundamental option features are assessed rapidly and separately in the human brain. Specifically, small magnitude elicited a larger P1 than did large magnitude, indicating that the perceptual and attentional processing of options is modulated by magnitude. Both the N2 and P3 amplitudes evoked by the risky context were larger than those evoked by the ambiguous one, reflecting that more cognitive conflicts and resources are involved in the former condition. Furthermore, the P1, but not the N2 or P3, amplitude was sensitive to decisions, suggesting that early attentional processes may contribute to human decision making. These findings may provide insight into the temporal mechanisms of option characteristic processing.

On the relationship between value-driven and stimulus-driven attentional capture

Reward history, physical salience, and task relevance all influence the degree to which a stimulus competes for attention, reflecting value-driven, stimulus-driven, and goal-contingent attentional capture, respectively. Theories of value-driven attention have likened reward cues to physically salient stimuli, positing that reward cues are preferentially processed in early visual areas as a result of value-modulated plasticity in the visual system. Such theories predict a strong coupling between value-driven and stimulus-driven attentional capture across individuals. In the present study, we directly test this hypothesis, and demonstrate a robust correlation between value-driven and stimulus-driven attentional capture. Our findings suggest substantive overlap in the mechanisms of competition underlying the attentional priority of reward cues and physically salient stimuli.

Value-driven attentional capture is modulated by the contents of working memory: An EEG study

Attention and working memory (WM) have previously been shown to interact closely when sensory information is being maintained. However, when non-sensory information is maintained in WM, the relationship between WM and sensory attention may be less strong. In the current study, we used electroencephalography to evaluate whether value-driven attentional capture (i.e., allocation of attention to a task-irrelevant feature previously associated with a reward) and its effects on either sensory or non-sensory WM performance might be greater than the effects of salient, non-reward-associated stimuli. In a training phase, 19 participants learned to associate a color with reward. Then, participants were presented with squares and encoded their locations into WM. Participants were instructed to convert the spatial locations either to another type of sensory representation or to an abstract, relational type of representation. During the WM delay period, task-irrelevant distractors, either previously-rewarded or non-rewarded, were presented, with a novel color distractor in the other hemifield. The results revealed lower alpha power and larger N2pc amplitude over posterior electrode sides contralateral to the previously rewarded color, compared to ipsilateral. These effects were mainly found during relational WM, compared to sensory WM, and only for the previously rewarded distractor color, compared to a previous non-rewarded target color or novel color. These effects were associated with modulations of WM performance. These results appear to reflect less capture of attention during maintenance of specific location information, and suggest that value-driven attentional capture can be mitigated as a function of the type of information maintained in WM.

Reward and emotion influence attentional bias in rapid serial visual presentation

Facial emotion constitutes an important source of information, and rapid processing of this information may bring adaptive advantages. Previous evidence suggests that emotional faces are sometimes prioritised for cognitive processing. Three experiments used an emotion-induced blindness task to examine whether this prioritisation occurs in a purely stimulus-driven fashion or whether it emerges only when the faces are task-relevant. Angry or neutral faces appeared as distractors in a rapid serial visual presentation sequence, shortly before a target that participants were required to identify. Either the emotion (Experiment 1) or gender (Experiments 2 and 3) of the distractor face indicated whether a correct/incorrect response to the target would produce reward/punishment, or not. The three experiments found that reward-related faces impaired subsequent target identification, replicating previous results. Target identification accuracy was also impaired following angry faces, compared with neutral faces, demonstrating an emotion-induced attentional bias. Importantly, this impairment was observed even when face emotion was entirely irrelevant to the participants' ongoing task (in Experiments 2 and 3), suggesting that rapid processing of the facial emotion might arise (at least in part) from the operation of relatively automatic cognitive-perceptual processes.

Punishment-related memory-guided attention: Neural dynamics of perceptual modulation

Remembering the outcomes of past experiences allows us to generate future expectations and shape selection in the long-term. A growing number of studies has shown that learned positive reward values impact spatial memory-based attentional biases on perception. However, whether memory-driven attentional biases extend to punishment-related values has received comparatively less attention. Here, we manipulated whether recent spatial contextual memories became associated with successful avoidance of punishment (potential monetary loss). Behavioral and electrophysiological measures were collected from 27 participants during a subsequent memory-based attention task, in which we tested for the effect of punishment avoidance associations. Punishment avoidance significantly amplified effects of spatial contextual memories on visual search processes within natural scenes. Compared to non-associated scenes, contextual memories paired with punishment avoidance lead to faster responses to targets presented at remembered locations. Event-related potentials elicited by target stimuli revealed that acquired motivational value of specific spatial locations, by virtue of their association with past avoidance of punishment, dynamically affected neural signatures of early visual processing (indexed by larger P1 and earlier N1 potentials) and target selection (as indicated by reduced N2pc potentials). The present results extend our understanding of how memory, attention, and punishment-related mechanisms interact to optimize perceptual decision in real world environments.

Neural correlates of attentional capture by stimuli previously associated with social reward

Our attention is strongly influenced by reward learning. Stimuli previously associated with monetary reward have been shown to automatically capture attention in both behavioral and neurophysiological studies. Stimuli previously associated with positive social feedback similarly capture attention; however, it is unknown whether such social facilitation of attention relies on similar or dissociable neural systems. Here, we used the value-driven attentional capture paradigm in an fMRI study to identify the neural correlates of attention to stimuli previously associated with social reward. The results reveal learning-dependent priority signals in the contralateral visual cortex, posterior parietal cortex, and caudate tail, similar to studies using monetary reward. An additional priority signal was consistently evident in the right middle frontal gyrus (MFG). Our findings support the notion of a common neural mechanism for directing attention on the basis of selection history that generalizes across different types of reward.

Do Reward-Related Distractors Impair Cognitive Performance? Perhaps Not

Over a hundred prior studies show that reward-related distractors capture attention. It is less clear, however, whether and when reward-related distractors affect performance on tasks that require cognitive control. In this experiment, we examined whether reward-related distractors impair performance during a demanding arithmetic task. Participants (N = 81) solved math problems, while they were exposed to task-irrelevant stimuli that were previously associated with monetary rewards (vs. not). Although we found some evidence for reward learning in the training phase, results from the test phase showed no evidence that reward-related distractors harm cognitive performance. This null effect was invariant across different versions of our task. We examined the results further with Bayesian analyses, which showed positive evidence for the null. Altogether, the present study showed that reward-related distractors did not harm performance on a mental arithmetic task. When considered together with previous studies, the present study suggests that the negative impact of reward-related distractors on cognitive control is not as straightforward as it may seem, and that more research is needed to clarify the circumstances under which reward-related distractors harm cognitive control.

Dissociating Reward- and Attention-driven Biasing of Global Feature-based Selection in Human Visual Cortex

Objects that promise rewards are prioritized for visual selection. The way this prioritization shapes sensory processing in visual cortex, however, is debated. It has been suggested that rewards motivate stronger attentional focusing, resulting in a modulation of sensory selection in early visual cortex. An open question is whether those reward-driven modulations would be independent of similar modulations indexing the selection of attended features that are not associated with reward. Here, we use magnetoencephalography in human observers to investigate whether the modulations indexing global color-based selection in visual cortex are separable for target- and (monetary) reward-defining colors. To assess the underlying global color-based activity modulation, we compare the event-related magnetic field response elicited by a color probe in the unattended hemifield drawn either in the target color, the reward color, both colors, or a neutral task-irrelevant color. To test whether target and reward relevance trigger separable modulations, we manipulate attention demands on target selection while keeping reward-defining experimental parameters constant. Replicating previous observations, we find that reward and target relevance produce almost indistinguishable gain modulations in ventral extratriate cortex contralateral to the unattended color probe. Importantly, increasing attention demands on target discrimination increases the response to the target-defining color, whereas the response to the rewarded color remains largely unchanged. These observations indicate that, although task relevance and reward influence the very same feature-selective area in extrastriate visual cortex, the associated modulations are largely independent.

Covert attention beyond the range of eye-movements: Evidence for a dissociation between exogenous and endogenous orienting

The relationship between covert shift of attention and the oculomotor system has been the subject of numerous studies. A widely held view, known as Premotor Theory, is that covert attention depends upon activation of the oculomotor system. However, recent work has argued that Premotor Theory is only true for covert, exogenous orienting of attention and that covert endogenous orienting is largely independent of the oculomotor system. To address this issue we examined how endogenous and exogenous covert orienting of attention was affected when stimuli were presented at a location outside the range of saccadic eye movements. Results from Experiment 1 showed that exogenous covert orienting was abolished when stimuli were presented beyond the range of saccadic eye movements, but preserved when stimuli were presented within this range. In contrast, in Experiment 2 endogenous covert orienting was preserved when stimuli appeared beyond the saccadic range. Finally, Experiment 3 confirmed the observations of Exp.1 and 2. Our results demonstrate that exogenous, covert orienting is limited to the range of overt saccadic eye movements, whereas covert endogenous orienting is not. These results are consistent with a weak, exogenous-only version of Premotor Theory.

Neurobiology of value-driven attention

What we pay attention to is influenced by reward learning. Converging evidence points to the idea that associative reward learning changes how visual stimuli are processed in the brain, rendering learned reward cues difficult to ignore. Behavioral evidence distinguishes value-driven attention from other established control mechanisms, suggesting a distinct underlying neurobiological process. Recently, studies have begun to explore the neural substrates of this value-driven attention mechanism. Here, I review the progress that has been made in this area, and synthesize the findings to provide an integrative account of the neurobiology of value-driven attention. The proposed account can explain both attentional capture by previously rewarded targets and the modulatory effect of reward on priming, as well as the decoupling of reward history and prior task relevance in value-driven attention.

Cross-modal integration during value-driven attentional capture

A growing body of evidence suggests that reward may be a powerful determinant of attentional selection. To date, the study of value-based attentional capture has been mainly focused on the visual sensory modality. It is yet unknown how reward information is communicated and integrated across the different senses in order to resolve between competing choices during selective attention. Our study investigated the interference produced by an auditory reward-associated distractor when a semantically-related visual target was concurrently presented. We measured both manual and saccadic response times towards a target image (drum or trumpet), while an irrelevant sound (congruent or incongruent instrument) was heard. Each sound was previously associated with either a high or a low reward. We found that manual responses were slowed by a high-reward auditory distractor when sound and image were semantically congruent. A similar effect was observed for saccadic responses, but only for participants aware of the past reward contingencies. Auditory events associated with reward value were thus capable of involuntarily capturing attention in the visual modality. This reward effect can mitigate cross-modal semantic integration and appears to be differentially modulated by awareness for saccadic vs. manual responses. Together, our results extend previous work on value-driven attentional biases in perception by showing that these may operate across sensory modalities and override cross-modal integration for semantically-related stimuli. This study sheds new light on the potential implication of brain regions underlying value-driven attention across sensory modalities.

Reward-associated distractors can harm cognitive performance

When people carry out cognitive tasks, they sometimes suffer from distractions, that is, drops in performance that occur close in time to task-irrelevant stimuli. In this research, we examine how the pursuit of rewards contributes to distractions. In two experiments, participants performed a math task (in which they could earn monetary rewards vs. not) while they were exposed to task-irrelevant stimuli (that were previously associated with monetary rewards vs. not). In Experiment 1, irrelevant cues that were previously associated with rewards (vs. not) impaired performance. In Experiment 2, this effect was only replicated when these reward-associated distractors appeared relatively early during task performance. While the results were thus somewhat mixed, they generally support the idea that reward associations can augment the negative effect of distractors on performance.

Test-retest reliability of value-driven attentional capture

Attention is biased toward learned predictors of reward. The degree to which attention is automatically drawn to arbitrary reward cues has been linked to a variety of psychopathologies, including drug dependence, HIV-risk behaviors, depressive symptoms, and attention deficit/hyperactivity disorder. In the context of addiction specifically, attentional biases toward drug cues have been related to drug craving and treatment outcomes. Given the potential role of value-based attention in psychopathology, the ability to quantify the magnitude of such bias before and after a treatment intervention in order to assess treatment-related changes in attention allocation would be desirable. However, the test-retest reliability of value-driven attentional capture by arbitrary reward cues has not been established. In the present study, we show that an oculomotor measure of value-driven attentional capture produces highly robust test-retest reliability for a behavioral assessment, whereas the response time (RT) measure more commonly used in the attentional bias literature does not. Our findings provide methodological support for the ability to obtain a reliable measure of susceptibility to value-driven attentional capture at multiple points in time, and they highlight a limitation of RT-based measures that should inform the use of attentional-bias tasks as an assessment tool.

Selection history: How reward modulates selectivity of visual attention

Visual attention enables us to selectively prioritize or suppress information in the environment. Prominent models concerned with the control of visual attention differentiate between goal-directed, top-down and stimulus-driven, bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. In the current review, we discuss recent studies that demonstrate that attentional selection does not need to be the result of top-down or bottom-up processing but, instead, is often driven by lingering biases due to the "history" of former attention deployments. This review mainly focuses on reward-based history effects; yet other types of history effects such as (intertrial) priming, statistical learning and affective conditioning are also discussed. We argue that evidence from behavioral, eye-movement and neuroimaging studies supports the idea that selection history modulates the topographical landscape of spatial "priority" maps, such that attention is biased toward locations having the highest activation on this map.

Dissociable signatures of visual salience and behavioral relevance across attentional priority maps in human cortex

Computational models posit that visual attention is guided by activity within spatial maps that index the image-computable salience and the behavioral relevance of objects in the scene. These spatial maps are theorized to be instantiated as activation patterns across a series of retinotopic visual regions in occipital, parietal, and frontal cortex. Whereas previous research has identified sensitivity to either the behavioral relevance or the image-computable salience of different scene elements, the simultaneous influence of these factors on neural "attentional priority maps" in human cortex is not well understood. We tested the hypothesis that visual salience and behavioral relevance independently impact the activation profile across retinotopically organized cortical regions by quantifying attentional priority maps measured in human brains using functional MRI while participants attended one of two differentially salient stimuli. We found that the topography of activation in priority maps, as reflected in the modulation of region-level patterns of population activity, independently indexed the physical salience and behavioral relevance of each scene element. Moreover, salience strongly impacted activation patterns in early visual areas, whereas later visual areas were dominated by relevance. This suggests that prioritizing spatial locations relies on distributed neural codes containing graded representations of salience and relevance across the visual hierarchy. NEW & NOTEWORTHY We tested a theory which supposes that neural systems represent scene elements according to both their salience and their relevance in a series of "priority maps" by measuring functional MRI activation patterns across human brains and reconstructing spatial maps of the visual scene. We found that different regions indexed either the salience or the relevance of scene items, but not their interaction, suggesting an evolving representation of salience and relevance across different visual areas.

Irrelevant learned reward associations disrupt voluntary spatial attention

Attention can be guided involuntarily by physical salience and by non-salient, previously learned reward associations that are currently task-irrelevant. Attention can be guided voluntarily by current goals and expectations. The current study examined, in two experiments, whether irrelevant reward associations could disrupt current, goal-driven, voluntary attention. In a letter-search task, attention was directed voluntarily (i.e., cued) on half the trials by a cue stimulus indicating the hemifield in which the target letter would appear with 100 % accuracy. On the other half of the trials, a cue stimulus was presented, but it did not provide information about the target hemifield (i.e., uncued). On both cued and uncued trials, attention could be involuntarily captured by the presence of a task-irrelevant, and physically non-salient, color, either within the cued or the uncued hemifield. Importantly, one week prior to the letter search task, the irrelevant color had served as a target feature that was predictive of reward in a separate training task. Target identification accuracy was better on cued compared to uncued trials. However, this effect was reduced when the irrelevant, and physically non-salient, reward-associated feature was present in the uncued hemifield. This effect was not observed in a second, control experiment in which the irrelevant color was not predictive of reward during training. Our results indicate that involuntary, value-driven capture can disrupt the voluntary control of spatial attention.

Funny money: the attentional role of monetary feedback detached from expected value

Stimuli associated with monetary reward can become powerful cues that effectively capture visual attention. We examined whether such value-driven attentional capture can be induced with monetary feedback in the absence of an expected cash payout. To this end, we implemented images of U.S. dollar bills as reward feedback. Participants knew in advance that they would not receive any money based on their performance. Our reward stimuli-$5 and $20 bill images-were thus dissociated from any practical utility. Strikingly, we observed a reliable attentional capture effect for the mere images of bills. Moreover, this finding generalized to Monopoly money. In two control experiments, we found no evidence in favor of nominal or symbolic monetary value. Hence, we claim that bill images are special monetary representations, such that there are strong associations between the defining visual features of bills and reward, probably due to a lifelong learning history. Together, we show that the motivation to earn cash plays a minor role when it comes to monetary rewards, while bill-defining visual features seem to be sufficient. These findings have the potential to influence human factor applications, such as gamification, and can be extended to novel value systems, such as the electronic cash Bitcoin being developed for use in mobile banking. Finally, our procedure represents a proof of concept on how images of money can be used to conserve expenditures in the experimental context.

Independent effects of motivation and spatial attention in the human visual cortex

Motivation and attention constitute major determinants of human perception and action. Nonetheless, it remains a matter of debate whether motivation effects on the visual cortex depend on the spatial attention system, or rely on independent pathways. This study investigated the impact of motivation and spatial attention on the activity of the human primary and extrastriate visual cortex by employing a factorial manipulation of the two factors in a cued pattern discrimination task. During stimulus presentation, we recorded event-related potentials and pupillary responses. Motivational relevance increased the amplitudes of the C1 component at ∼70 ms after stimulus onset. This modulation occurred independently of spatial attention effects, which were evident at the P1 level. Furthermore, motivation and spatial attention had independent effects on preparatory activation as measured by the contingent negative variation; and pupil data showed increased activation in response to incentive targets. Taken together, these findings suggest independent pathways for the influence of motivation and spatial attention on the activity of the human visual cortex.

Learned value and object perception: Accelerated perception or biased decisions?

Learned value is known to bias visual search toward valued stimuli. However, some uncertainty exists regarding the stage of visual processing that is modulated by learned value. Here, we directly tested the effect of learned value on preattentive processing using temporal order judgments. Across four experiments, we imbued some stimuli with high value and some with low value, using a nonmonetary reward task. In Experiment 1, we replicated the value-driven distraction effect, validating our nonmonetary reward task. Experiment 2 showed that high-value stimuli, but not low-value stimuli, exhibit a prior-entry effect. Experiment 3, which reversed the temporal order judgment task (i.e., reporting which stimulus came second), showed no prior-entry effect, indicating that although a response bias may be present for high-value stimuli, they are still reported as appearing earlier. However, Experiment 4, using a simultaneity judgment task, showed no shift in temporal perception. Overall, our results support the conclusion that learned value biases perceptual decisions about valued stimuli without speeding preattentive stimulus processing.

Mixed signals: The effect of conflicting reward- and goal-driven biases on selective attention

Attentional selection depends on the interaction between exogenous (stimulus-driven), endogenous (goal-driven), and selection history (experience-driven) factors. While endogenous and exogenous biases have been widely investigated, less is known about their interplay with value-driven attention. The present study investigated the interaction between reward-history and goal-driven biases on perceptual sensitivity (d') and response time (RT) in a modified cueing paradigm presenting two coloured cues, followed by sinusoidal gratings. Participants responded to the orientation of one of these gratings. In Experiment 1, one cue signalled reward availability but was otherwise task irrelevant. In Experiment 2, the same cue signalled reward, and indicated the target's most likely location at the opposite side of the display. This design introduced a conflict between reward-driven biases attracting attention and goal-driven biases directing it away. Attentional effects were examined comparing trials in which cue and target appeared at the same versus opposite locations. Two interstimulus interval (ISI) levels were used to probe the time course of attentional effects. Experiment 1 showed performance benefits at the location of the reward-signalling cue and costs at the opposite for both ISIs, indicating value-driven capture. Experiment 2 showed performance benefits only for the long ISI when the target was at the opposite to the reward-associated cue. At the short ISI, only performance costs were observed. These results reveal the time course of these biases, indicating that reward-driven effects influence attention early but can be overcome later by goal-driven control. This suggests that reward-driven biases are integrated as attentional priorities, just as exogenous and endogenous factors.

Linking dopaminergic reward signals to the development of attentional bias: A positron emission tomographic study

The attention system is shaped by reward history, such that learned reward cues involuntarily draw attention. Recent research has begun to uncover the neural mechanisms by which learned reward cues compete for attention, implicating dopamine (DA) signaling within the dorsal striatum. How these elevated priority signals develop in the brain during the course of learning is less well understood, as is the relationship between value-based attention and the experience of reward during learning. We hypothesized that the magnitude of the striatal DA response to reward during learning contributes to the development of a learned attentional bias towards the cue that predicted it, and examined this hypothesis using positron emission tomography with [¹¹C]raclopride. We measured changes in dopamine release for rewarded versus unrewarded visual search for color-defined targets as indicated by the density and distribution of the available D₂/D₃ receptors. We then tested for correlations of individual differences in this measure of reward-related DA release to individual differences in the degree to which previously reward-associated but currently task-irrelevant stimuli impair performance in an attention task (i.e., value-driven attentional bias), revealing a significant relationship in the right anterior caudate. The degree to which reward-related DA release was right hemisphere lateralized was also predictive of later attentional bias. Our findings provide support for the hypothesis that value-driven attentional bias can be predicted from reward-related DA release during learning.

On the feature specificity of value-driven attention

When an otherwise inconspicuous stimulus is learned to predict a reward, this stimulus will automatically capture visual attention. This learned attentional bias is not specific to the precise object previously associated with reward, but can be observed for different stimuli that share a defining feature with the reward cue. Under certain circumstances, value-driven attentional biases can even transfer to new contexts in which the reward cues were not previously experienced, and can also be evident for different exemplars of a stimulus category, suggesting some degree of tolerance in the scope of the underlying bias. Whether a match to a reward-predictive feature is necessary to support value-driven attention, or whether similar-looking features also receive some degree of elevated priority following associative reward learning, remains an open question. Here, I examine the impact of learned associations between reward and red- and green-colored stimuli on the processing of other colors. The findings show that even though other colors experienced during training were non-predictive with respect to reward, the speed with which targets possessing these colors were identified in a subsequent test phase was affected by their similarity to the high-value color. Thus, value-driven attentional biases for stimulus features are imprecise, as would be predicted by a sensory gain model of value-driven attention.