Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing

On the reliability of value-modulated attentional capture: An online replication and multiverse analysis

Stimuli predicting rewards are more likely to capture attention, even when they are not relevant to our current goals. Individual differences in value-modulated attentional capture (VMAC) have been associated with various psychopathological conditions in the scientific literature. However, the claim that this attentional bias can predict individual differences requires further exploration of the psychometric properties of the most common experimental paradigms. The current study replicated the VMAC effect in a large online sample (N = 182) and investigated the internal consistency, with a design that allowed us to measure the effect during learning (rewarded phase) and after acquisition, once feedback was omitted (unrewarded phase). Through the rewarded phase there was gradual increase of the VMAC effect, which did not decline significantly throughout the unrewarded phase. Furthermore, we conducted a reliability multiverse analysis for 288 different data preprocessing specifications across both phases. Specifications including more blocks in the analysis led to better reliability estimates in both phases, while specifications that removed more outliers also improved reliability, suggesting that specifications with more, but less noisy, trials led to better reliability estimates. Nevertheless, in most instances, especially those considering fewer blocks of trials, reliability estimates fell below the minimum recommended thresholds for research on individual differences. Given the present results, we encourage researchers working on VMAC to take into account reliability when designing studies aimed at capturing individual differences and provide recommendations to improve methodological practices.

An examination of the motivation to manage distraction

Individuals exhibit limited awareness of when their attention is captured by salient but irrelevant stimuli, and it has long been argued that involuntary attentional capture by such stimuli is minimally disruptive to information processing. Yet, robust mechanisms of distractor suppression are hypothesized to support the control of attention, which presumably serve in the interest of managing distraction. In the present study, I examine whether participants are aware of the cost of distraction with respect to task performance, and whether they are motivated to manage this cost even when it is effortful to do so. Across three experiments, participants were willing to exert physical effort in order to reduce the frequency with which they encountered physically salient distractors, and in a fourth experiment tended to prefer trials with fewer distractors when given a choice over distractor frequency. Importantly, the amount of physical effort exerted varied as a function of the degree to which task-irrelevant distractors impaired search performance, suggesting that people are sensitive to the cost of distraction.

Observational learning of threat-related attentional bias

Attentional bias to threat has been almost exclusively examined after participants experienced repeated pairings between a conditioned stimulus (CS) and an aversive unconditioned stimulus (US). This study aimed to determine whether threat-related attentional capture can result from observational learning, when participants acquire knowledge of the aversive qualities of a stimulus without themselves experiencing aversive outcomes. Non-clinical young-adult participants (N = 38) first watched a video of an individual (the demonstrator) performing a Pavlovian conditioning task in which one colour was paired with shock (CS+) and another colour was neutral (CS-). They then carried out visual search for a shape-defined target. Oculomotor measures evidenced an attentional bias toward the CS+ colour, suggesting that threat-related attentional capture can ensue from observational learning. Exploratory analyses also revealed that this effect was positively correlated with empathy for the demonstrator. Our findings extend empirical and theoretical knowledge about threat-driven attention and provide valuable insights to better understand the formation of anxiety disorders.

Attentional Bias, Pupillometry, and Spontaneous Blink Rate: Eye Characteristic Assessment Within a Translatable Nicotine Cue Virtual Reality Paradigm

Background

Incentive salience processes are important for the development and maintenance of addiction. Eye characteristics such as gaze fixation time, pupil diameter, and spontaneous eyeblink rate (EBR) are theorized to reflect incentive salience and may serve as useful biomarkers. However, conventional cue exposure paradigms have limitations that may impede accurate assessment of these markers.

Objective

This study sought to evaluate the validity of these eye-tracking metrics as indicators of incentive salience within a virtual reality (VR) environment replicating real-world situations of nicotine and tobacco product (NTP) use.

Methods

NTP users from the community were recruited and grouped by NTP use patterns: nondaily (n=33) and daily (n=75) use. Participants underwent the NTP cue VR paradigm and completed measures of nicotine craving, NTP use history, and VR-related assessments. Eye-gaze fixation time (attentional bias) and pupillometry in response to NTP versus control cues and EBR during the active and neutral VR scenes were recorded and analyzed using ANOVA and analysis of covariance models.

Results

Greater subjective craving, as measured by the Tobacco Craving Questionnaire-Short Form, following active versus neutral scenes was observed (F1,106=47.95; P<.001). Greater mean eye-gaze fixation time (F1,106=48.34; P<.001) and pupil diameter (F1,102=5.99; P=.02) in response to NTP versus control cues were also detected. Evidence of NTP use group effects was observed in fixation time and pupillometry analyses, as well as correlations between these metrics, NTP use history, and nicotine craving. No significant associations were observed with EBR.

Conclusions

This study provides additional evidence for attentional bias, as measured via eye-gaze fixation time, and pupillometry as useful biomarkers of incentive salience, and partially supports theories suggesting that incentive salience diminishes as nicotine dependence severity increases.

Manipulating the reliability of target-color information modulates value-driven attentional capture

Previously rewarded stimuli slow response times (RTs) during visual search, despite being physically non-salient and no longer task-relevant or rewarding. Such value-driven attentional capture (VDAC) has been measured in a training-test paradigm. In the training phase, the search target is rendered in one of two colors (one predicting high reward and the other low reward). In this study, we modified this traditional training phase to include pre-cues that signaled reliable or unreliable information about the trial-to-trial color of the training phase search target. Reliable pre-cues indicated the upcoming target color with certainty, whereas unreliable pre-cues indicated the target was equally likely to be one of two distinct colors. Thus reliable and unreliable pre-cues provided certain and uncertain information, respectively, about the magnitude of the upcoming reward. We then tested for VDAC in a traditional test phase. We found that unreliably pre-cued distractors slowed RTs and drew more initial eye movements during search for the test-phase target, relative to reliably pre-cued distractors, thus providing novel evidence for an influence of information reliability on attentional capture. That said, our experimental manipulation also eliminated value-dependency (i.e., slowed RTs when a high-reward-predicting distractor was present relative to a low-reward-predicting distractor) for both kinds of distractors. Taken together, these results suggest that target-color uncertainty, rather than reward magnitude, played a critical role in modulating the allocation of value-driven attention in this study.

Trichotomy revisited: A monolithic theory of attentional control

The control of attention was long held to reflect the influence of two competing mechanisms of assigning priority, one goal-directed and the other stimulus-driven. Learning-dependent influences on the control of attention that could not be attributed to either of those two established mechanisms of control gave rise to the concept of selection history and a corresponding third mechanism of attentional control. The trichotomy framework that ensued has come to dominate theories of attentional control over the past decade, replacing the historical dichotomy. In this theoretical review, I readily affirm that distinctions between the influence of goals, salience, and selection history are substantive and meaningful, and that abandoning the dichotomy between goal-directed and stimulus-driven mechanisms of control was appropriate. I do, however, question whether a theoretical trichotomy is the right answer to the problem posed by selection history. If we reframe the influence of goals and selection history as different flavors of memory-dependent modulations of attentional priority and if we characterize the influence of salience as a consequence of insufficient competition from such memory-dependent sources of priority, it is possible to account for a wide range of attention-related phenomena with only one mechanism of control. The monolithic framework for the control of attention that I propose offers several concrete advantages over a trichotomy framework, which I explore here.

Instructional learning of threat-related attentional capture is modulated by state anxiety

The present study aimed to determine whether persistent threat-related attentional capture can result from instructional learning, when participants acquire knowledge of the aversive qualities of a stimulus through verbal instruction. Fifty-four nonclinical adults first performed a visual search task in which a green or red circle was presented as a target. They were instructed that one of these two colors might be paired with an electric shock if they responded slowly or inaccurately, whereas the other color was never associated with shock. However, no shocks were actually delivered. In a subsequent test phase, in which participants were explicitly informed that shocks were no longer possible, former-target-color stimuli were presented as distractors in a visual search task for a shape-defined target. In both tasks, although participants were never exposed to the electric shock, we observed a significant correlation between threat-related attentional priority and state anxiety. Our results demonstrate that exposure to a stimulus with the belief that it could be threatening is sufficient to generate a persistent attentional bias toward that stimulus, but this effect is modulated by state anxiety. Attentional biases for fear-relevant stimuli have been implicated in anxiety disorders, and our findings demonstrate that for anxious participants, attentional biases can be entirely the product of erroneous beliefs concerning the linking between stimuli and possible outcomes. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Reliably Measuring Learning-Dependent Distractor Suppression with Eye Tracking

In the field of psychological science, behavioral performance in computer-based cognitive tasks often exhibits poor reliability. The absence of reliable measures of cognitive processes contributes to non-reproducibility in the field and impedes investigation of individual differences. Specifically in visual search paradigms, response time-based measures have shown poor test-retest reliability and internal consistency across attention capture and distractor suppression, but one study has demonstrated the potential for oculomotor measures to exhibit superior reliability. Therefore, in this study, we investigated three datasets to compare the reliability of learning-dependent distractor suppression measured via distractor fixations (oculomotor capture) and latency to fixate the target (fixation times). Our findings reveal superior split-half reliability of oculomotor capture compared to that of fixation times regardless of the critical distractor comparison, with the reliability of oculomotor capture in most cases falling within the range that is acceptable for the investigation of individual differences. We additionally find that older adults have superior oculomotor reliability compared with young adults, potentially addressing a significant limitation in the aging literature of high variability in response time measures due to slower responses. Our findings highlight the utility of measuring eye movements in the pursuit of reliable indicators of distractor processing and the need to further test and develop additional measures in other sensory domains to maximize statistical power, reliability, and reproducibility.

Generalisation of value-based attentional priority is category-specific

A large body of research suggests that previously reward-associated stimuli can capture attention. Recent evidence also suggests that value-driven attentional biases can occur for a particular category of objects. However, it is unclear how broadly these category-level attentional biases can generalise. In the present study, we examined whether value-driven attentional biases can generalise to new exemplars of a category or semantically related categories using a modified version of the value-driven attentional capture paradigm. In an initial training phase, participants searched for two categories of objects and were rewarded for correctly fixating members of one target category. In a subsequent test phase, participants searched for two new categories of objects. A new exemplar of one of the previous target categories or a member of a semantically related category could appear as a critical distractor in this phase. Participants were more likely to initially fixate the critical distractor and fixated the distractor longer when it was a new exemplar of the previously rewarded category. However, similar findings were not observed for members of semantically related categories. Together, these findings suggest that the generalisation of value-based attentional priority is category-specific.

Learned cognitive control counteracts value-driven attentional capture

Stimuli formerly associated with monetary reward capture our attention, even if this attraction is contrary to current goals (so-called value-driven attentional capture [VDAC], see Anderson (Ann N Y Acad Sci 1369:24-39, 2016), for a review). Despite the growing literature to this topic, little is known about the boundary conditions for the occurrence of VDAC. In three experiments, we investigated the role of response conflicts and spatial uncertainty regarding the target location during the training and test phase for the emergence of value-driven effects. Thus, we varied the occurrence of a response conflict, search components, and the type of task in both phases. In the training, value-driven effects were rather observed if the location of the value-associated target was not predictable and a response conflict was present. Value-driven effects also only occurred, if participants have not learned to deal with a response conflict, yet. However, the introduction of a response conflict during learning of the color-value association seemed to prevent attention to be distracted by this feature in a subsequent test. The study provides new insights not only into the boundary conditions of the learning of value associations, but also into the learning of cognitive control.

Value-driven attention and associative learning models: a computational simulation analysis

Value-driven attentional capture (VDAC) refers to a phenomenon by which stimulus features associated with greater reward value attract more attention than those associated with smaller reward value. To date, the majority of VDAC research has revealed that the relationship between reward history and attentional allocation follows associative learning rules. Accordingly, a mathematical implementation of associative learning models and multiple comparison between them can elucidate the underlying process and properties of VDAC. In this study, we implemented the Rescorla-Wagner, Mackintosh (Mac), Schumajuk-Pearce-Hall (SPH), and Esber-Haselgrove (EH) models to determine whether different models predict different outcomes when critical parameters in VDAC were adjusted. Simulation results were compared with experimental data from a series of VDAC studies by fitting two key model parameters, associative strength (V) and associability (α), using the Bayesian information criterion as a loss function. The results showed that SPH-V and EH- α outperformed other implementations of phenomena related to VDAC, such as expected value, training session, switching (or inertia), and uncertainty. Although V of models were sufficient to simulate VDAC when the expected value was the main manipulation of the experiment, α of models could predict additional aspects of VDAC, including uncertainty and resistance to extinction. In summary, associative learning models concur with the crucial aspects of behavioral data from VDAC experiments and elucidate underlying dynamics including novel predictions that need to be verified.

Graded prioritisation of targets in search: reward diminishes the low prevalence effect

In many real-life contexts, observers are required to search for targets that are rarely present (e.g. tumours in X-rays; dangerous items in airport security screenings). Despite the rarity of these items, they are of enormous importance for the health and safety of the public, yet they are easily missed during visual search. This is referred to as the prevalence effect. In the current series of experiments, we investigate whether unequal reward can modulate the prevalence effect, in a multiple target search task. Having first established the impact of prevalence (Experiment 1) and reward (Experiment 2) on how efficiently participants can find one of several targets in the current paradigm, we then combined the two forms of priority to investigate their interaction. An unequal reward distribution (where lower prevalence items are more rewarded; Experiment 3) was found to diminish the effect of prevalence, compared to an equal reward distribution (Experiment 4) as indicated by faster response times and fewer misses. These findings suggest that when combined with an unequal reward distribution, the low prevalence effect can be diminished.

Undeserved reward but not inevitable loss biases attention: Personal control moderates evaluative attentional biases in the additional-singleton paradigm

It is important for organisms to notice signals of opportunities (i.e., chances for performance-dependent reward) and dangers (i.e., performance-dependent risks of loss). Attentional biases towards opportunity and danger signals should therefore be functionally valuable. By contrast, the functional value of attentional biases towards signals of performance-independent (i.e., uncontrollable) rewards or losses is not obvious. The present study compares attentional biases towards positive and negative stimuli, depending on whether the stimuli signal performance-dependent or performance-independent reward or loss. Specifically, we induced colour-valence associations before engaging participants in an additional-singleton task that measures attentional bias. In the valence-induction phase, one colour signalled a potential reward, and another colour signalled a potential loss; importantly, in one group, rewards and losses were performance-dependent, whereas in another group, they were performance-independent (i.e., seemingly random). In the subsequent additional-singleton task, we found increased additional-singleton effects for colours associated with performance-dependent rewards and losses (i.e., opportunities and dangers). If, however, rewards and losses were performance-independent, the singleton effect was enhanced only for reward but not loss stimuli.

Stimulus salience conflicts and colludes with endogenous goals during urgent choices

Selecting where to look next depends on both the salience of objects and current goals (what we are looking for), but discerning their relative contributions over the time frame of typical visuomotor decisions (200-250 ms) has been difficult. Here we investigate this problem using an urgent choice task with which the two contributions can be dissociated and tracked moment by moment. Behavioral data from three monkeys corresponded with model-based predictions: when salience favored the target, perceptual performance evolved rapidly and steadily toward an asymptotic level; when salience favored the distracter, many rapid errors were produced and the rise in performance took more time-effects analogous to oculomotor and attentional capture. The results show that salience has a brief (∼50 ms) but inexorable impact that leads to exogenous, involuntary capture, and this can either help or hinder performance, depending on the alignment between salience and ongoing internal goals.

The persistence of value-driven attention capture is task-dependent

Visual features previously associated with reward can capture attention even when task-irrelevant, a phenomenon known as value-driven attention capture (VDAC). VDAC persists without reinforcement, unlike other forms of learning, where removing reinforcement typically leads to extinction. In five experiments, factors common to many studies were manipulated to examine their impact on VDAC and its extinction. All experiments included learning and test phases. During learning, participants completed a visual search task during which one of two target colors was associated with a reward, and the other with no reward. During test, 1 week later, participants completed another visual search task in which the reward association was not reinforced. When a rewarded feature remained task-relevant (Experiment 1), VDAC was observed. When the rewarded feature was made task-irrelevant (Experiments 2-5) there was no evidence of a VDAC effect, except when the target feature was physically salient and there was a reduction in the frequency of exposure to the reward-associated feature (Experiment 5). We failed to find evidence of VDAC in Experiments 2-4, suggesting that VDAC may depend on the demands of the task resulting in vulnerability to VDAC. When VDAC was observed, extinction was also observed. This indicates that VDAC is subject to extinction as would be expected from an effect driven by reinforcement learning.

Value-driven modulation of visual perception by visual and auditory reward cues: The role of performance-contingent delivery of reward

Perception is modulated by reward value, an effect elicited not only by stimuli that are predictive of performance-contingent delivery of reward (PC) but also by stimuli that were previously rewarded (PR). PC and PR cues may engage different mechanisms relying on goal-driven versus stimulus-driven prioritization of high value stimuli, respectively. However, these two modes of reward modulation have not been systematically compared against each other. This study employed a behavioral paradigm where participants' visual orientation discrimination was tested in the presence of task-irrelevant visual or auditory reward cues. In the first phase (PC), correct performance led to a high or low monetary reward dependent on the identity of visual or auditory cues. In the subsequent phase (PR), visual or auditory cues were not followed by reward delivery anymore. We hypothesized that PC cues have a stronger modulatory effect on visual discrimination and pupil responses compared to PR cues. We found an overall larger task-evoked pupil dilation in PC compared to PR phase. Whereas PC and PR cues both increased the accuracy of visual discrimination, value-driven acceleration of reaction times (RTs) and pupillary responses only occurred for PC cues. The modulation of pupil size by high reward PC cues was strongly correlated with the modulation of a combined measure of speed and accuracy. These results indicate that although value-driven modulation of perception can occur even when reward delivery is halted, stronger goal-driven control elicited by PC reward cues additionally results in a more efficient balance between accuracy and speed of perceptual choices.

The traces of imagination: early attention bias toward positively imagined stimuli

Positively imagined activities may capture visual attention due to an increase in positive value. Increasing attention toward activities, in turn, may prove useful for clinical interventions aiming to motivate behavioral engagement. Employing a within-subject experimental design, we examined the effect of positive imagery on attention using a visual probe task with concurrent eye tracking. Adults from the general population (N = 54) imagined performing activities involving visually presented objects in a positive (focusing on the positive emotional impact) or neutral (focusing on a neutral circumstance) manner. They then completed a visual probe task using picture stimuli depicting one object per type of imagery. Positive compared to neutral imagery increased self-reported behavioral motivation and biased the direction, but not the duration, of gaze toward objects associated with the imagined activities. An exploratory analysis showed a positive association between the direction bias and depressive symptoms. Our findings build on existing literature on positive imagery as a motivational amplifier by highlighting early attention as an underlying cognitive mechanism.

Auditory and cross-modal attentional bias toward positive natural sounds: Behavioral and ERP evidence

Recently, researchers have expanded the investigation into attentional biases toward positive stimuli; however, few studies have examined attentional biases toward positive auditory information. In three experiments, the present study employed an emotional spatial cueing task using emotional sounds as cues and auditory stimuli (Experiment 1) or visual stimuli (Experiment 2 and Experiment 3) as targets to explore whether auditory or visual spatial attention could be modulated by positive auditory cues. Experiment 3 also examined the temporal dynamics of cross-modal auditory bias toward positive natural sounds using event-related potentials (ERPs). The behavioral results of the three experiments consistently demonstrated that response times to targets were faster after positive auditory cues than they were after neutral auditory cues in the valid condition, indicating that healthy participants showed a selective auditory attentional bias (Experiment 1) and cross-modal attentional bias (Experiment 2 and Experiment 3) toward positive natural sounds. The results of Experiment 3 showed that N1 amplitudes were more negative after positive sounds than they were after neutral sounds, which further provided electrophysiological evidence that positive auditory information enhances attention at early stages in healthy adults. The results of the experiments performed in the present study suggest that humans exhibit an attentional bias toward positive natural sounds.

Spatial task relevance modulates value-driven attentional capture

Attention tends to be attracted to visual features previously associated with reward. To date, nearly all existing studies examined value-associated stimuli at or near potential target locations, making such locations meaningful to inspect. The present experiments examined whether the attentional priority of a value-associated stimulus depends on its location-wise task relevance. In three experiments we used an RSVP task to compare the attentional demands of a value-associated peripheral distractor to that of a distractor associated with the top-down search goal. At a peripheral location that could never contain the target, a value-associated color did not capture attention. In contrast, at the same location, a distractor in a goal-matching color did capture attention. The results show that value-associated stimuli lose their attentional priority at task-irrelevant locations, in contrast to other types of stimuli that capture attention.

Value-driven effects on perceptual averaging

Perceptual averaging refers to a strategy of encoding the statistical properties of entire sets of objects rather than encoding individual object properties, potentially circumventing the visual system's strict capacity limitations. Prior work has shown that such average representations of set properties, such as its mean size, can be modulated by top-down and bottom-up attention. However, it is unclear to what extent attentional biases through selection history, in the form of value-driven attentional capture, influences this type of summary statistical representation. To investigate, we conducted two experiments in which participants estimated the mean size of a set of heterogeneously sized circles while a previously rewarded color singleton was part of the set. In Experiment 1, all circles were gray, except either the smallest or the largest circle, which was presented in a color previously associated with a reward. When the largest circle in the set was associated with the highest value (as a proxy of selection history), we observed the largest biases, such that perceived mean size scaled linearly with the increasing value of the attended color singleton. In Experiment 2, we introduced a dual-task component in the form of an attentional search task to ensure that the observed bias of reward on perceptual averaging was not fully explained by focusing attention solely on the reward-signaling color singleton. Collectively, findings support the proposal that selection history, like bottom-up and top-down attention, influences perceptual averaging, and that this happens in a flexible manner proportional to the extent to which attention is captured.

Using Virtual Reality to Induce and Assess Objective Correlates of Nicotine Craving: Paradigm Development Study

BACKGROUND

Craving is a clinically important phenotype for the development and maintenance of nicotine addiction. Virtual reality (VR) paradigms are successful in eliciting cue-induced subjective craving and may even elicit stronger craving than traditional picture-cue methods. However, few studies have leveraged the advances of this technology to improve the assessment of craving.

OBJECTIVE

This report details the development of a novel, translatable VR paradigm designed to both elicit nicotine craving and assess multiple eye-related characteristics as potential objective correlates of craving.

METHODS

A VR paradigm was developed, which includes three Active scenes with nicotine and tobacco product (NTP) cues present, and three Neutral scenes devoid of NTP cues. A pilot sample (N=31) of NTP users underwent the paradigm and completed subjective measures of nicotine craving, sense of presence in the VR paradigm, and VR-related sickness. Eye-gaze fixation time ("attentional bias") and pupil diameter toward Active versus Neutral cues, as well as spontaneous blink rate during the Active and Neutral scenes, were recorded.

RESULTS

The NTP Cue VR paradigm was found to elicit a moderate sense of presence (mean Igroup Presence Questionnaire score 60.05, SD 9.66) and low VR-related sickness (mean Virtual Reality Sickness Questionnaire score 16.25, SD 13.94). Scene-specific effects on attentional bias and pupil diameter were observed, with two of the three Active scenes eliciting greater NTP versus control cue attentional bias and pupil diameter (Cohen d=0.30-0.92). The spontaneous blink rate metrics did not differ across Active and Neutral scenes.

CONCLUSIONS

This report outlines the development of the NTP Cue VR paradigm. Our results support the potential of this paradigm as an effective laboratory-based cue-exposure task and provide early evidence of the utility of attentional bias and pupillometry, as measured during VR, as useful markers for nicotine addiction.

Reward Weakened Inhibition of Return (IOR) in the Near Depth Plane

In attentional orienting, researchers have proposed that reward history is a component of attentional control, as the reward value might enhance the spatial attention process to achieve more efficient goal-directed behavior and to improve target-detection performance. Although the effect of reward-induced motivation on attentional orienting has been studied in two-dimensional (2-D) space, the specific mechanisms underlying the influence of reward on inhibition of return (IOR) of attentional orienting in three-dimensional space (3-D) remain unclear. In the present study, by incorporating the Posner spatial-cueing paradigm into a virtual 3-D environment, we aimed to investigate the influence of reward on IOR in 3-D space. The results showed the following: (1) IOR size in the rewarded conditions was smaller than IOR size in the unrewarded condition in the near depth plane, resulting in an IOR difference with or without reward. (2) Reward weakened IOR in the near depth plane because the response to the uncued location was delayed, not because the response to the cued location was accelerated. The present study indicated that the different depth planes of the target location in 3-D space could influence the interaction between reward and IOR, and reward weakened IOR in the near depth plane.

Diminishing sensitivity and absolute difference in value-driven attention

Kim and Beck (2020b) demonstrated that value-driven attention is based on relative value rather than absolute value, suggesting that prospect theory is relevant to our understanding of value-driven attention. To further this understanding, the present study investigated the impacts of diminishing sensitivity on value-driven attention. According to diminishing sensitivity, changes in outcomes have greater impacts nearer the reference point of 0 than farther from the point. Thus, the difference between $1 and $100 looms larger than that between $901 and $1000, due to their different ratios (100/1 > 1000/901). However, according to the absolute difference hypothesis, the differences should have similar impacts due to the absolute differences being the same (100 – 1 = 1000 – 901). Experiment 1 investigated whether diminishing sensitivity operates in the modified value-driven attention paradigm while controlling the impact of absolute differences. In the training phase, 100-point and 1000-point color targets had references of 1-point and 901-point color targets, respectively. In the test phase, 100-point color distractors attracted attention more than 1000-point color distractors, supporting the diminishing sensitivity hypothesis. Experiment 2 examined the absolute difference hypothesis while controlling the impact of diminishing sensitivity. Contrary to the absolute difference hypothesis, the test phase showed that 1000-point color distractors (compared with 10-point colors for a 990 absolute difference in the training phase) failed to attract attention more than 100-point color distractors (compared with 1-point colors, for a 99 absolute difference). These results suggest that diminishing sensitivity rather than absolute difference influences value-driven attention, further supporting the relevance of prospect theory to value-driven attention.

How the value of the environment controls persistence in visual search

Classic foraging theory predicts that humans and animals aim to gain maximum reward per unit time. However, in standard instrumental conditioning tasks individuals adopt an apparently suboptimal strategy: they respond slowly when the expected value is low. This reward-related bias is often explained as reduced motivation in response to low rewards. Here we present evidence this behavior is associated with a complementary increased motivation to search the environment for alternatives. We trained monkeys to search for reward-related visual targets in environments with different values. We found that the reward-related bias scaled with environment value, was consistent with persistent searching after the target was already found, and was associated with increased exploratory gaze to objects in the environment. A novel computational model of foraging suggests that this search strategy could be adaptive in naturalistic settings where both environments and the objects within them provide partial information about hidden, uncertain rewards.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

How Does Threat Modulate the Motivational Effects of Reward on Attention?

Studies on attentional bias have overwhelmingly focused on the priority of different stimuli and have rarely manipulated the state of the observer. Recently, the threat of unpredictable shock has been utilized to experimentally induce anxiety and investigate how negative arousal modulates attentional control. Experimentally induced anxiety has been shown to reduce the attentional priority afforded to reward-related stimuli while enhancing the efficiency of goal-directed attentional control. It is unclear which of these two influences might dominate when attending to reward-related stimuli is consistent with task goals and by extension what the scope of the modulatory influence of threat on attention is. In contrast to paradigms in the visual domain, a novel auditory identification task has demonstrated a robust influence of target-value associations on selective attention. In the present study, we examined how the threat of shock modulates the influence of learned value on voluntary attention. In both threat and no-threat conditions, we replicate prior findings of voluntary prioritization of reward-associated sounds. However, unlike in studies measuring involuntary attentional capture, threat did not modulate the influence of reward on attention. Our findings highlight important limitations to when and how threat modulates the control of attention, contextualizing prior findings.

Search strategies improve with practice, but not with time pressure or financial incentives

When searching for an object, do we minimize the number of eye movements we need to make? Under most circumstances, the cost of saccadic parsimony likely outweighs the benefit, given the cost is extensive computation and the benefit is a few hundred milliseconds of time saved. Previous research has measured the proportion of eye movements directed to locations where the target would have been visible in the periphery as a way of quantifying the proportion of superfluous fixations. A surprisingly large range of individual differences has emerged from these studies, suggesting some people are highly efficient and others much less so. Our question in the current study is whether these individual differences can be explained by differences in motivation. In two experiments, we demonstrate that neither time pressure nor financial incentive led to improvements of visual search strategies; the majority of participants continued to make many superfluous fixations in both experiments. The wide range of individual differences in efficiency observed previously was replicated here. We observed small but consistent improvements in strategy over the course of the experiment (regardless of reward or time pressure) suggesting practice, not motivation, makes participants more efficient. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Performance-dependent reward hurts performance: The non-monotonic attentional load modulation on task-irrelevant distractor processing

Selective attention is essential when we face sensory inputs with distractions. In the past decades, Lavie's load theory of selective attention delineates a complete picture of distractor suppression under different attentional control load. The present study was originally designed to explore how reward modulates the load effect of attentional selection. Unexpectedly, it revealed new findings under extended attentional load that was not involved in previous work. Participants were asked to complete a rewarded attentive visual tracking task while presented with irrelevant auditory oddball stimuli, with their behavioral performance, event-related potentials and pupillary responses recorded. We found that although the behavioral performance and pupil sizes varied unidirectionally with the attentional load, the processing of distractors as reflected by the mismatch negativity (MMN) increased first and then decreased. In contrast to the prediction of Lavie's theory that attentional control fails to effectively suppress distractor processing under high attentional control load, our finding suggests that extremely high attentional control load may instead require suppression of distractor processing at a stage as early as possible. Besides, P3a, a positive-polarity response sometimes following the MMN, was not affected by the attentional load, but both N1 (a negative-polarity component peaking ~100 ms from sound onset) and P3a were weakened at higher reward, indicating that reward leads to attenuated early processing of distractor and thus suppresses the attentional orienting towards distractors. These findings altogether complement Lavie's load theory of selective attention, presenting a more complex picture of how attentional load and reward affects selective attention.

Gotcha: Working memory prioritization from automatic attentional biases

Attention is an important resource for prioritizing information in working memory (WM), and it can be deployed both strategically and automatically. Most research investigating the relationship between WM and attention has focused on strategic efforts to deploy attentional resources toward remembering relevant information. However, such voluntary attentional control represents a mere subset of the attentional processes that select information to be encoded and maintained in WM (Theeuwes, Journal of Cognition, 1[1]: 29, 1-15, 2018). Here, we discuss three ways in which information becomes prioritized automatically in WM-physical salience, statistical learning, and reward learning. This review integrates findings from perception and working memory studies to propose a more sophisticated understanding of the relationship between attention and working memory.

Punishment-modulated attentional capture is context specific

Attention prioritizes stimuli previously associated with punishment. Despite the importance of this process for survival and adaptation, the potential generalization of punishment-related attentional biases has been largely ignored in the literature. This study aimed to determine whether stimulus-punishment associations learned in a specific context bias attention in another context (in which the stimulus was never paired with punishment). We examined this issue using an antisaccade task in which participants had to shift their gaze in the opposite direction of a colored square during stimulus-outcome learning. Two contexts and three colors were employed. One color was associated with punishment (i.e., electrical shock) in one context and never paired with punishment in the other context. For a second color, the punishment-context relationship was reversed. A third color never paired with shock in either context (neutral) was included in Experiment 1 but absent in Experiment 2. Participants then performed search for a shape-defined target in an extinction phase (in which no shock was delivered) in which attentional bias for the colors was assessed. Context was manipulated via the background image upon which the stimuli were presented. In each of the two experiments, a bias to selectively orient toward the color that had been associated with punishment in the current context was observed, suggesting that punishment-modulated attentional priority is context specific.

Neural Mechanisms of Reward-by-Cueing Interactions: ERP Evidence

Inhibition of return (IOR) refers to the phenomenon that a person is slower to respond to targets at a previously cued location. The present study aimed to explore whether target-reward association is subject to IOR, using event-related potentials (ERPs) to explore the underlying neural mechanism. Each participant performed a localization task and a color discrimination task in an exogenous cueing paradigm, with the targets presented in colors (green/red) previously associated with high- or low-reward probability. The results of both tasks revealed that the N1, Nd, and P3 components exhibited differential amplitudes between cued and uncued trials (i.e., IOR) under low reward, with the N1 and Nd amplitudes being enhanced for uncued trials compared to cued trials, and the P3 amplitude being enhanced for cued trials vs. uncued trials. Under high reward, however, no difference was found between the amplitudes on cued and uncued trials for any of the components. These findings demonstrate that targets that were previously associated with high reward can be resistant to IOR and the current results enrich the evidence for interactions between reward-association and attentional orientation in the cueing paradigm.

Beyond Looking for the Rewarded Target: The Effects of Reward on Attention in Search Tasks

One puzzling result in training-test paradigms is that effects of reward-associated stimuli on attention are often seen in test but not in training. We focus on one study, where reward-related performance benefits occur in the training and which was discussed contentiously. By using a similar design, we conceptually replicated the results. Moreover, we investigated the underlying mechanisms and processes resulting in these reward-related performance benefits. In two experiments, using search tasks and having participants perform the tasks either with or without individually adjusted time pressure, we disentangled the mechanisms and processes contributing to the reward-related benefits. We found evidence that not only search efficiency is increased with increasing reward, but also that non-search factors contribute to the results. By also investigating response time distributions, we were able to show that reward-related performance effects increased as search time increased in demanding tasks but not in less demanding tasks. Theoretical implications of the results regarding how reward influences attentional processing are discussed.

Does hunger promote the detection of foods? The effect of value on inattentional blindness

Although human perception has evolved into a potent and efficient system, we still fall prey to astonishing failures of awareness as we miss an unexpected object in our direct view when our attention is engaged elsewhere (inattentional blindness). While specific types of value of the unexpected object have been identified to modulate the likelihood of this failure of awareness, it is not clear whether the effect of value on inattentional blindness can be generalized. We hypothesized that the combination of hunger and food-stimuli might increase a more general type of value so that food stimuli have a higher probability to be noticed by hungry participants than by satiated participants. In total, 240 participants were assigned towards a hungry (16 h of fasting) or satiated (no fasting) manipulation and performed afterward a static inattentional blindness task. However, we did not find any effect of value on inattentional blindness based on hunger and food stimuli. We speculate that different underlying mechanisms are involved for different types of value and that value manipulations need to be strong enough to ensure certain value strengths.

A rise in prediction error increases attention to irrelevant cues

We investigated whether a sudden rise in prediction error widens an individual's focus of attention by increasing ocular fixations on cues that otherwise tend to be ignored. To this end, we used a discrimination learning task including cues that were either relevant or irrelevant for predicting the outcomes. Half of participants experienced contingency reversal once they had learned to predict the outcomes (reversal group, n = 30). The other half experienced the same contingencies throughout the task (control group, n = 30). As participants' prediction accuracy increased, they showed a decrease in the number of fixations directed to the irrelevant cues. Following contingency reversal, participants in the reversal group showed a drop in accuracy, indicating a rise in prediction error, and fixated on the irrelevant cues more often than participants in the control group. We discuss the results in the context of attentional theories of associative learning.

Inertia in value-driven attention

Previously reward-associated stimuli persistently capture attention. We attempted to extinguish this attentional bias through a reversal learning procedure where the high-value color changed unexpectedly. Attentional priority shifted during training in favor of the currently high-value color, although a residual bias toward the original high-value color was still evident. Importantly, during a subsequent test phase, attention was initially more strongly biased toward the original high-value color, counter to the attentional priorities evident at the end of training. Our results show that value-based attentional biases do not quickly update with new learning and lag behind the reshaping of strategic attentional priorities by reward.

Selection history is relative

Visual attention can be tuned to specific features to aid in visual search. The way in which these search strategies are established and maintained is flexible, reflecting goal-directed attentional control, but can exert a persistent effect on selection that remains even when these strategies are no longer advantageous, reflecting an attentional bias driven by selection history. Apart from feature-specific search, recent studies have shown that attention can be tuned to target-nontarget relationships. Here we tested whether a relational search strategy continues to bias attention in a subsequent task, where the relationally better color and former target color both serve as distractors (Experiment 1) or as potential targets (Experiment 2). We demonstrate that a relational bias can persist in a subsequent task in which color serves as a task-irrelevant feature, both impairing and facilitating visual search performance. Our findings extend our understanding of the relational account of attentional control and the nature of selection history effects on attention.

Relating value-driven attention to psychopathology

Reward-associated objects receive preferential attention, reflecting a bias in information processing that develops automatically following associative learning. Mounting evidence suggests that such value-driven attention operates abnormally in certain psychopathologies, with attentional biases for reward-associated objects being either exaggerated or blunted compared to healthy controls. Here, I review the evidence linking value-driven attention to psychopathology, including drug addiction, depression, attention-deficit hyperactivity disorder (ADHD), compulsivity, and impulsive and risky decision-making. I conclude by offering an integrative framework for conceptualizing the link between value-driven attention and psychopathology, along with suggestions for future research into this burgeoning area of investigation, including research on object attachment.

Motivated suppression of value- and threat-modulated attentional capture

Attention prioritizes stimuli previously associated with reward or punishment. The present study examined whether this attentional bias, widely considered to be involuntary and automatic, could be suppressed with sufficient motivation. Participants performed visual search for a shape-defined target. One color-singleton distractor predicted the possibility of receiving a reward and another an electric shock, with each outcome occurring infrequently. Participants were informed that the likelihood to earn a reward or avert punishment depended on fast and accurate performance, thus providing strong motivation to resist distraction by reward- and shock-related stimuli. Results revealed a reduction in the magnitude of attentional capture by reward- and threat-associated distractors, relative to neutral distractors, that persisted into extinction. In a second experiment, we replicated the suppression of value-modulated attentional capture in the absence of the shock condition, thus confirming that the suppression did not result from the presence of threat. Finally, in a third experiment, we replicated the typical pattern of attentional capture by reward cues using a more conventional procedure in which the motivation to suppress valent stimuli was low (the likelihood to be rewarded was high and not contingent on fast performance). This study demonstrates that signals for reward and threat can be actively suppressed with sufficient motivation. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Arousal-Biased Competition Explains Reduced Distraction by Reward Cues under Threat

Anxiety is an adaptive neural state that promotes rapid responses under heightened vigilance when survival is threatened. Anxiety has consistently been found to potentiate the attentional processing of physically salient stimuli. However, a recent study demonstrated that a threat manipulation reduces attentional capture by reward-associated stimuli, suggesting a more complex relationship between anxiety and the control of attention. The mechanisms by which threat can reduce the distracting quality of stimuli are unknown. In this study, using functional magnetic resonance imaging (fMRI) on human subjects, we examined the neural correlates of attention to previously reward-associated stimuli with and without the threat of unpredictable electric shock. We replicate enhanced distractor-evoked activity throughout the value-driven attention network (VDAN) in addition to enhanced stimulus-evoked activity generally under threat. Importantly, these two factors interacted such that the representation of previously reward-associated distractors was particularly pronounced under threat. Our results from neuroimaging fit well with the principle of arousal-biased competition (ABC), although such effects are typically associated with behavioral measures of increased attention to stimuli that already possess elevated attentional priority. The findings of our study suggest that ABC can be leveraged to support more efficient ignoring of reward cues, revealing new insights into the functional significance of ABC as a mechanism of attentional control, and provide a mechanistic explanation of how threat reduces attention to irrelevant reward information.

Attention capture by episodic long-term memory

Everyday behavior depends upon the operation of concurrent cognitive processes. In visual search, studies that examine memory-attention interactions have indicated that long-term memory facilitates search for a target (e.g., contextual cueing), but the potential for memories to capture attention and decrease search efficiency has not been investigated. To address this gap in the literature, five experiments were conducted to examine whether task-irrelevant encoded objects might capture attention. In each experiment, participants encoded scene-object pairs. Then, in a visual search task, 6-object search displays were presented and participants were told to make a single saccade to targets defined by shape (e.g., diamond among differently colored circles; Experiments 1, 4, and 5) or by color (e.g., blue shape among differently shaped gray objects; Experiments 2 and 3). Sometimes, one of the distractors was from the encoded set, and occasionally the scene that had been paired with that object was presented prior to the search display. Results indicated that eye movements were made, in error, more often to encoded distractors than to baseline distractors, and that this effect was greatest when the corresponding scene was presented prior to search. When capture did occur, participants looked longer at encoded distractors if scenes had been presented, an effect that we attribute to the representational match between a retrieved associate and the identity of the encoded distractor in the search display. In addition, the presence of a scene resulted in slower saccade deployment when participants made first saccades to targets, as instructed. Experiments 4 and 5 suggest that this slowdown may be due to the relatively rare and therefore, surprising, appearance of visual stimulus information prior to search. Collectively, results suggest that information encoded into episodic memory can capture attention, which is consistent with the recent proposal that selection history can guide attentional selection.

Value-based attention capture: Differential effects of loss and gain contingencies

There is evidence that attention can be captured by a feature that is associated with reward. However, it is unclear how associating a feature with loss impacts attentional capture. Some have found evidence for attentional capture by loss-associated stimuli, suggesting that attention is biased toward stimuli predictive of consequence, regardless of the valence of that consequence. However, in those studies, efficient attention to the loss-associated stimulus reduced the magnitude of the loss during training, so attention to the loss-associated stimulus was rewarded in relative terms. In Experiment 1 we associated a color with loss, gain, or no consequence during training and then investigated whether attention is captured by each color. Importantly, our training did not reward, even in a relative sense, attention to the loss-associated color. Although we found robust attentional capture by gain-associated colors, we found no evidence for capture by loss-associated colors. A second experiment showed that the observed effects cannot be explained by selection history and, hence, are specific to value learning. These results suggest that the learning mechanisms of value-based attentional capture are driven by reward, but not by loss or the predictability of consequences in general.

Atypical Value-Driven Selective Attention in Young Children With Autism Spectrum Disorder

Importance

Enhanced selective attention toward nonsocial objects and impaired attention to social stimuli constitute key clinical features of autism spectrum disorder (ASD). Yet, the mechanisms associated with atypical selective attention in ASD are poorly understood, which limits the development of more effective interventions. In typically developing individuals, selective attention to social and nonsocial stimuli is associated with the informational value of the stimuli, which is typically learned over the course of repeated interactions with the stimuli.

Objective

To examine value learning (VL) of social and nonsocial stimuli and its association with selective attention in preschoolers with and without ASD.

Design, Setting, and Participants

This case-control study compared children with ASD vs children with developmental delay (DD) and children with typical development (TD) recruited between March 3, 2017, and June 13, 2018, at a university-based research laboratory. Participants were preschoolers with ASD, DD, or TD.

Main Outcomes and Measures

Procedure consisted of an eye-tracking gaze-contingent VL task involving social (faces) and nonsocial (fractals) stimuli and consisting of baseline, training, and choice test phases. Outcome measures were preferential attention to stimuli reinforced (high value) vs not reinforced (low value) during training. The hypotheses were stated before data collection.

Results

Included were 115 preschoolers with ASD (n = 48; mean [SD] age, 38.30 [15.55] months; 37 [77%] boys), DD (n = 31; mean [SD] age, 45.73 [19.49] months; 19 [61%] boys), or TD (n = 36; mean [SD] age, 36.53 [12.39] months; 22 [61%] boys). The groups did not differ in sex distribution; participants with ASD or TD had similar chronological age; and participants with ASD or DD had similar verbal IQ and nonverbal IQ. After training, the ASD group showed preference for the high-value nonsocial stimuli (mean proportion, 0.61 [95% CI, 0.56-0.65]; P < .001) but not for the high-value social stimuli (mean proportion, 0.51 [95% CI, 0.46-0.56]; P = .58). In contrast, the DD and TD groups demonstrated preference for the high-value social stimuli (DD mean proportion, 0.59 [95% CI, 0.54-0.64]; P = .001 and TD mean proportion, 0.57 [95% CI, 0.53-0.61]; P = .002) but not for the high-value nonsocial stimuli (DD mean proportion, 0.52 [95% CI, 0.44-0.59]; P = .64 and TD mean proportion, 0.50 [95% CI, 0.44-0.57]; P = .91). Controlling for age and nonverbal IQ, autism severity was positively correlated with enhanced learning in the nonsocial domain (r = 0.22; P = .03) and with poorer learning in the social domain (r = -0.26; P = .01).

Conclusions and Relevance

Increased attention to objects in preschoolers with ASD may be associated with enhanced VL in the nonsocial domain. When paired with poor VL in the social domain, enhanced value-driven attention to objects may play a formative role in the emergence of autism symptoms by altering attentional priorities and thus learning opportunities in affected children.

Attention for future reward

When stimuli are consistently paired with reward, attention toward these stimuli becomes biased (e.g., Abrahamse, Braem, Notebaert & Verguts, et al., Psychological Bulletin 142:693-728, 2016, https://doi.org/10.1037/bul0000047). An important premise is that participants need to repeatedly experience stimulus-reward pairings to obtain these effects (e.g., Awh, Belopolsky & Theeuwes, Trends in Cognitive Sciences 16:437-443, 2012, https://doi.org/10.1016/j.tics.2012.06.010). This idea is based on associative learning theories (e.g., Pearce & Bouton, Annual Review of Psychology 52:111-139, 2001) that suggest that exposure to stimulus-reward pairings leads to the formation of stimulus-reward associations, and a transfer of salience of the reward to the neutral stimulus. However, novel learning theories (e.g., De Houwer, Learning and Motivation 53:7-23, 2009, https://doi.org/10.1016/j.lmot.2015.11.001) suggest such effects are not necessarily the result of associative learning, but can be caused by complex knowledge and expectancies as well. In the current experiment, we first instructed participants that a correct response to one centrally presented stimulus would be followed by a high reward, whereas a correct response to another centrally presented stimulus would be paired with a low reward. Before participants executed this task, they performed a visual probe task in which these stimuli were presented as distractors. We found that attention was drawn automatically toward high-reward stimuli relative to low-reward stimuli. This implies that complex inferences and expectancies can cause automatic attentional bias, challenging associative learning models of attentional control (Abrahamse et al., 2016; Awh et al., 2012).

Novelty competes with saliency for attention

A highly debated question in attention research is to what extent attention is biased by bottom-up factors such as saliency versus top-down factors as governed by the task. Visual search experiments in which participants are briefly familiarized with the task and then see a novel stimulus unannounced and for the first time support yet another factor, showing that novel and surprising features attract attention. In the present study, we tested whether gaze behavior as an indicator for attentional prioritization can be predicted accurately within displays containing both salient and novel stimuli by means of a priority map that assumes novelty as an additional source of activation. To that aim, we conducted a visual search experiment where a color singleton was presented for the first time in the surprise trial and manipulated the color-novelty of the remaining non-singletons between participants. In one group, the singleton was the only novel stimulus ("one-new"), whereas in another group, the non-singleton stimuli were likewise novel ("all-new"). The surprise trial was always target absent and designed such that top-down prioritization of any color was unlikely. The results show that the singleton in the all-new group captured the gaze less strongly, with more early fixations being directed to the novel non-singletons. Overall, the fixation pattern can accurately be explained by noisy priority maps where saliency and novelty compete for gaze control.

Selection History-Driven Signal Suppression

The control of attention is influenced by current goals, physical salience, and selection history. Under certain conditions, physically salient stimuli can be strategically suppressed below baseline levels, facilitating visual search for a target. It is unclear whether such signal suppression is a broad mechanism of selective information processing that extends to other sources of attentional priority evoked by task-irrelevant stimuli, or whether it is particular to physically salient perceptual signals. Using eye movements, in the present study we highlight a case where a former-target-color distractor facilitates search for a target on a large percentage of trials. Our findings provide evidence that the principle of signal suppression extends to other sources of attentional priority beyond physical salience, and that selection history can be leveraged to strategically guide attention away from a stimulus.

Neural underpinnings of value-guided choice during auction tasks: An eye-fixation related potentials study

Values are attributed to goods during free viewing of objects which entails multi- and trans-saccadic cognitive processes. Using electroencephalographic eye-fixation related potentials, the present study investigated how neural signals related to value-guided choice evolved over time when viewing household and office products during an auction task. Participants completed a Becker-DeGroot-Marschak auction task whereby half of the stimuli were presented in either a free or forced bid protocol to obtain willingness-to-pay. Stimuli were assigned to three value categories of low, medium and high value based on subjective willingness-to-pay. Eye fixations were organised into five 800 ms time-bins spanning the objects total viewing time. Independent component analysis was applied to eye-fixation related potentials. One independent component (IC) was found to represent fixations for high value products with increased activation over the left parietal region of the scalp. An IC with a spatial maximum over a fronto-central region of the scalp coded the intermediate values. Finally, one IC displaying activity that extends over the right frontal scalp region responded to intermediate- and low-value items. Each of these components responded early on during viewing an object and remained active over the entire viewing period, both during free and forced bid trials. Results suggest that the subjective value of goods are encoded using sets of brain activation patterns which are tuned to respond uniquely to either low, medium, or high values. Data indicates that the right frontal region of the brain responds to low and the left frontal region to high values. Values of goods are determined at an early point in the decision making process and carried for the duration of the decision period via trans-saccadic processes.

Working Memory Load Enhances the Attentional Capture of Low Reward History

Attention priority of reward history, also called value-driven attentional capture (VDAC), is different from that of saliency or contingency. The magnitude of VDAC was found to be correlated with working memory capacity, but how cognitive control interacts with the attentional allocation of reward association is not clear. Here, we examined whether the distraction by learned color-reward association would change under different working memory load conditions. Participants were first trained with color-reward associations by searching a green/red circle with low/high reward. Then, during the test session, participants needed to search a unique shape while a green/red shape was either presented as a distractor or not shown at all. To manipulate the working memory load in the test, a digital memory task was integrated with the visual search task in half of the trials (memory load condition), but not in the other half (no-load condition). Consistent results were found in two experiments that the magnitude of attentional capture caused by low-value distractors was larger under memory load condition than under no-load condition, while there was no enough evidence supporting the influence of memory load on attentional capture by high-value distractors. These results suggested that working memory load, which occupied part of cognitive resources, reduced the priority of target information and might also modulate the strength of reward association holding in working memory. These findings extend the knowledge regarding the influence of working memory load on attentional capture of reward and suggest that reward-induced distraction is dynamic and could be modulated by cognitive control.

Reward learning biases the direction of saccades

The role of associative reward learning in guiding feature-based attention and spatial attention is well established. However, no studies have looked at the extent to which reward learning can modulate the direction of saccades during visual search. Here, we introduced a novel reward learning paradigm to examine whether reward-associated directions of eye movements can modulate performance in different visual search tasks. Participants had to fixate a peripheral target before fixating one of four disks that subsequently appeared in each cardinal position. This was followed by reward feedback contingent upon the direction chosen, where one direction consistently yielded a high reward. Thus, reward was tied to the direction of saccades rather than the absolute location of the stimulus fixated. Participants selected the target in the high-value direction on the majority of trials, demonstrating robust learning of the task contingencies. In an untimed visual foraging task that followed, which was performed in extinction, initial saccades were reliably biased in the previously rewarded-associated direction. In a second experiment, following the same training procedure, eye movements in the previously high-value direction were facilitated in a saccade-to-target task. Our findings suggest that rewarding directional eye movements biases oculomotor search patterns in a manner that is robust to extinction and generalizes across stimuli and task.

Visual fixation patterns during economic choice reflect covert valuation processes that emerge with learning

Where we direct our gaze can have a big impact on what we choose. However, where we choose to gaze during the decision process is not well-characterized, despite the important role it plays. In our study, monkeys performed a simple decision-making experiment where they were free to look around a computer screen showing choice options. They then indicated their economic choice with a joystick movement. When choice options appeared, monkeys rapidly gazed toward more valuable and novel stimuli—suggesting there is a system that orients gaze toward important information. However, despite the gaze preference for novel stimuli, subjects did not prefer to choose them. This suggests the mechanisms governing value-guided attentional capture and value-guided choice are dissociable.

Visual fixations play a vital role in decision making. Recent studies have demonstrated that the longer subjects fixate an option, the more likely they are to choose it. However, the role of evaluating stimuli covertly (i.e., without fixating them), and how covert evaluations determine where to subsequently fixate, remains relatively unexplored. Here, we trained monkeys to perform a decision-making task where they made binary choices between reward-predictive stimuli which were well-learned (“overtrained”), recently learned (“novel”), or a combination of both (“mixed”). Subjects were free to saccade around the screen and make a choice (via joystick response) at any time. Subjects rarely fixated both options, yet choice behavior was better explained by assuming the values of both stimuli governed choices. The first fixation latency was fast (∼150 ms) but, surprisingly, its direction was value-driven. This suggests covert evaluation of stimulus values prior to first saccade. This was particularly evident for overtrained stimuli. For novel stimuli, first fixations became increasingly value-driven throughout a behavioral session. However, this improvement lagged behind learning of accurate economic choices, suggesting separate processes governed their learning. Finally, mixed trials revealed a strong bias toward fixating the novel stimulus first but no bias toward choosing it. Our results suggest that the primate brain contains fast covert evaluation mechanisms for guiding fixations toward highly valuable and novel information. By employing such covert mechanisms, fixation behavior becomes dissociable from the value comparison processes that drive final choice. This implies that primates use separable decision systems for value-guided fixations and value-guided choice.

Attentional avoidance of threatening stimuli

Aversive conditioning has been shown to influence the control of attention, such that aversively conditioned stimuli receive elevated priority. Although aversively conditioned but task-irrelevant distractors are known to capture attention during speeded search in rapid orienting tasks, it is unclear whether this bias extends to situations where orienting can be more deliberate. We demonstrate that punishment, via electric shock, does not give rise to oculomotor capture by shock-associated stimuli during a foraging task; rather, such aversively conditioned stimuli are actively avoided when searching through a display. On the other hand, even during a foraging task, we found some evidence for a covert attentional bias to threat. Our findings indicate that the previously described effects of aversive conditioning on visual search may not generalize beyond the initial glance and can be suppressed when conditions allow for more deliberate search strategies. More generally, our findings reveal that sustained attentional avoidance of aversively conditioned stimuli is possible during active search.