Irrelevant reward and selection histories have different influences on task-relevant attentional selection

The persistence of value-driven attention capture is task-dependent

Visual features previously associated with reward can capture attention even when task-irrelevant, a phenomenon known as value-driven attention capture (VDAC). VDAC persists without reinforcement, unlike other forms of learning, where removing reinforcement typically leads to extinction. In five experiments, factors common to many studies were manipulated to examine their impact on VDAC and its extinction. All experiments included learning and test phases. During learning, participants completed a visual search task during which one of two target colors was associated with a reward, and the other with no reward. During test, 1 week later, participants completed another visual search task in which the reward association was not reinforced. When a rewarded feature remained task-relevant (Experiment 1), VDAC was observed. When the rewarded feature was made task-irrelevant (Experiments 2-5) there was no evidence of a VDAC effect, except when the target feature was physically salient and there was a reduction in the frequency of exposure to the reward-associated feature (Experiment 5). We failed to find evidence of VDAC in Experiments 2-4, suggesting that VDAC may depend on the demands of the task resulting in vulnerability to VDAC. When VDAC was observed, extinction was also observed. This indicates that VDAC is subject to extinction as would be expected from an effect driven by reinforcement learning.

Value-driven modulation of visual perception by visual and auditory reward cues: The role of performance-contingent delivery of reward

Perception is modulated by reward value, an effect elicited not only by stimuli that are predictive of performance-contingent delivery of reward (PC) but also by stimuli that were previously rewarded (PR). PC and PR cues may engage different mechanisms relying on goal-driven versus stimulus-driven prioritization of high value stimuli, respectively. However, these two modes of reward modulation have not been systematically compared against each other. This study employed a behavioral paradigm where participants' visual orientation discrimination was tested in the presence of task-irrelevant visual or auditory reward cues. In the first phase (PC), correct performance led to a high or low monetary reward dependent on the identity of visual or auditory cues. In the subsequent phase (PR), visual or auditory cues were not followed by reward delivery anymore. We hypothesized that PC cues have a stronger modulatory effect on visual discrimination and pupil responses compared to PR cues. We found an overall larger task-evoked pupil dilation in PC compared to PR phase. Whereas PC and PR cues both increased the accuracy of visual discrimination, value-driven acceleration of reaction times (RTs) and pupillary responses only occurred for PC cues. The modulation of pupil size by high reward PC cues was strongly correlated with the modulation of a combined measure of speed and accuracy. These results indicate that although value-driven modulation of perception can occur even when reward delivery is halted, stronger goal-driven control elicited by PC reward cues additionally results in a more efficient balance between accuracy and speed of perceptual choices.

Spatial task relevance modulates value-driven attentional capture

Attention tends to be attracted to visual features previously associated with reward. To date, nearly all existing studies examined value-associated stimuli at or near potential target locations, making such locations meaningful to inspect. The present experiments examined whether the attentional priority of a value-associated stimulus depends on its location-wise task relevance. In three experiments we used an RSVP task to compare the attentional demands of a value-associated peripheral distractor to that of a distractor associated with the top-down search goal. At a peripheral location that could never contain the target, a value-associated color did not capture attention. In contrast, at the same location, a distractor in a goal-matching color did capture attention. The results show that value-associated stimuli lose their attentional priority at task-irrelevant locations, in contrast to other types of stimuli that capture attention.

Reward magnitude enhances early attentional processing of auditory stimuli

Reward associations are known to shape the brain's processing of visual stimuli, but relatively less is known about how reward associations impact the processing of auditory stimuli. We leveraged the high-temporal resolution of electroencephalography (EEG) and event-related potentials (ERPs) to investigate the influence of low- and high-magnitude stimulus-reward associations in an auditory oddball task. We associated fast, correct detection of certain auditory target stimuli with larger monetary rewards, and other auditory targets with smaller rewards. We found enhanced attentional processing of the more highly rewarded target stimuli, as evidenced by faster behavioral detection of those stimuli compared with lower-rewarded stimuli. Neurally, higher-reward associations enhanced the early sensory processing of auditory targets. Targets associated with higher-magnitude rewards had higher amplitude N1 and mismatch negativity (MMN) ERP components than targets associated with lower-magnitude rewards. Reward did not impact the latency of these early components. Higher-reward magnitude also decreased the latency and increased the amplitude of the longer-latency P3 component, suggesting that reward also can enhance the final processing stages of auditory target stimuli. These results provide insight into how the sensory and attentional neural processing of auditory stimuli is modulated by stimulus-reward associations and the magnitude of those associations, with higher-magnitude reward associations yielding enhanced auditory processing at both early and late stages compared with lower-magnitude reward associations.

Transient Focal Neurological Events in Cerebral Amyloid Angiopathy and the Long-term Risk of Intracerebral Hemorrhage and Death: A Systematic Review and Meta-analysis

Importance

Transient focal neurological episodes (TFNEs) are a frequently overlooked presentation of cerebral amyloid angiopathy (CAA), a condition with prognostic implications that are still not well described.

Objective

To perform a systematic review and meta-analysis to examine the factors associated with incident lobar intracerebral hemorrhage (ICH) and death in patients with CAA presenting with TFNEs.

Data Sources

A systematic review and individual participant meta-analysis including (1) a hospital-based cohort and (2) the results obtained from a systematic search performed in MEDLINE and Embase completed in December 2019.

Study Selection

Included studies were observational reports of TFNEs. Patient-level clinical, imaging, and prognostic data were required for inclusion. For aggregate data studies, patient-level data were requested. Disagreements were resolved by consensus.

Data Extraction and Synthesis

Data were extracted following Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines by 4 independent reviewers. The quality of reports was determined based on the modified Pearson Case Report Quality Scale.

Main Outcomes and Measures

The clinical characteristics of TFNEs, neuroimaging features, and use of antithrombotics during follow-up were considered exposures. The predefined main outcomes were lobar ICH and risk of death during follow-up.

Results

Forty-two studies and 222 CAA-associated TFNE cases were included from the initial 1612 records produced by the systematic search; 26 additional patients (11 men [42.3%]; mean [SD] age, 77 [8] years) were provided by the hospital-based cohort. A total of 108 TFNEs (43.5%) consisted of motor symptoms. Convexity subarachnoid hemorrhage and cortical superficial siderosis were detected in 193 individuals (77.8%) and 156 individuals (62.9%) in the systematic search and hospital-based cohort, respectively. Follow-up duration could be obtained in 185 patients (median duration, 1 year [IQR, 0.8-2.5 years]). During follow-up, symptomatic lobar ICH occurred in 76 patients (39.4%). Motor symptoms (odds ratio, 2.08 [95% CI, 1.16-3.70]) at baseline and antithrombotic use during follow-up (odds ratio, 3.61 [95% CI, 1.67-7.84]) were associated with an increase in risk of lobar ICH. A total of 31 patients (16.5%) died during follow-up; lobar ICH during follow-up and cortical superficial siderosis were the main risk factors for death (odds ratio, 3.01 [95% CI, 1.36-6.69]; odds ratio, 3.20 [95% CI, 1.16-8.91], respectively).

Conclusions and Relevance

Patients presenting with CAA-associated TFNEs are at high risk of lobar ICH and death. Motor TFNEs and use of antithrombotics after a TFNE, in many cases because of misdiagnosis, are risk factors for ICH, and therefore accurate diagnosis and distinguishing this condition from transient ischemic attacks is critical.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Social information rapidly prioritizes overt but not covert attention in a joint spatial cueing task

Coordinating actions with others is crucial for our survival. Our ability to see what others are seeing and to align our visual attention with them facilitates these joint actions. In the present research, we set out to increase our understanding of such joint attention by investigating the extent to which social information would be able to prioritize overt (when moving the eyes to attend) and covert (when shifting attention without eye movements) attention in a joint spatial cueing task. Participants saw a cue and detected a target at the same or a different location alongside an unseen partner of either higher or lower social rank. In a novel twist, participants were led to believe that the cue was connected to the gaze location of their partner. In Experiment 1, where participants were told to not move their eyes (covert attention), the partner's social rank did not change how quickly participants detected targets. But in Experiment 2, where participants were free to move their eyes naturally (overt attention), inhibition of return effects (slower responses to cued than uncued targets) were modulated by their partner's social rank. These social top-down effects occurred already at a short SOA of 150 ms. Our findings suggest that overt attention might provide a key tool for joint action, as it is penetrable for social information at the early stages of information processing.

Previously Reward-Associated Stimuli Capture Spatial Attention in the Absence of Changes in the Corresponding Sensory Representations as Measured with MEG

Studies of selective attention typically consider the role of task goals or physical salience, but attention can also be captured by previously reward-associated stimuli, even if they are currently task irrelevant. One theory underlying this value-driven attentional capture (VDAC) is that reward-associated stimulus representations undergo plasticity in sensory cortex, thereby automatically capturing attention during early processing. To test this, we used magnetoencephalography to probe whether stimulus location and identity representations in sensory cortex are modulated by reward learning. We furthermore investigated the time course of these neural effects, and their relationship to behavioral VDAC. Male and female human participants first learned stimulus-reward associations. Next, we measured VDAC in a separate task by presenting these stimuli in the absence of reward contingency and probing their effects on the processing of separate target stimuli presented at different time lags. Using time-resolved multivariate pattern analysis, we found that learned value modulated the spatial selection of previously rewarded stimuli in posterior visual and parietal cortex from ∼260 ms after stimulus onset. This value modulation was related to the strength of participants' behavioral VDAC effect and persisted into subsequent target processing. Importantly, learned value did not influence cortical signatures of early processing (i.e., earlier than ∼200 ms); nor did it influence the decodability of stimulus identity. Our results suggest that VDAC is underpinned by learned value signals that modulate spatial selection throughout posterior visual and parietal cortex. We further suggest that VDAC can occur in the absence of changes in early visual processing in cortex.SIGNIFICANCE STATEMENT Attention is our ability to focus on relevant information at the expense of irrelevant information. It can be affected by previously learned but currently irrelevant stimulus-reward associations, a phenomenon termed "value-driven attentional capture" (VDAC). The neural mechanisms underlying VDAC remain unclear. It has been speculated that reward learning induces visual cortical plasticity, which modulates early visual processing to capture attention. Although we find that learned value modulates spatial signals in visual cortical areas, an effect that correlates with VDAC, we find no relevant signatures of changes in early visual processing in cortex.

Impact of relative and absolute values on selective attention

Valuable stimuli receive attentional priority. However, it is unknown whether the mechanism of the attentional priority is based on relative (e.g., higher) or absolute (e.g., 45 points) values. Therefore, we manipulated the relative and absolute values independently in a modified value-driven attentional capture paradigm. In the training phase, where associative learning occurs between color and reward value, two test target colors were each presented with another different target color (reference target colors) in separate context blocks. Therefore, each test target color had different reference points. In the test phase, the two test target colors were used as singleton distractor colors. In the training phase of Experiment 1, the absolute reward value of the test target colors was the same, but one had a higher value than its reference target color and the other had a lower value. In the test phase, the high relative value color distractor captured attention more, suggesting that the relative value of stimuli influenced selective attention. In Experiment 2 the relative value of the test target colors was the same, but the absolute value was higher for one. The high and low absolute value color distractors captured attention equally in the test phase, indicating little impact of the absolute value on selective attention. These findings suggest that the relative value, rather than absolute value, plays a critical role in the allocation of attention. Accordingly, the present study suggests that prospect theory (Kahneman & Tversky, Econometrica, 47 (2), 363-391, 1979) can be extended to earlier cognitive stages such as selective attention.

Value-driven attentional capture enhances distractor representations in early visual cortex

When a behaviorally relevant stimulus has been previously associated with reward, behavioral responses are faster and more accurate compared to equally relevant but less valuable stimuli. Conversely, task-irrelevant stimuli that were previously associated with a high reward can capture attention and distract processing away from relevant stimuli (e.g., seeing a chocolate bar in the pantry when you are looking for a nice, healthy apple). Although increasing the value of task-relevant stimuli systematically up-regulates neural responses in early visual cortex to facilitate information processing, it is not clear whether the value of task-irrelevant distractors influences behavior via competition in early visual cortex or via competition at later stages of decision-making and response selection. Here, we measured functional magnetic resonance imaging (fMRI) in human visual cortex while subjects performed a value-based learning task, and we applied a multivariate inverted encoding model (IEM) to assess the fidelity of distractor representations in early visual cortex. We found that the fidelity of neural representations related to task-irrelevant distractors increased when the distractors were previously associated with a high reward. This finding suggests that value-driven attentional capture begins with sensory modulations of distractor representations in early areas of visual cortex.

Dissociating Reward- and Attention-driven Biasing of Global Feature-based Selection in Human Visual Cortex

Objects that promise rewards are prioritized for visual selection. The way this prioritization shapes sensory processing in visual cortex, however, is debated. It has been suggested that rewards motivate stronger attentional focusing, resulting in a modulation of sensory selection in early visual cortex. An open question is whether those reward-driven modulations would be independent of similar modulations indexing the selection of attended features that are not associated with reward. Here, we use magnetoencephalography in human observers to investigate whether the modulations indexing global color-based selection in visual cortex are separable for target- and (monetary) reward-defining colors. To assess the underlying global color-based activity modulation, we compare the event-related magnetic field response elicited by a color probe in the unattended hemifield drawn either in the target color, the reward color, both colors, or a neutral task-irrelevant color. To test whether target and reward relevance trigger separable modulations, we manipulate attention demands on target selection while keeping reward-defining experimental parameters constant. Replicating previous observations, we find that reward and target relevance produce almost indistinguishable gain modulations in ventral extratriate cortex contralateral to the unattended color probe. Importantly, increasing attention demands on target discrimination increases the response to the target-defining color, whereas the response to the rewarded color remains largely unchanged. These observations indicate that, although task relevance and reward influence the very same feature-selective area in extrastriate visual cortex, the associated modulations are largely independent.

Dissociable signatures of visual salience and behavioral relevance across attentional priority maps in human cortex

Computational models posit that visual attention is guided by activity within spatial maps that index the image-computable salience and the behavioral relevance of objects in the scene. These spatial maps are theorized to be instantiated as activation patterns across a series of retinotopic visual regions in occipital, parietal, and frontal cortex. Whereas previous research has identified sensitivity to either the behavioral relevance or the image-computable salience of different scene elements, the simultaneous influence of these factors on neural "attentional priority maps" in human cortex is not well understood. We tested the hypothesis that visual salience and behavioral relevance independently impact the activation profile across retinotopically organized cortical regions by quantifying attentional priority maps measured in human brains using functional MRI while participants attended one of two differentially salient stimuli. We found that the topography of activation in priority maps, as reflected in the modulation of region-level patterns of population activity, independently indexed the physical salience and behavioral relevance of each scene element. Moreover, salience strongly impacted activation patterns in early visual areas, whereas later visual areas were dominated by relevance. This suggests that prioritizing spatial locations relies on distributed neural codes containing graded representations of salience and relevance across the visual hierarchy. NEW & NOTEWORTHY We tested a theory which supposes that neural systems represent scene elements according to both their salience and their relevance in a series of "priority maps" by measuring functional MRI activation patterns across human brains and reconstructing spatial maps of the visual scene. We found that different regions indexed either the salience or the relevance of scene items, but not their interaction, suggesting an evolving representation of salience and relevance across different visual areas.

Irrelevant learned reward associations disrupt voluntary spatial attention

Attention can be guided involuntarily by physical salience and by non-salient, previously learned reward associations that are currently task-irrelevant. Attention can be guided voluntarily by current goals and expectations. The current study examined, in two experiments, whether irrelevant reward associations could disrupt current, goal-driven, voluntary attention. In a letter-search task, attention was directed voluntarily (i.e., cued) on half the trials by a cue stimulus indicating the hemifield in which the target letter would appear with 100 % accuracy. On the other half of the trials, a cue stimulus was presented, but it did not provide information about the target hemifield (i.e., uncued). On both cued and uncued trials, attention could be involuntarily captured by the presence of a task-irrelevant, and physically non-salient, color, either within the cued or the uncued hemifield. Importantly, one week prior to the letter search task, the irrelevant color had served as a target feature that was predictive of reward in a separate training task. Target identification accuracy was better on cued compared to uncued trials. However, this effect was reduced when the irrelevant, and physically non-salient, reward-associated feature was present in the uncued hemifield. This effect was not observed in a second, control experiment in which the irrelevant color was not predictive of reward during training. Our results indicate that involuntary, value-driven capture can disrupt the voluntary control of spatial attention.

Funny money: the attentional role of monetary feedback detached from expected value

Stimuli associated with monetary reward can become powerful cues that effectively capture visual attention. We examined whether such value-driven attentional capture can be induced with monetary feedback in the absence of an expected cash payout. To this end, we implemented images of U.S. dollar bills as reward feedback. Participants knew in advance that they would not receive any money based on their performance. Our reward stimuli-$5 and $20 bill images-were thus dissociated from any practical utility. Strikingly, we observed a reliable attentional capture effect for the mere images of bills. Moreover, this finding generalized to Monopoly money. In two control experiments, we found no evidence in favor of nominal or symbolic monetary value. Hence, we claim that bill images are special monetary representations, such that there are strong associations between the defining visual features of bills and reward, probably due to a lifelong learning history. Together, we show that the motivation to earn cash plays a minor role when it comes to monetary rewards, while bill-defining visual features seem to be sufficient. These findings have the potential to influence human factor applications, such as gamification, and can be extended to novel value systems, such as the electronic cash Bitcoin being developed for use in mobile banking. Finally, our procedure represents a proof of concept on how images of money can be used to conserve expenditures in the experimental context.

Social Beliefs and Visual Attention: How the Social Relevance of a Cue Influences Spatial Orienting

We are highly tuned to each other's visual attention. Perceiving the eye or hand movements of another person can influence the timing of a saccade or the reach of our own. However, the explanation for such spatial orienting in interpersonal contexts remains disputed. Is it due to the social appearance of the cue—a hand or an eye—or due to its social relevance—a cue that is connected to another person with attentional and intentional states? We developed an interpersonal version of the Posner spatial cueing paradigm. Participants saw a cue and detected a target at the same or a different location, while interacting with an unseen partner. Participants were led to believe that the cue was either connected to the gaze location of their partner or was generated randomly by a computer (Experiment 1), and that their partner had higher or lower social rank while engaged in the same or a different task (Experiment 2). We found that spatial cue‐target compatibility effects were greater when the cue related to a partner's gaze. This effect was amplified by the partner's social rank, but only when participants believed their partner was engaged in the same task. Taken together, this is strong evidence in support of the idea that spatial orienting is interpersonally attuned to the social relevance of the cue—whether the cue is connected to another person, who this person is, and what this person is doing—and does not exclusively rely on the social appearance of the cue. Visual attention is not only guided by the physical salience of one's environment but also by the mental representation of its social relevance.

Mixed signals: The effect of conflicting reward- and goal-driven biases on selective attention

Attentional selection depends on the interaction between exogenous (stimulus-driven), endogenous (goal-driven), and selection history (experience-driven) factors. While endogenous and exogenous biases have been widely investigated, less is known about their interplay with value-driven attention. The present study investigated the interaction between reward-history and goal-driven biases on perceptual sensitivity (d') and response time (RT) in a modified cueing paradigm presenting two coloured cues, followed by sinusoidal gratings. Participants responded to the orientation of one of these gratings. In Experiment 1, one cue signalled reward availability but was otherwise task irrelevant. In Experiment 2, the same cue signalled reward, and indicated the target's most likely location at the opposite side of the display. This design introduced a conflict between reward-driven biases attracting attention and goal-driven biases directing it away. Attentional effects were examined comparing trials in which cue and target appeared at the same versus opposite locations. Two interstimulus interval (ISI) levels were used to probe the time course of attentional effects. Experiment 1 showed performance benefits at the location of the reward-signalling cue and costs at the opposite for both ISIs, indicating value-driven capture. Experiment 2 showed performance benefits only for the long ISI when the target was at the opposite to the reward-associated cue. At the short ISI, only performance costs were observed. These results reveal the time course of these biases, indicating that reward-driven effects influence attention early but can be overcome later by goal-driven control. This suggests that reward-driven biases are integrated as attentional priorities, just as exogenous and endogenous factors.

Five Factors that Guide Attention in Visual Search

How do we find what we are looking for? Fundamental limits on visual processing mean that even when the desired target is in our field of view, we often need to search, because it is impossible to recognize everything at once. Searching involves directing attention to objects that might be the target. This deployment of attention is not random. It is guided to the most promising items and locations by five factors discussed here: Bottom-up salience, top-down feature guidance, scene structure and meaning, the previous history of search over time scales from msec to years, and the relative value of the targets and distractors. Modern theories of search need to specify how all five factors combine to shape search behavior. An understanding of the rules of guidance can be used to improve the accuracy and efficiency of socially-important search tasks, from security screening to medical image perception.

The attention habit: how reward learning shapes attentional selection

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications.

Value-based attentional capture influences context-dependent decision-making

Normative theories posit that value-based decision-making is context independent. However, decisions between two high-value options can be suboptimally biased by the introduction of a third low-value option. This context-dependent modulation is consistent with the divisive normalization of the value of each stimulus by the total value of all stimuli. In addition, an independent line of research demonstrates that pairing a stimulus with a high-value outcome can lead to attentional capture that can mediate the efficiency of visual information processing. Here we tested the hypothesis that value-based attentional capture interacts with value-based normalization to influence the optimality of decision-making. We used a binary-choice paradigm in which observers selected between two targets and the color of each target indicated the magnitude of their reward potential. Observers also had to simultaneously ignore a task-irrelevant distractor rendered in a color that was previously associated with a specific reward magnitude. When the color of the task-irrelevant distractor was previously associated with a high reward, observers responded more slowly and less optimally. Moreover, as the learned value of the distractor increased, electrophysiological data revealed an attenuation of the lateralized N1 and N2Pc responses evoked by the relevant choice stimuli and an attenuation of the late positive deflection (LPD). Collectively, these behavioral and electrophysiological data suggest that value-based attentional capture and value-based normalization jointly mediate the influence of context on free-choice decision-making.