The modulatory impact of reward and attention on global feature selection in human visual cortex

Cortical and subcortical substrates of minutes and days-long object value memory in humans

Obtaining valuable objects motivates many of our daily decisions. However, the neural underpinnings of object processing based on human value memory are not yet fully understood. Here, we used whole-brain functional magnetic resonance imaging (fMRI) to examine activations due to value memory as participants passively viewed objects before, minutes after, and 1-70 days following value training. Significant value memory for objects was evident in the behavioral performance, which nevertheless faded over the days following training. Minutes after training, the occipital, ventral temporal, interparietal, and frontal areas showed strong value discrimination. Days after training, activation in the frontal, temporal, and occipital regions decreased, whereas the parietal areas showed sustained activation. In addition, days-long value responses emerged in certain subcortical regions, including the caudate, ventral striatum, and thalamus. Resting-state analysis revealed that these subcortical areas were functionally connected. Furthermore, the activation in the striatal cluster was positively correlated with participants' performance in days-long value memory. These findings shed light on the neural basis of value memory in humans with implications for object habit formation and cross-species comparisons.

Neurophysiological mechanisms underlying the differential effect of reward prospect on response selection and inhibition

Reward and cognitive control play crucial roles in shaping goal-directed behavior. Yet, the behavioral and neural underpinnings of interactive effects of both processes in driving our actions towards a particular goal have remained rather unclear. Given the importance of inhibitory control, we investigated the effect of reward prospect on the modulatory influence of automatic versus controlled processes during response inhibition. For this, a performance-contingent monetary reward for both correct response selection and response inhibition was added to a Simon NoGo task, which manipulates the relationship of automatic and controlled processes in Go and NoGo trials. A neurophysiological approach was used by combining EEG temporal signal decomposition and source localization methods. Compared to a non-rewarded control group, rewarded participants showed faster response execution, as well as overall lower response selection and inhibition accuracy (shifted speed-accuracy tradeoff). Interestingly, the reward group displayed a larger interference of the interactive effects of automatic versus controlled processes during response inhibition (i.e., a larger Simon NoGo effect), but not during response selection. The reward-specific behavioral effect was mirrored by the P3 amplitude, underlining the importance of stimulus-response association processes in explaining variability in response inhibition performance. The selective reward-induced neurophysiological modulation was associated with lower activation differences in relevant structures spanning the inferior frontal and parietal cortex, as well as higher activation differences in the somatosensory cortex. Taken together, this study highlights relevant neuroanatomical structures underlying selective reward effects on response inhibition and extends previous reports on the possible detrimental effect of reward-triggered performance trade-offs on cognitive control processes.

Reward Rapidly Enhances Visual Perception

Rewards exert a deep influence on our cognition and behavior. Here, we used a paradigm in which reward information was provided at either encoding or retrieval of a brief, masked stimulus to show that reward can also rapidly modulate perceptual encoding of visual information. Experiment 1 (n = 30 adults) showed that participants' response accuracy was enhanced when a to-be-encoded grating signaled high reward relative to low reward, but only when the grating was presented very briefly and participants reported that they were not consciously aware of it. Experiment 2 (n = 29 adults) showed that there was no difference in participants' response accuracy when reward information was instead provided at the stage of retrieval, ruling out an explanation of the reward-modulation effect in terms of differences in motivated retrieval. Taken together, our findings provide behavioral evidence consistent with a rapid reward modulation of visual perception, which may not require consciousness.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Attention expedites target selection by prioritizing the neural processing of distractor features

Whether doing the shopping, or driving the car – to navigate daily life, our brain has to rapidly identify relevant color signals among distracting ones. Despite a wealth of research, how color attention is dynamically adjusted is little understood. Previous studies suggest that the speed of feature attention depends on the time it takes to enhance the neural gain of cortical units tuned to the attended feature. To test this idea, we had human participants switch their attention on the fly between unpredicted target color alternatives, while recording the electromagnetic brain response to probes matching the target, a non-target, or a distracting alternative target color. Paradoxically, we observed a temporally prioritized processing of distractor colors. A larger neural modulation for the distractor followed by its stronger attenuation expedited target identification. Our results suggest that dynamic adjustments of feature attention involve the temporally prioritized processing and elimination of distracting feature representations.

In order to investigate underlying mechanisms of color attention, Bartsch et al measured electromagnetic brain responses in participants who were challenged to switch their attention in accordance with unpredicted target colors changes in the absence or presence of ‘distractor colors’. They demonstrated that dynamic adjustments of feature attention involve the temporally prioritized processing and elimination of distracting feature representations.

Decreased modulation of segregated SEEKING and selective attention systems in chronic insomnia

Sleep-related attentional bias and instinctual craving-sleep status may be associated with value-driven selective attention network and SEEKING system. We hypothesized that the two networks might be important components and underlie etiology of inability to initiate or/and maintain sleep in patients with chronic insomnia (PIs). Our aim is to investigate whether frequency-frequency couplings(temporal and spatial coupling, and differences of a set of imaging parameters) could elevate the sensibility to characterize the two insomnia-related networks in studying their relationships with sleep parameters and post-insomnia emotions. Forty-eight PIs and 48 status-matched good sleepers were requested to complete sleep and emotion-related questionnaires. Receiver operating characteristic curve was used to calculate the discriminatory power of a set of parameters. Granger causality and mediating causality analysis were used to address the causal relationships between the two networks and sleep/emotion-related parameters. Frequency-frequency couplings could characterize the two networks with high discriminatory power (AUC, 0.951; sensitivity, 87.5%; specificity, 95.8%), which suggested that the frequency-frequency couplings could be served as a useful biomarker to address the insomnia-related brain networks. Functional deficits of the SEEKING system played decreased mediator acting in post-insomnia negative emotions (decreased frequency-frequency coupling). Functional hyperarousal of the value-driven attention network played decreased mediator acting in sleep regulation (increased frequency-frequency coupling). Granger causality analysis showed decreased causal effect connectivity between and within the two networks. The between-network causal effect connectivity segregation played decreased mediator acting in sleep regulation (decreased connectivity). These findings suggest that the functional deficits and segregation of the two systems may underlie etiology of PIs.

Value-based attention capture: Differential effects of loss and gain contingencies

There is evidence that attention can be captured by a feature that is associated with reward. However, it is unclear how associating a feature with loss impacts attentional capture. Some have found evidence for attentional capture by loss-associated stimuli, suggesting that attention is biased toward stimuli predictive of consequence, regardless of the valence of that consequence. However, in those studies, efficient attention to the loss-associated stimulus reduced the magnitude of the loss during training, so attention to the loss-associated stimulus was rewarded in relative terms. In Experiment 1 we associated a color with loss, gain, or no consequence during training and then investigated whether attention is captured by each color. Importantly, our training did not reward, even in a relative sense, attention to the loss-associated color. Although we found robust attentional capture by gain-associated colors, we found no evidence for capture by loss-associated colors. A second experiment showed that the observed effects cannot be explained by selection history and, hence, are specific to value learning. These results suggest that the learning mechanisms of value-based attentional capture are driven by reward, but not by loss or the predictability of consequences in general.

On the relationship between value-driven and stimulus-driven attentional capture

Reward history, physical salience, and task relevance all influence the degree to which a stimulus competes for attention, reflecting value-driven, stimulus-driven, and goal-contingent attentional capture, respectively. Theories of value-driven attention have likened reward cues to physically salient stimuli, positing that reward cues are preferentially processed in early visual areas as a result of value-modulated plasticity in the visual system. Such theories predict a strong coupling between value-driven and stimulus-driven attentional capture across individuals. In the present study, we directly test this hypothesis, and demonstrate a robust correlation between value-driven and stimulus-driven attentional capture. Our findings suggest substantive overlap in the mechanisms of competition underlying the attentional priority of reward cues and physically salient stimuli.

Neural correlates of attentional capture by stimuli previously associated with social reward

Our attention is strongly influenced by reward learning. Stimuli previously associated with monetary reward have been shown to automatically capture attention in both behavioral and neurophysiological studies. Stimuli previously associated with positive social feedback similarly capture attention; however, it is unknown whether such social facilitation of attention relies on similar or dissociable neural systems. Here, we used the value-driven attentional capture paradigm in an fMRI study to identify the neural correlates of attention to stimuli previously associated with social reward. The results reveal learning-dependent priority signals in the contralateral visual cortex, posterior parietal cortex, and caudate tail, similar to studies using monetary reward. An additional priority signal was consistently evident in the right middle frontal gyrus (MFG). Our findings support the notion of a common neural mechanism for directing attention on the basis of selection history that generalizes across different types of reward.

Reward cues readily direct monkeys' auditory performance resulting in broad auditory cortex modulation and interaction with sites along cholinergic and dopaminergic pathways

In natural settings, the prospect of reward often influences the focus of our attention, but how cognitive and motivational systems influence sensory cortex is not well understood. Also, challenges in training nonhuman animals on cognitive tasks complicate cross-species comparisons and interpreting results on the neurobiological bases of cognition. Incentivized attention tasks could expedite training and evaluate the impact of attention on sensory cortex. Here we develop an Incentivized Attention Paradigm (IAP) and use it to show that macaque monkeys readily learn to use auditory or visual reward cues, drastically influencing their performance within a simple auditory task. Next, this paradigm was used with functional neuroimaging to measure activation modulation in the monkey auditory cortex. The results show modulation of extensive auditory cortical regions throughout primary and non-primary regions, which although a hallmark of attentional modulation in human auditory cortex, has not been studied or observed as broadly in prior data from nonhuman animals. Psycho-physiological interactions were identified between the observed auditory cortex effects and regions including basal forebrain sites along acetylcholinergic and dopaminergic pathways. The findings reveal the impact and regional interactions in the primate brain during an incentivized attention engaging auditory task.

Dissociating Reward- and Attention-driven Biasing of Global Feature-based Selection in Human Visual Cortex

Objects that promise rewards are prioritized for visual selection. The way this prioritization shapes sensory processing in visual cortex, however, is debated. It has been suggested that rewards motivate stronger attentional focusing, resulting in a modulation of sensory selection in early visual cortex. An open question is whether those reward-driven modulations would be independent of similar modulations indexing the selection of attended features that are not associated with reward. Here, we use magnetoencephalography in human observers to investigate whether the modulations indexing global color-based selection in visual cortex are separable for target- and (monetary) reward-defining colors. To assess the underlying global color-based activity modulation, we compare the event-related magnetic field response elicited by a color probe in the unattended hemifield drawn either in the target color, the reward color, both colors, or a neutral task-irrelevant color. To test whether target and reward relevance trigger separable modulations, we manipulate attention demands on target selection while keeping reward-defining experimental parameters constant. Replicating previous observations, we find that reward and target relevance produce almost indistinguishable gain modulations in ventral extratriate cortex contralateral to the unattended color probe. Importantly, increasing attention demands on target discrimination increases the response to the target-defining color, whereas the response to the rewarded color remains largely unchanged. These observations indicate that, although task relevance and reward influence the very same feature-selective area in extrastriate visual cortex, the associated modulations are largely independent.

Test-retest reliability of value-driven attentional capture

Attention is biased toward learned predictors of reward. The degree to which attention is automatically drawn to arbitrary reward cues has been linked to a variety of psychopathologies, including drug dependence, HIV-risk behaviors, depressive symptoms, and attention deficit/hyperactivity disorder. In the context of addiction specifically, attentional biases toward drug cues have been related to drug craving and treatment outcomes. Given the potential role of value-based attention in psychopathology, the ability to quantify the magnitude of such bias before and after a treatment intervention in order to assess treatment-related changes in attention allocation would be desirable. However, the test-retest reliability of value-driven attentional capture by arbitrary reward cues has not been established. In the present study, we show that an oculomotor measure of value-driven attentional capture produces highly robust test-retest reliability for a behavioral assessment, whereas the response time (RT) measure more commonly used in the attentional bias literature does not. Our findings provide methodological support for the ability to obtain a reliable measure of susceptibility to value-driven attentional capture at multiple points in time, and they highlight a limitation of RT-based measures that should inform the use of attentional-bias tasks as an assessment tool.

Modulating Reward Induces Differential Neurocognitive Approaches to Sustained Attention

Reward and motivation have powerful effects on cognition and brain activity, yet it remains unclear how they affect sustained cognitive performance. We have recently shown that a variety of motivators improve accuracy and reduce variability during sustained attention. In the current study, we investigate how neural activity in task-positive networks supports these sustained attention improvements. Participants performed the gradual-onset continuous performance task with alternating motivated (rewarded) and unmotivated (unrewarded) blocks. During motivated blocks, we observed increased sustained neural recruitment of task-positive regions, which interacted with fluctuations in task performance. Specifically, during motivated blocks, participants recruited these regions in preparation for upcoming targets, and this activation predicted accuracy. In contrast, during unmotivated blocks, no such advanced preparation was observed. Furthermore, during motivated blocks, participants had similar activation levels during both optimal (in-the-zone) and suboptimal (out-of-the-zone) epochs of performance. In contrast, during unmotivated blocks, task-positive regions were only engaged to a similar degree as motivated blocks during suboptimal (out-of-the-zone) periods. These data support a framework in which motivated individuals act as "cognitive investors," engaging task-positive resources proactively and consistently during sustaining attention. When unmotivated, however, the same individuals act as "cognitive misers," engaging maximal task-positive resources only during periods of struggle.

Miss it and miss out: Counterproductive nonspatial attentional capture by task-irrelevant, value-related stimuli

Recent studies of visual search suggest that learning about valued outcomes (rewards and punishments) influences the likelihood that distractors will capture spatial attention and slow search for a target, even when those value-related distractors have never themselves been the targets of search. In the present study, we demonstrated a related effect in the context of temporal, rather than spatial, selection. Participants were presented with a temporal stream of pictures in a fixed central location and had to identify the orientation of a rotated target picture. Response accuracy was reduced if the rotated target was preceded by a "valued" distractor picture that signaled that a correct response to the target would be rewarded (and an incorrect response punished), relative to a distractor picture that did not signal reward or punishment. This effect of signal value on response accuracy was short-lived, being most prominent with a short lag between distractor and target. Impairment caused by a valued distractor was observed if participants were explicitly instructed regarding its relation to reward/punishment (Exps. 1, 3, and 4), or if they could learn this relationship only via trial-by-trial experience (Exp. 2). These findings show that the influence of signal value on attentional capture extends to temporal selection, and also demonstrate that value-related distractors can interfere with the conscious perception of subsequent target information.

Linking dopaminergic reward signals to the development of attentional bias: A positron emission tomographic study

The attention system is shaped by reward history, such that learned reward cues involuntarily draw attention. Recent research has begun to uncover the neural mechanisms by which learned reward cues compete for attention, implicating dopamine (DA) signaling within the dorsal striatum. How these elevated priority signals develop in the brain during the course of learning is less well understood, as is the relationship between value-based attention and the experience of reward during learning. We hypothesized that the magnitude of the striatal DA response to reward during learning contributes to the development of a learned attentional bias towards the cue that predicted it, and examined this hypothesis using positron emission tomography with [¹¹C]raclopride. We measured changes in dopamine release for rewarded versus unrewarded visual search for color-defined targets as indicated by the density and distribution of the available D₂/D₃ receptors. We then tested for correlations of individual differences in this measure of reward-related DA release to individual differences in the degree to which previously reward-associated but currently task-irrelevant stimuli impair performance in an attention task (i.e., value-driven attentional bias), revealing a significant relationship in the right anterior caudate. The degree to which reward-related DA release was right hemisphere lateralized was also predictive of later attentional bias. Our findings provide support for the hypothesis that value-driven attentional bias can be predicted from reward-related DA release during learning.

Reward processing in the value-driven attention network: reward signals tracking cue identity and location

Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value.

Motivational context for response inhibition influences proactive involvement of attention

Motoric inhibition is ingrained in human cognition and implicated in pervasive neurological diseases and disorders. The present electroencephalographic (EEG) study investigated proactive motivational adjustments in attention during response inhibition. We compared go-trial data from a stop-signal task, in which infrequently presented stop-signals required response cancellation without extrinsic incentives (“standard-stop”), to data where a monetary reward was posted on some stop-signals (“rewarded-stop”). A novel EEG analysis was used to directly model the covariation between response time and the attention-related N1 component. A positive relationship between response time and N1 amplitudes was found in the standard-stop context, but not in the rewarded-stop context. Simultaneously, average go-trial N1 amplitudes were larger in the rewarded-stop context. This suggests that down-regulation of go-signal-directed attention is dynamically adjusted in the standard-stop trials, but is overridden by a more generalized increase in attention in reward-motivated trials. Further, a diffusion process model indicated that behavior between contexts was the result of partially opposing evidence accumulation processes. Together these analyses suggest that response inhibition relies on dynamic and flexible proactive adjustments of low-level processes and that contextual changes can alter their interplay. This could prove to have ramifications for clinical disorders involving deficient response inhibition and impulsivity.

The Rapid Capture of Attention by Rewarded Objects

When a stimulus is associated with a reward, it becomes prioritized, and the allocation of attention to that stimulus increases. For low-level features, such as color, this reward-based allocation of attention can manifest early in time and as a faster and stronger shift of attention to targets with that color, as reflected by the N2pc (a parieto-occipital electrophysiological component peaking at ∼250 msec). It is unknown, however, if reward associations can similarly modulate attentional shifts to complex objects or object categories, or if reward-related modulation of attentional allocation to such stimuli would occur later in time or through a different mechanism. Here, we used magnetoencephalographic recordings in 24 participants to investigate how object categories with a reward association would modulate the shift of attention. On each trial, two colored squares were presented, one in a target color and the other in a distractor color, each with an embedded object. Participants searched for the target-colored square and performed a corner discrimination task. The embedded objects were from either a rewarded or non-rewarded category, and if a rewarded-category object were present within the target-colored square, participants could earn extra money for correct performance. We observed that when the target color contained an object from a rewarded versus a non-rewarded category, the neural shift of attention to the target was faster and of greater magnitude, although the rewarded objects were not relevant for correct task performance. These results suggest that reward associations of complex objects can rapidly modulate attentional allocation to a target.

The attention habit: how reward learning shapes attentional selection

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications.