Reward sharpens orientation coding independently of attention

Interaction of spatial attention and the associated reward value of audiovisual objects

Reward value and selective attention both enhance the representation of sensory stimuli at the earliest stages of processing. It is still debated whether and how reward-driven and attentional mechanisms interact to influence perception. Here we ask whether the interaction between reward value and selective attention depends on the sensory modality through which the reward information is conveyed. Human participants first learned the reward value of uni-modal visual and auditory stimuli during a conditioning phase. Subsequently, they performed a target detection task on bimodal stimuli containing a previously rewarded stimulus in one, both, or neither of the modalities. Additionally, participants were required to focus their attention on one side and only report targets on the attended side. Our results showed a strong modulation of visual and auditory event-related potentials (ERPs) by spatial attention. We found no main effect of reward value but importantly we found an interaction effect as the strength of attentional modulation of the ERPs was significantly affected by the reward value. When reward effects were examined separately with respect to each modality, auditory value-driven modulation of attention was found to dominate the ERP effects whereas visual reward value on its own led to no effect, likely due to its interference with the target processing. These results inspire a two-stage model where first the salience of a high reward stimulus is enhanced on a local priority map specific to each sensory modality, and at a second stage reward value and top-down attentional mechanisms are integrated across sensory modalities to affect perception.

Effects of selective attention on the C1 ERP component: A systematic review and meta-analysis

The C1 event-related potential (ERP) captures the earliest stage of feedforward processing in the primary visual cortex (V1). An ongoing debate is whether top-down selective attention can modulate the C1. One side of the debate pointed out that null findings appear to outnumber positive findings; thus, selective attention does not seem to influence the C1. However, this suggestion is not based on a valid approach to summarizing evidence across studies. Therefore, we conducted a systematic review and meta-analysis investigating the effects of selective attention on the C1, involving 47 experiments and 794 subjects in total. Despite heterogeneity across studies, results suggested that attention has a moderate effect on the C1 (Cohen's d z $$ {d}_z $$  = 0.33, p < .0001); that is, C1 amplitude is larger for visual stimuli that are attended than unattended. These results suggest that C1 is affected by top-down selective attention.

Moving fast and seeing slow? The visual consequences of vigorous movement

In active agents, sensory and motor processes form an inevitable bond. This wedding is particularly striking for saccadic eye movements - the prime target of Shadmehr and Ahmed's thesis - which impose frequent changes on the retinal image. Changes in movement vigor (latency and speed), therefore, will need to be accompanied by changes in visual and attentional processes. We argue that the mechanisms that control movement vigor may also enable vision to attune to changes in movement kinematics.

Performance-dependent reward hurts performance: The non-monotonic attentional load modulation on task-irrelevant distractor processing

Selective attention is essential when we face sensory inputs with distractions. In the past decades, Lavie's load theory of selective attention delineates a complete picture of distractor suppression under different attentional control load. The present study was originally designed to explore how reward modulates the load effect of attentional selection. Unexpectedly, it revealed new findings under extended attentional load that was not involved in previous work. Participants were asked to complete a rewarded attentive visual tracking task while presented with irrelevant auditory oddball stimuli, with their behavioral performance, event-related potentials and pupillary responses recorded. We found that although the behavioral performance and pupil sizes varied unidirectionally with the attentional load, the processing of distractors as reflected by the mismatch negativity (MMN) increased first and then decreased. In contrast to the prediction of Lavie's theory that attentional control fails to effectively suppress distractor processing under high attentional control load, our finding suggests that extremely high attentional control load may instead require suppression of distractor processing at a stage as early as possible. Besides, P3a, a positive-polarity response sometimes following the MMN, was not affected by the attentional load, but both N1 (a negative-polarity component peaking ~100 ms from sound onset) and P3a were weakened at higher reward, indicating that reward leads to attenuated early processing of distractor and thus suppresses the attentional orienting towards distractors. These findings altogether complement Lavie's load theory of selective attention, presenting a more complex picture of how attentional load and reward affects selective attention.

Effect of Methylphenidate on Resting-State Connectivity in Adolescents With a Disruptive Behavior Disorder: A Double-Blind Randomized Placebo-Controlled fMRI Study

Some studies suggest that methylphenidate (MPH) might be an effective treatment for antisocial and aggressive behavior in adolescence. However, little is known about the mechanism of action of MPH in adolescents with this kind of psychopathology. MPH is a dopamine and norepinephrine reuptake inhibitor and thus it is likely to affect dopaminergic mesocorticolimbic pathways. This is the first study to investigate the effect of MPH on resting-state connectivity of three mesolimbic seed regions with the rest of the brain in clinical referred male adolescents with a disruptive behavior disorder (DBD). Thirty-six male DBD adolescents and 31 male healthy controls (HCs) were included. DBD subjects were randomly allocated to a single dose of MPH (DBD-MPH, n = 20) or placebo (DBD-PCB, n = 16). Seed-based resting-state functional connectivity of the nucleus accumbens (NAcc), amygdala, and ventral tegmental area (VTA) with the rest of the brain was compared between groups. The NAcc seed showed increased connectivity in DBD-PCB compared to HC with the occipital cortex, posterior cingulate cortex (PCC), precuneus, and inferior parietal lobule (IPL) and increased connectivity in DBD-PCB compared to DBD-MPH with occipital cortex, IPL, and medial frontal gyrus. The amygdala seed showed increased connectivity in DBD-PCB compared to HC with the precuneus and PCC. The VTA seed showed increased connectivity in the DBD-MPH compared to the DBD-PCB group with a cluster in the postcentral gyrus and a cluster in the supplementary motor cortex/superior frontal gyrus. Both NAcc and amygdala seeds showed no connectivity differences in the DBD-MPH compared to the HC group, indicating that MPH normalizes the increased functional connectivity of mesolimbic seed regions with areas involved in moral decision making, visual processing, and attention.

Flexible top-down modulation in human ventral temporal cortex

Visual neuroscientists have long characterized attention as inducing a scaling or additive effect on fixed parametric functions describing neural responses (e.g., contrast response functions). Here, we instead propose that top-down effects are more complex and manifest in ways that depend not only on attention but also other cognitive processes involved in executing a task. To substantiate this theory, we analyze fMRI responses in human ventral temporal cortex (VTC) in a study where stimulus eccentricity and cognitive task are varied. We find that as stimuli are presented farther into the periphery, bottom-up stimulus-driven responses decline but top-down attentional enhancement increases substantially. This disproportionate enhancement of weak responses cannot be easily explained by conventional models of attention. Furthermore, we find that attentional effects depend on the specific cognitive task performed by the subject, indicating the influence of additional cognitive processes other than attention (e.g., decision-making). The effects we observe replicate in an independent experiment from the same study, and also generalize to a separate study involving different stimulus manipulations (contrast and phase coherence). Our results suggest that a quantitative understanding of top-down modulation requires more nuanced characterization of the multiple cognitive factors involved in completing a perceptual task.

Asymmetric perceptual confounds between canonical lightings and materials

To better understand the interactions between material perception and light perception, we further developed our material probe MatMix 1.0 into MixIM 1.0, which allows optical mixing of canonical lighting modes. We selected three canonical lighting modes (ambient, focus, and brilliance) and created scenes to represent the three illuminations. Together with four canonical material modes (matte, velvety, specular, glittery), this resulted in 12 basis images (the "bird set"). These images were optically mixed in our probing method. Three experiments were conducted with different groups of observers. In Experiment 1, observers were instructed to manipulate MixIM 1.0 and match optically mixed lighting modes while discounting the materials. In Experiment 2, observers were shown a pair of stimuli and instructed to simultaneously judge whether the materials and lightings were the same or different in a four-category discrimination task. In Experiment 3, observers performed both the matching and discrimination tasks in which only the ambient and focus light were implemented. Overall, the matching and discrimination results were comparable as (a) robust asymmetric perceptual confounds were found and confirmed in both types of tasks, (b) performances were consistent and all above chance levels, and (c) observers had higher sensitivities to our canonical materials than to our canonical lightings. The latter result may be explained in terms of a generic insensitivity for naturally occurring variations in light conditions. Our findings suggest that midlevel image features are more robust across different materials than across different lightings and, thus, more diagnostic for materials than for lightings, causing the asymmetric perceptual confounds.

High reward enhances perceptual learning

Studies of perceptual learning have revealed a great deal of plasticity in adult humans. In this study, we systematically investigated the effects and mechanisms of several forms (trial-by-trial, block, and session rewards) and levels (no, low, high, subliminal) of monetary reward on the rate, magnitude, and generalizability of perceptual learning. We found that high monetary reward can greatly promote the rate and boost the magnitude of learning and enhance performance in untrained spatial frequencies and eye without changing interocular, interlocation, and interdirection transfer indices. High reward per se made unique contributions to the enhanced learning through improved internal noise reduction. Furthermore, the effects of high reward on perceptual learning occurred in a range of perceptual tasks. The results may have major implications for the understanding of the nature of the learning rule in perceptual learning and for the use of reward to enhance perceptual learning in practical applications.

Differential aversive learning enhances orientation discrimination

A number of recent studies have documented rapid changes in behavioural sensory acuity induced by aversive learning in the olfactory and auditory modalities. The effect of aversive learning on the discrimination of low-level features in the visual system of humans remains unclear. Here, we used a psychophysical staircase procedure to estimate discrimination thresholds for oriented grating stimuli, before and after differential aversive learning. We discovered that when a target grating orientation was conditioned with an aversive loud noise, it subsequently led to an improvement of discrimination acuity in nearly all subjects. However, no such change was observed in a control group conditioned to an orientation shifted by ±90° from the target. Our findings cannot be explained by contextual learning or sensitisation factors. The results converge with those reported in the olfactory modality and provide further evidence that early sensory systems can be rapidly modified by recently experienced reinforcement histories.

A Hippocampal Signature of Perceptual Learning in Object Recognition

Perceptual learning is the improvement in perceptual performance through training or exposure. Here, we used fMRI before and after extensive behavioral training to investigate the effects of perceptual learning on the recognition of objects under challenging viewing conditions. Objects belonged either to trained or untrained categories. Trained categories were further subdivided into trained and untrained exemplars and were coupled with high or low monetary rewards during training. After a 3-day training, object recognition was markedly improved. Although there was a considerable transfer of learning to untrained exemplars within categories, an enhancing effect of reward reinforcement was specific to trained exemplars. fMRI showed that hippocampus responses to both trained and untrained exemplars of trained categories were enhanced by perceptual learning and correlated with the effect of reward reinforcement. Our results suggest a key role of hippocampus in object recognition after perceptual learning.

The effect of reward on orienting and reorienting in exogenous cuing

It is thought that reward-induced motivation influences perceptual, attentional, and cognitive control processes to facilitate behavioral performance. In this study, we investigated the effect of reward-induced motivation on exogenous attention orienting and inhibition of return (IOR). Attention was captured by peripheral onset cues that were nonpredictive for the target location. Participants performed a target discrimination task at short (170 ms) and long (960 ms) cue–target stimulus onset asynchronies. Reward-induced motivation was manipulated by exposing participants to low- and high-reward blocks. Typical cue facilitation effects on initial orienting were observed for both the low- and high-reward conditions. However, IOR was found only for the high-reward condition. This indicates that reward-induced motivation has a clear effect on reorienting and inhibitory processes following the initial capture of attention, but not on initial exogenous orienting that is considered to be exclusively automatic and stimulus-driven. We suggest that initial orienting is completely data-driven, not affected by top-down motivational processes, while reorienting and the accompanying IOR effect involve motivational top-down processes. To support this, we showed that reward-induced motivational processes and top-down control processes co-act in order to improve behavioral performance: High-reward-induced motivation caused an increase in top-down cognitive control, as signified by posterror slowing. Moreover, we show that personality trait propensity to reward-driven behavior (BAS-Drive scale) was related to reward-triggered behavioral changes in top-down reorienting, but not to changes in automatic orienting.

Attention modulates the dorsal striatum response to love stimuli

In previous functional magnetic resonance imaging (fMRI) studies concerning romantic love, several brain regions including the caudate and putamen have consistently been found to be more responsive to beloved-related than control stimuli. In those studies, infatuated individuals were typically instructed to passively view the stimuli or to think of the viewed person. In the current study, we examined how the instruction to attend to, or ignore the beloved modulates the response of these brain areas. Infatuated individuals performed an oddball task in which pictures of their beloved and friend served as targets and distractors. The dorsal striatum showed greater activation for the beloved than friend, but only when they were targets. The dorsal striatum actually tended to show less activation for the beloved than the friend when they were distractors. The longer the love and relationship duration, the smaller the response of the dorsal striatum to beloved-distractor stimuli was. We interpret our findings in terms of reinforcement learning. By virtue of using a cognitive task with a full factorial design, we show that the dorsal striatum is not activated by beloved-related information per se, but only by beloved-related information that is attended.

Set and setting: how behavioral state regulates sensory function and plasticity

Recently developed neuroimaging and electrophysiological techniques are allowing us to answer fundamental questions about how behavioral states regulate our perception of the external environment. Studies using these techniques have yielded surprising insights into how sensory processing is affected at the earliest stages by attention and motivation, and how new sensory information received during wakefulness (e.g., during learning) continues to affect sensory brain circuits (leading to plastic changes) during subsequent sleep. This review aims to describe how brain states affect sensory response properties among neurons in primary and secondary sensory cortices, and how this relates to psychophysical detection thresholds and performance on sensory discrimination tasks. This is not intended to serve as a comprehensive overview of all brain states, or all sensory systems, but instead as an illustrative description of how three specific state variables (attention, motivation, and vigilance [i.e., sleep vs. wakefulness]) affect sensory systems in which they have been best studied.

Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning.

Rewards teach visual selective attention

Visual selective attention is the brain function that modulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior. Enhanced analysis of currently relevant or otherwise salient information is often accompanied by suppressed processing of the less relevant or salient input. Recent findings indicate that rewards exert a powerful influence on the deployment of visual selective attention. Such influence takes different forms depending on the specific protocol adopted in the given study. In some cases, the prospect of earning a larger reward in relation to a specific stimulus or location biases attention accordingly in order to maximize overall gain. This is mediated by an effect of reward acting as a type of incentive motivation for the strategic control of attention. In contrast, reward delivery can directly alter the processing of specific stimuli by increasing their attentional priority, and this can be measured even when rewards are no longer involved, reflecting a form of reward-mediated attentional learning. As a further development, recent work demonstrates that rewards can affect attentional learning in dissociable ways depending on whether rewards are perceived as feedback on performance or instead are registered as random-like events occurring during task performance. Specifically, it appears that visual selective attention is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them. Overall this emerging literature demonstrates unequivocally that rewards "teach" visual selective attention so that processing resources will be allocated to objects, features and locations which are likely to optimize the organism's interaction with the surrounding environment and maximize positive outcome.