Dynamic Interplay between Reward and Voluntary Attention Determines Stimulus Processing in Visual Cortex

Reward-based modulation of task-switching performance: a diffusion model analysis

Investigating the interface between motivation and cognitive control, we conducted two task switching experiments (N = 96 each) with reward manipulation where participants switched between three different tasks. We measured N-2 task repetition costs, which denote the performance decrement in N-2 task repetition sequences (ABA) relative to N-2 task switch sequences (CBA), and which are presumed to be a marker of inhibitory control in task switching. Participants in the reward group received performance-contingent reward in the second phase of each experiment, and in the second experiment they were additionally penalized for errors. Reward thresholds were determined individually based on participants' performance during the first phase of each experiment. Participants in the control group did not receive any reward. The reward manipulation led to faster performance in the reward group relative to the control group. Diffusion modeling revealed that the reward manipulation induced an increase in drift rate parameter, consistent with dopamine-based enhancement of attentional focus under reward. Contrary to our expectations, no robust evidence for a reward-based modulation of N-2 repetition costs was found across the two experiments. N-2 task repetition costs were small in both experiments, and possibly, a larger amount of inhibitory control is needed in order to obtain empirical evidence for a reward-related modulation thereof. However, additional analyses suggested that reward may not interact with inhibitory control on the task level at all.

Can neural correlates of encoding explain the context dependence of reward-enhanced memory?

Selective encoding can be studied by manipulating how valuable it is for participants to remember specific stimuli, for instance, by varying the monetary reward participants receive for recalling a particular stimulus in a subsequent memory test. It would be reasonable for participants to strategically attend more to high-reward items compared to low-reward items in mixed list contexts, but to attend both types of items equally in pure list contexts, where all items are of equal value. Reward-enhanced memory may be driven by automatic dopaminergic interactions between reward circuitry and the hippocampus and thus be insensitive to list context; or it may be driven by meta-cognitive strategies, and thus context-dependent. We contrasted these alternatives by manipulating list composition and tracked selective encoding through multiple EEG measures of attention and rehearsal. Behavioral results were context-dependent, such that recall of high-reward items was increased only in mixed lists. This result and aspects of the recall dynamics confirm predictions of the eCMR (emotional Context Maintenance and Retrieval) model. The power of ssVEPs was lower for high-reward items regardless of list composition, suggesting decreased visual processing of high-reward stimuli and that ssVEPs may index the modulation of context-to-item associations predicted by eCMR. By contrast, reward modulated the amplitude of Late Positive Potential and Frontal Slow Wave only in mixed lists. Taken together, the results provide evidence that reward-enhanced memory is caused by an interplay between strategic processes applied when high- and low-reward items compete for cognitive resources during encoding and context-dependent mechanisms operating during recall.

Differential effects of intra-modal and cross-modal reward value on perception: ERP evidence

In natural environments objects comprise multiple features from the same or different sensory modalities but it is not known how perception of an object is affected by the value associations of its constituent parts. The present study compares intra- and cross-modal value-driven effects on behavioral and electrophysiological correlates of perception. Human participants first learned the reward associations of visual and auditory cues. Subsequently, they performed a visual discrimination task in the presence of previously rewarded, task-irrelevant visual or auditory cues (intra- and cross-modal cues, respectively). During the conditioning phase, when reward associations were learned and reward cues were the target of the task, high value stimuli of both modalities enhanced the electrophysiological correlates of sensory processing in posterior electrodes. During the post-conditioning phase, when reward delivery was halted and previously rewarded stimuli were task-irrelevant, cross-modal value significantly enhanced the behavioral measures of visual sensitivity, whereas intra-modal value produced only an insignificant decrement. Analysis of the simultaneously recorded event-related potentials (ERPs) of posterior electrodes revealed similar findings. We found an early (90-120 ms) suppression of ERPs evoked by high-value, intra-modal stimuli. Cross-modal stimuli led to a later value-driven modulation, with an enhancement of response positivity for high- compared to low-value stimuli starting at the N1 window (180-250 ms) and extending to the P3 (300-600 ms) responses. These results indicate that sensory processing of a compound stimulus comprising a visual target and task-irrelevant visual or auditory cues is modulated by the reward value of both sensory modalities, but such modulations rely on distinct underlying mechanisms.

Cognitive Control as a Multivariate Optimization Problem

A hallmark of adaptation in humans and other animals is our ability to control how we think and behave across different settings. Research has characterized the various forms cognitive control can take-including enhancement of goal-relevant information, suppression of goal-irrelevant information, and overall inhibition of potential responses-and has identified computations and neural circuits that underpin this multitude of control types. Studies have also identified a wide range of situations that elicit adjustments in control allocation (e.g., those eliciting signals indicating an error or increased processing conflict), but the rules governing when a given situation will give rise to a given control adjustment remain poorly understood. Significant progress has recently been made on this front by casting the allocation of control as a decision-making problem. This approach has developed unifying and normative models that prescribe when and how a change in incentives and task demands will result in changes in a given form of control. Despite their successes, these models, and the experiments that have been developed to test them, have yet to face their greatest challenge: deciding how to select among the multiplicity of configurations that control can take at any given time. Here, we will lay out the complexities of the inverse problem inherent to cognitive control allocation, and their close parallels to inverse problems within motor control (e.g., choosing between redundant limb movements). We discuss existing solutions to motor control's inverse problems drawn from optimal control theory, which have proposed that effort costs act to regularize actions and transform motor planning into a well-posed problem. These same principles may help shed light on how our brains optimize over complex control configuration, while providing a new normative perspective on the origins of mental effort.