How Does Awareness Modulate Goal-Directed and Stimulus-Driven Shifts of Attention Triggered by Value Learning?

Right Unilateral Spatial Neglect Improves with Intrinsic Motivation

Background. In the acute phase of stroke, it is well known that the incidence and severity of unilateral spatial neglect (USN) are more significant in the right hemisphere injuries. Still, the detection of USN in left hemisphere injuries has been increasing in recent years. This trend is because behavioral assessments have prevented the exclusion of patients who are difficult to assess for USN or apathy using conventional paper-and-pencil tests (e.g., aphasia). Right USN and post-stroke apathy share many common lesions. Therefore, clinical symptoms may overlap, but little validation considers this. Case Study. A man (62 years old) determined to have the right USN and apathy was treated for six weeks in 3 terms. In the first term (weeks 1 to 2), the patient was treated for the right USN by conventional therapy. In the second term (3–4 weeks), treatment for right USN and apathy by goal-directed therapy based on affinity behavior was implemented. In the third term (5–6 weeks), goal-directed therapy based on affinity behavior was discontinued, and treatment was returned to conventional therapy only. In the second term (goal-directed therapy based on affinity behavior), the improvement in patients' apathy (clinical assessment for spontaneity) was more significant than the effect size in the third term (conventional therapy). There were no significant differences in USN (catherine bergego scale) and intrinsic motivation (pittsburgh rehabilitation participation scale). However, the effect size in the second term tended to be larger than in the third term (conventional therapy). Clinical Rehabilitation Impact. This report aims to demonstrate the limitations of current treatment for cases determined to have both right USN and apathy. Second, to assess the extent to which this new intervention can complement the limitations of current treatment.

Task relevance and negative reward modulate the disengagement deficit of patients with spatial neglect

Though motivational value is a recognized trigger of approach and avoidance behavior, less is known about the potential of reward to capture attention. We here explored whether positive or negative reward modulates the characteristic deficit of patients with left spatial neglect to disengage attention from an ipsilesional distracter. We built our study on recent observations showing that the disengagement deficit is exaggerated for distracters with target-defining features, indicating that task-relevance captures attention. Patients with left neglect and matched healthy controls were asked to react to lateralized, colored targets preceded by a peripheral cue. Crucially, the cue either possessed the color of the target and was thus task-relevant, or was followed by a positive, negative, or neutral symbolic reward. Neglect patients only exhibited a disengagement deficit when cues were task-relevant or were followed by a negative reward. This finding indicates that attentional selection is driven by task-relevance and negative reward, possibly through interactions between limbic and attention networks.

The ABC Model of Happiness-Neurobiological Aspects of Motivation and Positive Mood, and Their Dynamic Changes through Practice, the Course of Life

Simple Summary

This article proposes a new model for exploring happiness primarily from a neurobiological perspective. Such understanding includes the dynamics of positive mood states and how they change throughout life. Happiness is not a cognitive construct: it is an immediate emotional experience—a feeling that relies on neurophysiological activation in the brain’s reward system. With this in mind, three types of happiness are proposed: (A) wanting, approaching, and pleasure, (B) avoiding, departing, and relief, (C) non-wanting, staying, and satisfaction. Behind this is a sophisticated (neuro)biological dynamic, ranging from the search for autonomy and ecstasy, which is particularly characteristic of young people, to the way we cope with stress, as we find it pronounced in the middle-aged, to deep contentment, peace, and inner joy, as it is mainly attributed to older people. Paradoxically, it is in fact the elderly who appear to be the happiest and most content—this phenomenon is also known as the “satisfaction paradox”. Apparently, these dynamic changes in happiness can be amplified with practice. Happiness is biological in this context, but can still be “learned”. Contemplative practices can serve as an example here to demonstrate this trainability, and they may themselves influence the course of happiness.

Abstract

Background: Happiness is a feeling, an immediate experience, not a cognitive construct. It is based on activity in the brain’s neurobiological reward and motivation systems, which have been retained in evolution. This conceptual review provides an overview of the basic neurobiological principles behind happiness phenomena and proposes a framework for further classification. Results: Three neurobiologically distinct types of happiness exist: (A) wanting, (B) avoiding, and (C) non-wanting. Behind these types lies a dynamic gradation, ranging from the more youthful anticipation, pleasure and ecstasy (A), to stress processing, escape and relief (B) as we find them accentuated in the middle-aged, to deep satisfaction, quiescence and inner joy (C), which is particularly attributed to older people. As a result, the development of happiness and satisfaction over the course of life typically takes the form of a U-curve. Discussion: The outlined triad and dynamic of happiness leads to the paradoxical finding that the elderly seem to be the happiest—a phenomenon that is termed “satisfaction paradox”. This assumed change in happiness and contentment over the life span, which includes an increasing “emancipation” from the idea of good health as a mandatory prerequisite for happiness and contentment, can itself be changed—it is trainable. Conclusions: Programs for mindfulness, contemplation, or stress reduction, including positive psychology and mind–body/behavioral medicine training, seem to be capable of influencing the course happiness over time: Happiness can be shaped through practice.

Reward-driven modulation of spatial attention in the human frontal eye-field

Attentional selection and the decision of where to make an eye-movement are driven by various factors such as the representation of salience, task goal, and stimulus relevance, as well as expectations or predictions based on past experience. Brain systems implicated in these processes recruit cortico-subcortical areas including the Frontal Eye-Field (FEF), parietal cortex, or superior colliculus. How these areas interact to govern attention remains elusive. Priority maps of space have been observed in several brain regions, but the neural substrates where different sources of information are combined and integrated to guide attentional selection has not been elucidated. We investigated here the neural mechanisms subserving how reward cues influence the voluntary deployment of attention, in conditions where stimulus-driven capture and task-related goals compete for attention selection. Using fMRI in a visual search task in n = 23 participants, we found a selective modulation of FEF by the reward value of distractors during attentional shifts, particularly after high-predictive cueing to invalid locations. Reward information also modulated FEF connectivity to superior colliculus, striatum, and visual cortex. We conclude that FEF may occupy a central position within brain circuits integrating different sources of top-down biases for the generation of spatial saliency maps and guidance of selective attention.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Reward-driven attention alters perceived salience

Many studies have revealed that reward-associated features capture attention. Neurophysiological evidence further suggests that this reward-driven attention effect modulates visual processes by enhancing low-level visual salience. However, no behavioral study to date has directly examined whether reward-driven attention changes how people see. Combining the two-phase paradigm with a psychophysical method, the current study found that compared with nonsalient cues associated with lower reward, the nonsalient cues associated with higher reward captured more attention, and increased the perceived contrast of the subsequent stimuli. This is the first direct behavioral evidence of the effect of reward-driven attention on low-level visual perception.

Motivation and reward mechanisms in health behavior change processes

With increasing prevalence of lifestyle-related chronic diseases worldwide, understanding health behavior change and the development of successful interventions to support lifestyle modification is gaining increasing interest among politicians, scientists, therapists and patients alike. A number of health behavior change theories have been developed aiming at explaining health behavior change and understanding the domains that make change more likely. Until now, only few studies have taken into account automatic, implicit or non-cognitive aspects of behavior, including emotion and positive affect. Recent progress in the neuroscience of motivation and reward systems can provide further insights into the relevance of such domains. In this integrative review, we present a description of the possible motivation and reward systems (approach/wanting = pleasure; aversion/avoiding = relief; assertion/non-wanting = quiescence) involved in behavior change. Therefore, based on established theories encompassing both initiation and maintenance of behavior change, we create a flexible seven-stage behavior change process with three engagement phases (non-engagement, motivational engagement, executive engagement) and relate the motivation and reward systems to each of these stages. We propose that either appetitive (preferably) or aversive motivational salience is activated during motivational engagement, that learning leads to continued behavior and that assertive salience prevails when the new behavior has become habitual. We discuss under which circumstances these mechanisms and reward-motivation pathways are likely to occur and address potential shortcomings of our proposed theoretical framework. We highlight implications for future interventions aiming at lifestyle modification.

Following the gold trail: Reward influences on spatial exploration in neglect

Spatial attention is guided by the perceived salience and relevance of objects in the environment, a process considered to depend on a broad parieto-frontal cortical network. Signals arising from the limbic and nigrostriatal pathways conveying affective and motivational cues are also known to modulate visual selection, but the nature of this contribution and its relation to spatial attention remain unclear. We investigated the role of reward information in 15 patients with left hemispatial neglect and 15 control subjects playing multiple rounds of a virtual foraging game. Participants' exploration tracked dynamically adjusted underlying reward distributions, largely unbeknownst to them. Both control and neglect participants showed typical exploration/exploitation balance, dependent on abundance or scarcity of rewards. De-reinforcing previously favored, mostly right, regions of space attenuated left space under-exploration in patients. Multiple regression analysis indicates that such reward-based training may benefit mostly patients early after lesion onset, with mild neglect and small lesions sparing subcortical regions. Our findings support the view that spatial exploration recruits heavily right hemispheric visuospatial attentional mechanisms as well as reward signals processed by basal ganglia and prefrontal cortical circuits, which serve to learn about the motivational relevance of environmental stimuli and help prioritize attention and motor response selection.

Knowledge about the predictive value of reward conditioned stimuli modulates their interference with cognitive processes

Stimuli conditioned with a substance can generate drug-approach behaviors due to their acquired motivational properties. According to implicit theories of addiction, these stimuli can decrease cognitive control automatically. The present study (n = 49) examined whether reward-associated stimuli can interfere with cognitive processes in the absence of knowledge about stimulus–outcome contingencies. Conditioned stimuli (CS) were paired with high-reward (HR) or low-reward (LR) probabilities of monetary reward using a Pavlovian learning task. Participants were categorized as Aware or Unaware of contingencies using a Bayesian analysis. CS were then used as task-irrelevant distractors in modified flanker and N-back tasks. Results show HR CS can generate increased interference in the flanker task for participants Unaware of contingencies, contributing further evidence for the existence of implicit Pavlovian conditioning. For the N-back task, working memory performance was affected by HR CS, albeit only for Aware participants. These results suggest that CS can interfere implicitly with cognitive processes in a similar way to drug-related stimuli. Such an effect could occur in a stimulus-driven fashion, devoid of top-down goal-directedness. These findings have implications for the conceptualization and study of implicit processes in addiction and highlights the necessity to reconsider the measurement of such phenomena.

Influence of reward learning on visual attention and eye movements in a naturalistic environment: A virtual reality study

Rewards constitute crucial signals that motivate approach behavior and facilitate the perceptual processing of objects associated with favorable outcomes in past encounters. Reward-related influences on perception and attention have been reliably observed in studies where a reward is paired with a unidimensional low-level visual feature, such as the color or orientation of a line in visual search tasks. However, our environment is drastically different and composed of multidimensional and changing visual features, encountered in complex and dynamic scenes. Here, we designed an immersive virtual reality (VR) experiment using a 4-frame CAVE system to investigate the impact of rewards on attentional orienting and gaze patterns in a naturalistic and ecological environment. Forty-one healthy participants explored a virtual forest and responded to targets appearing on either the left or right side of their path. To test for reward-induced biases in spatial orienting, targets on one side were associated with high reward, whereas those on the opposite side were paired with a low reward. Eye-movements recording showed that left-side high rewards led to subsequent increase of eye gaze fixations towards this side of the path, but no such asymmetry was found after exposure to right-sided high rewards. A milder spatial bias was also observed after left-side high rewards during subsequent exploration of a virtual castle yard, but not during route turn choices along the forest path. Our results indicate that reward-related influences on attention and behavior may be better learned in left than right space, in line with a right hemisphere dominance, and could generalize to another environment to some extent, but not to spatial choices in another decision task, suggesting some domain- or context-specificity. This proof-of-concept study also outlines the advantages and the possible drawbacks of the use of the 3D CAVE immersive platform for VR in neuroscience.

Can Monetary Reward Modulate Social Attention?

Selective visual attention is a primary cognitive function, which allows the selection of the most relevant stimuli in the environment by prioritizing their processing. Several studies showed that this process can be influenced by both social signals, such as gaze direction (i.e., the Gaze Cueing Effect, GCE) and by the motivational valence of gratifying stimuli, such as monetary rewards. The aim of this study was to explore whether GCE could be modulated by a monetary reward. To this end, we created an experiment in which participants performed a gaze cuing task before and after an implicit learning task aiming to induce an association between gaze direction and monetary reward (experimental condition), or after a perceptual task (control condition). Statistical analyses were conducted following both a frequentist and a Bayesian approach. Results supported previous findings showing the presence of the GCE, i.e., faster responses in congruent trials when the target appeared in the gazed-at location. Interestingly, our results did not reveal significant differences among the conditions. Therefore, contrary to what was reported by previous attentional orienting studies with non-social stimuli, monetary reward does not seem to be able to modulate (or interfere with) the orienting of attention mediated by gaze direction as measured by the GCE. Taken together our results suggest that social signals such as gaze direction have a greater impact than monetary reward in orienting selective attention.

Value-driven attentional capture in neglect

OBJECTIVE

Recent studies suggest that motivational cues such as rewards may be a powerful determinant of attentional selection, both in healthy subjects and in brain-damaged patients suffering from neglect. However, the exact brain mechanisms underlying these effects and their relation to other well-known attentional systems are still poorly known.

METHODS

We designed a visual search paradigm to examine how value-based attentional priority could modulate spatial orienting in patients with pathological biases due to neglect after right hemispheric stroke. Targets were preceded by exogenous valid or invalid spatial cues, in the presence or absence of distractors that were associated with high reward values subsequent to an initial reinforcement training phase.

RESULTS

We found that the learned reward value of distractors interfered with spatial reorienting toward the left (neglected) side when neglect patients were invalidly cued to the right side. Moreover, the presence of reward-associated distractors in the contralesional field interfered most with the detection of task-relevant targets on the same side, and this interference was exaggerated with more severe neglect. Voxelwise anatomical lesion analysis indicated that damage to the right angular gyrus, as well as lateral occipital and inferior temporal areas of the right hemisphere, were associated with stronger value-driven attentional effects.

CONCLUSIONS

Visual stimuli previously associated with rewards receive higher attentional priority during visual search despite pathological spatial biases due to neglect, and thus interfere with orienting to contralesional targets, presumably by competing with top-down mechanisms controlling exogenous spatial attention. Reward signals may bias neural activity evoked by visual stimuli, independent of conscious control, through a common priority map integrating several different attentional influences. These results do not only provide novel insights to link spatial orienting and motivational signals within current models of attention, but also open new perspectives that may usefully be exploited for neurological rehabilitation strategies in patients suffering from attentional deficits and neglect.

Cross-modal integration during value-driven attentional capture

A growing body of evidence suggests that reward may be a powerful determinant of attentional selection. To date, the study of value-based attentional capture has been mainly focused on the visual sensory modality. It is yet unknown how reward information is communicated and integrated across the different senses in order to resolve between competing choices during selective attention. Our study investigated the interference produced by an auditory reward-associated distractor when a semantically-related visual target was concurrently presented. We measured both manual and saccadic response times towards a target image (drum or trumpet), while an irrelevant sound (congruent or incongruent instrument) was heard. Each sound was previously associated with either a high or a low reward. We found that manual responses were slowed by a high-reward auditory distractor when sound and image were semantically congruent. A similar effect was observed for saccadic responses, but only for participants aware of the past reward contingencies. Auditory events associated with reward value were thus capable of involuntarily capturing attention in the visual modality. This reward effect can mitigate cross-modal semantic integration and appears to be differentially modulated by awareness for saccadic vs. manual responses. Together, our results extend previous work on value-driven attentional biases in perception by showing that these may operate across sensory modalities and override cross-modal integration for semantically-related stimuli. This study sheds new light on the potential implication of brain regions underlying value-driven attention across sensory modalities.