Emotion and attention: event-related brain potential studies

Imaging cortical activity following affective stimulation with a high temporal and spatial resolution

Background

The affective and motivational relevance of a stimulus has a distinct impact on cortical processing, particularly in sensory areas. However, the spatial and temporal dynamics of this affective modulation of brain activities remains unclear. The purpose of the present study was the development of a paradigm to investigate the affective modulation of cortical networks with a high temporal and spatial resolution. We assessed cortical activity with MEG using a visual steady-state paradigm with affective pictures. A combination of a complex demodulation procedure with a minimum norm estimation was applied to assess the temporal variation of the topography of cortical activity.

Results

Statistical permutation analyses of the results of the complex demodulation procedure revealed increased steady-state visual evoked field amplitudes over occipital areas following presentation of affective pictures compared to neutral pictures. This differentiation shifted in the time course from occipital regions to parietal and temporal regions.

Conclusion

It can be shown that stimulation with affective pictures leads to an enhanced activity in occipital region as compared to neutral pictures. However, the focus of differentiation is not stable over time but shifts into temporal and parietal regions within four seconds of stimulation. Thus, it can be crucial to carefully choose regions of interests and time intervals when analyzing the affective modulation of cortical activity.

Individual preferences modulate incentive values: Evidence from functional MRI

Background

In most studies on human reward processing, reward intensity has been manipulated on an objective scale (e.g., varying monetary value). Everyday experience, however, teaches us that objectively equivalent rewards may differ substantially in their subjective incentive values. One factor influencing incentive value in humans is branding. The current study explores the hypothesis that individual brand preferences modulate activity in reward areas similarly to objectively measurable differences in reward intensity.

Methods

A wheel-of-fortune game comprising an anticipation phase and a subsequent outcome evaluation phase was implemented. Inside a 3 Tesla MRI scanner, 19 participants played for chocolate bars of three different brands that differed in subjective attractiveness.

Results

Parametrical analysis of the obtained fMRI data demonstrated that the level of activity in anatomically distinct neural networks was linearly associated with the subjective preference hierarchy of the brands played for. During the anticipation phases, preference-dependent neural activity has been registered in premotor areas, insular cortex, orbitofrontal cortex, and in the midbrain. During the outcome phases, neural activity in the caudate nucleus, precuneus, lingual gyrus, cerebellum, and in the pallidum was influenced by individual preference.

Conclusion

Our results suggest a graded effect of differently preferred brands onto the incentive value of objectively equivalent rewards. Regarding the anticipation phase, the results reflect an intensified state of wanting that facilitates action preparation when the participants play for their favorite brand. This mechanism may underlie approach behavior in real-life choice situations.

Parallel processing of affective visual stimuli

Event-related potential (ERP) studies of affective picture processing have demonstrated an early posterior negativity (EPN) for emotionally arousing pictures that are embedded in a rapid visual stream. The present study examined the selective processing of emotional pictures while systematically varying picture presentation rates between 1 and 16 Hz. Previous results with presentation rates up to 5 Hz were replicated in that emotional compared to neutral pictures were associated with a greater EPN. Discrimination among emotional and neutral contents was maintained up to 12 Hz. To explore the notion of parallel processing, convolution analysis was used: EPNs generated by linear superposition of slow rate ERPs explained 70%-93% of the variance of measured EPNs, giving evidence for an impressive capacity of parallel affective discrimination in rapid serial picture presentation.

Electrophysiological evidence that drug cues have greater salience than other affective stimuli in opiate addiction

Previous research has demonstrated that drug cues are able to capture attentional resources in addicted populations. However, few studies have controlled for the possibility that drug users find all motivationally significant (i.e., affective) stimuli particularly salient. We examined this issue in opiate addiction, by exploring the impact of drug-related and affective stimuli on central attentional processes. Sixteen male heroin addicts (seven on opiate pharmacotherapy and nine recently detoxified subjects) and 12 matched controls were studied. Subjects were fitted with a 32-channel electrode cap and were instructed to passively view a series of neutral, affective and opiate-related images. The P300 elicited by drug-related stimuli was significantly larger than that elicited by affective and neutral stimuli in opiate users but not controls. Baseline ratings of craving were also found to predict the degree of P300 facilitation to the drug-related stimuli in the addicted group. Further, the opiate group demonstrated an absence of the typical enhancement of ERP responses to non-drug affective stimuli. These results suggest that opiate addicts demonstrate greater cortical processing of drug cues than other types of affective stimuli. Further research is required to assess whether addiction is specifically associated with reduced sensitivity to natural rewards, aversive stimuli or affective cues in general.

Affective ERP processing in a visual oddball task: arousal, valence, and gender

OBJECTIVE

To assess affective event-related brain potentials (ERPs) using visual pictures that were highly distinct on arousal level/valence category ratings and a response task.

METHODS

Images from the International Affective Pictures System (IAPS) were selected to obtain distinct affective arousal (low, high) and valence (negative, positive) rating levels. The pictures were used as target stimuli in an oddball paradigm, with a visual pattern as the standard stimulus. Participants were instructed to press a button whenever a picture occurred and to ignore the standard. Task performance and response time did not differ across conditions.

RESULTS

High-arousal compared to low-arousal stimuli produced larger amplitudes for the N2, P3, early slow wave, and late slow wave components. Valence amplitude effects were weak overall and originated primarily from the later waveform components and interactions with electrode position. Gender differences were negligible.

CONCLUSION

The findings suggest that arousal level is the primary determinant of affective oddball processing, and valence minimally influences ERP amplitude.

SIGNIFICANCE

Affective processing engages selective attentional mechanisms that are primarily sensitive to the arousal properties of emotional stimuli. The application and nature of task demands are important considerations for interpreting these effects.

Cocaine craving is associated with electrophysiological brain responses to cocaine-related stimuli

Several studies show that substance dependence disorders are characterized by an enhanced processing of substance-related stimuli. The present study was designed to examine the association between craving levels and selective processing of drug cues in cocaine-dependent patients using event-related brain potentials (ERPs). In abstinent cocaine-dependent patients and a healthy control group, we studied the late positive potential (LPP) amplitudes elicited by neutral and cocaine-related stimuli. The results show that cocaine-dependent patients have an enhanced electrophysiological response in the late LPP time window to cocaine-related stimuli as compared to controls, suggesting an enhanced processing of these stimuli. Most importantly, a robust association was observed between cocaine craving and LPP amplitude. High craving levels were associated with larger LPP amplitudes at central electrode sites in the right hemisphere. These findings are in line with theories linking motivational aspects and appetitive stimulus processing. Furthermore, it is demonstrated that ERPs are a useful index to assess motivational properties of stimuli in cocaine-dependent patients. These findings suggest that electrophysiological measures may have clinical relevance in substance use disorders.

Affective valence, stimulus attributes, and P300: color vs. black/white and normal vs. scrambled images

Pictures from the International Affective Picture System (IAPS) were selected to manipulate affective valence (unpleasant, neutral, pleasant) while keeping arousal level the same. The pictures were presented in an oddball paradigm, with a visual pattern used as the standard stimulus. Subjects pressed a button whenever a target was detected. Experiment 1 presented normal pictures in color and black/white. Control stimuli were constructed for both the color and black/white conditions by randomly rearranging 1 cm square fragments of each original picture to produce a "scrambled" image. Experiment 2 presented the same normal color pictures with large, medium, and small scrambled condition (2, 1, and 0.5 cm squares). The P300 event-related brain potential demonstrated larger amplitudes over frontal areas for positive compared to negative or neutral images for normal color pictures in both experiments. Attenuated and nonsignificant valence effects were obtained for black/white images. Scrambled stimuli in each study yielded no valence effects but demonstrated typical P300 topography that increased from frontal to parietal areas. The findings suggest that P300 amplitude is sensitive to affective picture valence in the absence of stimulus arousal differences, and that stimulus color contributes to ERP valence effects.

The costs of emotional attention: affective processing inhibits subsequent lexico-semantic analysis

The human brain has evolved to process motivationally relevant information in an optimized manner. The perceptual benefit for emotionally arousing material, termed motivated attention, is indexed by electrocortical amplification at various levels of stimulus analysis. An outstanding issue, particularly on a neuronal level, refers to whether and how perceptual enhancement for arousing signals translates into modified processing of information presented in temporal or spatial proximity to the affective cue. The present studies aimed to examine facilitation and interference effects of task-irrelevant emotional pictures on subsequent word identification. In the context of forced-choice lexical decision tasks, pictures varying in hedonic valence and emotional arousal preceded word/ pseudoword targets. Across measures and experiments, high-arousing compared to low-arousing pictures were associated with impaired processing of word targets. Arousing pleasant and unpleasant pictures prolonged word reaction times irrespective of stimulus-onset asynchrony (80 msec, 200 msec, 440 msec) and salient semantic category differences (e.g., erotica vs. mutilation pictures). On a neuronal level, interference was reflected in reduced N1 responses (204-264 msec) to both target types. Paralleling behavioral effects, suppression of the late positivity (404-704 msec) was more pronounced for word compared to pseudoword targets. Regional source modeling indicated that early reduction effects originated from inhibited cortical activity in posterior areas of the left inferior temporal cortex associated with orthographic processing. Modeling of later reduction effects argues for interference in distributed semantic networks comprising left anterior temporal and parietal sources. Thus, affective processing interferes with subsequent lexico-semantic analysis along the ventral stream.

Emotion processing in the visual brain: a MEG analysis

Recent functional magnetic resonance imaging (fMRI) and event-related brain potential (ERP) studies provide empirical support for the notion that emotional cues guide selective attention. Extending this line of research, whole head magneto-encephalogram (MEG) was measured while participants viewed in separate experimental blocks a continuous stream of either pleasant and neutral or unpleasant and neutral pictures, presented for 330 ms each. Event-related magnetic fields (ERF) were analyzed after intersubject sensor coregistration, complemented by minimum norm estimates (MNE) to explore neural generator sources. Both streams of analysis converge by demonstrating the selective emotion processing in an early (120-170 ms) and a late time interval (220-310 ms). ERF analysis revealed that the polarity of the emotion difference fields was reversed across early and late intervals suggesting distinct patterns of activation in the visual processing stream. Source analysis revealed the amplified processing of emotional pictures in visual processing areas with more pronounced occipito-parieto-temporal activation in the early time interval, and a stronger engagement of more anterior, temporal, regions in the later interval. Confirming previous ERP studies showing facilitated emotion processing, the present data suggest that MEG provides a complementary look at the spread of activation in the visual processing stream.

Affective picture processing: an integrative review of ERP findings

The review summarizes and integrates findings from 40 years of event-related potential (ERP) studies using pictures that differ in valence (unpleasant-to-pleasant) and arousal (low-to-high) and that are used to elicit emotional processing. Affective stimulus factors primarily modulate ERP component amplitude, with little change in peak latency observed. Arousal effects are consistently obtained, and generally occur at longer latencies. Valence effects are inconsistently reported at several latency ranges, including very early components. Some affective ERP modulations vary with recording methodology, stimulus factors, as well as task-relevance and emotional state. Affective ERPs have been linked theoretically to attention orientation for unpleasant pictures at earlier components (<300 ms). Enhanced stimulus processing has been associated with memory encoding for arousing pictures of assumed intrinsic motivational relevance, with task-induced differences contributing to emotional reactivity at later components (>300 ms). Theoretical issues, stimulus factors, task demands, and individual differences are discussed.

Physiology-based modeling of cortical auditory evoked potentials

Evoked potentials are the transient electrical responses caused by changes in the brain following stimuli. This work uses a physiology-based continuum model of neuronal activity in the human brain to calculate theoretical cortical auditory evoked potentials (CAEPs) from the model's linearized response. These are fitted to experimental data, allowing the fitted parameters to be related to brain physiology. This approach yields excellent fits to CAEP data, which can then be compared to fits of EEG spectra. It is shown that the differences between resting eyes-open EEG and standard CAEPs can be explained by changes in the physiology of populations of neurons in corticothalamic pathways, with notable similarities to certain aspects of slow-wave sleep. This pilot study demonstrates the ability of our model-based fitting method to provide information on the underlying physiology of the brain that is not available using standard methods.

Effects of dopaminergic modulation on electrophysiological brain response to affective stimuli

INTRODUCTION

Several theoretical accounts of the role of dopamine suggest that dopamine has an influence on the processing of affective stimuli. There is some indirect evidence for this from studies showing an association between the treatment with dopaminergic agents and self-reported affect.

MATERIALS AND METHODS

We addressed this issue directly by examining the electrophysiological correlates of affective picture processing during a single-dose treatment with a dopamine D2 agonist (bromocriptine), a dopamine D2 antagonist (haloperidol), and a placebo. We compared early and late event-related brain potentials (ERPs) that have been associated with affective processing in the three medication treatment conditions in a randomized double-blind crossover design amongst healthy males. In each treatment condition, subjects attentively watched neutral, pleasant, and unpleasant pictures while ERPs were recorded.

RESULTS

Results indicate that neither bromocriptine nor haloperidol has a selective effect on electrophysiological indices of affective processing. In concordance with this, no effects of dopaminergic modulation on self-reported positive or negative affect was observed. In contrast, bromocriptine decreased overall processing of all stimulus categories regardless of their affective content.

DISCUSSION

The results indicate that dopaminergic D2 receptors do not seem to play a crucial role in the selective processing of affective visual stimuli.

Affective picture processing: an integrative review of ERP findings

The review summarizes and integrates findings from 40 years of event-related potential (ERP) studies using pictures that differ in valence (unpleasant-to-pleasant) and arousal (low-to-high) and that are used to elicit emotional processing. Affective stimulus factors primarily modulate ERP component amplitude, with little change in peak latency observed. Arousal effects are consistently obtained, and generally occur at longer latencies. Valence effects are inconsistently reported at several latency ranges, including very early components. Some affective ERP modulations vary with recording methodology, stimulus factors, as well as task-relevance and emotional state. Affective ERPs have been linked theoretically to attention orientation for unpleasant pictures at earlier components (<300 ms). Enhanced stimulus processing has been associated with memory encoding for arousing pictures of assumed intrinsic motivational relevance, with task-induced differences contributing to emotional reactivity at later components (>300 ms). Theoretical issues, stimulus factors, task demands, and individual differences are discussed.

Affective visual event-related potentials: arousal, valence, and repetition effects for normal and distorted pictures

Event-related potentials (ERPs) were used to assess arousal (low, high), valence (negative, positive), and stimulus repetition effects for normal and distorted images from the International Affective Pictures System (IAPS). Distorted stimuli were constructed by dividing each image into small squares and rearranging the segments randomly to produce a "scrambled" picture. Event-related potentials (ERPs) were elicited by presenting the normal and scrambled images as target stimuli, with a repeated visual pattern used as the standard stimulus. Participants (N=32) were instructed to press a button to the targets and ignore the standard. Stimulus repetition effects were assessed by presenting each stimulus twice in the normal and scrambled condition. High-arousal stimuli yielded larger late positive components for both the normal and scrambled pictures. No overall valence effects were obtained, but arousal and valence influenced component amplitudes for middle-latency ERPs from the scrambled stimuli. For the normal pictures, stimulus repetition was associated with increased component amplitudes for all potentials and decreased RTs of all affective categories. For the scrambled pictures, no repetition changes were obtained. The findings suggest that stimulus arousal level contributes more than valence to affective ERP measures for normal as well as perceptually distorted pictures. Stimulus repetition engages memory for previous normal picture items but is not influenced by affective category. Theoretical implications are discussed.

Low spatial frequency filtering modulates early brain processing of affective complex pictures

Recent research on affective processing has suggested that low spatial frequency information of fearful faces provide rapid emotional cues to the amygdala, whereas high spatial frequencies convey fine-grained information to the fusiform gyrus, regardless of emotional expression. In the present experiment, we examined the effects of low (LSF, <15 cycles/image width) and high spatial frequency filtering (HSF, >25 cycles/image width) on brain processing of complex pictures depicting pleasant, unpleasant, and neutral scenes. Event-related potentials (ERP), percentage of recognized stimuli and response times were recorded in 19 healthy volunteers. Behavioral results indicated faster reaction times in response to unpleasant LSF than to unpleasant HSF pictures. Unpleasant LSF pictures and pleasant unfiltered pictures also elicited significant enhancements of P1 amplitudes at occipital electrodes as compared to neutral LSF and unfiltered pictures, respectively; whereas no significant effects of affective modulation were found for HSF pictures. Moreover, mean ERP amplitudes in the time between 200 and 500ms post-stimulus were significantly greater for affective (pleasant and unpleasant) than for neutral unfiltered pictures; whereas no significant affective modulation was found for HSF or LSF pictures at those latencies. The fact that affective LSF pictures elicited an enhancement of brain responses at early, but not at later latencies, suggests the existence of a rapid and preattentive neural mechanism for the processing of motivationally relevant stimuli, which could be driven by LSF cues. Our findings confirm thus previous results showing differences on brain processing of affective LSF and HSF faces, and extend these results to more complex and social affective pictures.

Selective visual attention to emotion

Visual attention can be voluntarily directed toward stimuli and is attracted by stimuli that are emotionally significant. The present study explored the case when both processes coincide and attention is directed to emotional stimuli. Participants viewed a rapid and continuous stream of high-arousing erotica and mutilation stimuli as well as low-arousing control images. Each of the three stimulus categories served in separate runs as target or nontarget category. Event-related brain potential measures revealed that the interaction of attention and emotion varied for specific processing stages. The effects of attention and emotional significance operated additively during perceptual encoding indexed by negative-going potentials over posterior regions (approximately 200-350 ms after stimulus onset). In contrast, thought to reflect the process of stimulus evaluation, P3 target effects (approximately 400-600 ms after stimulus onset) were markedly augmented when erotica and mutilation compared with control stimuli were the focus of attention. Thus, emotion potentiated attention effects specifically during later stages of processing. These findings suggest to specify the interaction of attention and emotion in distinct processing stages.