[Magnetoencephalography in psychiatry]

Neuropsychiatric disorders usually come with only sublime structural changes. Functional imaging can point at specific disturbances in information processing in neural networks. Besides imaging of receptor and metabolic functions with PET and fMRI, electromagnetic methods such as electroencephalography (EEG) and magnetoencephalography (MEG) offer the possibility for imaging of dynamic dysfunctions. As compared to EEG, MEG has a shorter history and is less common despite offering considerable advantages in temporospatial resolution and sensitivity to detect impaired signal processing and network functioning which renders it particularly interesting for psychiatric applications. Disturbed processing in the auditory and visual domain emerging in schizophrenic, affective and anxiety disorders can be detected with high sensitivity. Moreover, the neuromagnetic baseline activity allows conclusions to be drawn regarding neural network functions. Due to its high sensitivity to single deficits in information processing and to pharmacological effects, MEG will achieve clinical significance in specific areas.

Parallel processing of affective visual stimuli

Event-related potential (ERP) studies of affective picture processing have demonstrated an early posterior negativity (EPN) for emotionally arousing pictures that are embedded in a rapid visual stream. The present study examined the selective processing of emotional pictures while systematically varying picture presentation rates between 1 and 16 Hz. Previous results with presentation rates up to 5 Hz were replicated in that emotional compared to neutral pictures were associated with a greater EPN. Discrimination among emotional and neutral contents was maintained up to 12 Hz. To explore the notion of parallel processing, convolution analysis was used: EPNs generated by linear superposition of slow rate ERPs explained 70%-93% of the variance of measured EPNs, giving evidence for an impressive capacity of parallel affective discrimination in rapid serial picture presentation.

Early left-hemispheric dysfunction of face processing in congenital prosopagnosia: an MEG study

BACKGROUND

Congenital prosopagnosia is a severe face perception impairment which is not acquired by a brain lesion and is presumably present from birth. It manifests mostly by an inability to recognise familiar persons. Electrophysiological research has demonstrated the relevance to face processing of a negative deflection peaking around 170 ms, labelled accordingly as N170 in the electroencephalogram (EEG) and M170 in magnetoencephalography (MEG). The M170 was shown to be sensitive to the inversion of faces and to familiarity--two factors that are assumed to be crucial for congenital prosopagnosia. In order to locate the cognitive dysfunction and its neural correlates, we investigated the time course of neural activity in response to these manipulations.

METHODOLOGY

Seven individuals with congenital prosopagnosia and seven matched controls participated in the experiment. To explore brain activity with high accuracy in time, we recorded evoked magnetic fields (275 channel whole head MEG) while participants were looking at faces differing in familiarity (famous vs. unknown) and orientation (upright vs. inverted). The underlying neural sources were estimated by means of the least square minimum-norm-estimation (L2-MNE) approach.

PRINCIPAL FINDINGS

The behavioural data corroborate earlier findings on impaired configural processing in congenital prosopagnosia. For the M170, the overall results replicated earlier findings, with larger occipito-temporal brain responses to inverted than upright faces, and more right- than left-hemispheric activity. Compared to controls, participants with congenital prosopagnosia displayed a general decrease in brain activity, primarily over left occipitotemporal areas. This attenuation did not interact with familiarity or orientation.

CONCLUSIONS

The study substantiates the finding of an early involvement of the left hemisphere in symptoms of prosopagnosia. This might be related to an efficient and overused featural processing strategy which serves as a compensation of impaired configural processing.

Emotion processing in the visual brain: a MEG analysis

Recent functional magnetic resonance imaging (fMRI) and event-related brain potential (ERP) studies provide empirical support for the notion that emotional cues guide selective attention. Extending this line of research, whole head magneto-encephalogram (MEG) was measured while participants viewed in separate experimental blocks a continuous stream of either pleasant and neutral or unpleasant and neutral pictures, presented for 330 ms each. Event-related magnetic fields (ERF) were analyzed after intersubject sensor coregistration, complemented by minimum norm estimates (MNE) to explore neural generator sources. Both streams of analysis converge by demonstrating the selective emotion processing in an early (120-170 ms) and a late time interval (220-310 ms). ERF analysis revealed that the polarity of the emotion difference fields was reversed across early and late intervals suggesting distinct patterns of activation in the visual processing stream. Source analysis revealed the amplified processing of emotional pictures in visual processing areas with more pronounced occipito-parieto-temporal activation in the early time interval, and a stronger engagement of more anterior, temporal, regions in the later interval. Confirming previous ERP studies showing facilitated emotion processing, the present data suggest that MEG provides a complementary look at the spread of activation in the visual processing stream.

On the interplay between familiarity and emotional expression in face perception

Traditional models of face perception (e.g. Bruce and Young 1986) stress independent routes for processing identity and emotional expression. We investigated the interplay between familiarity and emotional expression by systematically varying both factors. In contrast to earlier studies which used binary forced-choice decisions, participants had to judge the familiarity of the presented face and the emotional hedonic valence and emotional arousal of its expressed emotion (angry, happy or neutral), using rating scales. The results demonstrated symmetric, strong interactions between familiarity and expressed emotion. Thus, this study supports more recent models of face perception (Haxby et al. 2000) that were mostly based on brain imaging data. These data together with our behavioural results emphasize the interaction of emotional expression and personal identity and support approaches that propose a relative segregation of these processes, rather than completely independent coding (Calder and Young 2005).

Rapid picture processing: affective primes and targets

In rapid serial visual presentation of pictures, an early ERP component shows enlarged negativity over occipital regions for emotional, compared to neutral, pictures. The present study examined the processing of emotional target pictures as a function of the hedonic valence of a preceding prime picture. Dense sensor ERPs were measured while subjects viewed a continuous stream of pleasant, neutral, and unpleasant pictures, presented for 335 ms each. Two main findings were observed: First, replicating previous results, emotional target pictures were associated with a larger posterior negativity, compared to neutral pictures. Second, the emotional content of the preceding prime picture affected target processing, with pleasant or unpleasant primes resulting in reduced negativity of the following picture, irrespective of its emotional valence. These findings are discussed within a framework of competition among successive pictures.

Electromagnetic indication of hypervigilant responses to emotional stimuli in blood-injection-injury fear

Blood phobia differs from other phobias and anxiety disorders in that no attentional bias for blood-related stimuli has been consistently observed. The present study aimed at clarifying this characteristic by investigating electromagnetic brain activity to blood-related and -unrelated pictures in high blood-fearful and non-fearful individuals. Relative to non-fearful controls, high blood-fearful subjects displayed more intense occipito-parietal activation 190-250ms after picture onset, which was interpreted as non-specifically enhanced sensory encoding of visual stimuli. Blood-related stimuli did not elicit different activity patterns in high blood-fearful subjects and controls, supporting the hypothesis that non-specific hypervigilance does not provide a basis for subsequent, specifically enhanced processing of fear-related contents.

Selective visual attention to emotion

Visual attention can be voluntarily directed toward stimuli and is attracted by stimuli that are emotionally significant. The present study explored the case when both processes coincide and attention is directed to emotional stimuli. Participants viewed a rapid and continuous stream of high-arousing erotica and mutilation stimuli as well as low-arousing control images. Each of the three stimulus categories served in separate runs as target or nontarget category. Event-related brain potential measures revealed that the interaction of attention and emotion varied for specific processing stages. The effects of attention and emotional significance operated additively during perceptual encoding indexed by negative-going potentials over posterior regions (approximately 200-350 ms after stimulus onset). In contrast, thought to reflect the process of stimulus evaluation, P3 target effects (approximately 400-600 ms after stimulus onset) were markedly augmented when erotica and mutilation compared with control stimuli were the focus of attention. Thus, emotion potentiated attention effects specifically during later stages of processing. These findings suggest to specify the interaction of attention and emotion in distinct processing stages.

Cross-modal attention capture by affective stimuli: Evidence from event-related potentials

The P3 component of the event-related potential (ERP) to an acoustic startle probe is modulated during picture viewing, with reduced P3 amplitude when participants view either pleasant or unpleasant, as opposed to neutral, pictures. We have interpreted this as reflecting capture of attentional resources by affective pictures, with fewer resources available for processing the secondary startle probe. In the present study, we tested this resource allocation hypothesis by presenting either pictures or sounds as foreground stimuli, with the prediction that P3 amplitude in response to secondary startle probes would be reduced for affectively engaging foregrounds regardless of modality. Using dense-array electroencephalography and a source estimation procedure, we observed that P3 amplitude was indeed smaller when startle probes were presented during emotional, as opposed to neutral, stimuli for both sound and picture foregrounds. Source modeling indicated a common frontocentral maximum of P3 modulation by affect. The data support the notion that emotionally arousing stimuli transmodally attract resources, leading to optimized processing of the affective stimuli at the cost of the processing of concurrent stimuli.

Explicit attention interferes with selective emotion processing in human extrastriate cortex

Background

Brain imaging and event-related potential studies provide strong evidence that emotional stimuli guide selective attention in visual processing. A reflection of the emotional attention capture is the increased Early Posterior Negativity (EPN) for pleasant and unpleasant compared to neutral images (~150–300 ms poststimulus). The present study explored whether this early emotion discrimination reflects an automatic phenomenon or is subject to interference by competing processing demands. Thus, emotional processing was assessed while participants performed a concurrent feature-based attention task varying in processing demands.

Results

Participants successfully performed the primary visual attention task as revealed by behavioral performance and selected event-related potential components (Selection Negativity and P3b). Replicating previous results, emotional modulation of the EPN was observed in a task condition with low processing demands. In contrast, pleasant and unpleasant pictures failed to elicit increased EPN amplitudes compared to neutral images in more difficult explicit attention task conditions. Further analyses determined that even the processing of pleasant and unpleasant pictures high in emotional arousal is subject to interference in experimental conditions with high task demand. Taken together, performing demanding feature-based counting tasks interfered with differential emotion processing indexed by the EPN.

Conclusion

The present findings demonstrate that taxing processing resources by a competing primary visual attention task markedly attenuated the early discrimination of emotional from neutral picture contents. Thus, these results provide further empirical support for an interference account of the emotion-attention interaction under conditions of competition. Previous studies revealed the interference of selective emotion processing when attentional resources were directed to locations of explicitly task-relevant stimuli. The present data suggest that interference of emotion processing by competing task demands is a more general phenomenon extending to the domain of feature-based attention. Furthermore, the results are inconsistent with the notion of effortlessness, i.e., early emotion discrimination despite concurrent task demands. These findings implicate to assess the presumed automatic nature of emotion processing at the level of specific aspects rather than considering automaticity as an all-or-none phenomenon.

Neuroimaging methods in affective neuroscience: selected methodological issues

A current goal of affective neuroscience is to reveal the relationship between emotion and dynamic brain activity in specific neural circuits. In humans, noninvasive neuroimaging measures are of primary interest in this endeavor. However, methodological issues, unique to each neuroimaging method, have important implications for the design of studies, interpretation of findings, and comparison across studies. With regard to event-related brain potentials, we discuss the need for dense sensor arrays to achieve reference-independent characterization of field potentials and improved estimate of cortical brain sources. Furthermore, limitations and caveats regarding sparse sensor sampling are discussed. With regard to event-related magnetic field (ERF) recordings, we outline a method to achieve magnetoencephalography (MEG) sensor standardization, which improves effects' sizes in typical neuroscientific investigations, avoids the finding of ghost effects, and facilitates comparison of MEG waveforms across studies. Focusing on functional magnetic resonance imaging (fMRI), we question the unjustified application of proportional global signal scaling in emotion research, which can greatly distort statistical findings in key structures implicated in emotional processing and possibly contributing to conflicting results in affective neuroscience fMRI studies, in particular with respect to limbic and paralimbic structures. Finally, a distributed EEG/MEG source analysis with statistical parametric mapping is outlined providing a common software platform for hemodynamic and electromagnetic neuroimaging measures. Taken together, to achieve consistent and replicable patterns of the relationship between emotion and neuroimaging measures, methodological aspects associated with the various neuroimaging techniques may be of similar importance as the definition of emotional cues and task context used to study emotion.

Effects of personal familiarity on early neuromagnetic correlates of face perception

This study investigated effects of familiarity and orientation on face processing by means of magnetoencephalography. Participants were presented with photographs of personally familiar, famous and unfamiliar faces in both upright and inverted orientation. They had to decide whether faces were familiar by means of manual yes/no responses. Independent of orientation, we observed a clear modulation of the M170 by familiarity, with personally familiar faces evoking larger amplitudes than unknown faces. The M170 was also sensitive to orientation, with larger amplitudes for inverted than upright faces. Moreover, the M170 exhibited larger amplitudes over the right than over the left hemisphere, but this asymmetry was present for upright faces only. The present data suggest that at least for personally familiar faces, neural correlates of identification start no later than approximately 170 ms, and underline a special role of the right hemisphere for faces in their typical upright orientation.

Electromagnetic brain activity evoked by affective stimuli in schizophrenia

Schizophrenia is typically associated with cognitive deficits, but symptoms also point to alterations in the processing of affective material, with potential impact on behavioral performance. This impact may unfold on multiple time scales, but initial processing of rapidly unfolding social cues may be particularly important. MEG-assessed regional brain activity associated with the capacity to process the emotional content of rapid visual stimuli (3/s) was examined in 12 individuals with schizophrenia and 12 matched controls. Patients showed less differentiation of emotional versus neutral stimuli 90-300 ms following picture onset. Together with group differences in the lateral topography of valence effects, these results are discussed as evidence of deficient automatic processing of emotionally potent stimuli in schizophrenia.

The categorization of natural scenes: Brain attention networks revealed by dense sensor ERPs

The present study examined cortical indicators of selective attention underlying categorization based on target features in natural scenes. The primary focus was to determine the neural sources associated with the processing of target stimuli containing animals compared to non-target control stimuli. Neural source estimation techniques [current source density (CSD) and L2-minimum norm estimate (L2-MNE)] were used to determine the sources of the potential fields measured from 58 sensor sites. Assuring an excellent signal-to-noise ratio, the categorization task consisted of 2400 trials. Replicating previous findings, target and non-target ERP activity diverged sharply around 150 ms after stimulus onset and the early differential ERP activity appeared as positive deflection over fronto-central sensor sites and as negative deflection over temporo-occipital regions. Both source estimation techniques (CSD and L2-MNE) suggested primary sources of the early differential ERP activity in posterior, visual-associative brain regions and, although less pronounced, revealed the contribution of additional anterior sources. These findings suggest that selective attention to category-relevant features reflects the interactions between prefrontal and inferior temporal cortex during visual processing of natural scenes.

Stimulus novelty and emotion perception: the near absence of habituation in the visual cortex

In rapid serial visual presentation of pictures, an early event-related brain potential component shows enlarged negativity over occipital regions for emotional pictures compared with neutral pictures. The present study examined whether the processing of emotional target pictures varies as a function of stimulus repetition. Accordingly, pictures of erotica, neutral contents, and mutilations were repeatedly presented (90 times) while the electroencephalogram was recorded with a 129 dense sensor array. As in previous studies, emotional pictures were associated with a larger posterior negativity than neutral pictures. Furthermore, differential emotion processing did not vary as a function of stimulus repetition and was similarly expressed across blocks of picture presentation. These findings suggest the near absence of habituation in differential emotion processing during perceptual processing.

Processing of emotional adjectives: Evidence from startle EMG and ERPs

Affective startle modulation in the electromyographic (EMG), auditory startle evoked potentials, and visually evoked potentials (VEPs) were assessed while subjects evaluated pleasant, unpleasant, and neutral adjectives. Acoustic startle probes were presented at random time points 2.5-4.0 s after word onset. The visual P2 and P3 potentials were generally larger during processing of emotional than of neutral adjectives. In contrast, the late positive component was enhanced and was correlated with larger EMG startle responses and auditory startle evoked potential P3 amplitudes for pleasant words only. During internal cognitive activity, the startle reflex represents a measure of "processing interrupt." Thus the startle tone interrupted processing of particularly pleasant adjectives and caused re-alerting to environmental stimuli. Specific effects for pleasant material may arise from a "positivity offset," favoring responses to pleasant material at lower arousal levels.

Fleeting images: rapid affect discrimination in the visual cortex

Converging electrophysiological and hemodynamic findings indicate sensory processing of emotional pictures is preferred to that of neutral pictures. Whereas neuroimaging studies of emotional picture perception have employed stimulus durations lasting several seconds, recent electrocortical investigations report early visual cortical discrimination between emotionally arousing and neutral picture processing. Here, we use a hybrid picture presentation paradigm covering a range of rapid presentation rates (0.75-6 Hz), while visual system activity is recorded with functional magnetic resonance imaging. Results demonstrate widespread sensitivity to emotional arousal in the secondary and inferior temporal visual cortex. Furthermore, activity in the lateral inferior occipital and medial inferior temporal visual cortex revealed equivalent emotion-sensitive activation across all presentation rates. Results further support the notion that attention and perceptual processing are in part directed by underlying motivational systems.

Emotion and attention: event-related brain potential studies

Emotional pictures guide selective visual attention. A series of event-related brain potential (ERP) studies is reviewed demonstrating the consistent and robust modulation of specific ERP components by emotional images. Specifically, pictures depicting natural pleasant and unpleasant scenes are associated with an increased early posterior negativity, late positive potential, and sustained positive slow wave compared with neutral contents. These modulations are considered to index different stages of stimulus processing including perceptual encoding, stimulus representation in working memory, and elaborate stimulus evaluation. Furthermore, the review includes a discussion of studies exploring the interaction of motivated attention with passive and active forms of attentional control. Recent research is reviewed exploring the selective processing of emotional cues as a function of stimulus novelty, emotional prime pictures, learned stimulus significance, and in the context of explicit attention tasks. It is concluded that ERP measures are useful to assess the emotion-attention interface at the level of distinct processing stages. Results are discussed within the context of two-stage models of stimulus perception brought out by studies of attention, orienting, and learning.

Neuroimaging of emotion: empirical effects of proportional global signal scaling in fMRI data analysis

Global variations of BOLD-fMRI signal are often considered as nuisance effects. This unwanted source of variance is commonly eliminated using proportional global signal scaling (PGSS). However, application of PGSS relies on the assumption that global variations of BOLD signal and experimental conditions are uncorrelated. It has been shown for cognitive tasks that the unjustified application of PGSS might greatly distort statistical results. The present study examined this issue in the domain of emotion research. Specifically, fMRI data were obtained in a block-design, while 21 subjects passively viewed high and low emotionally arousing pleasant, unpleasant, and neutral pictures. Violations of the orthogonality assumption were found for analyses of emotional pictures high in arousal, causing dramatically different outcomes when compared to analyses performed without PGSS. Application of PGSS was associated with attenuated emotional activation in visual cortical areas, insensitivity to emotional activations in limbic and paralimbic regions, and widely distributed artificial deactivations. In contrast, the orthogonality assumption was not violated for low arousing emotional materials. Thus, the validity of using PGSS varied as a function of the emotional arousal of the stimuli. Taken together, the unwarranted use of PGSS might contribute to conflicting results in affective neuroscience fMRI studies, in particular with respect to limbic and paralimbic structures.

The selective processing of briefly presented affective pictures: An ERP analysis

Recent event-related potential (ERP) studies revealed the selective processing of affective pictures. The present study explored whether the same phenomenon can be observed when pictures are presented only briefly. Toward this end, pleasant, neutral, and unpleasant pictures from the International Affective Pictures Series were presented for 120 ms while event related potentials were measured by dense sensor arrays. As observed for longer picture presentations, brief affective pictures were selectively processed. Specifically, pleasant and unpleasant pictures were associated with an early endogenous negative shift over temporo-occipital sensors compared to neutral images. In addition, affective pictures elicited enlarged late positive potentials over centro-parietal sensor sites relative to neutral images. These data suggest that a quick glimpse of emotionally relevant stimuli appears sufficient to tune the brain for selective perceptual processing.

The Facilitated Processing of Threatening Faces: An ERP Analysis

Threatening, friendly, and neutral faces were presented to test the hypothesis of the facilitated perceptual processing of threatening faces. Dense sensor event-related brain potentials were measured while subjects viewed facial stimuli. Subjects had no explicit task for emotional categorization of the faces. Assessing early perceptual stimulus processing, threatening faces elicited an early posterior negativity compared with nonthreatening neutral or friendly expressions. Moreover, at later stages of stimulus processing, facial threat also elicited augmented late positive potentials relative to the other facial expressions, indicating the more elaborate perceptual analysis of these stimuli. Taken together, these data demonstrate the facilitated perceptual processing of threatening faces. Results are discussed within the context of an evolved module of fear (A. Ohman & S. Mineka, 2001).

Attention and emotion: an ERP analysis of facilitated emotional stimulus processing

Recent event-related potential studies observed an early posterior negativity (EPN) reflecting facilitated processing of emotional images. The present study explored if the facilitated processing of emotional pictures is sustained while subjects perform an explicit non-emotional attention task. EEG was recorded from 129 channels while subjects viewed a rapid continuous stream of images containing emotional pictures as well as task-related checkerboard images. As expected, explicit selective attention to target images elicited large P3 waves. Interestingly, emotional stimuli guided stimulus-driven selective encoding as reflected by augmented EPN amplitudes to emotional stimuli, in particular to stimuli of evolutionary significance (erotic contents, mutilations, and threat). These data demonstrate the selective encoding of emotional stimuli while top-down attentional control was directed towards non-emotional target stimuli.

Emotional facilitation of sensory processing in the visual cortex

A key function of emotion is the preparation for action. However, organization of successful behavioral strategies depends on efficient stimulus encoding. The present study tested the hypothesis that perceptual encoding in the visual cortex is modulated by the emotional significance of visual stimuli. Event-related brain potentials were measured while subjects viewed pleasant, neutral, and unpleasant pictures. Early selective encoding of pleasant and unpleasant images was associated with a posterior negativity, indicating primary sources of activation in the visual cortex. The study also replicated previous findings in that affective cues also elicited enlarged late positive potentials, indexing increased stimulus relevance at higher-order stages of stimulus processing. These results support the hypothesis that sensory encoding of affective stimuli is facilitated implicitly by natural selective attention. Thus, the affect system not only modulates motor output (i.e., favoring approach or avoidance dispositions), but already operates at an early level of sensory encoding.