Rapid and highly resolving associative affective learning: Convergent electro- and magnetoencephalographic evidence from vision and audition

Unpredictable threat increases early event-related potential amplitudes and cardiac acceleration: A brain-heart coupling study

In the face of unpredictable threat, rapid processing of external events and behavioral mobilization through early psychophysiological responses are crucial for survival. While unpredictable threat generally enhances early processing, it would seem adaptive to particularly increase sensitivity for unexpected events as they may signal danger. To examine this possibility, n = 77 participants performed an auditory oddball paradigm and received unpredictable shocks in threat but not in safe contexts while a stream of frequent (standard) and infrequent (deviant) tones was presented. We assessed event-related potentials (ERP), heart period (HP), and time-lagged within-subject correlations of single-trial EEG and HP (cardio-EEG covariance tracing, CECT) time-locked to the tones. N1 and P2 ERP amplitudes were generally enhanced under threat. The P3 amplitude was enhanced to deviants versus standards and this effect was reduced in the threat condition. Regarding HP, both threat versus safe and unexpected versus expected tones led to stronger cardiac acceleration, suggesting separate effects of threat and stimulus expectancy on HP. Finally, CECTs revealed two correlation clusters, indicating that single-trial EEG magnitudes in the N1/P2 and P3 time-windows predicted subsequent cardiac acceleration. The current results show that an unpredictable threat context enhances N1 and P2 amplitudes and cardiac acceleration to benign auditory stimuli. They further suggest separable cortical correlates of different effects on cardiac activity: an early N1/P2 correlate associated with threat-effects on HP and a later P3 correlate associated with expectedness-effects. Finally, the results indicate that unpredictable threat attenuates rather than enhances the processing of unexpected benign events during the P3 latency.

Tinnitus-on the interplay between emotion and cognition

Subjective tinnitus (hereafter tinnitus) is often considered and studied as a perceptual phenomenon. Accordingly, various abnormalities in the area of cognitive processing have been reported in patients with tinnitus. At the same time, the disorder is characterized by considerable emotional distress, which is associated with a high comorbidity of affective disorders. Here, we aim to outline the close link between cognition and emotion, and how current research from the field of cognitive neuroscience examines the processing and acquisition of emotional stimuli. The emotional valence of stimuli can be acquired after brief exposure to learning, leading from neutral to appetitive or aversive evaluation. In contrast to neutral stimuli, emotional stimuli attract attention very early (about 100 ms) during processing, leading to deeper processing and corresponding memory effects. The involved subcortical and cortical network encompasses limbic and sensory areas. In particular, prefrontal regions are involved in the acquisition and evaluation of emotional stimuli as also shown in studies of patients with affect disorders. The interplay of cognitive and emotional processes seems to be central to the development, maintenance, and treatment of tinnitus.

Gender congruence and emotion effects in cross-modal associative learning: Insights from ERPs and pupillary responses

Social and emotional cues from faces and voices are highly relevant and have been reliably demonstrated to attract attention involuntarily. However, there are mixed findings as to which degree associating emotional valence to faces occurs automatically. In the present study, we tested whether inherently neutral faces gain additional relevance by being conditioned with either positive, negative, or neutral vocal affect bursts. During learning, participants performed a gender-matching task on face-voice pairs without explicit emotion judgments of the voices. In the test session on a subsequent day, only the previously associated faces were presented and had to be categorized regarding gender. We analyzed event-related potentials (ERPs), pupil diameter, and response times (RTs) of N = 32 subjects. Emotion effects were found in auditory ERPs and RTs during the learning session, suggesting that task-irrelevant emotion was automatically processed. However, ERPs time-locked to the conditioned faces were mainly modulated by the task-relevant information, that is, the gender congruence of the face and voice, but not by emotion. Importantly, these ERP and RT effects of learned congruence were not limited to learning but extended to the test session, that is, after removing the auditory stimuli. These findings indicate successful associative learning in our paradigm, but it did not extend to the task-irrelevant dimension of emotional relevance. Therefore, cross-modal associations of emotional relevance may not be completely automatic, even though the emotion was processed in the voice.

[Tinnitus-on the interplay between emotion and cognition. German version]

Subjective tinnitus (hereafter tinnitus) is often considered and studied as a perceptual phenomenon. Accordingly, various abnormalities in the area of cognitive processing have been reported in patients with tinnitus. At the same time, the disorder is characterized by considerable emotional distress, which is associated with a high comorbidity of affective disorders. Here, we aim to outline the close link between cognition and emotion, and how current research from the field of cognitive neuroscience examines the processing and acquisition of emotional stimuli. The emotional valence of stimuli can be acquired after brief exposure to learning, leading from neutral to appetitive or aversive evaluation. In contrast to neutral stimuli, emotional stimuli attract attention very early (about 100 ms) during processing, leading to deeper processing and corresponding memory effects. The involved subcortical and cortical network encompasses limbic and sensory areas. In particular, prefrontal regions are involved in the acquisition and evaluation of emotional stimuli as also shown in studies of patients with affect disorders. The interplay of cognitive and emotional processes seems to be central to the development, maintenance, and treatment of tinnitus.

Motivated attention and task relevance in the processing of cross-modally associated faces: Behavioral and electrophysiological evidence

It has repeatedly been shown that visually presented stimuli can gain additional relevance by their association with affective stimuli. Studies have shown effects of associated affect in event-related potentials (ERP) like the early posterior negativity (EPN), late positive complex (LPC), and even earlier components as the P1 or N170. However, findings are mixed as to the extent associated affect requires directed attention to the emotional quality of a stimulus and which ERP components are sensitive to task instructions during retrieval. In this preregistered study ( https://osf.io/ts4pb ), we tested cross-modal associations of vocal affect-bursts (positive, negative, neutral) to faces displaying neutral expressions in a flash-card-like learning task, in which participants studied face-voice pairs and learned to correctly assign them to each other. In the subsequent EEG test session, we applied both an implicit ("old-new") and explicit ("valence-classification") task to investigate whether the behavior at retrieval and neurophysiological activation of the affect-based associations were dependent on the type of motivated attention. We collected behavioral and neurophysiological data from 40 participants who reached the preregistered learning criterium. Results showed EPN effects of associated negative valence after learning and independent of the task. In contrast, modulations of later stages (LPC) by positive and negative associated valence were restricted to the explicit, i.e., valence-classification, task. These findings highlight the importance of the task at different processing stages and show that cross-modal affect can successfully be associated to faces.

Reward History Modulates the Processing of Task-Irrelevant Emotional Faces in a Demanding Task

The aim of the current study was to examine how reward-associated emotional facial distractors could capture attentional resources in a demanding visual task using event-related potentials (ERPs). In the learning phase, a high- or low-reward probability was paired with angry, happy, or neutral faces. Then, in the test phase, participants performed a face-irrelevant task with no reward at stake, in which they needed to discriminate the length of two lines presented in the center of the screen while faces that were taken from the learning phase were used as distractors presented in the periphery. The behavioral results revealed no effect of distractor emotional valence since the emotional information was task-irrelevant. The ERP results in the test phase revealed a significant main effect of distractor emotional valence for the parieto-occipital P200 (170-230 ms); the mean amplitudes in both the angry- and happy-face conditions were more positive than the neutral-face condition. Moreover, we found that the high-reward association enhanced both the N170 (140-180 ms) and EPN (260-330 ms) relative to the low-reward association condition. Finally, the N2pc (270-320 ms) also exhibited enhanced neural activity in the high-reward condition compared to the low-reward condition. The absence of emotional effects indicated that task-irrelevant emotional facial stimuli did not impact behavioral or neural responses in this highly demanding task. However, reward-associated information was processed when attention was directed elsewhere, suggesting that the processing of reward-associated information worked more in an automatic way, irrespective of the top-down task demand.

Tinnitus-frequency specific activity and connectivity: A MEG study

Tinnitus pathophysiology has been associated with an atypical cortical network that involves functional changes in auditory and non-auditory areas. Numerous resting-state studies have replicated a tinnitus brain network to be significantly different from healthy-controls. Yet it is still unknown whether the cortical reorganization is attributed to the tinnitus frequency specifically or if it is frequency-irrelevant. Employing magnetoencephalography (MEG), the current study aimed to identify frequency-specific activity patterns by using an individual tinnitus tone (TT) and a 500 Hz-control tone (CT) as auditory stimuli, across 54 tinnitus patients. MEG data were analyzed in a data-driven approach employing a whole-head model in source space and in sources' functional connectivity. Compared to the CT, the event related source space analysis revealed a statistically significant response to TT involving fronto-parietal regions. The CT mainly involved typical auditory activation-related regions. A comparison of the cortical responses to a healthy control group that underwent the same paradigm rejected the alternative interpretation that the frequency-specific activation differences were due to the higher frequency of the TT. Overall, the results suggest frequency-specificity of tinnitus-related cortical patterns. In line with previous studies, we demonstrated a tinnitus-frequency specific network comprising left fronto-temporal, fronto-parietal and tempo-parietal junctions.

EEG-based emotion recognition using hybrid CNN and LSTM classification

Emotions are a mental state that is accompanied by a distinct physiologic rhythm, as well as physical, behavioral, and mental changes. In the latest days, physiological activity has been used to study emotional reactions. This study describes the electroencephalography (EEG) signals, the brain wave pattern, and emotion analysis all of these are interrelated and based on the consequences of human behavior and Post-Traumatic Stress Disorder (PTSD). Post-traumatic stress disorder effects for long-term illness are associated with considerable suffering, impairment, and social/emotional impairment. PTSD is connected to subcortical responses to injury memories, thoughts, and emotions and alterations in brain circuitry. Predominantly EEG signals are the way of examining the electrical potential of the human feelings cum expression for every changing phenomenon that the individual faces. When going through literature there are some lacunae while analyzing emotions. There exist some reliability issues and also masking of real emotional behavior by the victims. Keeping this research gap and hindrance faced by the previous researchers the present study aims to fulfill the requirements, the efforts can be made to overcome this problem, and the proposed automated CNN-LSTM with ResNet-152 algorithm. Compared with the existing techniques, the proposed techniques achieved a higher level of accuracy of 98% by applying the hybrid deep learning algorithm.

No trait anxiety influences on early and late differential neuronal responses to aversively conditioned faces across three different tasks

The human brain's ability to quickly detect dangerous stimuli is crucial in selecting appropriate responses to possible threats. Trait anxiety has been suggested to moderate these processes on certain processing stages. To dissociate such different information-processing stages, research using classical conditioning has begun to examine event-related potentials (ERPs) in response to fear-conditioned (CS +) faces. However, the impact of trait anxiety on ERPs to fear-conditioned faces depending on specific task conditions is unknown. In this preregistered study, we measured ERPs to faces paired with aversive loud screams (CS +) or neutral sounds (CS −) in a large sample (N = 80) under three different task conditions. Participants had to discriminate face-irrelevant perceptual information, the gender of the faces, or the CS category. Results showed larger amplitudes in response to aversively conditioned faces for all examined ERPs, whereas interactions with the attended feature occurred for the P1 and the early posterior negativity (EPN). For the P1, larger CS + effects were observed during the perceptual distraction task, while the EPN was increased for CS + faces when deciding about the CS association. Remarkably, we found no significant correlations between ERPs and trait anxiety. Thus, fear-conditioning potentiates all ERP amplitudes, some processing stages being further modulated by the task. However, the finding that these ERP differences were not affected by individual differences in trait anxiety does not support theoretical accounts assuming increased threat processing or reduced threat discrimination depending on trait anxiety.

Common and separable behavioral and neural mechanisms underlie the generalization of fear and disgust

Generalization represents the transfer of a conditioned responses to stimuli that resemble the conditioned stimulus (CS). Previous studies on generalization of defensive avoidance responses have primarily focused on fear and have neglected disgust generalization, which represents a key pathological mechanism in some anxiety disorders. In the present study we examined common and distinct mechanisms of fear and disgust generalization by means of a fear or disgust multi-CS conditioning and generalization paradigm with concomitant event-related potential (ERPs) acquisition in n = 62 subjects. We demonstrate that compared to fear, disgust-relevant generalized stimuli (GS) elicited larger expectancy ratings and longer reaction times (RTs) reflecting stronger ratings of 'risk'. On the electrophysiological level, increased P2 amplitudes were found in response to conditioned CS+ versus CS- across both domains, possibly reflecting higher motivational and attentional salience of aversive conditioned stimuli per se. Contingent negative variation (CNV) amplitude was significantly larger for disgust-CS+ than disgust-CS-, reflecting a stronger preparation of the disgust US. Additionally, we found that the contingent negative variation (CNV) fear generalization gradient, and CNV amplitude were increased with similarity to CS+. In contrast the CNV to disgust-GS did not differ and did not reflect disgust generalization. Together this may indicate that the CNV represents a highly fear-specific index for generalization learning. This study provides the first neurobiological evidence for common and distinct generalization learning in fear versus disgust suggesting that dysregulations in separable defensive avoidance mechanisms may underly different anxiety disorder subtypes.

Neural correlates of fear conditioning are associated with treatment-outcomes to behavioral exposure in spider phobia - Evidence from magnetoencephalography

•

Magnetoencephalographic effects of fear conditioning predict exposure outcomes.

•

No associations between fear ratings of conditioned stimuli and exposure outcomes.

•

Prefrontal correlates of safety processing and/or fear inhibition are treatment-relevant.

•

Individual neural differences might be a promising predictor of exposure success.

Background

Models of anxiety disorders and the rationale of exposure therapy (ET) are grounded on classical fear conditioning. Yet, it is unclear whether lower fear ratings of conditioned safety versus threat cues and corresponding neural markers of safety-learning and/or fear inhibition assessed before treatment would predict better outcomes of behavioral exposure.

Methods

Sixty-six patients with spider phobia completed pre-treatment clinical and experimental fear conditioning assessments, one session of virtual reality ET, a post-treatment clinical assessment, and a 6-month follow-up assessment. Tilted Gabor gratings served as conditioned stimuli (CS) that were either paired (CS+) or remained unpaired (CS-) with an aversive phobia-related and phobia-unrelated unconditioned stimulus (UCS). CS+/CS- differences in fear ratings and magnetoencephalographic event-related fields (ERFs) were related to percentual symptom reductions from pre- to post-treatment, as assessed via spider phobia questionnaire (SPQ), behavioral avoidance test (BAT), and remission status at 6-month follow-up.

Results

We observed no associations between pre-treatment CS+/CS- differences in fear ratings and any treatment outcome. CS+/CS- differences in source estimations of ERFs revealed that higher CS- activity in bilateral dorsolateral prefrontal cortex (dlPFC) was related with SPQ- and BAT-reductions. Associations between CS+/CS- differences and treatment outcomes were also observed in left ventromedial prefrontal cortex (vmPFC) regions, which additionally revealed associations with the follow-up remission status.

Conclusions

Results provide initial evidence that neural pre-treatment CS+/CS- differences may hold predictive information regarding outcomes of behavioral exposure. Our findings highlight a key role of neural responses to safety cues with potentially inhibitory effects on affect-generating structures during fear conditioning.

Right medial temporal lobe structures particularly impact early stages of affective picture processing

Human vision prioritizes emotional stimuli. This is reflected in stronger electrocortical activation in response to emotional than neutral stimuli, measurable on the surface of the head. Feedback projections from brain structures deep within the medial temporal lobes (mTLs), in particular the amygdala, are thought to give rise to this phenomenon, although causal evidence is rare. Given the many pathways involved in visual processing, the influence of mTL structures could be restricted to specific time windows. Therefore, we delineate the temporal dynamics of the impact of right mTL structures on affective picture processing, investigating event-related potentials (ERPs) in 19 patients (10 female) with right mTL resections and 19 individually matched healthy participants, while they viewed negative and neutral scenes. Groups differed significantly at early- and mid-latency processing stages. Patients with right mTL resection, unlike controls, showed no (P1: 90-140 ms) or marginal (N1: 170-220 ms) emotion modulation. At mid-latency (early posterior negativity: 220-370 ms), emotion modulation over the ipsi-resectional right hemisphere was smaller in patients than in controls, but groups did not differ over the left hemisphere. During late parietal positivities (400-650 ms and 650-900 ms), both groups had similar emotion modulation. Our results demonstrate that right mTL structures attenuate particularly early processing of affectively negative scenes. This is theoretically consistent with an initial amygdala-dependent feedforward sweep in visual emotion processing whose absence is successively compensated. Findings specify the impact of right mTL structures on emotional picture processing and highlight the value of time-resolved measures in affective neuroscience.

Effect of the congruity of emotional contexts at encoding on source memory: Evidence from ERPs

Emotion's influence on source memory has proven more elusive and the lack of studies investigates the effect of the congruent emotional contexts on source memory. Here, we investigated these issues using event-related potentials (ERPs) to assess emotional-induced neural correlates. During encoding, congruent word-picture (a word 'shoes' - a picture described shoes) and incongruent word-picture (a word 'pepper' - a picture described shoes) with a prompt (Common? or Natural?) were presented. At retrieval, participants indicated which prompts were concomitantly presented with the word during encoding. Behavioral results revealed that source memory accuracy was enhanced in the neutral contexts compared to the negative contexts, and enhanced in the incongruent condition relative to the congruent condition, suggesting that emotional contexts impaired source memory performance, and incongruent information enhanced source memory. ERPs results showed that early P2 old/new effect (150-250 ms) and FN400 old/new effect (300-450 ms) were observed for words with correct source that had been encoded in the congruent emotional contexts, and that a larger parietal old/new effect, between 500 and 700 ms, was observed for words with correct source that had been encoded in the incongruent condition than in the congruent condition, irrespective the nature of context. The ERPs results indicate that retrieval of source details for the associated emotionally congruent information supports the idea that emotional events could attract more attentional resources, and reflects the contribution of familiarity-based process. Meanwhile, retrieval of source details for the associated incongruent information reflects a stronger contribution of recollection-based process.

Increased early and late neuronal responses to aversively conditioned faces across different attentional conditions

Faces with emotional information-by virtue of their expression or their history of affective learning-are prioritized during neuronal processing as compared to neutral faces. Classical conditioning studies have shown that aversively conditioned (CS+) faces potentiate different face processing stages as evidenced by increased early and late event-related potential (ERPs) components. However, it is unknown whether and how ERP modulations depend on certain attentional conditions. To examine this question, this preregistered study investigated ERPs to faces paired with aversive screams or neutral sounds under three tasks with increasing attention to CS + relevant features of the face: Participants (N = 40) had to discriminate either the orientation of superimposed lines, perceived gender, or the CS association. We found potentiation of the N170, the Early Posterior Negativity (EPN), and, most remarkably, the Late Positive Potential (LPP) to CS + faces regardless of task condition. This finding suggests that, in contrast to other types of emotional information and learning, classical conditioning boosts early and late processing stages, even if no explicit attention to the face information or the CS association is required.

Influence of Perceptual and Conceptual Information on Fear Generalization: A Behavioral and Event-Related Potential Study

Learned fear can be generalized through both perceptual and conceptual information. This study investigated how perceptual and conceptual similarities influence this generalization process. Twenty-three healthy volunteers completed a fear-generalization test as brain activity was recorded in the form of event-related potentials (ERPs). Participants were exposed to a de novo fear acquisition paradigm with four categories of conditioned stimuli (CS): two conceptual cues (animals and furniture); and two perceptual cues (blue and purple shapes). Animals (C+) and purple shapes (P+) were paired with the unconditioned stimulus (US), whereas furniture (C-) and blue shapes (P-) never were. The generalized stimuli were thus blue animals (C+P+, determined danger), blue furniture (C-P+, perceptual danger), purple animals (C+P-, conceptual danger), and purple furniture (C-P-, determined safe). We found that perceptual cues elicited larger fear responses and shorter reaction times than did conceptual cues during fear acquisition. This suggests that a perceptually related pathway might evoke greater fear than a conceptually based route. During generalization, participants were more afraid of C+ exemplars than of C- exemplars. Furthermore, C+ trials elicited greater N400 amplitudes. Thus, participants appear able to use conceptually based cues to infer the value of the current stimuli. Additionally, compared with C+ exemplars, we found an enhanced late positive potential effect in response to C- exemplars, which seems to reflect a late inhibitory process and might index safety learning. These findings may offer new insights into the pathological mechanism of anxiety disorders.

Learning dynamics of electrophysiological brain signals during human fear conditioning

Electrophysiological studies in rodents allow recording neural activity during threats with high temporal and spatial precision. Although fMRI has helped translate insights about the anatomy of underlying brain circuits to humans, the temporal dynamics of neural fear processes remain opaque and require EEG. To date, studies on electrophysiological brain signals in humans have helped to elucidate underlying perceptual and attentional processes, but have widely ignored how fear memory traces evolve over time. The low signal-to-noise ratio of EEG demands aggregations across high numbers of trials, which will wash out transient neurobiological processes that are induced by learning and prone to habituation. Here, our goal was to unravel the plasticity and temporal emergence of EEG responses during fear conditioning. To this end, we developed a new sequential-set fear conditioning paradigm that comprises three successive acquisition and extinction phases, each with a novel CS+/CS- set. Each set consists of two different neutral faces on different background colors which serve as CS+ and CS-, respectively. Thereby, this design provides sufficient trials for EEG analyses while tripling the relative amount of trials that tap into more transient neurobiological processes. Consistent with prior studies on ERP components, data-driven topographic EEG analyses revealed that ERP amplitudes were potentiated during time periods from 33-60 ms, 108-200 ms, and 468-820 ms indicating that fear conditioning prioritizes early sensory processing in the brain, but also facilitates neural responding during later attentional and evaluative stages. Importantly, averaging across the three CS+/CS- sets allowed us to probe the temporal evolution of neural processes: Responses during each of the three time windows gradually increased from early to late fear conditioning, while long-latency (460-730 ms) electrocortical responses diminished throughout fear extinction. Our novel paradigm demonstrates how short-, mid-, and long-latency EEG responses change during fear conditioning and extinction, findings that enlighten the learning curve of neurophysiological responses to threat in humans.

Conjunctive and Elemental Representations of a Context in Humans

The dual-process theory assumes that contexts are encoded in an elemental and in a conjunctive representation. However, this theory was developed from animal studies, and we still have to explore if and how elemental and conjunctive representations contribute to, for example, contextual anxiety in humans. Therefore, 28 participants underwent differential context conditioning in a newly developed flip-book paradigm. Virtual rooms were presented similar to a flip-book, that is, as a stream of 49 consecutive screenshots creating the impression of walking through the rooms. This allowed registration of event-related brain potentials triggered by specific screenshots. During two acquisition phases, two rooms were shown in this way for six times each. In one room, the anxiety context (CTX+), mildly painful electric stimuli (unconditioned stimuli [USs]) were administered unpredictably after 12 distinct screenshots, which became threat elements, whereas 12 selected comparable screenshots became nonthreat elements (elemental representation); all screenshots represented the anxiety context (conjunctive representation). In the second room, the safety context (CTX-), no USs were applied; thus, all screenshots created the safety context whereby 12 preselected screenshots represented safety elements. Increased US expectancy ratings for threat versus nonthreat or safety elements reflected elemental representation. Conjunctive representation was evident in differential ratings (arousal and contingency) and increased P100 and early posterior negativity amplitudes for threat and nonthreat CTX+ versus safety CTX- screenshots. These differences disappeared during two test phases without US delivery indicating successful extinction. In summary, we revealed the first piece of evidence for the simultaneous contributions of elemental and conjunctive representation during context conditioning in humans.

Spatiotemporal dynamics of reward and punishment effects induced by associative learning

While reward associative learning has been studied extensively across different species, punishment avoidance learning has received far less attention. Of particular interest is how the two types of learning change perceptual processing of the learned stimuli. We designed a task that required participants to learn the association of emotionally neutral images with reward, punishment, and no incentive value outcomes through trial-and-error. During learning, participants received monetary reward, neutral outcomes or avoided punishment by correctly identifying corresponding images. Results showed an early bias in favor of learning reward associations, in the form of higher accuracy and fewer trials needed to reach learning criterion. We subsequently assessed electrophysiological learning effects with a task in which participants viewed the stimuli with no feedback or reinforcement. Critically, we found modulation of two early event-related potential components for reward images: the frontocentral P2 (170-230 ms) and the anterior N2/Early Anterior Positivity (N2/EAP; 210-310 ms). We suggest that reward associations may change stimuli detection and incentive salience as indexed by P2 and N2/EAP. We also reported, on an exploratory basis, a late negativity with frontopolar distribution enhanced by punishment images.

An evil face? Verbal evaluative multi-CS conditioning enhances face-evoked mid-latency magnetoencephalographic responses

Humans have a remarkable capacity for rapid affective learning. For instance, using first-order US such as odors or electric shocks, magnetoencephalography (MEG) studies of multi-CS conditioning demonstrate enhanced early (<150 ms) and mid-latency (150–300 ms) visual evoked responses to affectively conditioned faces, together with changes in stimulus evaluation. However, particularly in social contexts, human affective learning is often mediated by language, a class of complex higher-order US. To elucidate mechanisms of this type of learning, we investigate how face processing changes following verbal evaluative multi-CS conditioning. Sixty neutral expression male faces were paired with phrases about aversive crimes (30) or neutral occupations (30). Post conditioning, aversively associated faces evoked stronger magnetic fields in a mid-latency interval between 220 and 320 ms, localized primarily in left visual cortex. Aversively paired faces were also rated as more arousing and more unpleasant, evaluative changes occurring both with and without contingency awareness. However, no early MEG effects were found, implying that verbal evaluative conditioning may require conceptual processing and does not engage rapid, possibly sub-cortical, pathways. Results demonstrate the efficacy of verbal evaluative multi-CS conditioning and indicate both common and distinct neural mechanisms of first- and higher-order multi-CS conditioning, thereby informing theories of associative learning.

Processing of gaze direction within the N170/M170 time window: A combined EEG/MEG study

Gaze direction is an important social signal for human beings. Beside the role of gaze in attention orienting, direct gaze (that is, gaze directed toward an observer) is a highly relevant biological stimulus that elicits attention capture and increases face encoding. Brain imaging studies have emphasized the role of the superior temporal sulcus (STS) in the coding of gaze direction and in the integration of gaze and head cues of social attention. The dynamics of the processing and integration of these cues remains, however, unclear. In order to address this question, we used deviated and frontal faces with averted and direct gaze in a combined electro- and magneto- encephalography (EEG-MEG) study. We showed distinct effects of gaze direction on the N170 and M170 responses. There was an interaction between gaze direction and head orientation between 134 and 162ms in MEG and a main effect of gaze direction between 171 and 186ms in EEG. These effects involved the posterior and anterior regions of the STS respectively. Both effects also emphasized the sensitivity to direct gaze. These data highlight the central role of the STS in gaze processing.

The Rewarding Effect of Pictures with Positive Emotional Connotation upon Perception and Processing of Pleasant Odors-An FMRI Study

This fMRI study was designed to investigate the effect of cross-modal conditioning in 28 female volunteers. Subjects underwent initial fMRI block design scanning during which three pleasant olfactory stimuli were presented and had to be rated with respect to intensity and pleasantness. This was followed by an odor identification task spread out over 3 days: the experimental group was rewarded for successful trials (correct odor identification) with emotionally salient photos, whilst the control group only received randomly displayed, emotionally neutral, pictures. In the final scanning session, the odors were again presented, and subjects rated pleasantness and intensity. Both pleasantness ratings and fMRI data showed effects of the rewarding procedure. Activation in nucleus accumbens and the orbitofrontal cortex confirmed the hypothesis that learnt association of odors with visual stimuli of emotionally positive valence not only increases pleasantness of the olfactory stimuli but is also reflected in the activation of brain structures relevant for hedonic and reward processing. To our knowledge, this is the first paper to report successful cross-modal conditioning of olfactory stimuli with visual clues.

Commonalities and differences in the neural substrates of threat predictability in panic disorder and specific phobia

Different degrees of threat predictability are thought to induce either phasic fear or sustained anxiety. Maladaptive, sustained anxious apprehension is thought to result in overgeneralization of anxiety and thereby to contribute to the development of anxiety disorders. Therefore, differences in threat predictability have been associated with pathological states of anxiety with specific phobia (SP) representing phasic fear as heightened response to predictable threat, while panic disorder (PD) is characterized by sustained anxiety (unpredictable threat) and, as a consequence, overgeneralization of fear. The present study aimed to delineate commonalities and differences in the neural substrates of the impact of threat predictability on affective processing in these two anxiety disorders. Twenty PD patients, 20 SP patients and 20 non-anxious control subjects were investigated with an adapted NPU-design (no, predictable, unpredictable threat) using whole-head magnetoencephalography (MEG). Group independent neural activity in the right dlPFC increased with decreasing threat predictability. PD patients showed a sustained hyperactivation of the vmPFC under threat and safety conditions. The magnitude of hyperactivation was inversely correlated with PDs subjective arousal and anxiety sensitivity. Both PD and SP patients revealed decreased parietal processing of affective stimuli. Findings indicate overgeneralization between threat and safety conditions and increased need for emotion regulation via the vmPFC in PD, but not SP patients. Both anxiety disorders showed decreased activation in parietal networks possibly indicating attentional avoidance of affective stimuli. Present results complement findings from fear conditioning studies and underline overgeneralization of fear, particularly in PD.

Conditioned inhibitory and excitatory gain modulations of visual cortex in fear conditioning: Effects of analysis strategies of magnetocortical responses

In unpredictable environments, stimuli that predict potential danger or its absence can change rapidly. Therefore, it is highly adaptive to prioritize incoming sensory information flexibly as a function of prior experience. Previously, these changes have only been conceptualized as excitatory gain increases in sensory cortices for acquired fear-relevant stimuli during associative learning. However, formal descriptions of associative processes by Rescorla and Wagner predict both conditioned excitatory and inhibitory processes in response systems for fear and safety cues, respectively. Magnetocortical steady-state visual evoked fields (ssVEFs) have been shown to vary in amplitude as a function of associative strength. Therefore, we wondered why previous studies reporting ssVEF modulations by fear learning did not observe conditioned inhibition of ssVEF responses for the safety cue. Three analysis strategies were applied: (1) traditional analysis of ssVEF amplitude at occipital MEG sensors, (2) applying a general linear model (GLM) at each sensor, and (3) fitting the same GLM to cortically localized ssVEF responses. First, we replicated previous findings of increased ssVEFs for acquired fear-relevant stimuli using all three analysis strategies. Critically, we demonstrated conditioned inhibition of ssVEF responses for fear-irrelevant cues for specific gradiometer sensor types using the traditional analysis technique and for all sensor types when applying a GLM to the sensor space. However, sensor space effects were rather small. In stark contrast, cortical source space effect sizes were most pronounced. The results of opposing CS+ and CS- modulations in sensory cortex reflect predictions of the Rescorla-Wagner model and current neurobiological findings.

Binding neutral information to emotional contexts: Brain dynamics of long-term recognition memory

There is abundant evidence in memory research that emotional stimuli are better remembered than neutral stimuli. However, effects of an emotionally charged context on memory for associated neutral elements is also important, particularly in trauma and stress-related disorders, where strong memories are often activated by neutral cues due to their emotional associations. In the present study, we used event-related potentials (ERPs) to investigate long-term recognition memory (1-week delay) for neutral objects that had been paired with emotionally arousing or neutral scenes during encoding. Context effects were clearly evident in the ERPs: An early frontal ERP old/new difference (300-500 ms) was enhanced for objects encoded in unpleasant compared to pleasant and neutral contexts; and a late central-parietal old/new difference (400-700 ms) was observed for objects paired with both pleasant and unpleasant contexts but not for items paired with neutral backgrounds. Interestingly, objects encoded in emotional contexts (and novel objects) also prompted an enhanced frontal early (180-220 ms) positivity compared to objects paired with neutral scenes indicating early perceptual significance. The present data suggest that emotional--particularly unpleasant--backgrounds strengthen memory for items encountered within these contexts and engage automatic and explicit recognition processes. These results could help in understanding binding mechanisms involved in the activation of trauma-related memories by neutral cues.

A pragmatic comparison of noise burst and electric shock unconditioned stimuli for fear conditioning research with many trials

Several methods that are promising for studying the neurophysiology of fear conditioning (e.g., EEG, MEG) require a high number of trials to achieve an adequate signal-to-noise ratio. While electric shock and white noise burst are among the most commonly used unconditioned stimuli (US) in conventional fear conditioning studies with few trials, it is unknown whether these stimuli are equally well suited for paradigms with many trials. Here, N = 32 participants underwent a 260-trial differential fear conditioning and extinction paradigm with a 240-trial recall test 24 h later and neutral faces as conditioned stimuli. In a between-subjects design, either white noise bursts (n = 16) or electric shocks (n = 16) served as US, and intensities were determined using the most common procedure for each US (i.e., a fixed 95 dB noise burst and a work-up procedure for electric shocks, respectively). In addition to differing US types, groups also differed in closely linked US-associated characteristics (e.g., calibration methods, stimulus intensities, timing). Subjective ratings (arousal/valence), skin conductance, and evoked heart period changes (i.e., fear bradycardia) indicated more reliable, extinction-resistant, and stable conditioning in the white noise burst versus electric shock group. In fear conditioning experiments where many trials are presented, white noise burst should serve as US.

Prepare for scare-Impact of threat predictability on affective visual processing in spider phobia

The visual processing of emotional faces is influenced by individual's level of stress and anxiety. Valence unspecific affective processing is expected to be influenced by predictability of threat. Using a design of phasic fear (predictable threat), sustained anxiety (unpredictable threat) and safety (no threat), we investigated the magnetoencephalographic correlates and temporal dynamics of emotional face processing in a sample of phobic patients. Compared to non-anxious controls, phobic individuals revealed decreased parietal emotional attention processes during affective processing at mid-latency and late processing stages. While control subjects showed increasing parietal processing of the facial stimuli in line with decreasing threat predictability, phobic subjects revealed the opposite pattern. Decreasing threat predictability also led to increasing neural activity in the orbitofrontal and dorsolateral prefrontal cortex at mid-latency stages. Additionally, unpredictability of threat lead to higher subjective discomfort compared to predictability of threat and no threat safety condition. Our findings indicate that visual processing of emotional information is influenced by both stress induction and pathologic anxiety.

How learning shapes the empathic brain

Deficits in empathy enhance conflicts and human suffering. Thus, it is crucial to understand how empathy can be learned and how learning experiences shape empathy-related processes in the human brain. As a model of empathy deficits, we used the well-established suppression of empathy-related brain responses for the suffering of out-groups and tested whether and how out-group empathy is boosted by a learning intervention. During this intervention, participants received costly help equally often from an out-group member (experimental group) or an in-group member (control group). We show that receiving help from an out-group member elicits a classical learning signal (prediction error) in the anterior insular cortex. This signal in turn predicts a subsequent increase of empathy for a different out-group member (generalization). The enhancement of empathy-related insula responses by the neural prediction error signal was mediated by an establishment of positive emotions toward the out-group member. Finally, we show that surprisingly few positive learning experiences are sufficient to increase empathy. Our results specify the neural and psychological mechanisms through which learning interacts with empathy, and thus provide a neurobiological account for the plasticity of empathic reactions.

Parallel processing of general and specific threat during early stages of perception

Differential processing of threat can consummate as early as 100 ms post-stimulus. Moreover, early perception not only differentiates threat from non-threat stimuli but also distinguishes among discrete threat subtypes (e.g. fear, disgust and anger). Combining spatial-frequency-filtered images of fear, disgust and neutral scenes with high-density event-related potentials and intracranial source estimation, we investigated the neural underpinnings of general and specific threat processing in early stages of perception. Conveyed in low spatial frequencies, fear and disgust images evoked convergent visual responses with similarly enhanced N1 potentials and dorsal visual (middle temporal gyrus) cortical activity (relative to neutral cues; peaking at 156 ms). Nevertheless, conveyed in high spatial frequencies, fear and disgust elicited divergent visual responses, with fear enhancing and disgust suppressing P1 potentials and ventral visual (occipital fusiform) cortical activity (peaking at 121 ms). Therefore, general and specific threat processing operates in parallel in early perception, with the ventral visual pathway engaged in specific processing of discrete threats and the dorsal visual pathway in general threat processing. Furthermore, selectively tuned to distinctive spatial-frequency channels and visual pathways, these parallel processes underpin dimensional and categorical threat characterization, promoting efficient threat response. These findings thus lend support to hybrid models of emotion.

Rapid prefrontal cortex activation towards aversively paired faces and enhanced contingency detection are observed in highly trait-anxious women under challenging conditions

Relative to healthy controls, anxiety-disorder patients show anomalies in classical conditioning that may either result from, or provide a risk factor for, clinically relevant anxiety. Here, we investigated whether healthy participants with enhanced anxiety vulnerability show abnormalities in a challenging affective-conditioning paradigm, in which many stimulus-reinforcer associations had to be acquired with only few learning trials. Forty-seven high and low trait-anxious females underwent MultiCS conditioning, in which 52 different neutral faces (CS+) were paired with an aversive noise (US), while further 52 faces (CS-) remained unpaired. Emotional learning was assessed by evaluative (rating), behavioral (dot-probe, contingency report), and neurophysiological (magnetoencephalography) measures before, during, and after learning. High and low trait-anxious groups did not differ in evaluative ratings or response priming before or after conditioning. High trait-anxious women, however, were better than low trait-anxious women at reporting CS+/US contingencies after conditioning, and showed an enhanced prefrontal cortex (PFC) activation towards CS+ in the M1 (i.e., 80-117 ms) and M170 time intervals (i.e., 140-160 ms) during acquisition. These effects in MultiCS conditioning observed in individuals with elevated trait anxiety are consistent with theories of enhanced conditionability in anxiety vulnerability. Furthermore, they point towards increased threat monitoring and detection in highly trait-anxious females, possibly mediated by alterations in visual working memory.

Facing Challenges in Differential Classical Conditioning Research: Benefits of a Hybrid Design for Simultaneous Electrodermal and Electroencephalographic Recording

Several challenges make it difficult to simultaneously investigate central and autonomous nervous system correlates of conditioned stimulus (CS) processing in classical conditioning paradigms. Such challenges include, for example, the discrepant requirements of electroencephalography (EEG) and electrodermal activity (EDA) recordings with regard to multiple repetitions of conditions and sufficient trial duration. Here, we propose a MultiCS conditioning set-up, in which we increased the number of CSs, decreased the number of learning trials, and used trials of short and long durations for meeting requirements of simultaneous EEG–EDA recording in a differential aversive conditioning task. Forty-eight participants underwent MultiCS conditioning, in which four neutral faces (CS+) were paired four times each with aversive electric stimulation (unconditioned stimulus) during acquisition, while four different neutral faces (CS−) remained unpaired. When comparing after relative to before learning measurements, EEG revealed an enhanced centro-posterior positivity to CS+ vs. CS− during 368–600 ms, and subjective ratings indicated CS+ to be less pleasant and more arousing than CS−. Furthermore, changes in CS valence and arousal were strong enough to bias subjective ratings when faces of CS+/CS− identity were displayed with different emotional expression (happy, angry) in a post-experimental behavioral task. In contrast to a persistent neural and evaluative CS+/CS− differentiation that sustained multiple unreinforced CS presentations, electrodermal differentiation was rapidly extinguished. Current results suggest that MultiCS conditioning provides a promising paradigm for investigating pre–post-learning changes under minimal influences of extinction and overlearning of simple stimulus features. Our data also revealed methodological pitfalls, such as the possibility of occurring artifacts when combining different acquisition systems for central and peripheral psychophysiological measures.

Abnormal, affect-specific modulatory effects on early auditory processing in schizophrenia: magnetoencephalographic evidence

Abnormalities in the perception and identification of emotions have frequently been reported in schizophrenia. Hemodynamic neuroimaging studies found functional abnormalities in cortical and subcortical brain circuits that are involved in normal affective processing, but the temporal dynamics of abnormal emotion processing in schizophrenia remain largely elusive. To investigate this issue, we recorded early auditory evoked field components by means of whole-head magnetoencephalography that were in response to emotion-associated tones in seventeen patients with schizophrenia and in seventeen healthy, matched controls. Forty-two click-like tones (conditioned stimuli; CS) acquired differential emotional meaning through an affective associative learning procedure by pairing each CS three times with either pleasant, unpleasant or neutral auditory scenes. As expected, differential affect-specific modulation in patients vs. controls was evident, starting at the auditory N1m onset latency of approximately 70ms, extending to 230ms. While controls showed the expected enhanced processing of emotion associated CS, patients revealed an inverted pattern with reduced processing of arousal, when compared to neutral stimuli, in the right prefrontal cortex. The present finding suggests impairments in the prioritization of emotionally salient vs. non-salient stimuli in patients with schizophrenia. Dysfunction in higher cognitive processes and behavior in schizophrenia may therefore reflect dysfunction in fundamental, early emotion processing stages.

It's all in your head - how anticipating evaluation affects the processing of emotional trait adjectives

Language has an intrinsically evaluative and communicative function. Words can serve to describe emotional traits and states in others and communicate evaluations. Using electroencephalography (EEG), we investigate how the cerebral processing of emotional trait adjectives is modulated by their perceived communicative sender in anticipation of an evaluation. 16 students were videotaped while they described themselves. They were told that a stranger would evaluate their personality based on this recording by endorsing trait adjectives. In a control condition a computer program supposedly randomly selected the adjectives. Actually, both conditions were random. A larger parietal N1 was found for adjectives in the supposedly human-generated condition. This indicates that more visual attention is allocated to the presented adjectives when putatively interacting with a human. Between 400 and 700 ms a fronto-central main effect of emotion was found. Positive, and in tendency also negative adjectives, led to a larger late positive potential (LPP) compared to neutral adjectives. A centro-parietal interaction in the LPP-window was due to larger LPP amplitudes for negative compared to neutral adjectives within the ‘human sender’ condition. Larger LPP amplitudes are related to stimulus elaboration and memory consolidation. Participants responded more to emotional content particularly when presented in a meaningful ‘human’ context. This was first observed in the early posterior negativity window (210–260 ms). But the significant interaction between sender and emotion reached only trend-level on post hoc tests. Our results specify differential effects of even implied communicative partners on emotional language processing. They show that anticipating evaluation by a communicative partner alone is sufficient to increase the relevance of particularly emotional adjectives, given a seemingly realistic interactive setting.

Rapid plasticity in the prefrontal cortex during affective associative learning

MultiCS conditioning is an affective associative learning paradigm, in which affective categories consist of many similar and complex stimuli. Comparing visual processing before and after learning, recent MultiCS conditioning studies using time-sensitive magnetoencephalography (MEG) revealed enhanced activation of prefrontal cortex (PFC) regions towards emotionally paired versus neutral stimuli already during short-latency processing stages (i.e., 50 to 80 ms after stimulus onset). The present study aimed at showing that this rapid differential activation develops as a function of the acquisition and not the extinction of the emotional meaning associated with affectively paired stimuli. MEG data of a MultiCS conditioning study were analyzed with respect to rapid changes in PFC activation towards aversively (electric shock) paired and unpaired faces that occurred during the learning of stimulus-reinforcer contingencies. Analyses revealed an increased PFC activation towards paired stimuli during 50 to 80 ms already during the acquisition of contingencies, which emerged after a single pairing with the electric shock. Corresponding changes in stimulus valence could be observed in ratings of hedonic valence, although participants did not seem to be aware of contingencies. These results suggest rapid formation and access of emotional stimulus meaning in the PFC as well as a great capacity for adaptive and highly resolving learning in the brain under challenging circumstances.

Early affective processing in patients with acute posttraumatic stress disorder: magnetoencephalographic correlates

Background

In chronic PTSD, a preattentive neural alarm system responds rapidly to emotional information, leading to increased prefrontal cortex (PFC) activation at early processing stages (<100 ms). Enhanced PFC responses are followed by a reduction in occipito-temporal activity during later processing stages. However, it remains unknown if this neuronal pattern is a result of a long lasting mental disorder or if it represents changes in brain function as direct consequences of severe trauma.

Methodology

The present study investigates early fear network activity in acutely traumatized patients with PTSD. It focuses on the question whether dysfunctions previously observed in chronic PTSD patients are already present shortly after trauma exposure. We recorded neuromagnetic activity towards emotional pictures in seven acutely traumatized PTSD patients between one and seven weeks after trauma exposure and compared brain responses to a balanced healthy control sample. Inverse modelling served for mapping sources of differential activation in the brain.

Principal Findings

Compared to the control group, acutely traumatized PTSD patients showed an enhanced PFC response to high-arousing pictures between 60 to 80 ms. This rapid prefrontal hypervigilance towards arousing pictorial stimuli was sustained during 120–300 ms, where it was accompanied by a reduced affective modulation of occipito-temporal neural processing.

Conclusions

Our findings indicate that the hypervigilance-avoidance pattern seen in chronic PTSD is not necessarily a product of an endured mental disorder, but arises as an almost immediate result of severe traumatisation. Thus, traumatic experiences can influence emotion processing strongly, leading to long-lasting changes in trauma network activation and expediting a chronic manifestation of maladaptive cognitive and behavioral symptoms.

Early prefrontal brain responses to the Hedonic quality of emotional words--a simultaneous EEG and MEG study

The hedonic meaning of words affects word recognition, as shown by behavioral, functional imaging, and event-related potential (ERP) studies. However, the spatiotemporal dynamics and cognitive functions behind are elusive, partly due to methodological limitations of previous studies. Here, we account for these difficulties by computing combined electro-magnetoencephalographic (EEG/MEG) source localization techniques. Participants covertly read emotionally high-arousing positive and negative nouns, while EEG and MEG were recorded simultaneously. Combined EEG/MEG current-density reconstructions for the P1 (80–120 ms), P2 (150–190 ms) and EPN component (200–300 ms) were computed using realistic individual head models, with a cortical constraint. Relative to negative words, the P1 to positive words predominantly involved language-related structures (left middle temporal and inferior frontal regions), and posterior structures related to directed attention (occipital and parietal regions). Effects shifted to the right hemisphere in the P2 component. By contrast, negative words received more activation in the P1 time-range only, recruiting prefrontal regions, including the anterior cingulate cortex (ACC). Effects in the EPN were not statistically significant. These findings show that different neuronal networks are active when positive versus negative words are processed. We account for these effects in terms of an “emotional tagging” of word forms during language acquisition. These tags then give rise to different processing strategies, including enhanced lexical processing of positive words and a very fast language-independent alert response to negative words. The valence-specific recruitment of different networks might underlie fast adaptive responses to both approach- and withdrawal-related stimuli, be they acquired or biological.

Preferential responses to extinguished face stimuli are preserved in frontal and occipito-temporal cortex at initial but not later stages of processing

Magnetoencephalographic correlates of rapid emotional responses (50-80 ms) in frontal and occipito-temporal regions have recently been reported using a novel MultiCS Conditioning paradigm with odor-conditioned faces. As those short-latency responses were supposed to partially reflect initial access to nonextinguished emotional memories, it could be predicted that they outlast the extinction phase. To test this hypothesis, appetitively and aversively odor-conditioned faces were frequently presented during extinction while event-related magnetic fields were recorded. Affect-specific responses in frontal and occipito-temporal areas were found in the early (50-80 ms) but not in the later (130-190 ms) time interval following extinction learning. These results suggest that previously acquired emotional memories can be accessed at initial processing stages but become ineffective in modulating processing at later stages as extinction proceeds.