Emotion-associated tones attract enhanced attention at early auditory processing: magnetoencephalographic correlates

Reduced generalization of reward among individuals with subthreshold depression: Behavioral and EEG evidence

Altered stimulus generalization has been well-documented in anxiety disorders; however, there is a paucity of research investigating this phenomenon in the context of depression. Depression is characterized by impaired reward processing and heightened attention to negative stimuli. It is hypothesized that individuals with depression exhibit reduced generalization of reward stimuli and enhanced generalization of loss stimuli. Nevertheless, no study has examined this process and its underlying neural mechanisms. In the present study, we recruited 25 participants with subthreshold depression (SD group) and 24 age-matched healthy controls (HC group). Participants completed an acquisition task, in which they learned to associate three distinct pure tones (conditioned stimuli, CSs) with a reward, a loss, or no outcome. Subsequently, a generalization session was conducted, during which similar tones (generalization stimuli, GSs) were presented, and participants were required to classify them as a reward tone, a loss tone, or neither. The results revealed that the SD group exhibited reduced generalization errors in the early phase of generalization, suggesting a diminished ability to generalize reward-related stimuli. The event-related potential (ERP) results indicated that the SD group exhibited decreased generalization of positive valence to reward-related GSs and heightened generalization of negative valence to loss-related GSs, as reflected by the N1 and P2 components. However, the late positive potential (LPP) was not modulated by depression in reward generalization or loss generalization. These findings suggested that individuals with subthreshold depression may have a blunted or reduced ability to generalize reward stimuli, shedding light on potential treatment strategies targeting this particular process.

Pitch Improvement in Attentional Blink: A Study across Audiovisual Asymmetries

Attentional blink (AB) is a phenomenon in which the perception of a second target is impaired when it appears within 200-500 ms after the first target. Sound affects an AB and is accompanied by the appearance of an asymmetry during audiovisual integration, but it is not known whether this is related to the tonal representation of sound. The aim of the present study was to investigate the effect of audiovisual asymmetry on attentional blink and whether the presentation of pitch improves the ability to detect a target during an AB that is accompanied by audiovisual asymmetry. The results showed that as the lag increased, the subject's target recognition improved and the pitch produced further improvements. These improvements exhibited a significant asymmetry across the audiovisual channel. Our findings could contribute to better utilizations of audiovisual integration resources to improve attentional transients and auditory recognition decline, which could be useful in areas such as driving and education.

Tinnitus-frequency specific activity and connectivity: A MEG study

Tinnitus pathophysiology has been associated with an atypical cortical network that involves functional changes in auditory and non-auditory areas. Numerous resting-state studies have replicated a tinnitus brain network to be significantly different from healthy-controls. Yet it is still unknown whether the cortical reorganization is attributed to the tinnitus frequency specifically or if it is frequency-irrelevant. Employing magnetoencephalography (MEG), the current study aimed to identify frequency-specific activity patterns by using an individual tinnitus tone (TT) and a 500 Hz-control tone (CT) as auditory stimuli, across 54 tinnitus patients. MEG data were analyzed in a data-driven approach employing a whole-head model in source space and in sources' functional connectivity. Compared to the CT, the event related source space analysis revealed a statistically significant response to TT involving fronto-parietal regions. The CT mainly involved typical auditory activation-related regions. A comparison of the cortical responses to a healthy control group that underwent the same paradigm rejected the alternative interpretation that the frequency-specific activation differences were due to the higher frequency of the TT. Overall, the results suggest frequency-specificity of tinnitus-related cortical patterns. In line with previous studies, we demonstrated a tinnitus-frequency specific network comprising left fronto-temporal, fronto-parietal and tempo-parietal junctions.

Attachment voices promote safety learning in humans: A critical role for P2

Humans have evolved to seek the proximity of attachment figures during times of threat in order to obtain a sense of safety. In this context, we examined whether or not the voice of an intimate partner (termed "attachment voice") could reduce fear-learning of conditioned stimuli (CS+) and enhance learning of safety signals (CS-). Although the ability to learn safety signals is vital for human survival, few studies have explored how attachment voices affect safety learning. To test our hypothesis, we recruited thirty-five young couples and performed a classic Pavlovian conditioning experiment, recording behavioral and electroencephalographic (EEG) data. The results showed that compared with a stranger's voice, the voices of the partners reduced expectancy of the unconditioned stimulus (a shock) during fear-conditioning, as well as the magnitude of P2 event-related potentials within the EEG responses, provided the voices were safety signals. Additionally, behavioral and EEG responses to the CS+ and CS- differed more when the participants heard their partner's voice than when they heard the stranger's voice. Thus, attachment voices, even as pure vowel sounds without any semantic information, enhanced acquisition of conditioned safety (CS-). These findings may provide implications for investigating other new techniques to improve clinical treatments for fear- and anxiety-related disorders and for psychological interventions against the mental health effects of the public health emergency.

Emotional Arousal and Valence Jointly Modulate the Auditory Response: A 40-Hz ASSR Study

Emotion is defined as a response to external stimuli and internal mental representations. It has been characterized as a multidimensional concept, primarily comprising two dimensions: valence and arousal. Existing studies have demonstrated that emotional experience exerts a powerful impact on auditory processing in terms of valence. However, it has also been shown that while negative emotion can improve auditory perception in healthy subjects, patients with depression show deficits in auditory perception. We thus speculated that both arousal and valence jointly modulate auditory perception. To examine the emotion-driven effects on the auditory response, we induced positive, negative, and neutral emotional states in healthy subjects and collected auditory steady-state response (ASSR) evoked by a 40-Hz chirp sound. We calculated peak-to-peak amplitude (PPA) and event-related spectral perturbation (ERSP) of evoked ASSRs and observed that the positive emotions significantly enhanced brain responses to auditory stimuli (p < 0.001), but that ASSRs in a negative state were not significantly enhanced compared with the neutral state. Subsequently, regression analysis showed a significant positive multiple linear relationship between the PPA and ratings of two emotional dimensions, indicating that arousal and valence jointly regulated the auditory cortex's synchronous oscillation, rather than the valence in isolation, offering the potential to clarify the conflicting results surrounding the role of negative emotions in auditory responses. Because depression is generally characterized by low arousal and low valence in actual life, whereas the negative emotion evoked under laboratory conditions is always with low valence but high arousal.

A novel beamformer-based imaging of phase-amplitude coupling (BIPAC) unveiling the inter-regional connectivity of emotional prosody processing in women with primary dysmenorrhea

Objective. Neural communication or the interactions of brain regions play a key role in the formation of functional neural networks. A type of neural communication can be measured in the form of phase-amplitude coupling (PAC), which is the coupling between the phase of low-frequency oscillations and the amplitude of high-frequency oscillations. This paper presents a beamformer-based imaging method, beamformer-based imaging of PAC (BIPAC), to quantify the strength of PAC between a seed region and other brain regions.Approach. A dipole is used to model the ensemble of neural activity within a group of nearby neurons and represents a mixture of multiple source components of cortical activity. From ensemble activity at each brain location, the source component with the strongest coupling to the seed activity is extracted, while unrelated components are suppressed to enhance the sensitivity of coupled-source estimation.Main results. In evaluations using simulation data sets, BIPAC proved advantageous with regard to estimation accuracy in source localization, orientation, and coupling strength. BIPAC was also applied to the analysis of magnetoencephalographic signals recorded from women with primary dysmenorrhea in an implicit emotional prosody experiment. In response to negative emotional prosody, auditory areas revealed strong PAC with the ventral auditory stream and occipitoparietal areas in the theta-gamma and alpha-gamma bands, which may respectively indicate the recruitment of auditory sensory memory and attention reorientation. Moreover, patients with more severe pain experience appeared to have stronger coupling between auditory areas and temporoparietal regions.Significance. Our findings indicate that the implicit processing of emotional prosody is altered by menstrual pain experience. The proposed BIPAC is feasible and applicable to imaging inter-regional connectivity based on cross-frequency coupling estimates. The experimental results also demonstrate that BIPAC is capable of revealing autonomous brain processing and neurodynamics, which are more subtle than active and attended task-driven processing.

Learning dynamics of electrophysiological brain signals during human fear conditioning

Electrophysiological studies in rodents allow recording neural activity during threats with high temporal and spatial precision. Although fMRI has helped translate insights about the anatomy of underlying brain circuits to humans, the temporal dynamics of neural fear processes remain opaque and require EEG. To date, studies on electrophysiological brain signals in humans have helped to elucidate underlying perceptual and attentional processes, but have widely ignored how fear memory traces evolve over time. The low signal-to-noise ratio of EEG demands aggregations across high numbers of trials, which will wash out transient neurobiological processes that are induced by learning and prone to habituation. Here, our goal was to unravel the plasticity and temporal emergence of EEG responses during fear conditioning. To this end, we developed a new sequential-set fear conditioning paradigm that comprises three successive acquisition and extinction phases, each with a novel CS+/CS- set. Each set consists of two different neutral faces on different background colors which serve as CS+ and CS-, respectively. Thereby, this design provides sufficient trials for EEG analyses while tripling the relative amount of trials that tap into more transient neurobiological processes. Consistent with prior studies on ERP components, data-driven topographic EEG analyses revealed that ERP amplitudes were potentiated during time periods from 33-60 ms, 108-200 ms, and 468-820 ms indicating that fear conditioning prioritizes early sensory processing in the brain, but also facilitates neural responding during later attentional and evaluative stages. Importantly, averaging across the three CS+/CS- sets allowed us to probe the temporal evolution of neural processes: Responses during each of the three time windows gradually increased from early to late fear conditioning, while long-latency (460-730 ms) electrocortical responses diminished throughout fear extinction. Our novel paradigm demonstrates how short-, mid-, and long-latency EEG responses change during fear conditioning and extinction, findings that enlighten the learning curve of neurophysiological responses to threat in humans.

Conjunctive and Elemental Representations of a Context in Humans

The dual-process theory assumes that contexts are encoded in an elemental and in a conjunctive representation. However, this theory was developed from animal studies, and we still have to explore if and how elemental and conjunctive representations contribute to, for example, contextual anxiety in humans. Therefore, 28 participants underwent differential context conditioning in a newly developed flip-book paradigm. Virtual rooms were presented similar to a flip-book, that is, as a stream of 49 consecutive screenshots creating the impression of walking through the rooms. This allowed registration of event-related brain potentials triggered by specific screenshots. During two acquisition phases, two rooms were shown in this way for six times each. In one room, the anxiety context (CTX+), mildly painful electric stimuli (unconditioned stimuli [USs]) were administered unpredictably after 12 distinct screenshots, which became threat elements, whereas 12 selected comparable screenshots became nonthreat elements (elemental representation); all screenshots represented the anxiety context (conjunctive representation). In the second room, the safety context (CTX-), no USs were applied; thus, all screenshots created the safety context whereby 12 preselected screenshots represented safety elements. Increased US expectancy ratings for threat versus nonthreat or safety elements reflected elemental representation. Conjunctive representation was evident in differential ratings (arousal and contingency) and increased P100 and early posterior negativity amplitudes for threat and nonthreat CTX+ versus safety CTX- screenshots. These differences disappeared during two test phases without US delivery indicating successful extinction. In summary, we revealed the first piece of evidence for the simultaneous contributions of elemental and conjunctive representation during context conditioning in humans.

Learning to see the threat: temporal dynamics of ERPs of motivated attention in fear conditioning

Social threat detection is important in everyday life. Studies of cortical activity have shown that event-related potentials (ERPs) of motivated attention are modulated during fear conditioning. The time course of motivated attention in learning and extinction of fear is, however, still largely unknown. We aimed to study temporal dynamics of learning processes in classical fear conditioning to social cues (neutral faces) by selecting an experimental setup that produces large effects on well-studied ERP components (early posterior negativity, EPN; late positive potential, LPP; stimulus preceding negativity, SPN) and then exploring small consecutive groups of trials. EPN, LPP, and SPN markedly and quickly increased during the acquisition phase in response to the CS+ but not the CS-. These changes were visible even at high temporal resolution and vanished completely during extinction. Moreover, some evidence was found for component differences in extinction learning, with differences between CS+ and CS- extinguishing faster for late as compared to early ERP components. Results demonstrate that fear learning to social cues is a very fast and highly plastic process and conceptually different ERPs of motivated attention are sensitive to these changes at high temporal resolution, pointing to specific neurocognitive and affective processes of social fear learning.

Affective modulation of executive control in early childhood: Evidence from ERPs and a Go/Nogo task

Modulation of adaptive executive control is particularly demanded in a pre- and early-school period. Therefore, in the present study, we investigated whether affective information can influence executive control in preschool children. We have recorded EEG during a Go/Nogo task where gender of a face served as a Go/Nogo cue and emotional expressions (positive, negative, neutral) were task irrelevant. Negative emotions modulated the magnitude of the conflict effect (Nogo vs. Go) in the N200 relative to neutral control, indicating enhanced cognitive control for negative emotions. Moreover, interpersonal characteristics (e.g., aggressive behavior) correlated with the emotion facilitated inhibitory control as indicated by N200. In addition, Go/Nogo conflict modulated neural responses in children already 100 ms after stimulus onset when paired with socially relevant emotional stimuli. These results show that emotions affect cognitive control in this age group in a valence specific manner.

Involuntary sensory enhancement of gain- and loss-associated tones: A general relevance principle

In a recent event-related potential (ERP) study (Folyi et al., 2016), we have demonstrated that sensory processing of task-irrelevant tones is enhanced when they were previously associated with positive or negative (by the means of monetary gains and losses, respectively) affective meaning relative to tones with neutral meaning, as indexed by the enhancement of the auditory N1-amplitude. In the present study, (1) in line with the hypothesis of affective counter-regulation, we investigated whether positive versus negative tones can receive differential attentional enhancement, depending on motivational context (Experiment 1); and (2) whether the early facilitation of positive and negative tones can operate strictly outside of the focus of voluntary attention (Experiment 2). In Experiment 1, we replicated the basic N1 valence effect, but found no moderation by motivational context. In Experiment 2, we found a small valence effect on the N1. By combining data from the three experiments (i.e., our previous experiment and the present ones; N = 72), we found a clear enhancement of N1-amplitudes for valenced tones without moderation by experiment. This pattern of results suggests comparable early attentional enhancement of valenced tones in general: (a) despite different level of concurrent task-relevant attentional and motivational demands in these experiments; and (b) without prioritizing one valence category over another, supporting our claim that the general relevance of the tones with high motivational value that governs early attentional facilitation.

Neuronal Correlates of Product Feature Attractiveness

Decision-making is the process of selecting a logical choice from among the available options and happens as a complex process in the human brain. It is based on information processing and cost-analysis; it involves psychological factors, specifically, emotions. In addition to cost factors personal preferences have significant influence on decision making. For marketing purposes, it is interesting to know how these emotions are related to product acquisition decision and how to improve these products according to the user's preferences. For our proof-of-concept study, we use magneto- and electro-encephalography (MEG, EEG) to evaluate the very early reactions in the brain related to the emotions. Recordings from these methods are comprehensive sources of information to investigate neural processes of the human brain with good spatial- and excellent temporal resolution. Those characteristics make these methods suitable to examine the neurologic process that gives origin to human behavior and specifically, decision making. Literature describes some neuronal correlates for individual preferences, like asymmetrical distribution of frequency specific activity in frontal and prefrontal areas, which are associated with emotional processing. Such correlates could be used to objectively evaluate the pleasantness of product appearance and branding (i.e., logo), thus avoiding subjective bias. This study evaluates the effects of different product features on brain activity and whether these methods could potentially be used for marketing and product design. We analyzed the influence of color and fit of sports shirts, as well as a brand logo on the brain activity, specifically in frontal asymmetric activation. Measurements were performed using MEG and EEG with 10 healthy subjects. Images of t-shirts with different characteristics were presented on a screen. We recorded the subjective evaluation by asking for a positive, negative or neutral rating. The results showed significantly different responses between positively and negatively rated shirts. While the influence of the presence of a logo was present in behavioral data, but not in the neurocognitive data, the influence of shirt fit and color could be reconstructed in both data sets. This method may enable evaluation of subjective product preference.

Emotional enhancement of error detection-The role of perceptual processing and inhibition monitoring in failed auditory stop trials

The first aim of the present study was to test whether arousing, aversive sounds can influence inhibitory task performance and lead to increased error monitoring relative to a neutral task condition. The second aim was to examine whether the enhancement of error monitoring in an affective context (if present) could be predicted from stop-signal-related brain activity. Participants performed an emotional stop-signal task that required response inhibition to aversive and neutral auditory stimuli. The behavioral data revealed that unpleasant sounds facilitated inhibitory processing by decreasing the stop-signal reaction time and increasing the inhibitory rate relative to neutral tones. Aversive sounds evoked larger N1, P3, and Pe components, indicating improvements in perceptual processing, inhibition, and conscious error monitoring. A first regression analysis, conducted regardless of the category of the stop signal, revealed that both selected indexes of stop-signal-related brain activity-the N1 and P3 amplitudes recorded in the unsuccessfully inhibited trials-significantly accounted for the Pe component variance, explaining a large amount of the observed variation (66%). A second regression model, focused on difference measures (emotional minus neutral), revealed that the affective increase in the P3 amplitude on failed stop trials was the only factor that significantly accounted for the emotional enhancement effect in the Pe amplitude. This suggests that, in general (regardless of stop-signal condition), error processing is stronger if the erroneous response directly follows the stimulus, which was effectively processed on both the perceptual and action-monitoring levels. However, only inhibition-monitoring evidence accounts for the emotional increase in conscious error detection.

An evil face? Verbal evaluative multi-CS conditioning enhances face-evoked mid-latency magnetoencephalographic responses

Humans have a remarkable capacity for rapid affective learning. For instance, using first-order US such as odors or electric shocks, magnetoencephalography (MEG) studies of multi-CS conditioning demonstrate enhanced early (<150 ms) and mid-latency (150–300 ms) visual evoked responses to affectively conditioned faces, together with changes in stimulus evaluation. However, particularly in social contexts, human affective learning is often mediated by language, a class of complex higher-order US. To elucidate mechanisms of this type of learning, we investigate how face processing changes following verbal evaluative multi-CS conditioning. Sixty neutral expression male faces were paired with phrases about aversive crimes (30) or neutral occupations (30). Post conditioning, aversively associated faces evoked stronger magnetic fields in a mid-latency interval between 220 and 320 ms, localized primarily in left visual cortex. Aversively paired faces were also rated as more arousing and more unpleasant, evaluative changes occurring both with and without contingency awareness. However, no early MEG effects were found, implying that verbal evaluative conditioning may require conceptual processing and does not engage rapid, possibly sub-cortical, pathways. Results demonstrate the efficacy of verbal evaluative multi-CS conditioning and indicate both common and distinct neural mechanisms of first- and higher-order multi-CS conditioning, thereby informing theories of associative learning.

Stimulus-invariant auditory cortex threat encoding during fear conditioning with simple and complex sounds

Learning to predict threat depends on amygdala plasticity and does not require auditory cortex (ACX) when threat predictors (conditioned stimuli, CS) are simple sine tones. However, ACX is required in rodents to learn from some naturally occurring CS. Yet, the precise function of ACX, and whether it differs for different CS types, is unknown. Here, we address how ACX encodes threat predictions during human fear conditioning using functional magnetic resonance imaging (fMRI) with multivariate pattern analysis. As in previous rodent work, CS+ and CS- were defined either by direction of frequency modulation (complex) or by frequency of pure tones (simple). In an instructed non-reinforcement context, different sets of simple and complex sounds were always presented without reinforcement (neutral sounds, NS). Threat encoding was measured by separation of fMRI response patterns induced by CS+/CS-, or similar NS1/NS2 pairs. We found that fMRI patterns in Heschl's gyrus encoded threat prediction over and above encoding the physical stimulus features also present in NS, i.e. CS+/CS- could be separated better than NS1/NS2. This was the case both for simple and complex CS. Furthermore, cross-prediction demonstrated that threat representations were similar for simple and complex CS, and thus unlikely to emerge from stimulus-specific top-down, or learning-induced, receptive field plasticity. Searchlight analysis across the entire ACX demonstrated further threat representations in a region including BA22 and BA42. However, in this region, patterns were distinct for simple and complex sounds, and could thus potentially arise from receptive field plasticity. Strikingly, across participants, individual size of Heschl's gyrus predicted strength of fear learning for complex sounds. Overall, our findings suggest that ACX represents threat predictions, and that Heschl's gyrus contains a threat representation that is invariant across physical stimulus categories.

Don't fear 'fear conditioning': Methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear

The so-called 'replicability crisis' has sparked methodological discussions in many areas of science in general, and in psychology in particular. This has led to recent endeavours to promote the transparency, rigour, and ultimately, replicability of research. Originating from this zeitgeist, the challenge to discuss critical issues on terminology, design, methods, and analysis considerations in fear conditioning research is taken up by this work, which involved representatives from fourteen of the major human fear conditioning laboratories in Europe. This compendium is intended to provide a basis for the development of a common procedural and terminology framework for the field of human fear conditioning. Whenever possible, we give general recommendations. When this is not feasible, we provide evidence-based guidance for methodological decisions on study design, outcome measures, and analyses. Importantly, this work is also intended to raise awareness and initiate discussions on crucial questions with respect to data collection, processing, statistical analyses, the impact of subtle procedural changes, and data reporting specifically tailored to the research on fear conditioning.

The Language, Tone and Prosody of Emotions: Neural Substrates and Dynamics of Spoken-Word Emotion Perception

Rapid assessment of emotions is important for detecting and prioritizing salient input. Emotions are conveyed in spoken words via verbal and non-verbal channels that are mutually informative and unveil in parallel over time, but the neural dynamics and interactions of these processes are not well understood. In this paper, we review the literature on emotion perception in faces, written words, and voices, as a basis for understanding the functional organization of emotion perception in spoken words. The characteristics of visual and auditory routes to the amygdala—a subcortical center for emotion perception—are compared across these stimulus classes in terms of neural dynamics, hemispheric lateralization, and functionality. Converging results from neuroimaging, electrophysiological, and lesion studies suggest the existence of an afferent route to the amygdala and primary visual cortex for fast and subliminal processing of coarse emotional face cues. We suggest that a fast route to the amygdala may also function for brief non-verbal vocalizations (e.g., laugh, cry), in which emotional category is conveyed effectively by voice tone and intensity. However, emotional prosody which evolves on longer time scales and is conveyed by fine-grained spectral cues appears to be processed via a slower, indirect cortical route. For verbal emotional content, the bulk of current evidence, indicating predominant left lateralization of the amygdala response and timing of emotional effects attributable to speeded lexical access, is more consistent with an indirect cortical route to the amygdala. Top-down linguistic modulation may play an important role for prioritized perception of emotions in words. Understanding the neural dynamics and interactions of emotion and language perception is important for selecting potent stimuli and devising effective training and/or treatment approaches for the alleviation of emotional dysfunction across a range of neuropsychiatric states.

Tinnitus- related distress: evidence from fMRI of an emotional stroop task

Background

Chronic tinnitus affects 5 % of the population, 17 % suffer under the condition. This distress seems mainly to be dependent on negative cognitive-emotional evaluation of the tinnitus and selective attention to the tinnitus. A well-established paradigm to examine selective attention and emotional processing is the Emotional Stroop Task (EST). Recent models of tinnitus distress propose limbic, frontal and parietal regions to be more active in highly distressed tinnitus patients. Only a few studies have compared high and low distressed tinnitus patients. Thus, this study aimed to explore neural correlates of tinnitus-related distress.

Methods

Highly distressed tinnitus patients (HDT, n = 16), low distressed tinnitus patients (LDT, n = 16) and healthy controls (HC, n = 16) underwent functional magnetic resonance imaging (fMRI) during an EST, that used tinnitus-related words and neutral words as stimuli. A random effects analysis of the fMRI data was conducted on the basis of the general linear model. Furthermore correlational analyses between the blood oxygen level dependent response and tinnitus distress, loudness, depression, anxiety, vocabulary and hypersensitivity to sound were performed.

Results

Contradictory to the hypothesis, highly distressed patients showed no Stroop effect in their reaction times. As hypothesized HDT and LDT differed in the activation of the right insula and the orbitofrontal cortex. There were no hypothesized differences between HDT and HC. Activation of the orbitofrontal cortex and the right insula were found to correlate with tinnitus distress.

Conclusions

The results are partially supported by earlier resting-state studies and corroborate the role of the insula and the orbitofrontal cortex in tinnitus distress.

Electrophysiological Correlates of Emotional Content and Volume Level in Spoken Word Processing

For visual stimuli of emotional content as pictures and written words, stimulus size has been shown to increase emotion effects in the early posterior negativity (EPN), a component of event-related potentials (ERPs) indexing attention allocation during visual sensory encoding. In the present study, we addressed the question whether this enhanced relevance of larger (visual) stimuli might generalize to the auditory domain and whether auditory emotion effects are modulated by volume. Therefore, subjects were listening to spoken words with emotional or neutral content, played at two different volume levels, while ERPs were recorded. Negative emotional content led to an increased frontal positivity and parieto-occipital negativity-a scalp distribution similar to the EPN-between ~370 and 530 ms. Importantly, this emotion-related ERP component was not modulated by differences in volume level, which impacted early auditory processing, as reflected in increased amplitudes of the N1 (80-130 ms) and P2 (130-265 ms) components as hypothesized. However, contrary to effects of stimulus size in the visual domain, volume level did not influence later ERP components. These findings indicate modality-specific and functionally independent processing triggered by emotional content of spoken words and volume level.

Modulatory Effects of Attention on Lateral Inhibition in the Human Auditory Cortex

Reduced neural processing of a tone is observed when it is presented after a sound whose spectral range closely frames the frequency of the tone. This observation might be explained by the mechanism of lateral inhibition (LI) due to inhibitory interneurons in the auditory system. So far, several characteristics of bottom up influences on LI have been identified, while the influence of top-down processes such as directed attention on LI has not been investigated. Hence, the study at hand aims at investigating the modulatory effects of focused attention on LI in the human auditory cortex. In the magnetoencephalograph, we present two types of masking sounds (white noise vs. withe noise passing through a notch filter centered at a specific frequency), followed by a test tone with a frequency corresponding to the center-frequency of the notch filter. Simultaneously, subjects were presented with visual input on a screen. To modulate the focus of attention, subjects were instructed to concentrate either on the auditory input or the visual stimuli. More specific, on one half of the trials, subjects were instructed to detect small deviations in loudness in the masking sounds while on the other half of the trials subjects were asked to detect target stimuli on the screen. The results revealed a reduction in neural activation due to LI, which was larger during auditory compared to visual focused attention. Attentional modulations of LI were observed in two post-N1m time intervals. These findings underline the robustness of reduced neural activation due to LI in the auditory cortex and point towards the important role of attention on the modulation of this mechanism in more evaluative processing stages.

Song Perception by Professional Singers and Actors: An MEG Study

The cortical correlates of speech and music perception are essentially overlapping, and the specific effects of different types of training on these networks remain unknown. We compared two groups of vocally trained professionals for music and speech, singers and actors, using recited and sung rhyme sequences from German art songs with semantic and/ or prosodic/melodic violations (i.e. violations of pitch) of the last word, in order to measure the evoked activation in a magnetoencephalographic (MEG) experiment. MEG data confirmed the existence of intertwined networks for the sung and spoken modality in an early time window after word violation. In essence for this early response, higher activity was measured after melodic/prosodic than semantic violations in predominantly right temporal areas. For singers as well as for actors, modality-specific effects were evident in predominantly left-temporal lateralized activity after semantic expectancy violations in the spoken modality, and right-dominant temporal activity in response to melodic violations in the sung modality. As an indication of a special group-dependent audiation process, higher neuronal activity for singers appeared in a late time window in right temporal and left parietal areas, both after the recited and the sung sequences.

Attentional enhancement for positive and negative tones at an early stage of auditory processing

We report an event-related potential (ERP) study based on the hypothesis that valenced (i.e., positive and/or negative) tones are prioritized over neutral ones at an early, perceptual stage of auditory processing. In order to avoid perceptual confounds, we induced valence experimentally during a learning phase by assigning positive, negative, and neutral valences to tone-frequencies in a balanced design. In a subsequent test phase, EEG was recorded while these tones were entirely task-irrelevant. The amplitude of the auditory N1 was increased for valenced compared with neutral tones, indicating enhanced attention. While behavioral results of the learning phase, and both implicit and explicit measures of tone evaluation indicated differentiation between positive and negative valence, there was no such differentiation on the N1 amplitude. Our results suggest that it is the general relevance of the valenced tones that governs early attentional processes.

One-year-old fear memories rapidly activate human fusiform gyrus

Fast threat detection is crucial for survival. In line with such evolutionary pressure, threat-signaling fear-conditioned faces have been found to rapidly (<80 ms) activate visual brain regions including the fusiform gyrus on the conditioning day. Whether remotely fear conditioned stimuli (CS) evoke similar early processing enhancements is unknown. Here, 16 participants who underwent a differential face fear-conditioning and extinction procedure on day 1 were presented the initial CS 24 h after conditioning (Recent Recall Test) as well as 9-17 months later (Remote Recall Test) while EEG was recorded. Using a data-driven segmentation procedure of CS evoked event-related potentials, five distinct microstates were identified for both the recent and the remote memory test. To probe intracranial activity, EEG activity within each microstate was localized using low resolution electromagnetic tomography analysis (LORETA). In both the recent (41-55 and 150-191 ms) and remote (45-90 ms) recall tests, fear conditioned faces potentiated rapid activation in proximity of fusiform gyrus, even in participants unaware of the contingencies. These findings suggest that rapid processing enhancements of conditioned faces persist over time.

Rapid prefrontal cortex activation towards aversively paired faces and enhanced contingency detection are observed in highly trait-anxious women under challenging conditions

Relative to healthy controls, anxiety-disorder patients show anomalies in classical conditioning that may either result from, or provide a risk factor for, clinically relevant anxiety. Here, we investigated whether healthy participants with enhanced anxiety vulnerability show abnormalities in a challenging affective-conditioning paradigm, in which many stimulus-reinforcer associations had to be acquired with only few learning trials. Forty-seven high and low trait-anxious females underwent MultiCS conditioning, in which 52 different neutral faces (CS+) were paired with an aversive noise (US), while further 52 faces (CS-) remained unpaired. Emotional learning was assessed by evaluative (rating), behavioral (dot-probe, contingency report), and neurophysiological (magnetoencephalography) measures before, during, and after learning. High and low trait-anxious groups did not differ in evaluative ratings or response priming before or after conditioning. High trait-anxious women, however, were better than low trait-anxious women at reporting CS+/US contingencies after conditioning, and showed an enhanced prefrontal cortex (PFC) activation towards CS+ in the M1 (i.e., 80-117 ms) and M170 time intervals (i.e., 140-160 ms) during acquisition. These effects in MultiCS conditioning observed in individuals with elevated trait anxiety are consistent with theories of enhanced conditionability in anxiety vulnerability. Furthermore, they point towards increased threat monitoring and detection in highly trait-anxious females, possibly mediated by alterations in visual working memory.

Facing Challenges in Differential Classical Conditioning Research: Benefits of a Hybrid Design for Simultaneous Electrodermal and Electroencephalographic Recording

Several challenges make it difficult to simultaneously investigate central and autonomous nervous system correlates of conditioned stimulus (CS) processing in classical conditioning paradigms. Such challenges include, for example, the discrepant requirements of electroencephalography (EEG) and electrodermal activity (EDA) recordings with regard to multiple repetitions of conditions and sufficient trial duration. Here, we propose a MultiCS conditioning set-up, in which we increased the number of CSs, decreased the number of learning trials, and used trials of short and long durations for meeting requirements of simultaneous EEG–EDA recording in a differential aversive conditioning task. Forty-eight participants underwent MultiCS conditioning, in which four neutral faces (CS+) were paired four times each with aversive electric stimulation (unconditioned stimulus) during acquisition, while four different neutral faces (CS−) remained unpaired. When comparing after relative to before learning measurements, EEG revealed an enhanced centro-posterior positivity to CS+ vs. CS− during 368–600 ms, and subjective ratings indicated CS+ to be less pleasant and more arousing than CS−. Furthermore, changes in CS valence and arousal were strong enough to bias subjective ratings when faces of CS+/CS− identity were displayed with different emotional expression (happy, angry) in a post-experimental behavioral task. In contrast to a persistent neural and evaluative CS+/CS− differentiation that sustained multiple unreinforced CS presentations, electrodermal differentiation was rapidly extinguished. Current results suggest that MultiCS conditioning provides a promising paradigm for investigating pre–post-learning changes under minimal influences of extinction and overlearning of simple stimulus features. Our data also revealed methodological pitfalls, such as the possibility of occurring artifacts when combining different acquisition systems for central and peripheral psychophysiological measures.

Negative emotion provides cues for orienting auditory spatial attention

The auditory stimuli provide information about the objects and events around us. They can also carry biologically significant emotional information (such as unseen dangers and conspecific vocalizations), which provides cues for allocation of attention and mental resources. Here, we investigated whether task-irrelevant auditory emotional information can provide cues for orientation of auditory spatial attention. We employed a covert spatial orienting task: the dot-probe task. In each trial, two task-irrelevant auditory cues were simultaneously presented at two separate locations (left-right or front-back). Environmental sounds were selected to form emotional vs. neutral, emotional vs. emotional, and neutral vs. neutral cue pairs. The participants' task was to detect the location of an acoustic target that was presented immediately after the task-irrelevant auditory cues. The target was presented at the same location as one of the auditory cues. The results indicated that participants were significantly faster to locate the target when it replaced the negative cue compared to when it replaced the neutral cue. The positive cues did not produce a clear attentional bias. Further, same valence pairs (emotional-emotional or neutral-neutral) did not modulate reaction times due to a lack of spatial attention capture by one cue in the pair. Taken together, the results indicate that negative affect can provide cues for the orientation of spatial attention in the auditory domain.

Enhancing Inhibition-Induced Plasticity in Tinnitus – Spectral Energy Contrasts in Tailor-Made Notched Music Matter

Chronic tinnitus seems to be caused by reduced inhibition among frequency selective neurons in the auditory cortex. One possibility to reduce tinnitus perception is to induce inhibition onto over-activated neurons representing the tinnitus frequency via tailor-made notched music (TMNM). Since lateral inhibition is modifiable by spectral energy contrasts, the question arises if the effects of inhibition-induced plasticity can be enhanced by introducing increased spectral energy contrasts (ISEC) in TMNM. Eighteen participants suffering from chronic tonal tinnitus, pseudo randomly assigned to either a classical TMNM or an ISEC-TMNM group, listened to notched music for three hours on three consecutive days. The music was filtered for both groups by introducing a notch filter centered at the individual tinnitus frequency. For the ISEC-TMNM group a frequency bandwidth of 3/8 octaves on each side of the notch was amplified, additionally, by about 20 dB. Before and after each music exposure, participants rated their subjectively perceived tinnitus loudness on a visual analog scale. During the magnetoencephalographic recordings, participants were stimulated with either a reference tone of 500 Hz or a test tone with a carrier frequency representing the individual tinnitus pitch. Perceived tinnitus loudness was significantly reduced after TMNM exposure, though TMNM type did not influence the loudness ratings. Tinnitus related neural activity in the N1m time window and in the so called tinnitus network comprising temporal, parietal and frontal regions was reduced after TMNM exposure. The ISEC-TMNM group revealed even enhanced inhibition-induced plasticity in a temporal and a frontal cortical area. Overall, inhibition of tinnitus related neural activity could be strengthened in people affected with tinnitus by increasing spectral energy contrast in TMNM, confirming the concepts of inhibition-induced plasticity via TMNM and spectral energy contrasts.

Emotion and goal-directed behavior: ERP evidence on cognitive and emotional conflict

Cognitive control supports goal-directed behavior by resolving conflict among opposing action tendencies. Emotion can trigger cognitive control processes, thus speeding up conflict processing when the target dimension of stimuli is emotional. However, it is unclear what role emotionality of the target dimension plays in the processing of emotional conflict (e.g. in irony). In two EEG experiments, we compared the influence of emotional valence of the target (emotional, neutral) in cognitive and emotional conflict processing. To maximally approximate real-life communication, we used audiovisual stimuli. Participants either categorized spoken vowels (cognitive conflict) or their emotional valence (emotional conflict), while visual information was congruent or incongruent. Emotional target dimension facilitated both cognitive and emotional conflict processing, as shown in a reduced reaction time conflict effect. In contrast, the N100 in the event-related potentials showed a conflict-specific reversal: the conflict effect was larger for emotional compared with neutral trials in cognitive conflict and smaller in emotional conflict. Additionally, domain-general conflict effects were observed in the P200 and N200 responses. The current findings confirm that emotions have a strong influence on cognitive and emotional conflict processing. They also highlight the complexity and heterogeneity of the interaction of emotion with different types of conflict.

Cardiac Response During Auditory Selective Attention to Tones and Affective Sounds

We conducted an experiment to determine if attention to affective sounds showed a lateral bias. Twenty-two participants were instructed to respond to one of two pure tones presented monaurally and to a set of pleasant and unpleasant sounds from the International Affective Digitized Sounds set. Participants were instructed to respond to pleasant or unpleasant sounds in the right or left ear, attending to pleasant/right, pleasant/left, unpleasant/right, and unpleasant/left sounds in separate blocks. Evoked cardiac response to the tones showed significant cardiac deceleration in response to attended sounds in the attended ear. In addition, pleasant sounds elicited significant cardiac deceleration when attended in the right ear, but not in the left. Unpleasant sounds elicited significant cardiac deceleration when attended in both ears. Consistent with the anterior valence hypothesis, our data suggests that pleasant sounds are mainly processed in the left hemisphere, but in contrast to this hypothesis, unpleasant sounds are processed bilaterally.

Abnormal, affect-specific modulatory effects on early auditory processing in schizophrenia: magnetoencephalographic evidence

Abnormalities in the perception and identification of emotions have frequently been reported in schizophrenia. Hemodynamic neuroimaging studies found functional abnormalities in cortical and subcortical brain circuits that are involved in normal affective processing, but the temporal dynamics of abnormal emotion processing in schizophrenia remain largely elusive. To investigate this issue, we recorded early auditory evoked field components by means of whole-head magnetoencephalography that were in response to emotion-associated tones in seventeen patients with schizophrenia and in seventeen healthy, matched controls. Forty-two click-like tones (conditioned stimuli; CS) acquired differential emotional meaning through an affective associative learning procedure by pairing each CS three times with either pleasant, unpleasant or neutral auditory scenes. As expected, differential affect-specific modulation in patients vs. controls was evident, starting at the auditory N1m onset latency of approximately 70ms, extending to 230ms. While controls showed the expected enhanced processing of emotion associated CS, patients revealed an inverted pattern with reduced processing of arousal, when compared to neutral stimuli, in the right prefrontal cortex. The present finding suggests impairments in the prioritization of emotionally salient vs. non-salient stimuli in patients with schizophrenia. Dysfunction in higher cognitive processes and behavior in schizophrenia may therefore reflect dysfunction in fundamental, early emotion processing stages.

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

In everyday life, multiple sensory channels jointly trigger emotional experiences and one channel may alter processing in another channel. For example, seeing an emotional facial expression and hearing the voice’s emotional tone will jointly create the emotional experience. This example, where auditory and visual input is related to social communication, has gained considerable attention by researchers. However, interactions of visual and auditory emotional information are not limited to social communication but can extend to much broader contexts including human, animal, and environmental cues. In this article, we review current research on audiovisual emotion processing beyond face-voice stimuli to develop a broader perspective on multimodal interactions in emotion processing. We argue that current concepts of multimodality should be extended in considering an ecologically valid variety of stimuli in audiovisual emotion processing. Therefore, we provide an overview of studies in which emotional sounds and interactions with complex pictures of scenes were investigated. In addition to behavioral studies, we focus on neuroimaging, electro- and peripher-physiological findings. Furthermore, we integrate these findings and identify similarities or differences. We conclude with suggestions for future research.

Rapid plasticity in the prefrontal cortex during affective associative learning

MultiCS conditioning is an affective associative learning paradigm, in which affective categories consist of many similar and complex stimuli. Comparing visual processing before and after learning, recent MultiCS conditioning studies using time-sensitive magnetoencephalography (MEG) revealed enhanced activation of prefrontal cortex (PFC) regions towards emotionally paired versus neutral stimuli already during short-latency processing stages (i.e., 50 to 80 ms after stimulus onset). The present study aimed at showing that this rapid differential activation develops as a function of the acquisition and not the extinction of the emotional meaning associated with affectively paired stimuli. MEG data of a MultiCS conditioning study were analyzed with respect to rapid changes in PFC activation towards aversively (electric shock) paired and unpaired faces that occurred during the learning of stimulus-reinforcer contingencies. Analyses revealed an increased PFC activation towards paired stimuli during 50 to 80 ms already during the acquisition of contingencies, which emerged after a single pairing with the electric shock. Corresponding changes in stimulus valence could be observed in ratings of hedonic valence, although participants did not seem to be aware of contingencies. These results suggest rapid formation and access of emotional stimulus meaning in the PFC as well as a great capacity for adaptive and highly resolving learning in the brain under challenging circumstances.

Auditory pre-experience modulates classification of affect intensity: evidence for the evaluation of call salience by a non-human mammal, the bat Megaderma lyra

INTRODUCTION

Immediate responses towards emotional utterances in humans are determined by the acoustic structure and perceived relevance, i.e. salience, of the stimuli, and are controlled via a central feedback taking into account acoustic pre-experience. The present study explores whether the evaluation of stimulus salience in the acoustic communication of emotions is specifically human or has precursors in mammals. We created different pre-experiences by habituating bats (Megaderma lyra) to stimuli based on aggression, and response, calls from high or low intensity level agonistic interactions, respectively. Then we presented a test stimulus of opposite affect intensity of the same call type. We compared the modulation of response behaviour by affect intensity between the reciprocal experiments.

RESULTS

For aggression call stimuli, the bats responded to the dishabituation stimuli independent of affect intensity, emphasising the attention-grabbing function of this call type. For response call stimuli, the bats responded to a high affect intensity test stimulus after experiencing stimuli of low affect intensity, but transferred habituation to a low affect intensity test stimulus after experiencing stimuli of high affect intensity. This transfer of habituation was not due to over-habituation as the bats responded to a frequency-shifted control stimulus. A direct comparison confirmed the asymmetric response behaviour in the reciprocal experiments.

CONCLUSIONS

Thus, the present study provides not only evidence for a discrimination of affect intensity, but also for an evaluation of stimulus salience, suggesting that basic assessment mechanisms involved in the perception of emotion are an ancestral trait in mammals.

Activation of auditory cortex by anticipating and hearing emotional sounds: an MEG study

To study how auditory cortical processing is affected by anticipating and hearing of long emotional sounds, we recorded auditory evoked magnetic fields with a whole-scalp MEG device from 15 healthy adults who were listening to emotional or neutral sounds. Pleasant, unpleasant, or neutral sounds, each lasting for 6 s, were played in a random order, preceded by 100-ms cue tones (0.5, 1, or 2 kHz) 2 s before the onset of the sound. The cue tones, indicating the valence of the upcoming emotional sounds, evoked typical transient N100m responses in the auditory cortex. During the rest of the anticipation period (until the beginning of the emotional sound), auditory cortices of both hemispheres generated slow shifts of the same polarity as N100m. During anticipation, the relative strengths of the auditory-cortex signals depended on the upcoming sound: towards the end of the anticipation period the activity became stronger when the subject was anticipating emotional rather than neutral sounds. During the actual emotional and neutral sounds, sustained fields were predominant in the left hemisphere for all sounds. The measured DC MEG signals during both anticipation and hearing of emotional sounds implied that following the cue that indicates the valence of the upcoming sound, the auditory-cortex activity is modulated by the upcoming sound category during the anticipation period.

Phasic boosting of auditory perception by visual emotion

Emotionally negative stimuli boost perceptual processes. There is little known, however, about the timing of this modulation. The present study aims at elucidating the phasic effects of, emotional processing on auditory processing within subsequent time-windows of visual emotional, processing in humans. We recorded the electroencephalogram (EEG) while participants responded to a, discrimination task of faces with neutral or fearful expressions. A brief complex tone, which subjects, were instructed to ignore, was displayed concomitantly, but with different asynchronies respective to, the image onset. Analyses of the N1 auditory event-related potential (ERP) revealed enhanced brain, responses in presence of fearful faces. Importantly, this effect occurred at picture-tone asynchronies of, 100 and 150ms, but not when these were displayed simultaneously, or at 50ms or 200ms asynchrony. These results confirm the existence of a fast-operating crossmodal effect of visual emotion on auditory, processing, suggesting a phasic variation according to the time-course of emotional processing.

Early prefrontal brain responses to the Hedonic quality of emotional words--a simultaneous EEG and MEG study

The hedonic meaning of words affects word recognition, as shown by behavioral, functional imaging, and event-related potential (ERP) studies. However, the spatiotemporal dynamics and cognitive functions behind are elusive, partly due to methodological limitations of previous studies. Here, we account for these difficulties by computing combined electro-magnetoencephalographic (EEG/MEG) source localization techniques. Participants covertly read emotionally high-arousing positive and negative nouns, while EEG and MEG were recorded simultaneously. Combined EEG/MEG current-density reconstructions for the P1 (80–120 ms), P2 (150–190 ms) and EPN component (200–300 ms) were computed using realistic individual head models, with a cortical constraint. Relative to negative words, the P1 to positive words predominantly involved language-related structures (left middle temporal and inferior frontal regions), and posterior structures related to directed attention (occipital and parietal regions). Effects shifted to the right hemisphere in the P2 component. By contrast, negative words received more activation in the P1 time-range only, recruiting prefrontal regions, including the anterior cingulate cortex (ACC). Effects in the EPN were not statistically significant. These findings show that different neuronal networks are active when positive versus negative words are processed. We account for these effects in terms of an “emotional tagging” of word forms during language acquisition. These tags then give rise to different processing strategies, including enhanced lexical processing of positive words and a very fast language-independent alert response to negative words. The valence-specific recruitment of different networks might underlie fast adaptive responses to both approach- and withdrawal-related stimuli, be they acquired or biological.

Visuocortical changes during delay and trace aversive conditioning: evidence from steady-state visual evoked potentials

The visual system is biased toward sensory cues that have been associated with danger or harm through temporal co-occurrence. An outstanding question about conditioning-induced changes in visuocortical processing is the extent to which they are driven primarily by top-down factors such as expectancy or by low-level factors such as the temporal proximity between conditioned stimuli and aversive outcomes. Here, the authors examined this question using 2 different differential aversive conditioning experiments: participants learned to associate a particular grating stimulus with an aversive noise that was presented either in close temporal proximity (delay conditioning experiment) or after a prolonged stimulus-free interval (trace conditioning experiment). In both experiments, the authors probed cue-related cortical responses by recording steady-state visual evoked potentials. Although behavioral ratings indicated that all participants successfully learned to discriminate between the grating patterns that predicted the presence versus absence of the aversive noise, selective amplification of population-level responses in visual cortex for the conditioned danger signal was observed only when the grating and the noise were temporally contiguous. Our findings are in line with notions purporting that changes in the electrocortical response of visual neurons induced by aversive conditioning are a product of Hebbian associations among sensory cell assemblies rather than being driven entirely by expectancy-based, declarative processes.