Effect of emotional context in auditory-cortex processing

Pupillary response reflects attentional modulation to sound after emotional arousal

There have been various studies on the effects of emotional visual processing on subsequent non-emotional auditory stimuli. A previous study with EEG has shown that responses to deviant sounds presented after presenting negative pictures collected more attentional resources than those for neutral pictures. To investigate such a compelling between emotional and cognitive processing, this study aimed to examined pupillary responses to an auditory stimulus after a positive, negative, or neutral emotional state was elicited by an emotional image. An emotional image was followed by a beep sound that was either repetitive or unexpected, and the pupillary dilation was measured. As a result, we found that the early component of the pupillary response to the beep sound was larger for negative and positive emotional states than the neutral emotional state, whereas the late component was larger for the positive emotional state than the negative and neutral emotional states. In addition, the peak latency of the pupillary response was earlier for negative than neutral or positive images. Further, to compensate for the disadvantage of low-temporal resolution of the pupillary data, the pupillary responses were deconvoluted and used in the analysis. The deconvolution analysis of pupillary responses confirmed that the responses to beep sound were more likely to be modulated by the emotional state rather than being influenced by the short presentation interval between the images and sounds. These findings suggested that pupil size index modulations in the compelling situation between emotional and cognitive processing.

Cortical plasticity elicited by acoustically cued monetary losses: an ERP study

Both human and animal studies have demonstrated remarkable findings of experience-induced plasticity in the cortex. Here, we investigated whether the widely used monetary incentive delay (MID) task changes the neural processing of incentive cues that code expected monetary outcomes. We used a novel auditory version of the MID task, where participants responded to acoustic cues that coded expected monetary losses. To investigate task-induced brain plasticity, we presented incentive cues as deviants during passive oddball tasks before and after two sessions of the MID task. During the oddball task, we recorded the mismatch-related negativity (MMN) as an index of cortical plasticity. We found that two sessions of the MID task evoked a significant enhancement of MMN for incentive cues that predicted large monetary losses, specifically when monetary cue discrimination was essential for maximising monetary outcomes. The task-induced plasticity correlated with the learning-related neural activity recorded during the MID task. Thus, our results confirm that the processing of (loss)incentive auditory cues is dynamically modulated by previously learned monetary outcomes.

Greater learning transfer effect for avoidance of loss than for achievement of gain in Finnish and Russian schoolchildren

Classification of behavior into principal categories of approach and avoidance is grounded in evolutionary considerations and multiple results of behavioral, self-report, and brain-activity analyses. Contrasted via measures of cognitive processes, avoidance is accompanied by greater cognitive engagement than approach. Considering outcome as a key constituent of behavioral underpinnings, we interpret approach/avoidance distinction in terms of structure of experience: avoidance domain provides more detailed interaction with the environment, than approach domain. Learning outwardly similar behaviors aimed at gain or loss outcomes manifests formation of different structures that underlie further learning. Therefore, we predicted difference of learning transfer between gain and loss contexts that was revealed here by introducing two tasks for different groups of schoolchildren in Finland and Russia. The cultural specificity of gain/loss differences was also evident with employed measures, including error rate and post-error slowing. The results support that avoidance-motivated behavior is organized as a more complex organism-environment interaction, than the approach-motivated behavior.

Event-related potentials during individual, cooperative, and competitive task performance differ in subjects with analytic vs. holistic thinking

It has been presented that Western cultures (USA, Western Europe) are mostly characterized by competitive forms of social interaction, whereas Eastern cultures (Japan, China, Russia) are mostly characterized by cooperative forms. It has also been stated that thinking in Eastern countries is predominantly holistic and in Western countries analytic. Based on this, we hypothesized that subjects with analytic vs. holistic thinking styles show differences in decision making in different types of social interaction conditions. We investigated behavioural and brain-activity differences between subjects with analytic and holistic thinking during a choice reaction time (ChRT) task, wherein the subjects either cooperated, competed (in pairs), or performed the task without interaction with other participants. Healthy Russian subjects (N=78) were divided into two groups based on having analytic or holistic thinking as determined with an established questionnaire. We measured reaction times as well as event-related brain potentials. There were significant differences between the interaction conditions in task performance between subjects with analytic and holistic thinking. Both behavioral performance and physiological measures exhibited higher variance in holistic than in analytic subjects. Differences in amplitude and P300 latency suggest that decision making was easier for the holistic subjects in the cooperation condition, in contrast to analytic subjects for whom decision making based on these measures seemed to be easier in the competition condition. The P300 amplitude was higher in the individual condition as compared with the collective conditions. Overall, our results support the notion that the brains of analytic and holistic subjects work differently in different types of social interaction conditions.

Mental Reactivation and Pleasantness Judgment of Experience Related to Vision, Hearing, Skin Sensations, Taste and Olfaction

Language acquisition is based on our knowledge about the world and forms through multiple sensory-motor interactions with the environment. We link the properties of individual experience formed at different stages of ontogeny with the phased development of sensory modalities and with the acquisition of words describing the appropriate forms of sensitivity. To test whether early-formed experience related to skin sensations, olfaction and taste differs from later-formed experience related to vision and hearing, we asked Russian-speaking participants to categorize or to assess the pleasantness of experience mentally reactivated by sense-related adjectives found in common dictionaries. It was found that categorizing adjectives in relation to vision, hearing and skin sensations took longer than categorizing adjectives in relation to olfaction and taste. In addition, experience described by adjectives predominantly related to vision, hearing and skin sensations took more time for the pleasantness judgment and generated less intense emotions than that described by adjectives predominantly related to olfaction and taste. Interestingly the dynamics of skin resistance corresponded to the intensity and pleasantness of reported emotions. We also found that sense-related experience described by early-acquired adjectives took less time for the pleasantness judgment and generated more intense and more positive emotions than that described by later-acquired adjectives. Correlations were found between the time of the pleasantness judgment of experience, intensity and pleasantness of reported emotions, age of acquisition, frequency, imageability and length of sense-related adjectives. All in all these findings support the hypothesis that early-formed experience is less differentiated than later-formed experience.

Use of auditory evoked potentials for intra-operative awareness in anesthesia: a consciousness-based conceptual model

Auditory evoked potentials (AEPs) have been used as a measure of the depth of anesthesia during the intra-operative process. AEPs are classically divided, on the basis of their latency, into first, fast, middle, slow, and late components. The use of auditory evoked potential has been advocated for the assessment of Intra-operative awareness (IOA), but has not been considered seriously enough to universalize it. It is because we have not explored enough the impact of auditory perception and auditory processing on the IOA phenomena as well as on the subsequent psychological impact of IOA on the patient. More importantly, we have seldom tried to look at the phenomena of IOP from the perspective of consciousness itself. This perspective is especially important because many of IOA phenomena exist in the subconscious domain than they do in the conscious domain of explicit recall. Two important forms of these subconscious manifestations of IOA are the implicit recall phenomena and post-operative dreams related to the operation. Here, we present an integrated auditory consciousness-based model of IOA. We start with a brief description of auditory awareness and the factors affecting it. Further, we proceed to the evaluation of conscious and subconscious information processing by auditory modality and how they interact during and after intra-operative period. Further, we show that both conscious and subconscious auditory processing affect the IOA experience and both have serious psychological implications on the patient subsequently. These effects could be prevented by using auditory evoked potential during monitoring of anesthesia, especially the mid-latency auditory evoked potentials (MLAERs). To conclude our model with present hypothesis, we propose that the use of auditory evoked potential should be universal with general anesthesia use in order to prevent the occurrences of distressing outcomes resulting from both conscious and subconscious auditory processing during anesthesia.

Paying attention to my voice or yours: An ERP study with words

Self-related stimuli-such as one's own face or name-seem to be processed differently from non-self stimuli and to involve greater attentional resources, as indexed by larger amplitude of the P3 event-related potential (ERP) component. Nonetheless, the differential processing of self-related vs. non-self information using voice stimuli is still poorly understood. The present study investigated the electrophysiological correlates of processing self-generated vs. non-self voice stimuli, when they are in the focus of attention. ERP data were recorded from twenty right-handed healthy males during an oddball task comprising pre-recorded self-generated (SGV) and non-self (NSV) voice stimuli. Both voices were used as standard and deviant stimuli in distinct experimental blocks. SGV was found to elicit more negative N2 and more positive P3 in comparison with NSV. No association was found between ERP data and voice acoustic properties. These findings demonstrated an earlier and later attentional bias to self-generated relative to non-self voice stimuli. They suggest that one's own voice representation may have a greater affective salience than an unfamiliar voice, confirming the modulatory role of salience on P3.

Neurophysiological and Neuropsychological Correlates of Subconscious Auditory Processing During Anesthesia and Their Implications in Anesthesia Awareness

Like any other unusual state of consciousness, the condition of anesthesia remains a mystery, especially regarding the information processing events of the brain. Evoked potentials are the only known way to understand the neurophysiological events of brain in this condition. Auditory evoked potentials (AEPs) have been used as a measure of the depth of anesthesia during the intra-operative process. AEPs have been classically divided, on the basis of their latency, into first, fast, middle, slow, and late components. Auditory evoked potential has been advocated for the assessment of intra-operative awareness (IOA) but has not been considered seriously enough to be universalized. It is because we have not explored enough the impact of auditory perception and auditory information processing on the IOA phenomena as well as on the subsequent psychological impact of IOA on the patient. This limitation is because we have poor understanding of the subconscious auditory processing itself. This perspective is especially important because more of the IOA phenomena exist in the subconscious domain than they do in the conscious domain of explicit recall. Two important forms of these subconscious manifestations of IOA are the implicit recall phenomena and post-operative dreams related to the operation. Here we present a review of the neurophysiological and neuropsychological correlates of auditory processing during anesthesia. We start with a brief description of auditory awareness and the factors affecting it. Further, we proceed to the evaluation of conscious and subconscious information processing by auditory modality and how they interact during and after intra-operative period. Further, we show that both conscious and subconscious auditory processing affect the IOA experience and both have serious psychological implications on the patient subsequently. These effects could be prevented using auditory evoked potential during monitoring of anesthesia, especially the midlatency auditory evoked potentials. To conclude, we propose that the use of Auditory evoked potential should be universal with general anesthesia use in order to prevent the occurrences of distressing outcomes resulting from both conscious and subconscious auditory processing during anesthesia.

Emotional valence and spatial congruency differentially modulate crossmodal processing: an fMRI study

Salient exogenous stimuli modulate attentional processes and lead to attention shifts-even across modalities and at a pre-attentive level. Stimulus properties such as hemispheric laterality and emotional valence influence processing, but their specific interaction in audio-visual attention paradigms remains ambiguous. We conducted an fMRI experiment to investigate the interaction of supramodal spatial congruency, emotional salience, and stimulus presentation side on neural processes of attention modulation. Emotionally neutral auditory deviants were presented in a dichotic listening oddball design. Simultaneously, visual target stimuli (schematic faces) were presented, which displayed either a negative or a positive emotion. These targets were presented in the left or in the right visual field and were either spatially congruent (valid) or incongruent (invalid) with the concurrent deviant auditory stimuli. According to our expectation we observed that deviant stimuli serve as attention-directing cues for visual target stimuli. Region-of-interest (ROI) analyses suggested differential effects of stimulus valence and spatial presentation on the hemodynamic response in bilateral auditory cortices. These results underline the importance of valence and presentation side for attention guidance by deviant sound events and may hint at a hemispheric specialization for valence and attention processing.

Emotional processing modulates attentional capture of irrelevant sound input in adolescents

The main goal of this study was to investigate how emotional processing modulates the allocation of attention to irrelevant background sound events in adolescence. We examined the effect of viewing positively and negatively valenced video clips on components of event-related brain potentials (ERPs), while irrelevant sounds were presented to the ears. All sounds evoked the P1, N1, P2, and N2 components. The infrequent, randomly occurring novel environmental sounds evoked the P3a component in all trial types. The main finding was that the P3a component was larger in amplitude when evoked by salient, distracting background sound events when participants were watching negatively charged video clips, compared to when viewing of the positive or neutral video clips. The results suggest that the threshold for involuntary attention to the novel sounds was lowered during viewing of the negative movie contexts. This indicates a survival mechanism, which would be needed for more automatic processing of irrelevant sounds to monitor the unattended environment in situations perceived as more threatening.

Mood modulates auditory laterality of hemodynamic mismatch responses during dichotic listening

Hemodynamic mismatch responses can be elicited by deviant stimuli in a sequence of standard stimuli even during cognitive demanding tasks. Emotional context is known to modulate lateralized processing. Right-hemispheric negative emotion processing may bias attention to the right and enhance processing of right-ear stimuli. The present study examined the influence of induced mood on lateralized pre-attentive auditory processing of dichotic stimuli using functional magnetic resonance imaging (fMRI). Faces expressing emotions (sad/happy/neutral) were presented in a blocked design while a dichotic oddball sequence with consonant-vowel (CV) syllables in an event-related design was simultaneously administered. Twenty healthy participants were instructed to feel the emotion perceived on the images and to ignore the syllables. Deviant sounds reliably activated bilateral auditory cortices and confirmed attention effects by modulation of visual activity. Sad mood induction activated visual, limbic and right prefrontal areas. A lateralization effect of emotion-attention interaction was reflected in a stronger response to right-ear deviants in the right auditory cortex during sad mood. This imbalance of resources may be a neurophysiological correlate of laterality in sad mood and depression. Conceivably, the compensatory right-hemispheric enhancement of resources elicits increased ipsilateral processing.

Phase re-setting of gamma neural oscillations during novelty processing in an appetitive context

Based on the previous study where phase-synchronization (PS) of gamma-band responses (GBRs) proved a reliable cerebral correlate of involuntary attention and its enhancement under threat, we measured gamma-PS elicited by novel sounds from human electroencephalogram (EEG) scalp-recordings when participants responded to visual stimuli displaying either highly motivational or neutral sceneries. We then tested the modulatory effect of the emotional conditions on auditory responses. Novel distractor sounds did not affect behavioural accuracy on subjects' visual task performance in neutral context but markedly decreased hit rate in the appetitive one. Similarly, gamma-PS to novel sounds remained intact in neutral context, whereas it showed an increase, within the 35-Hz sub-range, in the appetitive context. These results suggest that a context of processing positive emotional stimuli results into an enhanced processing of task-irrelevant novel auditory events, and, furthermore, that gamma-PS is tuned under conditions that could promote long-term survival.

Emotion modulates early auditory response to speech

In order to understand how emotional state influences the listener's physiological response to speech, subjects looked at emotion-evoking pictures while 32-channel EEG evoked responses (ERPs) to an unchanging auditory stimulus ("danny") were collected. The pictures were selected from the International Affective Picture System database. They were rated by participants and differed in valence (positive, negative, neutral), but not in dominance and arousal. Effects of viewing negative emotion pictures were seen as early as 20 msec (p = .006). An analysis of the global field power highlighted a time period of interest (30.4-129.0 msec) where the effects of emotion are likely to be the most robust. At the cortical level, the responses differed significantly depending on the valence ratings the subjects provided for the visual stimuli, which divided them into the high valence intensity group and the low valence intensity group. The high valence intensity group exhibited a clear divergent bivalent effect of emotion (ERPs at Cz during viewing neutral pictures subtracted from ERPs during viewing positive or negative pictures) in the time period of interest (r(Phi) = .534, p < .01). Moreover, group differences emerged in the pattern of global activation during this time period. Although both groups demonstrated a significant effect of emotion (ANOVA, p = .004 and .006, low valence intensity and high valence intensity, respectively), the high valence intensity group exhibited a much larger effect. Whereas the low valence intensity group exhibited its smaller effect predominantly in frontal areas, the larger effect in the high valence intensity group was found globally, especially in the left temporal areas, with the largest divergent bivalent effects (ANOVA, p < .00001) in high valence intensity subjects around the midline. Thus, divergent bivalent effects were observed between 30 and 130 msec, and were dependent on the subject's subjective state, whereas the effects at 20 msec were evident only for negative emotion, independent of the subject's behavioral responses. Taken together, it appears that emotion can affect auditory function early in the sensory processing stream.

The impact of stimulus type and early motherhood on attentional processing

The present study evaluated the impact of stimulus type and early motherhood on attentional processing. Auditory ERPs were recorded with a modified novelty oddball paradigm both in mothers who had recently given birth and in control women who were not in the state of early motherhood. Conventional tone pips were used as standards and deviants, and an infant cry served as an experimental stimulus of novelty value. Differences were revealed in the N100 amplitudes between the study groups with higher amplitudes in the mothers. A few days after childbirth the mothers seemed to be in a stage with an increased level of alertness and different types of surrounding stimuli may elicit a stronger arousal response than normally, not just those directly related to the new baby. The gating and the mechanisms of further processing of stimulus information were not different in mothers from controls and seemed to guarantee normal control of stimulus-elicited cognitive load in early motherhood.