Does emotion change auditory prediction and deviance detection?

Lower Childhood Socioeconomic Status Is Associated with Greater Neural Responses to Ambient Auditory Changes in Adulthood

Humans' early life experience varies by socioeconomic status (SES), raising the question of how this difference is reflected in the adult brain. An important aspect of brain function is the ability to detect salient ambient changes while focusing on a task. Here, we ask whether subjective social status during childhood is reflected by the way young adults' brain detecting changes in irrelevant information. In two studies (total n = 58), we examine electrical brain responses in the frontocentral region to a series of auditory tones, consisting of standard stimuli (80%) and deviant stimuli (20%) interspersed randomly, while participants were engaged in various visual tasks. Both studies showed stronger automatic change detection indexed by MMN in lower SES individuals, regardless of the unattended sound's feature, attended emotional content, or study type. Moreover, we observed a larger MMN in lower-SES participants, although they did not show differences in brain and behavior responses to the attended task. Lower-SES people also did not involuntarily orient more attention to sound changes (i.e., deviant stimuli), as indexed by the P3a. The study indicates that individuals with lower subjective social status may have an increased ability to automatically detect changes in their environment, which may suggest their adaptation to their childhood environments.

The effect of sad mood on early sensory event-related potentials to task-irrelevant faces

It has been shown that the perceiver's mood affects the perception of emotional faces, but it is not known how mood affects preattentive brain responses to emotional facial expressions. To examine the question, we experimentally induced sad and neutral mood in healthy adults before presenting them with task-irrelevant pictures of faces while an electroencephalography was recorded. Sad, happy, and neutral faces were presented to the participants in an ignore oddball condition. Differential responses (emotional - neutral) for the P1, N170, and P2 amplitudes were extracted and compared between neutral and sad mood conditions. Emotional facial expressions modulated all the components, and an interaction effect of expression by mood was found for P1: an emotional modulation to happy faces, which was found in neutral mood condition, disappeared in sad mood condition. For N170 and P2, we found larger response amplitudes for both emotional faces, regardless of the mood. The results add to the previous behavioral findings showing that mood already affects low-level cortical feature encoding of task-irrelevant faces.

From communication dysfunction to treatment options in serious mental illness

The Commentary covers research focused on language dysfunction in schizophrenia, and more broadly in communication dysfunction in this disorder, which I have examined with a variety of both behavioral and imaging methodologies. It briefly outlines how further progress can be achieved in pursuing the goal of a comprehensive understanding of its underlying causes. Possible therapeutic approaches are also briefly discussed.

Linking Affective and Hearing Sciences-Affective Audiology

A growing number of health-related sciences, including audiology, have increasingly recognized the importance of affective phenomena. However, in audiology, affective phenomena are mostly studied as a consequence of hearing status. This review first addresses anatomical and functional bidirectional connections between auditory and affective systems that support a reciprocal affect-hearing relationship. We then postulate, by focusing on four practical examples (hearing public campaigns, hearing intervention uptake, thorough hearing evaluation, and tinnitus), that some important challenges in audiology are likely affect-related and that potential solutions could be developed by inspiration from affective science advances. We continue by introducing useful resources from affective science that could help audiology professionals learn about the wide range of affective constructs and integrate them into hearing research and clinical practice in structured and applicable ways. Six important considerations for good quality affective audiology research are summarized. We conclude that it is worthwhile and feasible to explore the explanatory power of emotions, feelings, motivations, attitudes, moods, and other affective processes in depth when trying to understand and predict how people with hearing difficulties perceive, react, and adapt to their environment.

Neurocognitive Dynamics of Prosodic Salience over Semantics during Explicit and Implicit Processing of Basic Emotions in Spoken Words

How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 women) were presented with spoken words denoting happiness, sadness and neutrality in either the prosodic or semantic channel. They were asked to judge the emotional content (explicit task) and speakers' gender (implicit task) of the stimuli. Results indicated that emotional prosody (relative to semantics) triggered larger N100, P200 and N400 amplitudes with greater delta, theta and alpha inter-trial phase coherence (ITPC) and event-related spectral perturbation (ERSP) values in the corresponding early time windows, and continued to produce larger LPC amplitudes and faster responses during late stages of higher-order cognitive processing. The relative salience of prosodic and semantics was modulated by emotion and task, though such modulatory effects varied across different processing stages. The prosodic salience effect was reduced for sadness processing and in the implicit task during early auditory processing and decision-making but reduced for happiness processing in the explicit task during conscious emotion processing. Additionally, across-trial synchronization of delta, theta and alpha bands predicted the ERP components with higher ITPC and ERSP values significantly associated with stronger N100, P200, N400 and LPC enhancement. These findings reveal the neurocognitive dynamics of emotional speech processing with prosodic salience tied to stage-dependent emotion- and task-specific effects, which can reveal insights into understanding language and emotion processing from cross-linguistic/cultural and clinical perspectives.

Visually Perceived Negative Emotion Enhances Mismatch Negativity but Fails to Compensate for Age-Related Impairments

Objective: Automatic detection of auditory stimuli, represented by the mismatch negativity (MMN), facilitates rapid processing of salient stimuli in the environment. The amplitude of MMN declines with ageing. However, whether automatic detection of auditory stimuli is affected by visually perceived negative emotions with normal ageing remains unclear. We aimed to evaluate how fearful facial expressions affect the MMN amplitude under ageing.

Methods: We used a modified oddball paradigm to analyze the amplitude of N100 (N1) and MMN in 22 young adults and 21 middle-aged adults.

Results: We found that the amplitude of N1 elicited by standard tones was smaller under fearful facial expressions than neutral facial expressions and was more negative for young adults than middle-aged adults. The MMN amplitude under fearful facial expressions was greater than neutral facial expressions, but the amplitude in middle-aged adults was smaller than in young adults.

Conclusion: Visually perceived negative emotion promotes the extraction of auditory features. Additionally, it enhances the effect of auditory change detection in middle-aged adults but fails to compensate for this decline with normal ageing.

Significance: The study may help to understand how visually perceived emotion affects the early stage of auditory information processing from an event process perspective.

Pupillary response reflects attentional modulation to sound after emotional arousal

There have been various studies on the effects of emotional visual processing on subsequent non-emotional auditory stimuli. A previous study with EEG has shown that responses to deviant sounds presented after presenting negative pictures collected more attentional resources than those for neutral pictures. To investigate such a compelling between emotional and cognitive processing, this study aimed to examined pupillary responses to an auditory stimulus after a positive, negative, or neutral emotional state was elicited by an emotional image. An emotional image was followed by a beep sound that was either repetitive or unexpected, and the pupillary dilation was measured. As a result, we found that the early component of the pupillary response to the beep sound was larger for negative and positive emotional states than the neutral emotional state, whereas the late component was larger for the positive emotional state than the negative and neutral emotional states. In addition, the peak latency of the pupillary response was earlier for negative than neutral or positive images. Further, to compensate for the disadvantage of low-temporal resolution of the pupillary data, the pupillary responses were deconvoluted and used in the analysis. The deconvolution analysis of pupillary responses confirmed that the responses to beep sound were more likely to be modulated by the emotional state rather than being influenced by the short presentation interval between the images and sounds. These findings suggested that pupil size index modulations in the compelling situation between emotional and cognitive processing.

Voluntary control of auditory hallucinations: phenomenology to therapeutic implications

Auditory verbal hallucinations (AVH) have traditionally been thought to be outside the influence of conscious control. However, recent work with voice hearers makes clear that both treatment-seeking and non-treatment-seeking voice hearers may exert varying degrees of control over their voices. Evidence suggests that this ability may be a key factor in determining health status, but little systematic examination of control in AVH has been carried out. This review provides an overview of the research examining control over AVH in both treatment-seeking and non-treatment-seeking populations. We first examine the relationship between control over AVH and health status as well as the psychosocial factors that may influence control and functioning. We then link control to various cognitive constructs that appear to be important for voice hearing. Finally, we reconcile the possibility of control with the field’s current understanding of the proposed cognitive, computational, and neural underpinnings of hallucinations and perception more broadly. Established relationships between control, health status, and functioning suggest that the development of control over AVH could increase functioning and reduce distress. A more detailed understanding of the discrete types of control, their development, and their neural underpinnings is essential for translating this knowledge into new therapeutic approaches.

Is internal source memory recognition modulated by emotional encoding contexts?

The influence of emotion on memory has been mainly examined by manipulating the emotional valence and/or arousal of critical items. Few studies probed how emotional information presented during the encoding of critical neutral items modulates memory recognition, particularly when considering source memory features. In this study, we specified the role of emotional encoding contexts in internal source memory performance (discrimination between encoding tasks) using a mixed (Experiment 1) and a blocked design (Experiment 2). During the study phase, participants were required to evaluate a set of neutral words, using either a self-referential or a semantic (common judgment) encoding strategy. Prior and concomitantly with each word, negative, neutral or positive pictures were presented in the background. The beneficial effect of self-referential encoding was observed for both item and internal source memory in both experiments. Remarkably, item and internal source memory recognition was not modulated by emotion, even though a secondary analysis indicated that the consistent exposure to negative (vs. positive) information led to worse source memory performance. These findings suggest that internal source memory of neutral items is not always affected by changing or repetitive emotional encoding contexts.

Happy you, happy me: expressive changes on a stranger's voice recruit faster implicit processes than self-produced expressions

In social interactions, people have to pay attention both to the ‘what’ and ‘who’. In particular, expressive changes heard on speech signals have to be integrated with speaker identity, differentiating e.g. self- and other-produced signals. While previous research has shown that self-related visual information processing is facilitated compared to non-self stimuli, evidence in the auditory modality remains mixed. Here, we compared electroencephalography (EEG) responses to expressive changes in sequence of self- or other-produced speech sounds using a mismatch negativity (MMN) passive oddball paradigm. Critically, to control for speaker differences, we used programmable acoustic transformations to create voice deviants that differed from standards in exactly the same manner, making EEG responses to such deviations comparable between sequences. Our results indicate that expressive changes on a stranger’s voice are highly prioritized in auditory processing compared to identical changes on the self-voice. Other-voice deviants generate earlier MMN onset responses and involve stronger cortical activations in a left motor and somatosensory network suggestive of an increased recruitment of resources for less internally predictable, and therefore perhaps more socially relevant, signals.

Evidence of P3a During Sleep, a Process Associated With Intrusions Into Consciousness in the Waking State

The present study examines processes associated with intrusions into consciousness during an unconscious state, natural sleep. The definition of sleep is still much debated. Almost all researchers agree that sleep onset represents a gradual loss of consciousness of the external environment. For sleep to be beneficial, it needs to remain as undisturbed as possible. Nevertheless, unlike other unconsciousness states, sleep is reversible. For purposes of survival, it is critical that the sleeper be able to “detect” and perhaps become conscious of highly relevant biological or personal information. Therefore, even in sleep, the brain must decide whether a new incoming stimulus is relevant and if so, may require an arousal to wakefulness, or whether it is irrelevant and can be gated to prevent disruption of sleep. Event-related potentials (ERPs) were used to measure the extent processing of auditory stimuli some of which elicited an ERP component, the P3a, in the waking state. The P3a is associated with processes resulting in the interruption of frontal central executive, leading to conscious awareness. Very little research has focused on the occurrence of the P3a during sleep. A multi-feature paradigm was used to examine the processing of a frequently occurring “standard” stimulus and six rarely occurring different “deviant” stimuli during wakefulness, NREM, and REM sleep. A P3a was elicited by novel environmental sounds and white noise bursts in the waking state, replicating previous studies. Other deviant stimuli (changes in pitch, intensity, duration) failed to do so. The ERPs indicated that processing of the stimuli that did not elicit a P3a in wakefulness were much inhibited during both NREM and REM sleep. Surprisingly, those deviants that did elicit a P3a in wakefulness continued to do so in stage N2 and REM sleep. The subject did not, however, awaken. These results suggest processes leading to consciousness in wakefulness may still remain active during sleep possibly allowing subjects to act on potentially highly relevant input. This may also explain how sleep can be reversed if the stimulus input is sufficiently critical.

Neurophysiological differentiation between preattentive and attentive processing of emotional expressions on French vowels

The present electrophysiological study investigated the processing of emotional prosody by minimizing as much as possible the effect of emotional information conveyed by the lexical-semantic context. Emotionally colored French vowels (i.e., happiness, sadness, fear, and neutral) were presented in a mismatch negativity (MMN) oddball paradigm. Both the MMN, i.e., an event-related potential (ERP) component thought to reflect preattentive change detection, and the P3a, i.e., an ERP marker of involuntary orientation of attention toward deviant stimuli, were significantly modulated by the emotional deviants compared to the neutral ones. Critically, the largest amplitude (MMN, P3a) and the shortest peak latency (MMN) were observed for fear deviants, all other things being equal. Taken together, the present findings lend support to a sequential neurocognitive model of emotion processing (Scherer, 2001) which postulates, among other checks, a first stage of automatic emotion detection (MMN) followed by a second stage of subjective evaluation of the stimulus or event (P3a). Consistently with previous studies, our data suggest that among the six universal emotions, fear could have a special status probably because of its adaptive role in the evolution of the human species.