Enhanced processing of facial emotion for target stimuli

Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography

Brain-computer interface (BCI) offers a novel means of communication and control for individuals with disabilities and can also enhance the interactions between humans and machines for the broader population. This paper explores the brain neural signatures of unmanned aerial vehicle (UAV) operators in emergencies and develops an operator's electroencephalography (EEG) signals-based detection method for UAV emergencies. We found regularity characteristics similar to classic event-related potential (ERP) components like visual mismatch negativity (vMMN) and contingent negative variation (CNV). Source analysis revealed a sequential activation of the occipital, temporal, and frontal lobes following the onset of emergencies, corresponding to the processing of attention, emotion, and motor intention triggered by visual stimuli. Furthermore, an online detection system was implemented and tested. Experimental results showed that the system achieved an average accuracy of over 88% in detecting emergencies with a detection latency of 431.95 ms from the emergency onset. This work lays a foundation for understanding the brain activities of operators in emergencies and developing an EEG-based detection method for emergencies to assist UAV operations.

Facial feedback manipulation influences the automatic detection of unexpected emotional body expressions

Unexpected or changing facial expressions are known to be able to engage more automatic processing than frequently occurring facial expressions, thereby inducing a neural differential wave response known as expression mismatch negativity (EMMN). Recent studies have shown that EMMN can be modulated by the observer's facial feedback (i.e., feedback from their own facial movements). A similar EMMN activity has been discovered for body expressions, but thus far only a few emotion types have been investigated. It is unknown whether the EMMNs evoked by body expressions can be influenced by facial feedback. To explore this question, we recorded EEG activity of 29 participants in the reverse oddball paradigm. Here two unexamined categories of body expressions were presented, happy and sad, placed in two paired stimulus sequences: in one the happy body was presented with a probability of 80% (standards) while the sad body was presented with a probability of 20% (deviants), and in the other the probabilities were reversed. The facial feedback was manipulated by different pen holding conditions (i.e., participants holding the pen with the teeth, lips, or nondominant hand). The nonparametric cluster permutation test revealed significant happy and sad body-related EMMN (bEMMN) activities. The happy-bEMMN were more negative than sad-bEMMN within the range of 100-150 ms. Additionally, the bEMMN amplitude of both emotions is modulated by the facial feedback conditions. These results expand the range of emotional types applicable to bEMMN and provide evidence for the validity of the facial feedback hypothesis across emotional carriers.

The effect of sad mood on early sensory event-related potentials to task-irrelevant faces

It has been shown that the perceiver's mood affects the perception of emotional faces, but it is not known how mood affects preattentive brain responses to emotional facial expressions. To examine the question, we experimentally induced sad and neutral mood in healthy adults before presenting them with task-irrelevant pictures of faces while an electroencephalography was recorded. Sad, happy, and neutral faces were presented to the participants in an ignore oddball condition. Differential responses (emotional - neutral) for the P1, N170, and P2 amplitudes were extracted and compared between neutral and sad mood conditions. Emotional facial expressions modulated all the components, and an interaction effect of expression by mood was found for P1: an emotional modulation to happy faces, which was found in neutral mood condition, disappeared in sad mood condition. For N170 and P2, we found larger response amplitudes for both emotional faces, regardless of the mood. The results add to the previous behavioral findings showing that mood already affects low-level cortical feature encoding of task-irrelevant faces.

Links between social avoidance and frontal alpha asymmetry during processing emotional facial stimuli: An exploratory study

Individuals who are socially avoidant actively remove themselves from opportunities for social interaction and have a strong desire for solitude. Although social avoidance is associated with a host of adjustment difficulties, its neural substrates remain under-explored. To address this gap, we conducted an exploratory study to compare electroencephalography (EEG) frontal alpha asymmetry (FAA) scores during processing emotional facial stimuli in socially avoidant and non-withdrawn comparison individuals. From an original sample of N = 384 undergraduate students, 25 avoidant and 27 comparison individuals were identified. For this subset of participants, EEG modulations and self-reported experience ratings during a picture processing task were assessed. Among the results, the socially avoidant group's ratings of positive stimuli were significantly lower than the non-withdrawn comparison group. The socially avoidant group also had significantly lower FAA scores in response to positive stimuli than the comparison group. Further, asymmetry scores of the comparison group in the positive conditions were higher than in the negative and neutral conditions. However, there were no significant differences between these three conditions in the socially avoidant group. Our results suggest that socially avoidant individuals may eschew interpersonal relationships because of a relatively greater right hemisphere cortical activity, which may contribute to a withdrawal motivation when confronted with negative emotional stimuli in social contexts.

Visual Mismatch Negativity Reflects Enhanced Response to the Deviant: Evidence From Event-Related Potentials and Electroencephalogram Time-Frequency Analysis

Automatic detection of information changes in the visual environment is crucial for individual survival. Researchers use the oddball paradigm to study the brain’s response to frequently presented (standard) stimuli and occasionally presented (deviant) stimuli. The component that can be observed in the difference wave is called visual mismatch negativity (vMMN), which is obtained by subtracting event-related potentials (ERPs) evoked by the deviant from ERPs evoked by the standard. There are three hypotheses to explain the vMMN. The sensory fatigue (or refractoriness) hypothesis considers that weakened neural activity caused by repetition results in decreased ERPs of the standard. The memory trace hypothesis proposes that vMMN results from increased responses to the deviant. The predictive coding hypothesis attributes the difference to enhanced responses for deviants and suppression for standards. However, when distinguishing between these effects, previous researchers did not consider the effect of low-level features on the vMMN. In this experiment, we used face sequences composed of different emotions (e.g., neutral and fearful face) and presented an oddball sequence, a reverse oddball sequence, and an equiprobable sequence to participants. The deviant of the oddball sequence was subtracted from the standard of the oddball sequence, the reverse oddball sequence, and the same type of stimulus of the equiprobable sequence to get oddball-vMMN (vMMN1), reverse oddball-vMMN (vMMN2), and equiprobable-vMMN (vMMN3), respectively. The results showed no significant difference between vMMN2 and vMMN3 in 100–350 ms following stimulus onset, while the vMMN effect was significant, indicating that the probability of the standard did not affect vMMN, which supported the memory trace hypothesis. Additionally, the fearful-related vMMN were more negative than the neutral-related vMMN within the range of 100–150 ms, suggesting a negative bias. We analyzed the source location of different vMMNs. There was no significant difference in brain regions between different vMMNs. Time-frequency analysis showed that the deviant had stronger theta-band oscillatory than the standard (visual mismatch oscillatory responses, vMORs). However, there was no difference between vMORs2 and vMORs3, indicating that vMORs reflect an enhanced response to the deviant in terms of neural oscillation, supporting the memory trace hypothesis.

Emotional visual mismatch negativity: a joint investigation of social and non-social dimensions in adults with autism

Unusual behaviors and brain activity to socio-emotional stimuli have been reported in Autism Spectrum Disorder (ASD). Atypical reactivity to change and intolerance of uncertainty are also present, but little is known on their possible impact on facial expression processing in autism. The visual mismatch negativity (vMMN) is an electrophysiological response automatically elicited by changing events such as deviant emotional faces presented among regular neutral faces. While vMMN has been found altered in ASD in response to low-level changes in simple stimuli, no study has investigated this response to visual social stimuli. Here two deviant expressions were presented, neutral and angry, embedded in a sequence of repetitive neutral stimuli. vMMN peak analyses were performed for latency and amplitude in early and late time windows. The ASD group presented smaller amplitude of the late vMMN to both neutral and emotional deviants compared to the typically developed adults (TD) group, and only the TD group presented a sustained activity related to emotional change (i.e., angry deviant). Source reconstruction of the vMMNs further revealed that any change processing elicited a reduced activity in ASD group compared to TD in the saliency network, while the specific processing emotional change elicited activity in the temporal region and in the insula. This study confirms atypical change processing in ASD and points to a specific difficulty in the processing of emotional changes, potentially playing a crucial role in social interaction deficits. Nevertheless, these results require to be further replicated with a greater sample size and generalized to other emotional expressions.

Subliminal affective priming effect: Dissociated processes for intense versus normal facial expressions

Positive vs. negative intense-facial expressions are difficult to explicitly distinguish; yet, whether they dissociate when subliminally presented remains unclear. Through three experiments using affective priming paradigms, we assessed how intense facial expressions, when presented briefly (17 ms) and masked, influenced following neutral ambiguous words (Experiment 1) or visible facial expressions (Experiments 2&3). We also compared these results with those of using normal facial expressions as primes in each experiment. All experiments indicated masked affective priming effects (biasing valence judgement of neutral words or facilitating reaction time to faces with the same valence as the prime) in normal facial expression, but not those intense ones. Experiment 3 using event related potentials (ERPs) further revealed that two ERP components N250 and LPP were consistent with behavioral changes in the normal condition (larger when valences of primes and targets were different), but inconsistent in the intense condition. Taken together, our results provided behavioral and neural evidence for distinctive processing between normal and intense facial expressions under masked condition.

The reduced auditory evoked potential component N1 after repeated stimulation: Refractoriness hypothesis vs. habituation account

Similar to other event-related potential (ERP) components, the amplitude of the auditory evoked N1 depends on the interstimulus interval (ISI). At ISIs > 0.4 s, the amplitude of the N1 increases with longer ISIs, until it saturates at ISIs around 10 s. This amplitude increase with increasing ISI has been conceptualized as a function of N1 recovery or N1 refractoriness. Habituation (as a simple form of learning) represents an elaborated, opposing account for such stimulus repetition effects. For passive oddball experiments (stimulation protocols with frequent standards and rare deviants), the two accounts make different predictions. According to the habituation account, the presentation of small deviants should lead to an increased N1 for subsequent standards (= dishabituation); according to the N1 refractoriness account, there should be no or just minor effects on the N1. In the current study, we tested these predictions and compared the ERPs to standards after small deviants and to standards preceded by other standards. We observed that the ERPs to standards after small deviants were characterized by a small mismatch negativity with an onset latency > 150 ms, but the N1 to standards after deviants did not differ from the N1 to standards preceded by other standards. This negative finding is in line with other previous studies that were also not able to reveal evidence for N1 dishabituation. Aside from this repeated lack of evidence for dishabituation, the N1 habituation account is challenged by the finding that the N1 decrease is stronger for more intense stimuli. Overall, the current and previous findings are more compatible with the N1 refractoriness account, although the mechanisms underlying N1 refractoriness remain to be elucidated. Knowledge about these mechanisms would also help to understand why N1 deficits in schizophrenia are more pronounced at longer ISIs.