Emotions in word and face processing: Early and late cortical responses

Emotional text messages affect the early processing of emoticons depending on their emotional congruence: evidence from the N170 and EPN event related potentials

Emoticons have been considered pragmatic cues that enhance emotional expressivity during computer-mediated communication. Yet, it is unclear how emoticons are processed in ambiguous text-based communication due to incongruences between the emoticon's emotional valence and its context. In this study, we investigated the electrophysiological correlates of contextual influence on the early emotional processing of emoticons, during an emotional congruence judgment task. Participants were instructed to judge the congruence between a text message expressing an emotional situation (positive or negative), and a subsequent emoticon expressing positive or negative emotions. We analyzed early event-related potentials elicited by emoticons related to face processing (N170) and emotional salience in visual perception processing (Early Posterior Negativity, EPN). Our results show that accuracy and Reaction Times depend on the interaction between the emotional valence of the context and the emoticon. Negative emoticons elicited a larger N170, suggesting that the emotional information of the emoticon is integrated at the early stages of the perceptual process. During emoticon processing, a valence effect was observed with enhanced EPN amplitudes in occipital areas for emoticons representing negative valences. Moreover, we observed a congruence effect in parieto-temporal sites within the same time-window, with larger amplitudes for the congruent condition. We conclude that, similar to face processing, emoticons are processed differently according to their emotional content and the context in which they are embedded. A congruent context might enhance the emotional salience of the emoticon (and therefore, its emotional expression) during the early stages of their processing.

Relevance of pre-stimulus oscillatory activity for the perceived valence of emotional facial expressions

The interpretation of emotional facial expressions is crucial in everyday social interactions, and rapid processing of these expressions is necessary. Although extensive research has shed light on the mechanisms involved in facial expression processing, there is limited research on the potential role of the state of neural activity that directly precedes the occurrence of a face. Here, we investigated the potential modulatory role of pre-stimulus oscillatory activity in emotional facial expression processing. We tested emotional facial processing in two experiments, one utilizing artificial and the other natural facial expressions. The participants had to evaluate the emotional valence of the presented ambiguous facial expressions. In a univariate analysis, differences in the oscillation activity of the later rated valence of the faces were observed in both experiments, and these differences were observed even before the presentation of the facial expressions. Importantly, two different multivariate approaches directly supported the relevance of pre-stimulus oscillatory activity by exclusively using pre-stimulus oscillatory data to predict the perceived valence of the latter rated facial expression across the two experiments within as well as across subjects. The behavioral data shows the often observed negativity bias, i.e. ambiguous faces resulted in the tendency to rate them as negative. This negativity bias was related to neural activity modulations in the pre-stimulus period and also within post-stimulus processing related activity. These findings underscore the significance of pre-stimulus oscillatory activity in facial expression processing, indicating a functional role of ongoing neural states that affects the processing of facial expressions and constitute a basis for the well described negativity bias.

Processing of emotional connotations in Chinese monomorphic and compound words reflected by the early posterior negativity

Writing stands as one of humanity's most profound inventions, facilitating the efficient sharing and transmission of vast amounts of information. Similar to images and facial expressions, visual (written) words possess the ability to evoke emotional connotations. Understanding how the brain perceives these emotional nuances encoded in highly symbolic visual words is a key focus of the emerging field of "affective neurolinguistics." At the core of this inquiry lies the examination of the early posterior negativity (EPN), an event-related potentials (ERPs) component peaking around 300 ms after stimulus onset in the occipitotemporal scalp region. EPN has consistently emerged in response to emotional stimuli, encompassing pictures, faces, and visual words. However, prior research has notably lacked observation of EPN in response to Chinese emotional words, raising questions about potential differences in emotional processing between Chinese and other languages. Given the logographic nature of the Chinese writing system and the prevalence of compound words in the Chinese lexicon, this study aims to explore whether the emotional processing of Chinese monomorphic and compound words elicits an EPN response. Two experiments were conducted: Experiment 1 utilized one-character words (monomorphic words), while Experiment 2 employed two-character words (compound words). Participants were assigned a go/no-go task, instructed to respond to unknown words (word recognition task) or blue stimuli (color decision task). Data analysis using a data-driven mass univariate approach revealed significant ERP differences between emotional and neutral words. Notably, the time course, scalp topography, and cortical generators of the difference ERP presented a characteristic EPN response in both experiments. These findings strongly support the notion that the processing of emotional connotations in both Chinese monomorphic and compound words is reflected by the EPN, paving the way for future research using EPN as an emotion-related ERP component for investigating emotional processing of Chinese words.

Co-learning companionship benefits word learning in a new language: Evidence from a dual-brain EEG examination

Companionship refers to one's being in the presence of another individual. For adults, acquiring a new language is a highly social activity that often involves learning in the context of companionship. However, the effects of companionship on new language learning have gone relatively underexplored, particularly with respect to word learning. Using a within-subject design, the current study employs electroencephalography to examine how two types of companionship (monitored and co-learning) affect word learning (semantic and lexical) in a new language. Dyads of Chinese speakers of English as a second language participated in a pseudo-word-learning task during which they were placed in monitored and co-learning companionship contexts. The results showed that exposure to co-learning companionship affected the early attention stage of word learning. Moreover, in this early stage, evidence of a higher representation similarity between co-learners showed additional support that co-learning companionship influenced attention. Observed increases in delta and theta interbrain synchronization further revealed that co-learning companionship facilitated semantic access. In all, the similar neural representations and interbrain synchronization between co-learners suggest that co-learning companionship offers important benefits for learning words in a new language.

The impact of facial attractiveness and alleged personality traits on fairness decisions in the ultimatum game: Evidence from ERPs

In the mind of the beholder the personality and facial attractiveness of others are interrelated. However, how these specific properties are processed in the neurocognitive system and interact with each other while economic decisions are made is not well understood. Here, we combined the ultimatum game with EEG technology, to investigate how alleged personality traits and the perceived facial attractiveness of proposers of fair and unfair offers influence their acceptance by the responders. As expected, acceptance rate was higher for fair than unfair allocations. Overall, responders were more likely to accept proposals from individuals with higher facial attractiveness and with more positive personality traits. In ERPs, words denoting negative personality traits elicited larger P2 components than positive trait words, and more attractive faces elicited larger LPC amplitudes. Replicating previous findings, FRN amplitudes were larger to unfair than to fair allocations. This effect was diminished if the proposer's faces were attractive or associated with positive personality traits. Hence, facial attractiveness and the valence of personality traits seem to be evaluated independently and at different time points. Subsequent decision making about unfair offers is similarly influenced by high attractiveness and positive personality of the proposer, diminishing the negative response normally elicited by "unfair" proposals, possibly due a "reward" effect. In the ERPs to the proposals the effect of positive personality and attractiveness were seen in the FRN and P300 components but for positive personality traits the effect even preceded the FRN effect. Altogether, the present results indicate that both high facial attractiveness and alleged positive personality mitigate the effects of unfair proposals, with temporally overlapping but independent neurocognitive correlates.

Mathematical problem solving is modulated by word priming

This study aimed to explore the influence of word priming on mathematical problem solving. In two experiments, participants were required to finish multiplication estimation tasks with a specified estimation strategy under different word priming conditions (Experiment 1: concrete words vs. Experiment 2: abstract words). The results showed that: (1) under the concrete word priming condition, in comparison to neutral, positive word priming improved accuracies (ACCs) when using a down-up strategy (e.g., doing 40 × 80 = 3200 for 43 × 78), while both positive and negative word priming reduced reaction time (RT); (2) under the abstract word priming condition, both positive and negative (vs. neutral) abstract word priming reduced RTs, while individuals' ACCs of completing the estimation task were not influenced by valence. The present study showed that whether concrete words or abstract words were adopted as experimental stimuli, participants' performance of completing mathematical problems was modulated by the valence of the priming word, which led us to develop a better understanding of how arithmetic performance is influenced by word processing.

Morality or competence is more important? The effect of evaluation dimensions on ERP responses to neutral faces depends on contextual valence and self-relevance

Recent studies have shown that the processing of neutral facial expressions could be modulated by the valence and self-relevance of preceding verbal evaluations. However, these studies have not distinguished the dimension (i.e., morality and competence) from verbal evaluations. In fact, there is a hot controversy about whether morality or competence receives more weight. Therefore, using the ERP technique, the current study aimed to address this issue by comparing the influence of morality and competence evaluations on behavioral and neural responses to neutral facial expressions when these evaluations varied with contextual valence and self-relevance. Our ERP results revealed that the early EPN amplitudes were larger for neutral faces after receiving evaluations about self relative to evaluations about senders. Moreover, the EPN was more negative after a competence evaluation relative to a morality evaluation when these evaluations were positive, while this effect was absent when these evaluations were negative. The late LPP was larger after a morality evaluation compared to a competence evaluation when these evaluations were negative and directed to self. However, no significant LPP effect between morality and competence evaluations was observed when these evaluations were positive. The present study extended previous studies by showing that early and late processing stages of faces are affected by the evaluation dimension in a top-down manner and further modulated by contextual valence and self-relevance.

Additive effects of emotional expression and stimulus size on the perception of genuine and artificial facial expressions: an ERP study

Seeing an angry individual in close physical proximity can not only result in a larger retinal representation of that individual and an enhanced resolution of emotional cues, but may also increase motivation for rapid visual processing and action preparation. The present study investigated the effects of stimulus size and emotional expression on the perception of happy, angry, non-expressive, and scrambled faces. We analyzed event-related potentials (ERPs) and behavioral responses of N = 40 participants who performed a naturalness classification task on real and artificially created facial expressions. While the emotion-related effects on accuracy for recognizing authentic expressions were modulated by stimulus size, ERPs showed only additive effects of stimulus size and emotional expression, with no significant interaction with size. This contrasts with previous research on emotional scenes and words. Effects of size were present in all included ERPs, whereas emotional expressions affected the N170, EPN, and LPC, irrespective of size. These results imply that the decoding of emotional valence in faces can occur even for small stimuli. Supra-additive effects in faces may necessitate larger size ranges or dynamic stimuli that increase arousal.

The effect of reward expectation on working memory of emotional faces under different levels of cognitive load: an ERP study

Using event-related potentials (ERPs), this study examined the impact of reward expectations on working memory of emotional faces under different levels of cognitive load in a task combining the N-back paradigm and the reward expectation paradigm. The experiment involved presenting high- or low-reward cues followed by an N-back task for emotional faces with different loads. The accuracy results showed that under a high task load, both reward and emotion effects were significantly observed. However, these effects disappeared under a low task load. Analysis of the ERP data revealed that the early P2 and VPP components exhibited greater responses to fearful faces than to neutral faces. In the later stages, the P3 and LPP components showed greater reactions to high rewards than to low rewards. Additionally, the P2 component was found to be modulated by task load in relation to rewards, the EPN component demonstrated task load modulation with respect to emotions, and the N170 component showed an interaction effect between rewards and emotions. These findings imply that load regulates the reward effect and the emotional superiority effect in the process of working memory for emotional faces. In the cognitive processing of working memory, motivation and emotion jointly influence processing. Emotional factors have a greater impact in the early stage of processing, while motivation factors have a greater impact in the late stage of processing.

An EPR study of the cognitive processes underlying the impact of self-relevant information on emotional word processing

Using the event-related potentials (ERPs) technique, this study successively presented names (in either a supra- or subthreshold manner) and emotional words to examine how self-relevant cue (self-name) affects emotional word processing in word class judgment task (to determine whether an emotional word is a noun or adjective) and valence judgment task (to determine whether an emotional word is positive or negative). At the suprathreshold condition, self-relevant positive words elicited a more significant Early posterior negativity (EPN) than negative words only in the valence judgment task. In contrast, at the subthreshold condition, self-relevant negative words elicited an enhanced Late positive potential (LPP) than positive words only in the word class judgment task. These results indicate that self-relevant cue affects emotional word processing at both suprathreshold and subthreshold conditions; nevertheless, the effect manifests as self-positive bias at the suprathreshold condition and self-negative bias at the subthreshold condition. The experimental task modulates these dynamics.

(Micro)saccade-related potentials during face recognition: A study combining EEG, eye-tracking, and deconvolution modeling

Under natural viewing conditions, complex stimuli such as human faces are typically looked at several times in succession, implying that their recognition may unfold across multiple eye fixations. Although electrophysiological (EEG) experiments on face recognition typically prohibit eye movements, participants still execute frequent (micro)saccades on the face, each of which generates its own visuocortical response. This finding raises the question of whether the fixation-related potentials (FRPs) evoked by these tiny gaze shifts also contain psychologically valuable information about face processing. Here, we investigated this question by corecording EEG and eye movements in an experiment with emotional faces (happy, angry, neutral). Deconvolution modeling was used to separate the stimulus ERPs to face onset from the FRPs generated by subsequent microsaccades-induced refixations on the face. As expected, stimulus ERPs exhibited typical emotion effects, with a larger early posterior negativity (EPN) for happy/angry compared with neutral faces. Eye tracking confirmed that participants made small saccades in 98% of the trials, which were often aimed at the left eye of the stimulus face. However, while each saccade produced a strong response over visual areas, this response was unaffected by the face's emotional expression, both for the first and for subsequent (micro)saccades. This finding suggests that the face's affective content is rapidly evaluated after stimulus onset, leading to only a short-lived sensory enhancement by arousing stimuli that does not repeat itself during immediate refixations. Methodologically, our work demonstrates how eye tracking and deconvolution modeling can be used to extract several brain responses from each EEG trial, providing insights into neural processing at different latencies after stimulus onset.

Neural correlates of word processing influenced by painful primes

The administration of painful primes has been shown to influence the perception of successively presented semantic stimuli. Painful primes lead to more negative valence ratings of pain-related, negative, and positive words than no prime. This effect was greater for pain-related than negative words. The identities of this effect's neural correlates remain unknown. In this EEG experiment, 48 healthy subjects received noxious electrical stimuli of moderate intensity. During this priming, they were presented with adjectives of variable valence (pain-related, negative, positive, and neutral). The triggered event-related potentials were analyzed during N1 (120-180 ms), P2 (170-260 ms), P3 (300-350 ms), N400 (370-550 ms), and two late positive complex components (LPC1 [650-750 ms] and LPC2 [750-1000 ms]). Larger event-related potentials were found for negative and pain-related words compared to positive words in later components (N400, LPC1, and LPC2), mainly in the frontal regions. Early components (N1, P2) were less affected by the word category but were by the prime condition (N1 amplitude was smaller with than without painful stimulation, P2 amplitude was larger with than without painful stimulation). Later components (LPC1, LPC2) were not affected by the prime condition. An interaction effect involving prime and word category was found on the behavioral level but not the electrophysiological level. This finding indicates that the interaction effect does not directly translate from the behavioral to the electrophysiological level. Possible reasons for this discrepancy are discussed.

Distrust before first sight? Examining knowledge- and appearance-based effects of trustworthiness on the visual consciousness of faces

The present EEG study with 32 healthy participants investigated whether affective knowledge about a person influences the visual awareness of their face, additionally considering the impact of facial appearance. Faces differing in perceived trustworthiness based on appearance were associated with negative or neutral social information and shown as target stimuli in an attentional blink task. As expected, participants showed enhanced awareness of faces associated with negative compared to neutral social information. On the neurophysiological level, this effect was connected to differences in the time range of the early posterior negativity (EPN)-a component associated with enhanced attention and facilitated processing of emotional stimuli. The findings indicate that the social-affective relevance of a face based on emotional knowledge is accessed during a phase of attentional enhancement for conscious perception and can affect prioritization for awareness. In contrast, no clear evidence for influences of facial trustworthiness during the attentional blink was found.

A neurophysiological signature of dynamic emotion recognition associated with social communication skills and cortical gamma-aminobutyric acid levels in children

Introduction

Emotion recognition is a core feature of social perception. In particular, perception of dynamic facial emotional expressions is a major feature of the third visual pathway. However, the classical N170 visual evoked signal does not provide a pure correlate of such processing. Indeed, independent component analysis has demonstrated that the N170 component is already active at the time of the P100, and is therefore distorted by early components. Here we implemented, a dynamic face emotional paradigm to isolate a more pure face expression selective N170. We searched for a neural correlate of perception of dynamic facial emotional expressions, by starting with a face baseline from which a facial expression evolved. This allowed for a specific facial expression contrast signal which we aimed to relate with social communication abilities and cortical gamma-aminobutyric acid (GABA) levels.

Methods

We recorded event-related potentials (ERPs) and Magnetic Resonance (MRS) measures in 35 typically developing (TD) children, (10-16 years) sex-matched, during emotion recognition of an avatar morphing/unmorphing from neutral to happy/sad expressions. This task allowed for the elimination of the contribution low-level visual components, in particular the P100, by morphing baseline isoluminant neutral faces into specific expressions, isolating dynamic emotion recognition. Therefore, it was possible to isolate a dynamic face sensitive N170 devoid of interactions with earlier components.

Results

We found delayed N170 and P300, with a hysteresis type of dependence on stimulus trajectory (morphing/unmorphing), with hemispheric lateralization. The delayed N170 is generated by an extrastriate source, which can be related to the third visual pathway specialized in biological motion processing. GABA levels in visual cortex were related with N170 amplitude and latency and predictive of worse social communication performance (SCQ scores). N170 latencies reflected delayed processing speed of emotional expressions and related to worse social communication scores.

Discussion

In sum, we found a specific N170 electrophysiological signature of dynamic face processing related to social communication abilities and cortical GABA levels. These findings have potential clinical significance supporting the hypothesis of a spectrum of social communication abilities and the identification of a specific face-expression sensitive N170 which can potentially be used in the development of diagnostic and intervention tools.

Zero-derivation in Korean: the effect of covert structure in real-time processing

Korean words like balgda 'bright/become bright' and gilda 'long/become long' are categorially ambiguous; they can appear as both adjectives and verbs. Some suggest that these words are listed under separate lexical entries, while others propose that they share one single lexical entry, and that the verb form is morphologically derived from the base adjective through a process called zero derivation. This study presents the results of a real-time experiment that investigates whether these words involve zero derivation and if so, how zero derivation may affect the real-time processing of these words. Our findings suggest that the reader recognizes the base adjective and obtains the derived-verb form by virtue of adding a covert category-changing morpheme in real-time sentence processing. This study provides promising evidence of the zero derivation of Korean categorially ambiguous adjectives and verbs, as well as crosslinguistic evidence of the role of covert structure in lexical access.

Dominance of face over voice in human attractiveness judgments: ERP evidence

The attractiveness of a person, a complex, and socially relevant type of information, is transmitted in many ways, not least through face and voice. However, it is unclear how the stimulus domains carrying attractiveness information interact. The present study explored the audiovisual perception of attractiveness in a Stroop-like paradigm using event-related potentials (ERPs). Participants were presented with face-voice pairs carrying congruent or incongruent attractiveness information and, in turn, judged the attractiveness level of each domain while ignoring the other. Voice attractiveness judgments were influenced by unattended face attractiveness, in terms of both, early perceptual encoding (N170, P200) as well as later evaluative stages (N400, LPC). In contrast, effects of unattended voice attractiveness on face attractiveness judgments were confined to early perceptual encoding (N170). These results demonstrate not only the interaction of multiple domains in human attractiveness perception at different processing stages but also a relative dominance of face over voice attractiveness.

Gender congruence and emotion effects in cross-modal associative learning: Insights from ERPs and pupillary responses

Social and emotional cues from faces and voices are highly relevant and have been reliably demonstrated to attract attention involuntarily. However, there are mixed findings as to which degree associating emotional valence to faces occurs automatically. In the present study, we tested whether inherently neutral faces gain additional relevance by being conditioned with either positive, negative, or neutral vocal affect bursts. During learning, participants performed a gender-matching task on face-voice pairs without explicit emotion judgments of the voices. In the test session on a subsequent day, only the previously associated faces were presented and had to be categorized regarding gender. We analyzed event-related potentials (ERPs), pupil diameter, and response times (RTs) of N = 32 subjects. Emotion effects were found in auditory ERPs and RTs during the learning session, suggesting that task-irrelevant emotion was automatically processed. However, ERPs time-locked to the conditioned faces were mainly modulated by the task-relevant information, that is, the gender congruence of the face and voice, but not by emotion. Importantly, these ERP and RT effects of learned congruence were not limited to learning but extended to the test session, that is, after removing the auditory stimuli. These findings indicate successful associative learning in our paradigm, but it did not extend to the task-irrelevant dimension of emotional relevance. Therefore, cross-modal associations of emotional relevance may not be completely automatic, even though the emotion was processed in the voice.

How much is a chef's touch worth? Affective, emotional and behavioural responses to food images: A multimodal study

BACKGROUND

Food aesthetics influences affective dimensions (valence and arousal) and subsequent emotional and behavioural responses in images presented in more traditional form, almost rustic in some cases, to the signature dishes of haute cuisine. However, the visual impact of images of haute cuisine dishes on consumers' affective and emotional responses compared to traditional dishes is still understudied.

METHODS

We recorded electrodermal activity, ocular movements and self-report affect of 35 volunteers while they performed a picture viewing paradigm using images of haute cuisine food, traditional food, and non-food. Additionally, the moderating role of age was examined.

RESULTS

Our results showed that subjects had higher feelings of pleasure and arousal toward images of food (haute cuisine and traditional dishes) compared to non-food images. However, no difference in self-report affect, physiological and behavioural responses was found between haute cuisine and traditional dishes. Interestingly, a moderating effect of age was revealed, reporting that younger participants had greater feelings of pleasure and shorter eye-to-screen distance towards traditional food than haute cuisine.

CONCLUSIONS

As a whole, our findings suggest that food aesthetics could at least partially affect consumers' affective and emotional responses. Interestingly, physiological responses to food pictures seemed to be relatively independent of approach/avoidance motivational states, supporting the assumption that traditional visual restaurant menus with attractive images might be insufficient for eliciting intense positive emotions. This study also contributes to advancing the understanding of the role that age plays in emotional impact when images of haute cuisine dishes are presented to consumers.

Mass-univariate analysis of scalp ERPs reveals large effects of gaze fixation location during face processing that only weakly interact with face emotional expression

Decoding others' facial expressions is critical for social functioning. To clarify the neural correlates of expression perception depending on where we look on the face, three combined gaze-contingent ERP experiments were analyzed using robust mass-univariate statistics. Regardless of task, fixation location impacted face processing from 50 to 350 ms, maximally around 120 ms, reflecting retinotopic mapping around C2 and P1 components. Fixation location also impacted majorly the N170-P2 interval while weak effects were seen at the face-sensitive N170 peak. Results question the widespread assumption that faces are processed holistically into an indecomposable perceptual whole around the N170. Rather, face processing is a complex and view-dependent process that continues well beyond the N170. Expression and fixation location interacted weakly during the P1-N170 interval, supporting a role for the mouth and left eye in fearful and happy expression decoding. Expression effects were weakest at the N170 peak but strongest around P2, especially for fear, reflecting task-independent affective processing. Results suggest N170 reflects a transition between processes rather than the maximum of a holistic face processing stage. Focus on this peak should be replaced by data-driven analyses of the epoch using robust statistics to fully unravel the early visual processing of faces and their affective content.

Dissociating different temporal stages of emotional word processing by feature-based attention

Negative emotional content is prioritized across different stages of information processing as reflected by different components of the event-related potential (ERP). In this preregistered study (N = 40), we investigated how varying the attentional focus allows us to dissociate the involvement of specific ERP components in the processing of negative and neutral words. Participants had to discriminate the orientation of lines overlaid onto the words, the word type (adjective/noun), or the emotional content (negative/neutral). Thus, attention was either not focused on words (distraction task), non-emotional aspects, or the emotional relevance of words. Regardless of the task, there were no significant differences between negative and neutral words for the P1, N1, or P2 components. In contrast, interactions between emotion and task were observed for the early posterior negativity (EPN) and late positive potential (LPP). EPN differences were absent during the distraction task but were present in the other two tasks. LPP emotion differences were found only when attention was directed to the emotional content of words. Our study adds to the evidence that early ERP components do not reliably separate negative and neutral words. However, results show that mid-latency and late stages of emotion processing are separable by different attention tasks. The EPN represents a stage of attentional enhancement of negative words given sufficient attentional resources. Differential activations during the LPP stage are associated with more elaborative processing of the emotional meaning of words.

The influence of selective attention to specific emotions on the processing of faces as revealed by event-related brain potentials

Event-related potential studies using affective words have indicated that selective attention to valence can increase affective discrimination at early perceptual stages. This effect most likely relies on neural associations between perceptual features of a stimulus and its affective value. Similar to words, emotional expressions in human faces are linked to specific visual elements. Therefore, selectively attending to a given emotion should allow for the preactivation of neural networks coding for the emotion and associated first-order visual elements, leading to enhanced early processing of faces expressing the attended emotion. To investigate this, we employed an expression detection task (N = 65). Fearful, happy, and neutral faces were randomly presented in three blocks while participants were instructed to respond only to one predefined target level of expression in each block. Reaction times were the fastest for happy target faces, which was accompanied by an increased occipital P1 for happy compared with fearful faces. The N170 yielded an arousal effect (emotional > neutral) while both components were not modulated by target status. In contrast, the early posterior negativity (EPN) arousal effect tended to be larger for target compared with nontarget faces. The late positive potential (LPP) revealed large effects of status and expression as well as an interaction driven by an increased LPP specifically for nontarget fearful faces. These findings tentatively indicate that selective attention to facial affect may enhance early emotional processing (EPN) even though further research is needed. Moreover, late controlled processing of facial emotions appears to involve a negativity bias.

The Relationship Between Personality Traits and the Processing of Emotion Words: Evidence from Eye-Movements in Sentence Reading

Previous research shows that processing times on emotion words (both negative and positive) are faster than on non-emotional neutral words. In the current study, we explored how personality traits (the Big Five and the trait emotional intelligence factors) may further influence the processing of emotion versus non-emotion words by conducting two experiments where participants silently read sentences while their eye movements were recorded. The results replicated the facilitative emotion effect and showed that those with higher agreeableness scores had stronger emotion effects on positive words and those with higher extraversion scores, higher openness scores, higher agreeableness scores, lower sociability scores, and higher emotionality scores had stronger emotion effects on negative words. Furthermore, some personality traits also led to different ways that readers approach text, for example, through more risky reading strategies.

Deepfake smiles matter less-the psychological and neural impact of presumed AI-generated faces

High-quality AI-generated portraits ("deepfakes") are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological and neural measures of human face perception. Using EEG, we tracked participants' (N = 30) brain responses to real faces showing positive, neutral, and negative expressions, after being informed that they are either real or fake. Smiling faces marked as fake appeared less positive, as reflected in expression ratings, and induced slower evaluations. Whereas presumed real smiles elicited canonical emotion effects with differences relative to neutral faces in the P1 and N170 components (markers of early visual perception) and in the EPN component (indicative of reflexive emotional processing), presumed deepfake smiles showed none of these effects. Additionally, only smiles presumed as fake showed enhanced LPP activity compared to neutral faces, suggesting more effortful evaluation. Negative expressions induced typical emotion effects, whether considered real or fake. Our findings demonstrate a dampening effect on perceptual, emotional, and evaluative processing of presumed deepfake smiles, but not angry expressions, adding new specificity to the debate on the societal impact of AI-generated content.

Time distortions induced by high-arousing emotional compared to low-arousing neutral faces: an event-related potential study

Emotions influence our perception of time. Arousal and valence are considered different dimensions of emotions that might interactively affect the perception of time. In the present study, we aimed to investigate the possible time distortions induced by emotional (happy/angry) high-arousing faces compared to neutral, low-arousing faces. Previous works suggested that emotional stimuli enhance the amplitudes of several posterior components, such as Early Posterior Negativity (EPN) and Late Positive Potential (LPP). These components reflect several stages of emotional processing. To this end, we conducted an event-related potential (ERP) study with a temporal bisection task. We hypothesized that the partial dissociation of these ERP components would shed more light on the possible relations of valence and arousal on emotional facial regulation and their consequential effects on behavioral timing. The behavioral results demonstrated a significant effect for emotional stimuli, as happy faces were overestimated relative to angry faces. Our results also indicated higher temporal sensitivity for angry faces. The analyzed components (EPN and LLP) provided further insights into the qualitative differences between stimuli. Finally, the results were interpreted considering the internal clock model and two-stage processing of emotional stimuli.

Processing emotions from faces and words measured by event-related brain potentials

Affective aspects of a stimulus can be processed rapidly and before cognitive attribution, acting much earlier for verbal stimuli than previously considered. Aimed for specific mechanisms, event-related brain potentials (ERPs), expressed in facial expressions or word meaning and evoked by six basic emotions - anger, disgust, fear, happy, sad, and surprise - relative to emotionally neutral stimuli were analysed in a sample of 116 participants. Brain responses in the occipital and left temporal regions elicited by the sadness in facial expressions or words were indistinguishable from responses evoked by neutral faces or words. Confirming previous findings, facial fear elicited an early and strong posterior negativity. Instead of expected parietal positivity, both the happy faces and words produced significantly more negative responses compared to neutral. Surprise in facial expressions and words elicited a strong early response in the left temporal cortex, which could be a signature of appraisal. The results of this study are consistent with the view that both types of affective stimuli, facial emotions and word meaning, set off rapid processing and responses occur very early in the processing stage.

Semantic satiation of emotional words impedes facial expression processing in two stages

To explore the mechanism of emotional words semantic satiation effect on facial expression processing, participants were asked to judge the facial expression (happiness or sadness) after an emotional word ((cry) or (smile)) or a neutral word ((Ah), baseline condition) was presented for 20 s. The results revealed that participants were slower in judging valence-congruent facial expressions and reported a more enlarged (Experiment 1) and prolonged (Experiment 2) N170 component than the baseline condition. No significant difference in behavior and N170 appeared between the valence-incongruent and the baseline condition. However, the amplitude of LPC (Late Positive Complex) under both valence-congruent/incongruent conditions was smaller than the baseline condition. It indicates that, in the early stage, the impeding effect of satiated emotional words is specifically constrained to facial expressions with the same emotional valence; in the late stage, such an impeding effect might spread to facial expressions with the opposite valence of the satiated emotional word.

Reward History Modulates the Processing of Task-Irrelevant Emotional Faces in a Demanding Task

The aim of the current study was to examine how reward-associated emotional facial distractors could capture attentional resources in a demanding visual task using event-related potentials (ERPs). In the learning phase, a high- or low-reward probability was paired with angry, happy, or neutral faces. Then, in the test phase, participants performed a face-irrelevant task with no reward at stake, in which they needed to discriminate the length of two lines presented in the center of the screen while faces that were taken from the learning phase were used as distractors presented in the periphery. The behavioral results revealed no effect of distractor emotional valence since the emotional information was task-irrelevant. The ERP results in the test phase revealed a significant main effect of distractor emotional valence for the parieto-occipital P200 (170-230 ms); the mean amplitudes in both the angry- and happy-face conditions were more positive than the neutral-face condition. Moreover, we found that the high-reward association enhanced both the N170 (140-180 ms) and EPN (260-330 ms) relative to the low-reward association condition. Finally, the N2pc (270-320 ms) also exhibited enhanced neural activity in the high-reward condition compared to the low-reward condition. The absence of emotional effects indicated that task-irrelevant emotional facial stimuli did not impact behavioral or neural responses in this highly demanding task. However, reward-associated information was processed when attention was directed elsewhere, suggesting that the processing of reward-associated information worked more in an automatic way, irrespective of the top-down task demand.

On the dynamics of gain and loss: Electrophysiological evidence from associative learning

Associated relevance affects the sensory encoding of low-level visual features of symbolic stimuli. It is unclear, however, which dimension of low-level visual features benefits from prioritized processing, and how these effects develop throughout the course of relevance acquisition. Moreover, previous evidence is inconclusive regarding the preservation of processing advantage once the association is no longer relevant, as well as its generalization to perceptually similar but novel stimuli. The present study addresses these questions by employing an associative learning paradigm. In two experiments (N = 24 each, between-subject design), different dimensions of low-level visual features of symbolic stimuli were associated with monetary gain, loss, or zero outcome. In a consecutive old/new decision task, associated stimuli were presented together with perceptually similar but novel stimuli. Event-related brain potentials (P1, EPN, LPC) were measured throughout both sessions. Early sensory encoding (P1) was boosted by loss association and appeared to be sensitive to the dimension of the associated low-level visual features. Gain association influenced post-perceptual processing stages (LPC), arising over the course of the learning phase, and are preserved even when the associated outcome was no longer relevant. Gain association also resulted in EPN modulations similar to the effects observed in the case of emotional words. None of the observed effects generalized to perceptually similar stimuli. These results show that acquired relevance can influence the sensory processing of specific dimensions of low-level visual features. Moreover, this study extends previous evidence of a dissociation of early and late neural effects of associated motivational relevance.

The impact of emotional facial expressions on reflexive attention depends on the aim of dynamic gaze changes: An ERP study

The emotional expression and gaze direction of a face are important cues for human social interactions. However, the interplay of these factors and their neural correlates are only partially understood. In the current study, we investigated ERP correlates of gaze and emotion processing following the initial presentation of faces with different emotional expressions (happy, neutral, angry) and an averted or direct gaze direction as well as following a subsequent change in gaze direction that occurred in half of the trials. We focused on the time course and scalp topography of the N170 and EPN components. The N170 amplitude was larger to averted than direct gaze for the initial face presentation and larger to gaze changes from direct to averted than from averted to direct in response to the gaze change. For the EPN component in response to the initial face presentation, we replicate classic effects of emotion, which did not interact with gaze direction. As a major new finding, changes from direct to averted gaze elicited an EPN-like effect when the face showed a happy expression. No such effect was seen for angry expressions. We conclude that happy faces reflexively attract attention when they look at the observer rather than away from the observer. These results for happy expressions are in line with the shared signal hypothesis that posits a better processing of expressions if their approach or avoidance tendency is consistent with gaze direction. However, the shared signal hypothesis is not supported by the present results for angry faces.

Influence of advisees' facial feedback on subsequent advice-giving by advisors: Evidence from the behavioral and neurophysiological approach

Previous work has demonstrated the interpersonal implications of advisees' decisions (acceptance or rejection) on advisors' advice-giving behavior in subsequent exchanges. Here, using an ERP technique, we investigated how advisees' facial feedback (smiling, neutral, or frowning) accompanying their decisions (acceptance or rejection) influenced advisors' feedback evaluation from advisees and their advice-giving in subsequent exchanges. Behaviorally, regardless of whether the advice was accepted or rejected, advisors who received smiling-expression feedback would show higher willingness rates in subsequent advice-giving decisions, while advisors who received frowning-expression feedback would show lower willingness rates. On the neural level, in the feedback evaluation stage, the FRN and P3 responses were not sensitive to facial feedback. In contrast, frowning-expression feedback elicited a larger LPC amplitude than neutral- and smiling-expression feedback, regardless of whether the advice was accepted or rejected. In the advice decision stage, advisors who received neutral-expression feedback showed a larger N2 in making decisions than advisors who received frowning-expression feedback only after the advice was rejected. Additionally, Advisors who received smiling- and neutral-expression feedback showed a larger P3 in making decisions than advisors who received frowning-expression feedback only after the advice was accepted. In sum, the current findings extended previous research findings by showing that the effect of advisees' facial expressions on the advisors' advice-giving existed in multiple stages, including both the feedback evaluation stage and the advice decision stage.

The role of subjective significance, valence and arousal in the explicit processing of emotion-laden words

Emotional categorisation (deciding whether a word is emotional or not) is a task that employs the explicit analysis of the emotional meaning of words. Therefore, it allows for assessing the role of emotional factors, i.e., valence, arousal, and subjective significance, in emotional word processing. The aim of the current experiment was to investigate the role of subjective significance, a reflective form of activation that is similar to arousal (the automatic form), in the processing of emotional meaning. We applied the orthogonal manipulation of three emotional factors. Thus, we were able to precisely differentiate the effects of each factor and search for interactions between them. We expected valence to shape the late positive complex LPC component, while subjective significance and arousal were expected to shape the P300 and N400 components. We observed the effects of subjective significance throughout the whole span of processing, while the arousal effect was present only in the LPC component. We also observed that amplitudes for N400 and LPC discriminated negative from positive valence. The results showed that all factors included in the analysis should be taken into account while explaining the processing of emotion-laden words; especially interesting is the subjective significance, which was shown to shape processing individually, as well as to come into interaction with valence and arousal.

The time course of categorical perception of facial expressions

Decoding emotions on others' faces is one of the most important functions of the human brain, which has been widely studied in cognitive neuroscience. However, the precise time course of facial expression categorization in the human brain is still a matter of debate. Here we used an original paradigm to measure categorical perception of facial expression changes during event-related potentials (ERPs) recording, in which a face stimulus dynamically switched either to a different expression (between-category condition) or to the same expression (within-category condition), the physical distance between the two successive faces being equal across conditions. The switch between faces generated a negative differential potential peaking at around 160 ms over occipito-temporal regions, similar in term of latency and topography to the well-known face-selective N170 component. This response was larger in the condition where the switch occurred between faces that were perceived as having different facial expressions compared to the same expression. In addition, happy expressions were categorized around 20 ms faster than fearful expressions (respectively, 135 and 156 ms). These findings provide evidence that changes of facial expressions are categorically perceived as early as 160 ms following stimulus onset over the occipito-temporal cortex.

Dissociable effects of emotional stimuli on electrophysiological indices of time and decision-making

Previous research has demonstrated that emotional faces affect time perception, however, the underlying mechanisms are not fully understood. Earlier attempts focus on effects at the different stages of the pacemaker-accumulator model (clock, memory, and/or decision-making) including, an increase in pacemaker rate or accumulation rate via arousal or attention, respectively, or by biasing decision-making. A visual temporal bisection task with sub-second intervals was conducted in two groups to further investigate these effects; one group was strictly behavioral whereas the second included a 64-channel electroencephalogram (EEG). To separate the influence of face and timing responses, participants timed a visual stimulus, temporally flanked (before and after) by two faces, either negative or neutral, creating three trial-types: Neg→Neut, Neut→Neg, or Neut→Neut. We found a leftward shift in bisection point (BP) in Neg→Neut relative to Neut→Neut suggests an overestimation of the temporal stimulus when preceded by a negative face. Neurally, we found the face-responsive N170 was larger for negative faces and the N1 and contingent negative variation (CNV) were larger when the temporal stimulus was preceded by a negative face. Additionally, there was an interaction effect between condition and response for the late positive component of timing (LPCt) and a significant difference between response (short/long) in the neutral condition. We concluded that a preceding negative face affects the clock stage leading to more pulses being accumulated, either through attention or arousal, as indexed by a larger N1, CNV, and N170; whereas viewing a negative face after impacted decision-making mechanisms, as evidenced by the LPCt.

Visual competition attenuates emotion effects during overt attention shifts

Numerous different objects are simultaneously visible in a person's visual field, competing for attention. This competition has been shown to affect eye-movements and early neural responses toward stimuli, while the role of a stimulus' emotional meaning for mechanisms of overt attention shifts under competition is unclear. The current study combined EEG and eye-tracking to investigate effects of competition and emotional content on overt shifts of attention to human face stimuli. Competition prolonged the latency of the P1 component and of saccades, while faces showing emotional expressions elicited an early posterior negativity (EPN). Remarkably, the emotion-related modulation of the EPN was attenuated when two stimuli were competing for attention compared to non-competition. In contrast, no interaction effects of emotional expression and competition were observed on other event-related potentials. This finding indicates that competition can decelerate attention shifts in general and also diminish the emotion-driven attention capture, measured through the smaller effects of emotional expression on EPN amplitude. Reduction of the brain's responsiveness to emotional content in the presence of distractors contradicts models that postulate fully automatic processing of emotions.

Attention and regulation during emotional word comprehension in older adults: Evidence from event-related potentials and brain oscillations

Older adults often show a positivity bias effect during picture processing, focusing more on positive than negative information. It is unclear whether this positivity bias effect generalizes to language and whether arousal matters. The present study investigated how age affects emotional word comprehension with varied valence (positive, negative) and arousal (high, low). We recorded older and younger participants' brainwaves (EEG) while they read positive/negative and high/low-arousing words and pseudowords, and made word/non-word judgments. Older adults showed increased N400s and left frontal alpha decreases (300-450 ms) for low-arousing positive as compared to low-arousing negative words, suggesting an arousal-dependent positivity bias during lexical retrieval. Both age groups showed similar LPPs to negative words. Older adults further showed a larger mid-frontal theta increase (500-700 ms) than younger adults for low-arousing negative words, possibly indicating down-regulation of negative meanings of low-arousing words. Altogether, our data supported the strength and vulnerability integration model of aging.

Arousal, subjective significance and the origin of valence aligned words in the processing of an emotional categorisation task

An emotional categorisation task allows us to study how emotionality is understood and how emotional factors influence decisions. As emotionality is not only the valence but is also composed of activation (arousal and subjective significance) and the type of process needed to produce emotion (origin), we wanted to test the influence of these emotional factors on with a group of stimuli not differing in valence. We predicted that increasing activation levels should lead to increased classification of stimuli as emotional, with a focus on the late processing stages, when explicit word processing occurs, which on the electrophysiological level corresponds to P300, N450 and LPC components. The behavioural results showed that the emotionality of words increased with increasing levels of arousal and subjective significance. Automatically originated words were assessed as more emotional than reflective ones. The amplitude of the N450 component revealed dissociation for subjective significance and origin effects, showing that these two dimensions ascribe distinct properties of emotionality. Finally, the LPC component was susceptible to all affective dimensions used in manipulation. Our study showed that arousal, subjective significance and origin are dimensions of affect that shape the processing of words' emotionality, when the values of valence were aligned among the stimuli.

The role of sex and emotion on emotion perception in artificial faces: An ERP study

Sex has a significant impact on the perception of emotional expressions. However, it remains unclear whether sex influences the perception of emotions in artificial faces, which are becoming popular in emotion research. We used an emotion recognition task with FaceGen faces portraying six basic emotions aiming to investigate the effect of sex and emotion on behavioural and electrophysiological parameters. 71 participants performed the task while EEG was recorded. The recognition of sadness was the poorest, however, females recognized sadness better than males. ERP results indicated that fear, disgust, and anger evoked higher amplitudes of late positive potential over the left parietal region compared to neutral expression. Females demonstrated higher values of global field power as compared to males. The interaction between sex and emotion on ERPs was not significant. The results of our study may be valuable for future therapies and research, as it emphasizes possibly distinct processing of emotions and potential sex differences in the recognition of emotional expressions in FaceGen faces.

Shared Attention Amplifies the Neural Processing of Emotional Faces

Sharing an experience, without communicating, affects people's subjective perception of the experience, often by intensifying it. We investigated the neural mechanisms underlying shared attention by implementing an EEG study where participants attended to and rated the intensity of emotional faces, simultaneously or independently. Participants performed the task in three experimental conditions: (a) alone; (b) simultaneously next to each other in pairs, without receiving feedback of the other's responses (shared without feedback); and (c) simultaneously while receiving the feedback (shared with feedback). We focused on two face-sensitive ERP components: The amplitude of the N170 was greater in the "shared with feedback" condition compared to the alone condition, reflecting a top-down effect of shared attention on the structural encoding of faces, whereas the EPN was greater in both shared context conditions compared to the alone condition, reflecting an enhanced attention allocation in the processing of emotional content of faces, modulated by the social context. Taken together, these results suggest that shared attention amplifies the neural processing of faces, regardless of the valence of facial expressions.

Altered electromyographic responses to emotional and pain information in awake bruxers: case-control study

OBJECTIVES

This study aims to investigate how emotional information and pain-related information affect the activity of the masticatory muscles in participants with awake bruxism and controls.

MATERIAL AND METHODS

Different videos and texts, with positive, negative, and neutral valence or related to pain, were presented to a sample of university students, while their electromyographic (EMG) activity around the masseter muscle and their skin conductance were recorded. Two groups were selected, with 24 subjects each: one group of subjects with definitive awake bruxism (confirmed by posterior EMG activity) who also suffered from moderate jaw discomfort, and another group of subjects without bruxism.

RESULTS

The results demonstrated that the subjects with definitive awake bruxism displayed greater muscular activity when presented videos and texts with negative valence, especially when related to pain, than the non-bruxist group.

CONCLUSIONS

This study supports the idea that persons with bruxism who also suffer moderate levels of jaw discomfort present greater bruxism activity when watching pain-related stimuli, and to a lesser extent when watching negative stimuli.

CLINICAL RELEVANCE

The increased muscular activity induced by negative and pain-related information might contribute to pain exacerbation and perpetuation in persons with bruxism who suffer from discomfort.

Multimodal Evidence of Atypical Processing of Eye Gaze and Facial Emotion in Children With Autistic Traits

According to the shared signal hypothesis (SSH) the impact of facial expressions on emotion processing partially depends on whether the gaze is directed toward or away from the observer. In autism spectrum disorder (ASD) several aspects of face processing have been found to be atypical, including attention to eye gaze and the identification of emotional expressions. However, there is little research on how gaze direction affects emotional expression processing in typically developing (TD) individuals and in those with ASD. This question is investigated here in two multimodal experiments. Experiment 1 required processing eye gaze direction while faces differed in emotional expression. Forty-seven children (aged 9-12 years) participated. Their Autism Diagnostic Observation Schedule (ADOS) scores ranged from 0 to 6 in the experiment. Event-related potentials (ERPs) were sensitive to gaze direction and emotion, but emotion processing did not depend on gaze direction. However, for angry faces the gaze direction effect on the N170 amplitude, as typically observed in TD individuals, diminished with increasing ADOS score. For neutral expressions this correlation was not significant. Experiment 2 required explicit emotion classifications in a facial emotion composite task while eye gaze was manipulated incidentally. A group of 22 children with ASD was compared to a propensity score-matched group of TD children (mean age = 13 years). The same comparison was carried out for a subgroup of nine children with ASD who were less trained in social cognition, according to clinician's report. The ASD group performed overall worse in emotion recognition than the TD group, independently of emotion or gaze direction. However, for disgust expressions, eye tracking data revealed that TD children fixated relatively longer on the eyes of the stimulus face with a direct gaze as compared with averted gaze. In children with ASD we observed no such modulation of fixation behavior as a function of gaze direction. Overall, the present findings from ERPs and eye tracking confirm the hypothesis of an impaired sensitivity to gaze direction in children with ASD or elevated autistic traits, at least for specific emotions. Therefore, we conclude that multimodal investigations of the interaction between emotional processing and stimulus gaze direction are promising to understand the characteristics of individuals differing along the autism trait dimension.

How accentuation influences the processing of emotional words in spoken language: An ERP study

Pitch accent marks information structure in utterances in many languages but little is known about the effects of accent on the perception of emotional word meaning. The present study explored the processing of accentuation and its influence on the semantic integration of emotional words during spoken sentence comprehension. Twenty-five participants were presented with sets of spoken Chinese sentences while accentuation and emotional meaning of the adjectives were orthogonally manipulated. An implicit task required the recognition of words contained in the sentences, whereas an explicit task required judging the presence of an accented or emotional word. In the ERPs to the adjectives, accentuation induced a long-lasting anterior negativity starting around 150-250 ms and a late posterior positivity. More importantly, emotionally negative words elicited larger negativities between 300 and 700 ms as compared to neutral words but only when they were accented. Interestingly, these negativities showed a parietal N400-typical distribution when accent was implicit but strongly overlapped with the accent-induced anterior negativity when accent was task-relevant. Hence, accentuation may enable the processing of emotional meaning by directing attention towards the accented words. When accent and emotion are explicit parts of the task, similar frontal attentional networks are activated by emotion as by accent alone. In contrast, when accent and emotion are implicit to the task, emotion appears to merely activate parietal networks, typical for semantic integration effects. Together, these results suggest that accentuation plays an important role in spoken sentence comprehension, deserving further study.

Orienting to Different Dimensions of Word Meaning Alters the Representation of Word Meaning in Early Processing Regions

Conscious processing of word meaning can be guided by attention. In this event-related functional magnetic resonance imaging study in 22 healthy young volunteers, we examined in which regions orienting attention to two fundamental and generic dimensions of word meaning, concreteness versus valence, alters the semantic representations coded in activity patterns. The stimuli consisted of 120 nouns in written or spoken modality which varied factorially along the concreteness and valence axis. Participants performed a forced-choice judgement of either concreteness or valence. Rostral and subgenual anterior cingulate were strongly activated during valence judgement, and precuneus and the dorsal attention network during concreteness judgement. Task and stimulus type interacted in right posterior fusiform gyrus, left lingual gyrus, precuneus, and insula. In the right posterior fusiform gyrus and the left lingual gyrus, the correlation between the pairwise similarity in activity patterns evoked by words and the pairwise distance in valence and concreteness was modulated by the direction of attention, word valence or concreteness. The data indicate that orienting attention to basic dimensions of word meaning exerts effects on the representation of word meaning in more peripheral nodes, such as the ventral occipital cortex, rather than the core perisylvian language regions.

Sound gaps boost emotional audiovisual integration independent of attention: Evidence from an ERP study

The emotion discrimination paradigm was adopted to study the effect of interrupted sound on visual emotional processing under different attentional states. There were two experiments: Experiment 1: judging facial expressions (explicit task), Experiment 2: judging the position of a bar (implicit task). In Experiment 1, ERP results showed that there was a sound gap accelerating the effect of P1 present only under neutral faces. In Experiment 2, the accelerating effect (P1) existed regardless of the emotional condition. Combining two experiments, P1 findings suggest that sound gap enhances bottom-up attention. The N170 and late positive component (LPC) were found to be regulated by emotion face in both experiments, with fear over the neutral. Comparing the two experiments, the explicit task induced a larger LPC than the implicit task. Overall, sound gaps boosted the audiovisual integration by bottom-up attention in early integration, while cognitive expectations led to top-down attention in late stages.

Emotional content influences eye-movements under natural but not under instructed conditions

ABSTRACTIn everyday life, people can freely decide if and where they would like to move their attention and gaze, often influenced by physical and emotional salience of stimuli. However, many laboratory paradigms explicitly instruct participants when and how to move their eyes, leading to unnatural instructed eye-movements. The current preregistered study compared eye-movements to peripherally appearing faces with happy, angry and neutral expressions under natural and instructed conditions. Participants reliably moved their eyes towards peripheral faces, even when they were not instructed to do so; however, eye-movements were significantly slower under natural than under instructed conditions. Competing central stimuli decelerated eye-movements independently of instructions. Unexpectedly, the emotional salience only affected eye-movements under natural conditions, with faster saccades towards emotional than towards neutral faces. No effects of emotional expression occurred when participants were instructed to move their eyes. The study shows that natural eye-movements significantly differ from instructed eye-movements and emotion-driven attention effects are reduced when participants are artificially instructed to move their eyes, suggesting that research should investigate eye-movements under natural conditions.

Electrophysiological Correlates of Social Decision-making: An EEG Investigation of a Modified Ultimatum Game

Cooperation behaviors during social decision-making have been shown to be sensitive to manipulations of context. However, it remains unclear how aspects of context in dynamic social interactions, such as observed nonverbal behaviors, may modulate cooperation decisions and the associated neural mechanisms. In this study, participants responded to offers from proposers to split $10 in an Ultimatum Game following observation of proposer approach (friendly) or avoidance (nonfriendly) behaviors, displayed by dynamic whole-body animated avatars, or following a nonsocial interaction control condition. As expected, behavioral results showed that participants tended to have greater acceptance rates for unfair offers following observed nonverbal social interactions with proposers compared with control, suggesting an enhancing effect of social interactions on cooperative decisions. ERP results showed greater N1 and N2 responses at the beginning of social interaction conditions compared with control, and greater sustained and late positivity responses for observed approach and avoidance proposer behaviors compared with control. Event-related spectral perturbation (ERSP) results showed differential sensitivity within theta, alpha, and beta bands during observation of social interactions and offers that was associated with subsequent decision behaviors. Together, these results point to the impact of proposers' nonverbal behaviors on subsequent cooperation decisions at both behavioral and neural levels. The ERP and ERSP findings suggest modulated attention, monitoring, and processing of biological motion during the observed nonverbal social interactions, influencing the participants' responses to offers. These findings shed light on electrophysiological correlates of response to observed social interactions that predict subsequent social decisions.

Negative news dominates fast and slow brain responses and social judgments even after source credibility evaluation

Remedies to counter the impact of misinformation are in high demand, but little is known about the neuro-cognitive consequences of untrustworthy information and how they can be mitigated. In this preregistered study, we investigated the effects of social-emotional headline contents on social judgments and brain responses and whether they can be modulated by explicit evaluations of the trustworthiness of the media source. Participants (N = 30) evaluated -and clearly discerned- the trustworthiness of news sources before they were exposed to person-related news headlines. Despite this intervention, social judgments and brain responses were dominated largely by emotional headline contents. Results suggest differential effects of source credibility might depend on headline valence. Electrophysiological indexes of fast emotional and arousal-related brain responses, as well as correlates of slow evaluative processing were enhanced for persons associated with positive headline contents from trusted sources, but not when positive headlines stemmed from distrusted sources. In contrast, negative headlines dominated fast and slow brain responses unaffected by explicit source credibility evaluations. These results provide novel insights into the brain mechanisms underlying the "success" of emotional news from untrustworthy sources, suggesting a pronounced susceptibility to negative information even from distrusted sources that is reduced for positive contents. The differential pattern of responses to misinformation in mind and brain sheds light on the cognitive mechanisms underlying the processing of misinformation and possible strategies to avoid their potentially detrimental effects.

Unraveling the Mystery About the Negative Valence Bias: Does Arousal Account for Processing Differences in Unpleasant Words?

Many studies have found that the emotional content of words affects visual word recognition. However, most of them have only considered affective valence, finding inconsistencies regarding the direction of the effects, especially in unpleasant words. Recent studies suggest that arousal might explain why not all unpleasant words elicit the same behavior. The aim of the present research was to study the role of arousal in unpleasant word recognition. To do that, we carried out an ERP experiment in which participants performed a lexical decision task that included unpleasant words which could vary across three levels of arousal (intermediate, high, and very high) and words which were neutral in valence and had an intermediate level of arousal. Results showed that, within unpleasant words, those intermediate in arousal evoked smaller LPC amplitudes than words that were high or very high in arousal, indicating that arousal affects unpleasant word recognition. Critically, arousal determined whether the effect of negative valence was found or not. When arousal was not matched between unpleasant and neutral valenced words, the effect of emotionality was weak in the behavioral data and absent in the ERP data. However, when arousal was intermediate in both unpleasant and neutral valenced words, larger EPN amplitudes were reported for the former, pointing to an early allocation of attention. Interestingly, these unpleasant words which had an intermediate level of arousal showed a subsequent inhibitory effect in that they evoked smaller LPC amplitudes and led to slower reaction times and more errors than neutral words. Our results highlight the relevance that the arousal level has for the study of negative valence effects in word recognition.