Origin of Emotion Effects on ERP Correlates of Emotional Word Processing: The Emotion Duality Approach

Hybrid computational model depicts the contribution of non-significant lobes of human brain during the perception of emotional stimuli

Emotions are synchronizing responses of human brain while executing cognitive tasks. Earlier studies had revealed strong correlation between specific lobes of the brain to different types of emotional valence. In the current study, a comprehensive three-dimensional mapping of human brain for executing emotion specific tasks had been formulated. A hybrid computational machine learning model customized from Custom Weight Allocation Model (CWAM) and defined as Custom Rank Allocation Model (CRAM). This regression-based hybrid computational model computes the allocated tasks to different lobes of the brain during their respective executive stage. Event Related Potentials (ERP) were obtained with significant effect at P1, P2, P3, N170, N2, and N4. These ERPs were configured at Pz, Cz, F3, and T8 regions of the brain with maximal responses; while regions like Cz, C4 and F4 were also found to make effective contributions to elevate the responses of the brain, and thus these regions were configured as augmented source regions of the brain. In another circumstance of frequent -deviant - equal (FDE) presentation of the emotional stimuli, it was observed that the brain channels C3, C4, P3, P4, O1, O2, and Oz were contributing their emotional quotient to the overall response of the brain regions; whereas, the interaction effect was found presentable at O2, Oz, P3, P4, T8 and C3 regions of brain. The proposed computational model had identified the potential neural pathways during the execution of emotional task.

Sensory Emotion in Words: Evidence From an Event-related Potential (ERP) Study in Light of the Emotioncy Model

Introduction

Delving into the prominent role of emotions and senses in language is not something new in the field. Thereupon, the newly developed notion of emotioncy has been introduced to foreign language education to underscore the role of sense-induced emotions in the language learning and teaching process.

Methods

The present study implemented event-related potentials (ERPs) to provide evidence of the significance of employing emosensory instructional strategies in teaching vocabulary items. Hence, 18 female participants were randomly instructed on six English nouns toward which they had no prior knowledge and received no instruction for the other three words. Then, while the participants' electroencephalogram (EEG) was being recorded, they took a sentence comprehension task.

Results

Behavioral results demonstrated significant differences among the avolved, the exvolved, and the involved nouns. However, ERP analyses of target words indicated the modulations of N100 and N480 components while no significant effect was observed at P200. Further, the analysis of sensory N100 for the critical words revealed no significant effect.

Conclusion

In conclusion, emotioncy-based language instruction can affect neural correlates of emotional word comprehension from the early stages of EEG recording. The results of this study can clarify the importance of including senses and emotions in language teaching, learning, and testing, along with materials development.

Highlights

Direct emosensory involvement can affect word semantic processing.Indirect emosensory involvement can affect sensorial comprehension of the word.Direct sensory involvement may enhance the accuracy of the responses.Direct sensory involvement may reduce the response time.

Plain Language Summary

Nowadays, learning a foreign language is considered one of the challenges in our lives. It is believed that including senses and emotions in education can foster learning new words in a foreign language. One concept that focuses on the use of sensory emotions is called emotioncy. This study employed brain imaging to analyze the effects of teaching through emotioncy on related neural modulations. Based on the results of the study, higher levels of employing senses and emotions can affect the processing and comprehension of words.

The Role of the Valence, Arousing Properties and Subjective Significance of Subliminally Presented Words in Affective Priming

In the verbal affective priming paradigm, the properties of a subliminally presented stimulus alter the interpretation of neutral target stimulus. In the experiment reported here, we tested the role of four factors (valence, origin, arousing properties and subjective significance) that determine the emotional reactions to words in affective priming. Subliminal masked presentation of words preceded the explicit task, which was assessment of neutral Quick Response code (QR code) stimuli. The QRs were codes for words representing personality traits. The results showed the effect of assimilation (negative words caused a negative interpretation, positive caused a positive interpretation) for words' emotional valence and no effects for origin. Concerning arousal, we found a weak negative trend. In the case of subjective significance, a moderate positive trend was found. These results suggest that affective priming effects are susceptible not only to the valence of priming stimuli but also to activation factors.

Affective Attitudes in the Face of the COVID-19 Pandemic: The Dynamics of Negative Emotions and a Sense of Threat in Poles in the First Wave of the Pandemic

For millions of people, the COVID-19 pandemic situation and its accompanying restrictions have been a source of threat and confrontation with negative emotions. The pandemic's universal and long-term character, as well as the ensuing drastic limitation of control over one's life, have made it necessary to work out adaptive strategies that would reduce negative experiences and eventually lead to the restoration of well-being. The aim of this research was to identify strategies that people use in response to a long-term threat that restore affective balance and a subjective sense of security. We registered selected manifestations of affective reactions to the pandemic situation. The researchers focused on the dynamics of changes in the areas of (1) experienced negative emotions (asked in an indirect way) and (2) a subjective feeling of threat regarding the pandemic (in three different contexts: Poland, Europe, and worldwide) during the first phase of the pandemic in Poland. It was expected that both the negative emotions and the sense of threat would decrease with time. In addition, it was anticipated that the physical distance would modify the assessment of the situation as threatening depending on the geographical proximity: in Poland, Europe, and worldwide. We used the mixed quasi-experimental design in the series of four studies conducted by Internet in March, May, June, and July 2020. The intensity of negative emotions and the sense of threat caused by the pandemic situation in Poland, Europe, and worldwide were measured. Despite the objective number of confirmed COVID-19 cases during each of the stages of the study, both the intensity of emotions attributed by participants as well as the feeling of threat were found to have decreased. In addition, surprisingly, a reversed effect of the distance was revealed: namely, a sense of threat experienced towards distant locations (Europe and the world) was found to be more acute when compared with the threat experienced in Poland. The obtained results are interpreted as a manifestation of adaptive perception of the threat that lies beyond one's control, which takes the form of unconscious, biased distortions: unrealistic optimism. The decrease in the intensity of negative emotions explains unrealistic absolute optimism, while the perception of the situation in Poland as less threatening than in Europe and around the world is predicted by unrealistic comparative optimism.

Inhibitory control effectiveness can be improved: The role of arousal, subjective significance and origin of words in modified Emotional Stroop Test

The interference control measured in the Emotional Stroop Task is the phenomenon that gives us an insight into mechanisms of emotion-cognition interactions. Especially the role of dimensions of affect can be easily studied with this paradigm. In the current study, we were interested in the role of the complexity of emotional stimuli (origin). We also aimed at searching for activation-like factors that impair (arousal) or improve (subjective significance) the effectiveness of cognitive control. We have used an orthogonal manipulation of all the above dimensions in words. We expected to find the contrastive effects of arousal and subjective significance on reaction times and Event Related Potential’s amplitudes. On a behavioural level, we observed the reduction of reaction times with increasing subjective significance of stimuli and reflective origin. We also found a correlation between subjective significance and reduction of amplitude polarisation in the N450 component associated with cognitive control execution effort. This experiment shows that subjective significance has an improving role for cognitive control effectiveness, even when valence, arousal and origin levels are controlled. This guides us to conclude that external stimuli may drive not only disruption of control but also its improvement.

The role and use of event-related potentials in aphasia: A scoping review

Event-related potentials (ERPs) can provide important insights into underlying language processes in both unimpaired and neurologically impaired populations and may be particularly useful in aphasia. This scoping review was conducted to provide a comprehensive summary of how ERPs have been used with people with aphasia (PWA), with the goal of exploring the potential clinical application of ERPs in aphasia assessment and treatment. We identified 117 studies that met inclusionary criteria, reflecting six thematic domains of inquiry that relate to understanding both unimpaired and aphasic language processing and the use of ERPs with PWA. In these studies, a wide variety of ERP components were reported. Inconsistencies in reporting of participant characteristics and study protocols limit our ability to generalize beyond the individual studies and understand implications for clinical applicability. We discuss the potential roles of ERPs in aphasia management and make recommendations for further developing ERPs for clinical utility in PWA.

Limitations of Standard Accessible Captioning of Sounds and Music for Deaf and Hard of Hearing People: An EEG Study

Captioning is the process of transcribing speech and acoustical information into text to help deaf and hard of hearing people accessing to the auditory track of audiovisual media. In addition to the verbal transcription, it includes information such as sound effects, speaker identification, or music tagging. However, it just takes into account a limited spectrum of the whole acoustic information available in the soundtrack, and hence, an important amount of emotional information is lost when attending just to the normative compliant captions. In this article, it is shown, by means of behavioral and EEG measurements, how emotional information related to sounds and music used by the creator in the audiovisual work is perceived differently by normal hearing group and hearing disabled group when applying standard captioning. Audio and captions activate similar processing areas, respectively, in each group, although not with the same intensity. Moreover, captions require higher activation of voluntary attentional circuits, as well as language-related areas. Captions transcribing musical information increase attentional activity, instead of emotional processing.

Self-Reference Emerges Earlier than Emotion during an Implicit Self-Referential Emotion Processing Task: Event-Related Potential Evidence

Self-referential emotion refers to the process of evaluating emotional stimuli with respect to the self. Processes indicative of a self-positivity bias are reflected in electroencephalogram (EEG) signals at ~400 ms when the task does not require a discrimination of self from other. However, when distinguishing between self-referential and other-referential emotions is required, previous studies have shown inconsistent temporal dynamics of EEG signals in slightly different tasks. Based on the observation of early self–other discrimination, we hypothesized that self would be rapidly activated in the early stage to modulate emotional processing in the late stage during an implicit self-referential emotion. To test this hypothesis, we employed an implicit task in which participants were asked to judge the order of Chinese characters of trait adjectives preceded by a self (“I”) or other pronoun (“He” or “She”). This study aimed to explore the difference of social-related emotional evaluation from self-reference; the other pronoun was not defined to a specific person, rather it referred to the general concept. Sixteen healthy Chinese subjects participated in the experiment. Event-related potentials (ERPs) showed that there were self-other discrimination effects in the N1 (80–110 ms) and P1 (170–200 ms) components in the anterior brain. The emotional valence was discriminated in the later component of N2 (220–250 ms). The interaction between self-reference and emotional valence occurred during the late positive potential (LPP; 400–500 ms). Moreover, there was a positive correlation between response time (RT) and N1 in the self-reference condition based on the positive-negative contrast, suggesting a modulatory effect of the self-positivity bias. The results indicate that self-reference emerges earlier than emotion and then combines with emotional processing in an implicit task. The findings extend the view that the self plays a highly integrated and modulated role in self-referential emotion processing.

The Affective Norms for Polish Short Texts (ANPST) Database Properties and Impact of Participants' Population and Sex on Affective Ratings

The Affective Norms for Polish Short Texts (ANPST) dataset (Imbir, 2016d) is a list of 718 affective sentence stimuli with known affective properties with respect to subjectively perceived valence, arousal, dominance, origin, subjective significance, and source. This article examines the reliability of the ANPST and the impact of population type and sex on affective ratings. The ANPST dataset was introduced to provide a recognized method of eliciting affective states with linguistic stimuli more complex than single words and that included contextual information and thus are less ambiguous in interpretation than single word. Analysis of the properties of the ANPST dataset showed that norms collected are reliable in terms of split-half estimation and that the distributions of ratings are similar to those obtained in other affective norms studies. The pattern of correlations was the same as that found in analysis of an affective norms dataset for words based on the same six variables. Female psychology students' valence ratings were also more polarized than those of their female student peers studying other subjects, but arousal ratings were only higher for negative words. Differences also appeared for all other measured dimensions. Women's valence ratings were found to be more polarized and arousal ratings were higher than those made by men, and differences were also present for dominance, origin, and subjective significance. The ANPST is the first Polish language list of sentence stimuli and could easily be adapted for other languages and cultures.

N450 and LPC Event-Related Potential Correlates of an Emotional Stroop Task with Words Differing in Valence and Emotional Origin

Affective meaning of verbal stimuli was found to influence cognitive control as expressed in the Emotional Stroop Task (EST). Behavioral studies have shown that factors such as valence, arousal, and emotional origin of reaction to stimuli associated with words can lead to lengthening of reaction latencies in EST. Moreover, electrophysiological studies have revealed that affective meaning altered amplitude of some components of evoked potentials recorded during EST, and that this alteration correlated with the performance in EST. The emotional origin was defined as processing based on automatic vs. reflective mechanisms, that underlines formation of emotional reactions to words. The aim of the current study was to investigate, within the framework of EST, correlates of processing of words differing in valence and origin levels, but matched in arousal, concreteness, frequency of appearance and length. We found no behavioral differences in response latencies. When controlling for origin, we found no effects of valence. We found the effect of origin on ERP in two time windows: 290–570 and 570–800 ms. The earlier effect can be attributed to cognitive control while the latter is rather the manifestation of explicit processing of words. In each case, reflective originated stimuli evoked more positive amplitudes compared to automatic originated words.

Subliminal Emotional Words Impact Syntactic Processing: Evidence from Performance and Event-Related Brain Potentials

Recent studies demonstrate that syntactic processing can be affected by emotional information and that subliminal emotional information can also affect cognitive processes. In this study, we explore whether unconscious emotional information may also impact syntactic processing. In an Event-Related brain Potential (ERP) study, positive, neutral and negative subliminal adjectives were inserted within neutral sentences, just before the presentation of the supraliminal adjective. They could either be correct (50%) or contain a morphosyntactic violation (number or gender disagreements). Larger error rates were observed for incorrect sentences than for correct ones, in contrast to most studies using supraliminal information. Strikingly, emotional adjectives affected the conscious syntactic processing of sentences containing morphosyntactic anomalies. The neutral condition elicited left anterior negativity (LAN) followed by a P600 component. However, a lack of anterior negativity and an early P600 onset for the negative condition were found, probably as a result of the negative subliminal correct adjective capturing early syntactic resources. Positive masked adjectives in turn prompted an N400 component in response to morphosyntactic violations, probably reflecting the induction of a heuristic processing mode involving access to lexico-semantic information to solve agreement anomalies. Our results add to recent evidence on the impact of emotional information on syntactic processing, while showing that this can occur even when the reader is unaware of the emotional stimuli.

Affective Norms for 4900 Polish Words Reload (ANPW_R): Assessments for Valence, Arousal, Dominance, Origin, Significance, Concreteness, Imageability and, Age of Acquisition

In studies that combine understanding of emotions and language, there is growing demand for good-quality experimental materials. To meet this expectation, a large number of 4905 Polish words was assessed by 400 participants in order to provide a well-established research method for everyone interested in emotional word processing. The Affective Norms for Polish Words Reloaded (ANPW_R) is designed as an extension to the previously introduced the ANPW dataset and provides assessments for eight different affective and psycholinguistic measures of Valence, Arousal, Dominance, Origin, Significance, Concreteness, Imageability, and subjective Age of Acquisition. The ANPW_R is now the largest available dataset of affective words for Polish, including affective scores that have not been measured in any other dataset (concreteness and age of acquisition scales). Additionally, the ANPW_R allows for testing hypotheses concerning dual-mind models of emotion and activation (origin and subjective significance scales). Participants in the current study assessed all 4905 words in the list within 1 week, at their own pace in home sessions, using eight different Self-assessment Manikin (SAM) scales. Each measured dimension was evaluated by 25 women and 25 men. The ANPW_R norms appeared to be reliable in split-half estimation and congruent with previous normative studies in Polish. The quadratic relation between valence and arousal was found to be in line with previous findings. In addition, nine other relations appeared to be better described by quadratic instead of linear function. The ANPW_R provides well-established research materials for use in psycholinguistic and affective studies in Polish-speaking samples.

Effects of Valence and Origin of Emotions in Word Processing Evidenced by Event Related Potential Correlates in a Lexical Decision Task

This paper presents behavioral and event-related potential (ERP) correlates of emotional word processing during a lexical decision task (LDT). We showed that valence and origin (two distinct affective properties of stimuli) help to account for the ERP correlates of LDT. The origin of emotion is a factor derived from the emotion duality model. This model distinguishes between the automatic and controlled elicitation of emotional states. The subjects' task was to discriminate words from pseudo-words. The stimulus words were carefully selected to differ with respect to valence and origin whilst being matched with respect to arousal, concreteness, length and frequency in natural language. Pseudo-words were matched to words with respect to length. The subjects were 32 individuals aged from 19 to 26 years who were invited to participate in an EEG study of lexical decision making. They evaluated a list of words and pseudo-words. We found that valence modulated the amplitude of the FN400 component (290-375 ms) at centro-frontal (Fz, Cz) region, whereas origin modulated the amplitude of the component in the LPC latency range (375-670 ms). The results indicate that the origin of stimuli should be taken into consideration while deliberating on the processing of emotional words.